Skip to main content

PCA-based bootstrap confidence interval tests for gene-disease association involving multiple SNPs



Genetic association study is currently the primary vehicle for identification and characterization of disease-predisposing variant(s) which usually involves multiple single-nucleotide polymorphisms (SNPs) available. However, SNP-wise association tests raise concerns over multiple testing. Haplotype-based methods have the advantage of being able to account for correlations between neighbouring SNPs, yet assuming Hardy-Weinberg equilibrium (HWE) and potentially large number degrees of freedom can harm its statistical power and robustness. Approaches based on principal component analysis (PCA) are preferable in this regard but their performance varies with methods of extracting principal components (PC s).


PCA-based bootstrap confidence interval test (PCA-BCIT), which directly uses the PC scores to assess gene-disease association, was developed and evaluated for three ways of extracting PC s, i.e., cases only(CAES), controls only(COES) and cases and controls combined(CES). Extraction of PC s with COES is preferred to that with CAES and CES. Performance of the test was examined via simulations as well as analyses on data of rheumatoid arthritis and heroin addiction, which maintains nominal level under null hypothesis and showed comparable performance with permutation test.


PCA-BCIT is a valid and powerful method for assessing gene-disease association involving multiple SNPs.


Genetic association studies now customarily involve multiple SNPs in candidate genes or genomic regions and have a significant role in identifying and characterizing disease-predisposing variant(s). A critical challenge in their statistical analysis is how to make optimal use of all available information. Population-based case-control studies have been very popular[1] and typically involve contingency table tests of SNP-disease association[2]. Notably, the genotype-wise Armitage trend test does not require HWE and has equivalent power to its allele-wise counterpart under HWE[3, 4]. A thorny issue with individual tests of SNPs for linkage disequilibrium (LD) in such setting is multiple testing, however, methods for multiple testing adjustment assuming independence such as Bonferroni's[5, 6] is knowingly conservative[7]. It is therefore necessary to seek alternative approaches which can utilize multiple SNPs simultaneously. The genotype-wise Armitage trend test is appealing since it is equivalent to the score test from logistic regression[8] of case-control status on dosage of disease-predisposing alleles of SNP. However, testing for the effects of multiple SNPs simultaneously via logistic regression is no cure for difficulty with multicollinearity and curse of dimensionality[9]. Haplotype-based methods have many desirable properties[10] and could possibly alleviate the problem[1114], but assumption of HWE is usually required and a potentially large number of degrees of freedom are involved[7, 11, 1518].

It has recently been proposed that PCA can be combined with logistic regression test (LRT)[7, 16, 17] in a unified framework so that PCA is conducted first to account for between-SNP correlations in a candidate region, then LRT is applied as a formal test for the association between PC scores (linear combinations of the original SNPs) and disease. Since PC s are orthogonal, it avoids multicollinearity and at the meantime is less computer-intensive than haplotype-based methods. Studies have shown that PCA-LRT is at least as powerful as genotype- and haplotype-based methods[7, 16, 17]. Nevertheless, the power of PCA-based approaches vary with ways by which PC s are extracted, e.g., from genotype correlation, LD, or other kinds of metrics[17], and in principle can be employed in frameworks other than logistic regression[7, 16, 17]. Here we investigate ways of extracting PCs using genotype correlation matrix from different types of samples in a case-control study, while presenting a new approach testing for gene-disease association by direct use of PC scores in a PCA-based bootstrap confidence interval test (PCA-BCIT). We evaluated its performance via simulations and compared it with PCA-LRT and permutation test using real data.



Assume that p SNPs in a candidate region of interest have coded values (X1, X2, , X p ) according to a given genetic model (e.g., additive model) whose correlation matrix is C. PCA solves the following equation,


where = 1, i = 1,2, , p, l i = (li 1, li 2, , l ip )' are loadings of PC s. The score for an individual subject is


where cov (F i , F j ) = 0, ij, and var(F1) ≥ var(F2) ≥ ≥ var(F p ).

Methods of extracting PC s

Potentially, PCA can be conducted via four distinct extracting strategies (ES) using case-control data, i.e., 0. Calculate PC scores of individuals in cases and controls separately (SES), 1. Use cases only (CAES) to obtain loadings for calculation of PC scores for subjects in both cases and controls, 2. Use controls only (COES) to obtain the loadings for both groups, and 3. Use combined cases and controls (CES) to obtain the loadings for both groups. It is likely that in a case-control association study, loadings calculated from cases and controls can have different connotations and hence we only consider scenarios 1-3 hereafter. More formally, let (X1, X2, , X p ) and (Y1, Y2, , Y p ) be p-dimension vectors of SNPs at a given candidate region for cases and controls respectively, then we have,

Strategy 1 (CAES):


where C XX is the correlation matrix of (X1, X2, , X p ), and = 1, i = 1,2, , p. The ithPC for cases is calculated by


and for controls


Strategy 2 (COES):


where C YY is the correlation matrix of (Y1, Y2, , Y p ). The ithPC for controls is calculated by


And for cases, the ithPC, i = 1,2, , p, is calculated by


Strategy 3 (CES):


where C is the correlation matrix obtained from the pooled data of cases and controls, and . The ithPC of cases is calculated by


The ithPC of controls is calculated by



Given a sample of N cases and M controls with p-SNP genotypes (X1, X2, , X N )T, (Y1, Y2, , Y M )T, and X i = (X1i, X2i, , x pi ) for the ithcase, Y i = (Y1i, Y2i, , y pi ) for the ithcontrol, a PCA-BCIT is furnished in three steps:

Step 1: Sampling

Replicate samples of cases and controls are obtained with replacement separately from (X1(b, X2(b), , X N (b))Tand (Y1(b, Y2(b), , Y M (b))T, b = 1,2, , B (B = 1000).

Step 2: PCA

For each replicate sample obtained at Step 1, PCA is conducted and a given number of PC s retained with a threshold of 80% explained variance for all three strategies[16], expressed as and .

Step 3: PCA-BCIT

3a) For each replicate, the mean of the kthPC in cases is calculated by


and that of the kthPC in controls is calculated by


3b) Given confidence level (1 - α ), the confidence interval of is estimated by percentile method, with form


where is the percentile of , and is the percentile.

The confidence interval of is estimated by


where is the percentile of , and is the percentile.

3c) Confidence intervals of cases and controls are compared. The null hypothesis is rejected if and do not overlap, which is and are statistically different[19], indicating the candidate region is significantly associated with disease at level α. Otherwise, the candidate region is not significantly associated with disease at level α.

Simulation studies

We examine the performance of PCA-BCIT through simulations with data from the North American Rheumatoid Arthritis (RA) Consortium (NARAC) (868 cases and 1194 controls)[20], taking advantage of the fact that association between protein tyrosine phosphatase non-receptor type 22 (PTPN22) and the development of RA has been established[2124]. Nine SNPs have been selected from the PNPT22 region (114157960-114215857), and most of the SNPs are within the same LD block (Figure 1). Females are more predisposed (73.85%) and are used in our simulation to ensure homogeneity. The corresponding steps for the simulation are as follows.

Figure 1
figure 1

LD ( r2) among nine PTPN22 SNPs. The nine PTPN22 SNPs are rs971173, rs1217390, rs878129, rs11811771, rs11102703, rs7545038, rs1503832, rs12127377, rs11485101. The triangle marks a single LD block within this region: (rs878129, rs11811771, rs11102703, rs7545038, rs1503832, rs12127377, rs11485101).

Step 1: Sampling

The observed genotype frequencies in the study sample are taken to be their true frequencies in populations of infinite sizes. Replicate samples of cases and controls of given size (N, N = 100, 200, , 1000) are generated whose estimated genotype frequencies are expected to be close to the true population frequencies while both the allele frequencies and LD structure are maintained. Under null hypothesis, replicate cases and controls are sampled with replacement from the controls. Under alternative hypothesis, replicate cases and controls are sampled with replacement from the cases and controls respectively.

Step 2: PCA-BCITing

For each replicate sample, PCA-BCITs are conducted through the three strategies of extracting PC s as outlined above on association between PC scores and disease (RA).

Step 3: Evaluating performance of PCA-BCIT s

Repeat steps 1 and 2 for K ( K = 1000 ) times under both null and alternative hypotheses, and obtain the frequencies (P α ) of rejecting null hypothesis at level α (α = 0.05).


PCA-BCITs are applied to both the NARAC data on PTPN22 in 1493 females (641 cases and 852 controls) described above and a data containing nine SNPs near μ-opioid receptor gene (OPRM1) in Han Chinese from Shanghai (91 cases and 245 controls) with endophenotype of heroin-induced positive responses on first use[25]. There are two LD blocks in the region of gene OPRM1 (Figure 2).

Figure 2
figure 2

LD ( r2) among nine OPRM1 SNPs. The nine OPRM1 SNPs are rs1799971, rs510769, rs696522, rs1381376, rs3778151, rs2075572, rs533586, rs550014, rs658156. The triangles mark the LD block 1 (rs696522, rs1381376, rs3778151) and LD block 2 (rs550014, rs658156).


Simulation study

The performance of PCA-BCIT is shown in Table 1 for the three strategies given a range of sample sizes. It can be seen that strategies 2 and 3 both have type I error rates approaching the nominal level (α = 0.05), but those from strategy 1 deviate heavily. When sample size larger than 800, the power of PCA-BCIT is above 0.8, and strategies 2 and 3 outperform strategy 1 slightly.

Table 1 Performance of PCA-BCIT at level 0.05 with strategies 1-3†


For the NARAC data, Armitage trend test reveals none of the SNPs in significant association with RA using Bonferroni correction (Table 2), but the results of PCA-BCIT with strategies 2 and 3 show that the first PC extracted in region of PTPN22 is significantly associated with RA. The results are similar to that from permutation test (Table 3).

Table 2 Armitage trend test on nine PTPN2 2 SNPs and RA susceptibility
Table 3 PCA-BCIT, PCA-LRT and permutation test on real data

For the OPRM1 data, the sample characteristics are comparable between cases and controls (Table 4), and three SNPs (rs696522, rs1381376 and rs3778151) are showed significant association with the endophenotype (Table 5). The results of PCA-BCIT with strategies 2 and 3 and permutation test are all significant at level α = 0.01. In contrast, result from PCA-LRT is not significant at level α = 0.05 with strategy 2 (Table 3). The apparent separation of cases and controls are shown in Figure 3 for PCA-BCIT with strategy 3, suggesting an intuitive interpretation.

Table 4 Sample characteristics of heroin-induced positive responses on first use
Table 5 Armitage trend tests on nine OPRM1 SNPs and heroin-induced positive responses on first use
Figure 3
figure 3

Real data analyses by PCA-BCIT with strategy 3 and confidence level 0.95. The horizontal axis denotes studies and vertical axis mean(PC1), the statistic used to calculate confidence intervals for cases and controls. PCA-BCIT s with strategy 3 were significant at confidence level 0.95.


In this study, a PCA-based bootstrap confidence interval test[19, 2628] (PCA-BCIT) is developed to study gene-disease association using all SNPs genotyped in a given region. There are several attractive features of PCA-based approaches. First of all, they are at least as powerful as genotype- and haplotype-based methods[7, 16, 17]. Secondly, they are able to capture LD information between correlated SNPs and easy to compute with needless consideration of multicollinearity and multiple testing. Thirdly, BCIT integrates point estimation and hypothesis testing as a single inferential statement of great intuitive appeal[29] and does not rely on the distributional assumption of the statistic used to calculate confidence interval[19, 2629].

While there have been several different but closely related forms of bootstrap confidence interval calculations[28], we focus on percentiles of the asymptotic distribution of PC s for given confidence levels to estimate the confidence interval. PCA-BCIT is a data-learning method[29], and shown to be valid and powerful for sufficiently large number of replicates in our study. Our investigation involving three strategies of extracting PC s reveals that strategy 1 is invalid, while strategies 2 and 3 are acceptable. From analyses of real data we find that PCA-BCIT is more favourable compared with PCA-LRT and permutation test. It is suggested that a practical advantage of PCA-BCIT is that it offers an intuitive measure of difference between cases and controls by using the set of SNPs (PC scores) in a candidate region (Figure 3). As extraction of PC s through COES is more in line with the principle of a case-control study, it will be our method of choice given that it has a comparable performance with CES. Nevertheless, PCA-BCIT has the limitation that it does not directly handle covariates as is usually done in a regression model.


PCA-BCIT is both a valid and a powerful PCA-based method which captures multi-SNP information in study of gene-disease association. While extracting PC s based on CAES, COES and CES all have good performances, it appears that COES is more appropriate to use.



single nucleotide polymorphism


Hardy-Weinberg Equilibrium

LD :

linkage disequilibrium


logistic regression test


principle component analysis

PC :

principle component

ES :

extracting strategy


separate case and control extracting strategy (strategy 0)


case-based extracting strategy (strategy 1)


control-based extracting strategy (strategy 2)


combined case and control extracting strategy (strategy 3)


bootstrap confidence interval test.


  1. Morton NE, Collins A: Tests and estimates of allelic association in comples. Proc Natl Acad Sci USA. 1998, 95: 11389-11393. 10.1073/pnas.95.19.11389.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  2. Sasieni PD: From genotypes to genes: doubling the sample size. Biometrics. 1997, 53: 1253-1261. 10.2307/2533494.

    Article  CAS  PubMed  Google Scholar 

  3. Gordon D, Haynes C, Yang Y, Kramer PL, Finch SJ: Linear trend tests for case-control genetic association that incorporate random phenotype and genotype misclassification error. Genet Epidemiol. 2007, 31: 853-870. 10.1002/gepi.20246.

    Article  PubMed  Google Scholar 

  4. Slager SL, Schaid DJ: Case-control studies of genetic markers: Power and sample size approximations for Armitage's test for trend. Human Heredity. 2001, 52: 149-153. 10.1159/000053370.

    Article  CAS  PubMed  Google Scholar 

  5. Sidak Z: On Multivariate Normal Probabilities of Rectangles: Their Dependence on Correlations. The Annals of Mathematical Statistics. 1968, 39: 1425-1434.

    Google Scholar 

  6. Sidak Z: On Probabilities of Rectangles in Multivariate Student Distributions: Their Dependence on Correlations. The Annals of Mathematical Statistics. 1971, 42: 169-175. 10.1214/aoms/1177693504.

    Article  Google Scholar 

  7. Zhang FY, Wagener D: An approach to incorporate linkage disequilibrium structure into genomic association analysis. Journal of Genetics and Genomics. 2008, 35: 381-385. 10.1016/S1673-8527(08)60055-7.

    Article  PubMed Central  PubMed  Google Scholar 

  8. Balding DJ: A tutorial on statistical methods for population association studies. Nature Reviews Genetics. 2006, 7: 781-791. 10.1038/nrg1916.

    Article  CAS  PubMed  Google Scholar 

  9. Schaid DJ, McDonnell SK, Hebbring SJ, Cunningham JM, Thibodeau SN: Nonparametric tests of association of multiple genes with human disease. American Journal of Human Genetics. 2005, 76: 780-793. 10.1086/429838.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  10. Becker T, Schumacher J, Cichon S, Baur MP, Knapp M: Haplotype interaction analysis of unlinked regions. Genetic Epidemiology. 2005, 29: 313-322. 10.1002/gepi.20096.

    Article  PubMed  Google Scholar 

  11. Chapman JM, Cooper JD, Todd JA, Clayton DG: Detecting disease associations due to linkage disequilibrium using haplotype tags: A class of tests and the determinants of statistical power. Human Heredity. 2003, 56: 18-31. 10.1159/000073729.

    Article  PubMed  Google Scholar 

  12. Epstein MP, Satten GA: Inference on haplotype effects in case-control studies using unphased genotype data. American Journal of Human Genetics. 2003, 73: 1316-1329. 10.1086/380204.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  13. Fallin D, Cohen A, Essioux L, Chumakov I, Blumenfeld M, Cohen D, Schork NJ: Genetic analysis of case/control data using estimated haplotype frequencies: Application to APOE locus variation and Alzheimer's disease. Genome Research. 2001, 11: 143-151. 10.1101/gr.148401.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  14. Stram DO, Pearce CL, Bretsky P, Freedman M, Hirschhorn JN, Altshuler D, Kolonel LN, Henderson BE, Thomas DC: Modeling and E-M estimation of haplotype-specific relative risks from genotype data for a case-control study of unrelated individuals. Human Heredity. 2003, 55: 179-190. 10.1159/000073202.

    Article  PubMed  Google Scholar 

  15. Clayton D, Chapman J, Cooper J: Use of unphased multilocus genotype data in indirect association studies. Genetic Epidemiology. 2004, 27: 415-428. 10.1002/gepi.20032.

    Article  PubMed  Google Scholar 

  16. Gauderman WJ, Murcray C, Gilliland F, Conti DV: Testing association between disease and multiple SNPs in a candidate gene. Genetic Epidemiology. 2007, 31: 383-395. 10.1002/gepi.20219.

    Article  PubMed  Google Scholar 

  17. Oh S, Park T: Association tests based on the principal-component analysis. BMC Proc. 2007, 1 (Suppl 1): S130-10.1186/1753-6561-1-s1-s130.

    Article  PubMed Central  PubMed  Google Scholar 

  18. Wang T, Elston RC: Improved power by use of a weighted score test for linkage disequilibrium mapping. American Journal of Human Genetics. 2007, 80: 353-360. 10.1086/511312.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  19. Heller G, Venkatraman ES: Resampling procedures to compare two survival distributions in the presence of right-censored data. Biometrics. 1996, 52: 1204-1213. 10.2307/2532836.

    Article  Google Scholar 

  20. Plenge RM, Seielstad M, Padyukov L, Lee AT, Remmers EF, Ding B, Liew A, Khalili H, Chandrasekaran A, Davies LRL, et al: TRAF1-C5 as a risk locus for rheumatoid arthritis - A genomewide study. New England Journal of Medicine. 2007, 357: 1199-1209. 10.1056/NEJMoa073491.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  21. Begovich AB, Carlton VE, Honigberg LA, Schrodi SJ, Chokkalingam AP, Alexander HC, Ardlie KG, Huang Q, Smith AM, Spoerke JM, et al: A missense single-nucleotide polymorphism in a gene encoding a protein tyrosine phosphatase (PTPN22) is associated with rheumatoid arthritis. Am J Hum Genet. 2004, 75: 330-337. 10.1086/422827.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  22. Carlton VEH, Hu XL, Chokkalingam AP, Schrodi SJ, Brandon R, Alexander HC, Chang M, Catanese JJ, Leong DU, Ardlie KG, et al: PTPN22 genetic variation: Evidence for multiple variants associated with rheumatoid arthritis. American Journal of Human Genetics. 2005, 77: 567-581. 10.1086/468189.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  23. Kallberg H, Padyukov L, Plenge RM, Ronnelid J, Gregersen PK, Helm-van Mil van der AHM, Toes REM, Huizinga TW, Klareskog L, Alfredsson L, et al: Gene-gene and gene-environment interactions involving HLA-DRB1, PTPN22, and smoking in two subsets of rheumatoid arthritis. American Journal of Human Genetics. 2007, 80: 867-875. 10.1086/516736.

    Article  PubMed Central  PubMed  Google Scholar 

  24. Plenge RM, Padyukov L, Remmers EF, Purcell S, Lee AT, Karlson EW, Wolfe F, Kastner DL, Alfredsson L, Altshuler D, et al: Replication of putative candidate-gene associations with rheumatoid arthritis in > 4,000 samples from North America and Sweden: Association of susceptibility with PTPN22, CTLA4, and PADI4. American Journal of Human Genetics. 2005, 77: 1044-1060. 10.1086/498651.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  25. Zhang D, Shao C, Shao M, Yan P, Wang Y, Liu Y, Liu W, Lin T, Xie Y, Zhao Y, et al: Effect of mu-opioid receptor gene polymorphisms on heroin-induced subjective responses in a Chinese population. Biol Psychiatry. 2007, 61: 1244-1251. 10.1016/j.biopsych.2006.07.012.

    Article  CAS  PubMed  Google Scholar 

  26. Carpenter J: Test Inversion Bootstrap Confidence Intervals. Journal of the Royal Statistical Society Series B (Statistical Methodology). 1999, 61: 159-172. 10.1111/1467-9868.00169.

    Article  Google Scholar 

  27. Davison AC, Hinkley DV, Young GA: Recent developments in bootstrap methodology. Statistical Science. 2003, 18: 141-157. 10.1214/ss/1063994969.

    Article  Google Scholar 

  28. DiCiccio TJ, Efron B: Bootstrap confidence intervals. Statistical Science. 1996, 11: 189-212. 10.1214/ss/1032280214.

    Article  Google Scholar 

  29. Efron B: Bootstrap Methods: Another Look at the Jackknife. The Annals of Statistics. 1979, 7: 1-26. 10.1214/aos/1176344552.

    Article  Google Scholar 

Download references


This work was supported by grant from the National Natural Science Foundation of China (30871392). We wish to thank Dr. Dandan Zhang (Fudan University) and NARAC for supplying us with the data, and comments from the Associate Editor and anonymous referees which greatly improved the manuscript. Special thanks to referee for the insightful comment that extraction of PC s with controls is line with the case-control principles.

Author information

Authors and Affiliations


Corresponding authors

Correspondence to Jinghua Zhao or Fuzhong Xue.

Additional information

Authors' contributions

QQP, JHZ, and FZX conceptualized the study, acquired and analyzed the data and prepared for the manuscript. All authors approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Peng, Q., Zhao, J. & Xue, F. PCA-based bootstrap confidence interval tests for gene-disease association involving multiple SNPs. BMC Genet 11, 6 (2010).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: