Skip Navigation


Mol. Hum. Reprod. Advance Access originally published online on November 16, 2005
Molecular Human Reproduction 2005 11(10):729-743; doi:10.1093/molehr/gah206
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
11/10/729    most recent
gah206v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (5)
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Guo, S.-W.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Guo, S.-W.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© The Author 2005. Published by Oxford University Press on behalf of the European Society of Human Reproduction and Embryology. All rights reserved. For Permissions, please email: journals.permissions@oupjournals.org

Glutathione S-transferases M1/T1 gene polymorphisms and endometriosis: a meta-analysis of genetic association studies

Sun-Wei Guo1

Department of Pediatrics, Medical College of Wisconsin, Milwaukee, WI, USA

1 To whom correspondence should be addressed at: Department of Pediatrics, Medical College of Wisconsin, 8701 Watertown Plank Road, MS 756, Milwaukee, WI 53226-0509, USA. E-mail: swguo{at}mail.mcw.edu


    Abstract
 Top
 Abstract
 Introduction
 Materials and methods
 Results
 Discussion
 References
 
In view of the controversies surrounding the glutathione S-transferases (GST) M1/T1–endometriosis association, a meta-analysis of the GSTM1/GSTT1 genetic association studies of endometriosis was performed. In this meta-analysis involving 14 GSTM1 studies with 1539 cases and 1805 controls and nine GSTT1 studies with 746 cases and 834 controls, respectively, substantial heterogeneities among studies were found. In addition, asymmetry in funnel plot was evident, which is likely to stem from publication bias, given no apparent indication of true heterogeneity. The bias appears to be prominent for GSTM1 studies, but is less so for GSTT1 studies. After correction for this bias, there is no evidence that women with GSTM1 null genotype have increased risk of developing endometriosis as compared with women with other genotypes. For GSTT1, the risk associated with the null genotype is 29% higher than other genotypes. However, even this estimate should be viewed with a large grain of salt, because the estimate could easily lose its statistical significance if there is a realistic 69–80% publication probability.

Key words: association/endometriosis/genetic/glutathione S-transferase/GSTM1/GSTT1/meta-analysis/polymorphism


    Introduction
 Top
 Abstract
 Introduction
 Materials and methods
 Results
 Discussion
 References
 
Endometriosis is one of the most common gynecologic disorders affecting, reportedly, 2–22% of women of reproductive age (Mahmood and Templeton, 1991Go; Olive and Schwartz, 1993Go). Despite extensive research on endometriosis, our current knowledge of its etiology and pathogenesis is quite limited (Giudice et al., 1998Go; D’Hooghe et al., 2003Go). With the completion of the first draft of the human genome and the availability of cheaper and faster genotyping technologies, there is a burgeoning interest in identifying genes and genetic polymorphisms that predispose women to increased risk of developing endometriosis (Zondervan et al., 2002aGo; Kennedy, 2003Go), based on reports that there is a heritable component in endometriosis susceptibility (Bischoff and Simpson, 2000Go). Among all published studies aimed at the identification of genetic susceptibility to endometriosis, glutathione S-transferases (GST) gene polymorphisms GSTM1 and GSTT1 are the most studied (see the website: http://www.well.ox.ac.uk/~krinaz/genepi_endo.htm).

GSTs are phase II enzymes involved in the detoxification of a broad range of toxic compounds and carcinogens (Hayes and Pulford, 1995Go), including dioxins and polycyclic aromatic hydrocarbons (PAH), which are ubiquitous and probably the most feared environmental contaminants worldwide. In humans, six classes of GST enzymes, {alpha}, µ, {omega}, {pi}, {theta} and {zeta}, have been identified, with each class being encoded by a separate gene or gene subfamily (Nebert and Vasiliou, 2004Go). The GSTM1 gene, located on chromosome 1p13.3 (Pearson et al., 1993Go), codes for cytosolic GST µ class enzyme, and has a deletion polymorphism that, when homozygote (GSTM1 null), results in the complete absence of a functional gene product (Seidegard et al., 1988Go). The GSTT1 gene, located on chromosome 22q11.2 (Webb et al., 1996Go), codes for GST class enzyme and also has an inactivating homozygous deletion polymorphism (Pemble et al., 1994Go). The frequency of the GSTM1 null genotype varies from population to population and was reported to be about 53% in Caucasians and Asians (Cotton et al., 2000Go; Garte et al., 2001Go;Geisler and Olshan, 2001Go). The frequency of its GSTT1 counterpart is lower and was reported to range from 11 to 20% in Caucasians and about 47% in Asians (Rebbeck, 1997Go).

The first report on the GSTM1 and endometriosis link was made by Baranov et al. in 1996 in a study of the proportion of GSTM1 null genotype in patient groups with different medical conditions and in some Slavic populations (Baranov et al., 1996Go). In 1999, Baranova et al. reported possible involvement of GSTT1 deletion polymorphism in the development of endometriosis. The impetus for evaluating the endometriosis patient group was apparently due to the report that exposure to dioxin increases the risk of endometriosis in rhesus monkeys, which was first reported in 1993 (Rier et al., 1993Go). Given the detoxification properties of the GST enzyme family, it is plausible that the lack of or reduced function of detoxification enzymes due to the deletion polymorphism may predispose women with increased risk for endometriosis.

Despite this plausibility, however, there have been conflicting reports on the GSTM1/GSTT1 and endometriosis association (see Results section). In addition, a recent comprehensive reappraisal of all published primate data on the dioxin–endometriosis link casts serious doubt about the dioxin–endometriosis link (Guo, 2004Go). In fact, the reappraisal exposes some major methodological deficiencies in the 1993 article that had not been recognized previously. These deficiencies seriously undermine the conclusions of the first report (Guo, 2004Go). Three recent publications on the same topic (Fierens et al., 2003Go; De Felip et al., 2004Go; Lim et al., 2004Go), not included in the reappraisal, appear to lend further support to the view that such a link does not exist.

In the light of this development, and in view of the controversies surrounding the GSTM1/GSTT1–endometriosis association, the role of GSTs, as a detoxification mechanism, in the pathogenesis of endometriosis begs for a reassessment. To provide a comprehensive and quantitative assessment of the impact of GSTM1/GSTT1 gene polymorphisms on the risk of endometriosis, a meta-analysis of all relevant published genetic association studies was performed to estimate effect size, to determine the extent of heterogeneity in the strength of associations between studies and to attempt to identify possible sources of this heterogeneity by searching for possible publication bias.


    Materials and methods
 Top
 Abstract
 Introduction
 Materials and methods
 Results
 Discussion
 References
 
Search strategy and inclusion and exclusion criteria
The PubMed database (http://www.ncbi.nlm.nih.gov/entrez/query.fcgi) was searched in a systematic and diligent manner for all genetic association studies on GSTM1/GSTT1 and endometriosis from 1996, when the GSTM1 association endometriosis was first reported (Baranov et al., 1996Go), up until the end of 2004. The search used the following keywords association studies, endometriosis, glutathione, glutathione-S-transferase, GSTM1, GSTT1, GSTM1 polymorphisms and GSTT1 polymorphisms, or their combinations. Because there is only one published study that examined GSTP1 polymorphism and its effect on the risk of endometriosis, GSTP1 was not included in this analysis. The references of all computer-identified publications were searched for additional studies, and the PubMed option related articles was used to search for potentially relevant articles. Articles published in all languages were selected if they met the following criteria: (i) study was an association study, and (ii) study reported on the genotypic frequencies of either GSTM1 or GSTT1 in a group of unrelated patients with endometriosis and a group of unrelated individuals serving as a control group. Those retrieved studies that are review articles or that provide no new data were excluded. In the case of sequential or multiple publications of analyses of the same or overlapping data sets, the study that reports the data from the largest or most recent publication was included, as recommended by Little et al. (2002)Go.

Data extraction
Following the meta-analysis of observational studies in epidemiology (MOOSE) guidelines for reporting meta-analysis of observational studies (Stroup et al., 2000Go), the following data were extracted from eligible studies: authors’ names, region/country where the study was conducted, year of publication, numbers of cases/patients and controls, stages of endometriosis and their percentages in cases/patients, diagnostic criteria, mean age and standard deviation or age range in both case and control groups, how the controls were selected, and numbers of subjects with GSTM1/GSTT1 null/null genotype in both cases and controls. Information on whether the study made any attempt to test for Hardy–Weinberg proportion (HWP), to check for and correcting genotyping errors, and to control for confounding risk factors were also noted.

The search resulted in 15 published articles on genetic association of GSTM1 and endometriosis, 11 in English (Baranov et al., 1996Go; Baranova et al., 1997Go, 1999Go; Arvanitis et al., 2001Go, 2003Go; Baxter et al., 2001Go; Hadfield et al., 2001Go; Lin et al., 2003Go; Hsieh et al., 2004Go; Morizane et al., 2004Go; Hur et al., 2005Go), two each in Chinese (Peng et al., 2003Go; Ding et al., 2004Go) and in Russian (Baranov et al., 1999Go; Ivashchenko et al., 2003Go). One article, by Arvanitis et al. (2001)Go, was excluded from the meta-analysis because it used a single 17–member pedigree for association study. It is excluded also on the ground of its apparent and serious methodological deficiencies (Guo, 2002Go). One article (Baranov et al., 1999Go) reported the GSTM1–endometriosis association in two populations, French and Russian. Because the data on the French population were identical to the data reported in Baranova et al. (1999)Go, only the data on the Russian population were used in this analysis. Another article, by Baranova et al. (1997)Go, was later expanded and reported by Baranova et al. (1999)Go. Following the recommendation by Little et al. (Littel et al., 2002), this article (Baranova et al., 1999Go) was excluded from the analysis. The article by Ding et al. (2004)Go reported data on two ethnic populations, Hans and Uygurs, and were counted as two studies in this analysis. Therefore, among 15 identified, two were excluded. One of the 13 remaining studies contains data on two different populations and were thus counted as two studies, yielding 14 studies.

Of the eight published articles on GSTT1–endometriosis association, 6 were published in English (Baranova et al., 1999Go; Hadfield et al., 2001Go; Arvanitis et al., 2003Go; Lin et al., 2003Go; Morizane et al., 2004Go; Hur et al., 2005Go), and one each in Chinese (Ding et al., 2004Go) and in Russian (Ivashchenko et al., 2003Go). Again, one article by Ding et al. (2004)Go presented data on two ethnic populations and was thus counted as two studies, resulting in nine studies.

Seven studies examined, individually, the frequencies of both GSTM1 and GSTT1 null genotypes in cases and controls. However, only four studies (Baranova et al., 1999Go; Arvanitis et al., 2003Go; Morizane et al., 2004Go; Hur et al., 2005Go) examined the risk of combined GSTM1-GSTT1 null genotype. One study (Arvanitis et al., 2003Go) also examined the effect of combined genotype of GSTM1, GSTT1, CYP1A1, and CYP19. Data on the combined GSTM1-GSTT1 null genotype were extracted except (Baranova et al., 1999Go), which only mentioned in passing that the combined genotype did not increase the risk of endometriosis.

Statistical analysis
The goals of this analysis were to pool crude odds ratio (OR) estimates from included studies, to identify any heterogeneity, and attempt to identify its sources. For each included study, the OR and its 95% confidence interval (CI) and the standard error (SE) of the log OR were computed. The choice of log OR was simply due to the fact that, in contrast to the OR, its SE is unaffected by the magnitude of the log OR.

For both GSTM1 and GSTT1 polymorphisms, a summary OR incorporating both within- and between-study variations was calculated using a random-effects model proposed by DerSimonian and Laird (DerSimonian, 1996Go). This model also provides a means to test for heterogeneity in OR estimates across studies. In contrast to the fixed-effects model which assumes that all studies aim at evaluating a common truth and results differ purely as a result of sampling errors (Mantel and Haenszel, 1959Go), the random-effects model stipulates that the studies may have genuine variations in their results, in addition to sampling errors. These genuine variations may be attributable to some unknown variables not accounted for by all studies. The fixed-effects model is not appropriate when there is genuine heterogeneity (due, most likely, to population heterogeneity or heterogeneity in selecting controls etc.) in the size of genetic effects across subpopulations, in which case the random-effects model is more preferable.

An array of statistical/graphical methods were employed to identify heterogeneity and, if present, to identify its sources. The use of different methods is necessary because different methods typically entail different assumptions.

Funnel plots were used to examine asymmetry, in which the ORs were plotted on a logarithmic scale against the inverse of their corresponding standard errors, a measure of precision (Light and Pillemer, 1984Go). If bias is absent, small studies will have ORs that are widely scattered but symmetric about the OR estimates provided by larger, more precise studies. In this case, the plot would resemble an inverted funnel with the tip pointing roughly towards the true log OR. If publication bias is present, the plot will be asymmetric because some negative studies are not published.

The asymmetry of the funnel plot was visually evaluated by the Galbraith plot (Galbraith, 1988Go), in which the standard normal deviate (SND), defined as the log OR divided by its standard error, is plotted against the estimate’s precision (i.e. 1/SE), and by the test of significance of the intercept coefficient of the linear regression model of Galbraith plot (Egger et al., 1997Go). An intercept coefficient that statistically significantly deviates from 0 indicates asymmetry (Egger et al., 1997Go). Begg’s rank correlation test was also used to test for asymmetry (Begg and Mazumdar, 1994Go).

The sources of heterogeneity were further evaluated by a graphical method proposed by Baujat et al. (2002)Go. In Baujat’s plot, the X-axis represents the contribution of the study in question to the overall heterogeneity, as measured by Cochran’s Q, whereas the Y-axis represents the influence of the study on the overall risk effect, defined as the square of the difference between the risk effect estimated from the study and that of the rest of the studies, weighted by the inverse of the estimated variance of the risk effect after exclusion of the study.

In addition, the sources of heterogeneity were evaluated by an inconsistency measure proposed by Higgins and Thompson (2004)Go. This measure, I2, defined to be 100% x (Qdf)/Q, where Q is Cochran’s heterogeneity statistic and df is the degrees of freedom, describes the percentage of total variation across studies that is due to heterogeneity rather than chance. In addition, the presence of asymmetry in funnel plots, often an indication of publication bias, a nonparametric ‘trim and fill’ method proposed by Duval and Tweedie (2000)Go was used to estimate the number of missing studies and to estimate an ‘adjusted’ OR and its CI. This method identifies and estimates the number of asymmetric studies in the right side of the funnel. These studies are then ‘trimmed’ from the funnel, revealing a more or less symmetric but smaller funnel from which the true center of the funnel is estimated by standard meta-analysis methods. The trimmed studies are then replaced and their missing counterparts, i.e. those studies with negative findings, are statistically imputed or ‘filled’. The imputed OR estimates and their standard errors are then combined with the whole studies to come up with an adjusted ‘true’ pooled estimate of OR and its standard errors.

Finally, given strong evidence for publication bias, I investigated the effect of publication bias on the pooled OR estimate using a method by Copas and Jackson (2004)Go. This method, under the only and plausible assumption that the chance that a study gets published cannot get smaller as the study size, as measured by precision, gets larger, estimates the maximum bias in estimating the pooled log OR under all possible publication bias mechanisms as a function of the number of unpublished studies, m. This analysis was necessary because characterization of the bias mechanism can be difficult, if not impossible, and hence a sensitivity analysis of some sort will be of help in gauging the value of m which gives a bias just large enough to cast doubt on the overall conclusion. In addition, as the number of included studies for meta-analysis can be small, the lack of significant evidence for publication bias does not necessarily mean there is no publication bias at all. Hence, again, a sensitivity analysis is helpful.

All computations were carried out in R (version 2.0.0), a language and environment for statistical computing and graphics (www.r-project.org).

Role of the funding source
The sponsor of the study had no role in study design, data collection, data analysis, data interpretation, or writing of this report.


    Results
 Top
 Abstract
 Introduction
 Materials and methods
 Results
 Discussion
 References
 
Characteristics of included studies
Fourteen studies on GSTM1-endometriosis involved 1539 cases/patients and 1805 controls, whereas nine studies on GSTT1 involved 1021 cases/patients and 1180 controls. Detailed characteristics of each study are described in Table I for GSTM1 and Table II for GSTT1. The frequency of GSTM1 0/0 genotype in controls ranges from 5.0% in Chinese people from Taiwan to 56.0% in Koreans. With the exception of a study conducted in Taiwan (Hsieh et al., 2004Go), the GSTM1 null genotype frequency is about 50% in all controls of included studies. The frequency of GSTT1 0/0 genotype in controls ranges from 9.7% in French to 48.3% in Koreans. The three studies, AK03, MY04 and HL04, from which data on combined GSTM1/GSTT1 null genotype could be deduced, involved 577 cases and 778 controls (Table III).


View this table:
[in this window]
[in a new window]
 
Table I. Characteristics of included studies of glutathione S-transferases (GST) M1 and endometriosis

 

View this table:
[in this window]
[in a new window]
 
Table II. Characteristics of included studies of glutathione S-transferases (GST) T1 and endometriosis

 

View this table:
[in this window]
[in a new window]
 
Table III. Characteristics of included studies of combined glutathione S-transferases (GST) M1/GSTT1 null genotype and endometriosis

 

Qualitative assessment of included studies
The first publication that reported the GST–endometriosis association was based on a relatively small study involving 42 women with endometriosis (Baranov et al., 1996Go). Using DNA samples taken from nondescript ‘healthy male and female donors’ as a reference group, the study investigated disease associations for six different diseases, including endometriosis, with two of the six diseases each having two different subtypes. No information was given regarding the ages of the patients or the quality assurance procedures in genotyping, and no attempt was made to control for known risk factors for endometriosis, such as smoking status. The inclusion of males in the control sample may be also questionable (Zondervan et al., 2002bGo). Therefore, from a methodological standpoint, this study was not a methodologically rigorous one. As a result, any finding that came out of the study should be viewed as preliminary.

Of the14 studies on GSTM1, half of them were conducted in Europe, and the other half, in East Asia. Three studies (Baranov et al., 1996Go, 1999Go; Ivashchenko et al., 2003Go), including the first report on the GSTM1–endometriosis association, were conducted in Russia by the same research group. Four studies were conducted in China. Among seven studies on GSTT1, three were conducted in China.

The selection of cases or patients varies among the included studies. Some selected prevalent cases, whereas others selected incident cases. Some studies selected cases/patients with a mixture of various revised American Fertility Society (rAFS) stages, or exclusively advanced rAFS stages (rAFS III/IV), whereas others merely selected ‘ovarian endometriosis’ or ‘extragenital endometriosis’ or simply did not report the type of endometriosis. Most studies did not report the ages of the recruited cases/patients. The earlier studies tended to pay less attention to methodological details, such as the criteria of case/patient selection, staging and age.

The selection of controls also varied substantially. Some were population based (but not necessarily from the same source population from which the cases arise), whereas others were hospital-based. Both population- and hospital-based controls appeared to be selected based on convenience, and further variations exist within each category. For population-based controls, for example, it ranged from ‘donors’, apparently involving both men and women, to healthy newborn females. For hospital-based studies, it ranged from women undergoing induced abortions to women with gynecologic complaints but without endometriosis.

Despite such tremendous heterogeneities, there are several conspicuous commonalities shared by all studies. First, no information was provided in any included study regarding the assessment of HWP in controls. Deviation from the HWP could be due to chance, but more likely it signals some potential biases or problems in control selection or genotyping. It also tends to inflate artificially the error of a false–positive association (Little et al., 2002Go). Because the evaluation of HWP is regarded as an important criterion in the evaluation of genetic association studies (Little et al., 2002Go), caution should be exercised in evaluating these studies. Second, the quality measures used for genotyping or the degree of reproducibility between quality control and replicates were not specified in almost all of studies. Third, no study made any serious attempt to match controls with the cases on factors that may confound the result. For example, age is the only sociodemographic risk factor consistently reported for endometriosis (Eskenazi and Warner, 1997Go), yet no study attempted to match, either individually or by frequency, controls in age with the cases. In several studies, in fact, the controls, as a group, were apparently younger than the cases, leaving the possibility that some of them may have endometriosis later in their life. Lastly, all studies made little, or, in most cases, no serious attempt to control for some known risk factors for endometriosis, such as smoking and body mass index (Eskenazi and Warner, 1997Go). In fact, in one earlier study (Baranova et al., 1997Go), not included in this meta-analysis but reported the bulk of the data later in Baranov et al. (1999)Go, controls were significantly younger than the cases and had significantly more smokers. These glaring omissions suggest that the overall quality of the GST–endometriosis association studies, especially those of earlier ones, leaves much to be desired.

GSTM1/GSTT1 and risk for endometriosis
The OR for endometriosis in women with GSTM1 0/0 genotype as compared with other genotypes ranged from 0.8 to 32.6 (Figure 1A). The pooled summary OR based on a random effect model was 1.96 (95% CI = 1.29–2.98), suggesting that women with the GSTM1 0/0 genotype have nearly twice the risk of developing endometriosis as compared with women with other genotypes. However, there was strong indication of a tremendous heterogeneity among studies ({chi}213 = 97.25, P < 5.7 x 10–5, and the estimated variance of the random effect, {tau}2 = 0.53).


Figure 1
View larger version (17K):
[in this window]
[in a new window]
 
Figure 1. Individual and pooled odds ratio estimates and their 95% confidence intervals (CI) for glutathione S-transferases (GST) M1 (A) and GSTT1 (B). The size of the square is proportional to the percent weight of each study in the random effect meta-analysis. Horizontal line represents the 95% CI. The summary pooled OR and its 95% CI are indicated by the shaded diamond.

 

For GSTT1, the OR ranged from 0.9 to 7.5 (Figure 1B). The random-effects model yielded a pooled OR of 1.77 (95% CI = 1.19–2.63), suggesting that the risk of developing endometriosis in women with the at-risk genotype is increased by nearly 80% as compared with women with other GSTT1 genotypes. Again, there was sign of substantial heterogeneity ({chi}28= 25.98, P = 0.0011, and the estimated variance of random effect {tau}2 = 0.24).

For the combined GSTM1/GSTT1 null genotype, the three studies, AK03, MY04 and HL04, gave an OR estimate of 0.86 (95% CI = 0.39–1.88), 1.16 (95% CI = 0.67–2.00) and 1.45 (95% CI = 0.98–2.15), respectively. The pooled OR based on the random-effects model is 1.26 (95% CI = 0.94–1.70), which is consistent with the conclusion reached by BC99. There was no indication for heterogeneity ({tau}2 = 0.0, P = 0.472). Because all OR CI include 1, and there was no sign of heterogeneity, no further analysis was performed.

Tables IV and V summarize the ORs for endometriosis in different subgroups for GSTM1 and GSTT1 studies, respectively. Several observations are in order. First, for both GSTM1 and GSTT1, there was no difference in OR estimate between the continents where the study was conducted. Second, for GSTM1, the OR estimate from pooled studies published in English was higher than that from pooled studies published in other languages, but the two estimates overlap in CIs. For GSTT1, the magnitudes of the OR estimates were reversed. Lastly, although the OR estimate for GSTM1 from small studies, defined to be the one with overall sample size less than 200, was almost identical to that from large studies (overall sample size >200), the CI of latter OR includes 1, which indicates no significant deviation from the null effect. For GSTT1, the OR from small studies was higher than that from large studies. Similarly, the CI of the pooled OR from larger GSTT1 studies also included 1.


View this table:
[in this window]
[in a new window]
 
Table IV. Meta-analysis of the effect of the glutathione S-transferases (GST) M1 null genotype on risk of endometriosis, according to potential sources of heterogeneity

 

View this table:
[in this window]
[in a new window]
 
Table V. Meta-analysis of the effect of the glutathione S-transferases (GST) T1 null genotype on risk of endometriosis, according to potential sources of heterogeneity

 

Assessment of heterogeneity
In view of clear evidence of heterogeneity among included studies, I used Baujat’s plot to identify studies that account for most of the heterogeneity without having to explore all possible sources of heterogeneity by subgroup analyses. Figure 2 (upper panel) shows the Baujat’s plot for both GSTM1 and GSTT1 studies. For GSTM1, it can be seen that the study HC04 stands out prominently as being the study that contributes most to the overall heterogeneity (upper left panel of Figure 2). For GSTT1, it is LZ03 that was the most influential. The I2 values were 86.6 and 69.5% for GSTM1 and GSTT1, respectively, suggesting that most of the variability across studies is due to heterogeneity rather than chance. After removing HC04, the I2 only reduced very moderately to 67.6% and the heterogeneity test remains highly significant (P = 0.00022). After further removing GSTM1 studies BI96, BC99 and LZ03, the I2 finally dipped below 39–23.3% and the heterogeneity test was no longer significant at 0.1 level (Figure 2, lower left panel).


Figure 2
View larger version (19K):
[in this window]
[in a new window]
 
Figure 2. Upper panel: Baujat’s plot for 14 glutathione S-transferases (GST) M1 studies (left) and 8 GSTT1 studies (right). Each study is identified by the initials of the last names of the first two authors, followed by the last two digits of year when the study was published. DC04U and DC04H refer to the two substudies in the Uygur and Han populations in Ding et al. (2004)Go, respectively. Lower panel: Baujat’s plot for GSTM1 studies after excluding studies BI96, BC99, LZ03 and HC04 (left), and for GSTT1 studies after removing DC04H and LZ03 (right). Each plot also shows the associated inconsistency measure I2.

 

After removing LZ03 from GSTT1 studies, the I2 increased to 87%, and the Cochran’s heterogeneity test was still significant (P = 1.9 x 10–14). After further removing DC04H, the I2 reduced to 13.6%, and the heterogeneity test was no longer significant (P = 0.326).

That the study HC04 contributes apparently a disproportional share to the overall heterogeneity in GSTM1, studies can also be viewed from a different angle. Figure 3 is the plot of log OR versus genotype GSTM1 0/0 frequency in the cases. With the only exception of HC04, there was a near-perfect linear relationship between the two variables (Formula = 0.93, F1,11 = 160.8, P = 6.6 x 10–8). This suggests that HC04 was evidently an outlier and somehow different from the rest of the studies.


Figure 3
View larger version (9K):
[in this window]
[in a new window]
 
Figure 3. Log OR versus the frequency of glutathione S-transferases (GST) M1 null genotype in cases/patients. The dashed line represents the linear regression after removing the study HC04.

 

Evaluation of publication bias
Figure 4 is the funnel plot for GSTM1 and GSTT1 studies. As can be seen from the figure, both GSTM1 studies and GSTT1 studies showed some signs of asymmetry, especially in GSTM1 studies. Begg’s rank test of asymmetry yielded rank correlation coefficient of 0.52 (P = 0.0098) for GSTM1 studies and of 0.39 (P = 0.180) for GSTT1 studies, respectively. Egger’s test of bias yielded a P value of 0.042 for GSTM1 studies and a P value of 0.114 for GSTT1 studies. Both tests suggest that although there was no statistically significant evidence for bias or asymmetry for GSTT1 studies, there is strong evidence for bias for GSTM1 studies. However, given the rather small number of GSTT1 studies, the lack of statistical evidence may well be attributed to the lack of statistical power. The moderate rank correlation coefficient appeared to suggest that such bias may exist.


Figure 4
View larger version (8K):
[in this window]
[in a new window]
 
Figure 4. Funnel plot for glutathione S-transferases (GST) M1 (A) and GSTT1 (B) studies. Each alphabet-numeric combination represents a study. The x represents missing studies estimated and imputed by the trim and fill method. The unshaded diamond indicates the magnitude of the pooled log OR estimate based on the original data, and the shaded diamond indicates the magnitude of the adjusted pooled log OR estimate after the trim and fill procedure. The horizontal line passing the diamond represent the 95% CI for the estimate. The vertical dotted line represents a null effect.

 

Assessment of the effect of publication bias on risk estimate
I further used the ‘trim and fill’ method to evaluate publication bias and its impact on pooled estimate of OR. For GSTM1 studies, the estimated number of missing studies is four (SE = 3.16), and the adjusted pooled OR estimate is 1.23 (95% CI = 0.95–1.59) (Figure 4A). It is interesting to note that the trim and fill method trimmed the four studies (BI96, BC99, LZ03 and HC04) that are identical to those identified by the successive use of Baujat’s plot (see above). It is also of note that the 95% CI of adjusted pooled log OR now included 0, indicating that the effect of the putative risk genotype was not significantly different from the null. For GSTT1 studies, the estimated number of missing studies was 0 (SE = 1.41).

Although the pooled OR estimate was still greater than 1 for GSTT1 after removing two studies that contribute disproportionately to the overall heterogeneity, the funnel plot (Figure 4B) appeared to indicate that publication bias may have influenced these findings. In fact, higher log OR estimates tended to be those with higher standard errors (the correlation coefficient was 0.65, P = 0.16, or 0.57, P = 0.14 if the two studies were removed). Figure 5A shows the maximum bias in estimating the pooled log OR in the presence and the absence of heterogeneity for GSTM1, based on the method of Copas and Jackson (2004)Go. For GSTM1 studies, the pooled log OR estimate was 0.67 (95% CI = 0.25–1.09) if all studies were included, or 0.20 (95% CI = 0.02–0.39) when the four studies were excluded (Table IV). In the former case, there was a clear indication for heterogeneity ({tau}2 = 0.53, P < 0.00001), whereas in the latter heterogeneity appeared to be absent or negligible ({tau}2 = 0.0.02, P = 0.23) (Table IV). For any given number of unpublished studies, Figure 5A shows the estimated largest possible bias that could result from publication bias. In the presence of heterogeneity, it can be seen that when the publication probability is 14/(14+4) = 78%, where 4 is the number of unpublished studies, the maximum bias can be as high as 0.31, which reduces the log OR from 0.67 to 0.36 and could effectively render the CI to include 0, i.e. the null effect. In the absence of heterogeneity, a bias of 0.04 would be enough to wipe out the statistical significance of the estimated log OR, which can happen when there is only one missing study, or 8/(8+1) = 89% publication probability.


Figure 5
View larger version (8K):
[in this window]
[in a new window]
 
Figure 5. The effect of publication bias on the pooled log OR: maximum bias as a function of the number of missing studies. H, presence of heterogeneity; N, no heterogeneity.

 

For GSTT1, the pooled log OR estimate was 0.57 (95% CI = 0.17–0.97) if all studies were included, or 0.25 (95% CI = 0.01–0.50) when the two studies were excluded (Table V). In the former case, there was a clear indication for heterogeneity ({tau}2 = 0.24, P = 0.0011), whereas in the latter heterogeneity appeared to be absent ({tau}2 = 0.02, P = 0.33) (Table V). The log OR could easily lose its statistical significance when the publication probability is 9/(9+4) = 69% in the presence of heterogeneity or is 7/(7+1) = 88% in the absence of heterogeneity (Figure 5B). These results suggest that, with a fairly realistic publication probability ranging from 69 to 88%, the pooled OR from the eight published studies is very vulnerable to publication bias and should thus be viewed as volatile.


    Discussion
 Top
 Abstract
 Introduction
 Materials and methods
 Results
 Discussion
 References
 
In this meta-analysis on GSTM1/T1–endometriosis association studies, I found substantial heterogeneities among studies, which are likely to result from publication bias. The publication bias appears to be prominent and significant for GSTM1 studies, but is less so for GSTT1 studies. After correction for this bias, I found no evidence that women with GSTM1 null genotype have increased risk of developing endometriosis as compared with women with other genotypes. For GSTT1, the risk associated with the null genotype is 29% higher than other genotypes (the pooled OR = 1.29, 95% CI = 1.01–1.65, after removing two studies contributing disproportionately heterogeneity). However, even this estimate should be viewed with a pinch of salt, because the estimate could easily lose its statistical significance if there is a realistic 69–80% publication probability. It should be noted that asymmetry of funnel plots can be caused by biases other than publication bias, such as true heterogeneity (effect size differs according to study size), data irregularities (poor methodological design of small studies, inadequate analysis and fraud) and chance (Sterne et al., 2001Go). In the absence of clear evidence for true heterogeneity and data irregularity and in view of a well-known ‘tendency on the part of investigators, reviewers and editors to submit or accept manuscripts for publication based on the direction or strength of the study findings’ (Dickersin, 1990Go), publication bias becomes the primary suspect for the asymmetry. This suspicion appears to be reinforced and somewhat justified by analyses using a range of statistical tests that are designed to test for the existence of this bias, such as the trim and fill method (Figure 4A and B) and the Copas and Jackson method (Figure 5A and B).

The findings of this report appear to be consistent with a well-recognized perennial problem associated with genetic association studies of complex diseases (Risch and Botstein, 1996Go; Cardon and Bell, 2001Go): lack of consistent replication. In an extensive review of 166 disease–gene associations, it is reported that only six, or less than 4% of them had been consistently replicated (Hirschhorn et al., 2002Go). Other investigators reported slightly better percentage of 16% (Ioannidis et al., 2003Go). In fact, quantitative analyses of published association studies revealed that significant heterogeneity or lack of consistency is rampant, and that a small sample size of the first publication and a large number of studies are two independent predictors of reaching discrepancies (Ioannidis et al., 2001Go). In addition, the magnitude of the genetic effect differs significantly between large and small studies (Ioannidis et al., 2003Go), as evidenced also in this analysis.

There are many possible explanations for the lack of consistency that plagues genetic association studies: genuine population heterogeneity, difference in selection of cases and/or controls, false negative due to lack of statistical power, or false positive due to population stratification. For example, prevalent or incident cases or the selection of patients with different pathological stages (not necessarily equivalent to the rAFS stages) could have different genetic components. Flawed study design, faulty statistical analysis, genotyping errors or selective reporting also exacerbate the lack of consistency and often are the causes for the first positive reports.

Another study in point is Hsieh et al. (2004)Go, which reported an OR of 32.6 for GSTM1 null genotype, higher than the risk of ovarian cancer with BRCA2 mutations (Rafnar et al., 2004Go). Yet extraordinary claims usually warrant careful examinations. Like that of BI96, no information was given regarding the ages of the patients or the quality assurance procedures in genotyping, and no attempt was made to control for known risk factors for endometriosis, such as smoking status. The selection of controls was also based on convenience: they were women admitted to the hospital with nondescript disorders. What sets this study apart from others is its inordinately low frequency of GSTM1 null genotype (5%), far lower than reported 40–50% in different populations (Seidegard et al., 1990Go), than the reported 58% in the Chinese (Board, 1981Go) and than those in Chinese, Japanese and Korean reported in (Lin et al., 2003Go; Peng et al., 2003Go; Ding et al., 2004Go; Morizane et al., 2004Go; Hur et al., 2005Go). In fact, the frequency is significantly lower than any studies included in this analysis. As Figure 3 shows, this population appears to be fundamentally different than other populations. Naturally, there is question as to why this control group has a genotype frequency that is vastly different from others, and whether the selected controls were appropriate for the association study. A test of HWP in the controls may have been useful in the identification of any anomaly in this group.

Is it possible that GSTM1 or GSTT1 by itself does not exhibit appreciable marginal effect on the risk of endometriosis but interacts with other genes to confer, jointly, increased risk of endometriosis? This is possible. In fact, Hadfield et al. (2001)Go suggested that the combination of GSTM1 null genotype and the CYP1A1 polymorphism is associated with a small increased risk. Arvanitis et al. (Arvanitis et al., 2003Go) also reported a similar finding. However, there is concern that the finding of Hadfield et al. (2001)Go may be a result of a post hoc analysis of data, and that the finding was not quite self-consistent (the difference between male controls and familial endometriosis cases is significant, but is not for other groups of cases and controls). This may stem from the fact that the sample sizes in (Hadfield et al., 2001Go) are not sufficient to permit a thorough analysis of gene–gene interactions. The finding of Arvanitis et al. (2003)Go shares the same problem and might also be spurious because the finding was concluded after computing over one hundred 95% CIs (Tables II and III of Arvanitis et al., 2003Go). This post hoc analysis, in conjunction with multiple testing, is akin to the subgroup analysis in clinical trials (Freemantle et al., 1999Go).

The findings are also consistent with a recent reappraisal of the link between dioxin and endometriosis, which maintains that, because of major study design flaws and faulty statistical analysis, the first report of the dioxin–endometriosis link is questionable at best (Guo, 2004Go). Some recent studies on the link appear to lend further support for this view (Fierens et al., 2003Go; De Felip et al., 2004Go; Lim et al., 2004Go).

Recent laboratory findings also cast doubt on the dioxin–endometriosis link. The effects of dioxin have been shown to be mediated through high-affinity binding to the arylhydrocarbon receptor (AhR), which forms an activated heterodimer complex with the structurally related AhR nuclear translocator protein (ARNT) upon binding to dioxin (Bofinger et al., 2001Go). The two most studied members of the AhR gene battery are cytochrome P450 enzymes 1A1 (CYP1A1) and 1B1 (CYP1B1), which in conjunction with AhR and ANRT, form the phase I biotransformation process in dioxin detoxification, whereas GSTs play their roles in phase II. It has been recently reported that there is no significant endometriosis-related differences in CYPA1, CYP1B1, AhR and ARNT expression in cultured human endometrial explants exposed to dioxin cultures (Bofinger et al., 2001Go; Pitt et al., 2001Go). The expression of AhR and dioxin-related genes in the endometrium do not differ in women with or without endometriosis (Igarashi et al., 1999Go).

It is regrettable that although all included studies attempted to measure the risk of endometriosis for GST polymorphisms, no attempt has ever been made to measure the blood concentration of any dioxin or dioxin exposure levels in cases and controls, in conjunction with the genotyping. Though technically and logistically demanding, these measurements, if made, would have been more convincing if there is a belief that the role of GSTs in endometriosis pathogenesis is the detoxification of dioxins or other environmental pollutants. Moreover, no study has ever attempted to resolve the conundrum: should GST null genotype increase the risk of endometriosis which is associated with subfertility, which, in turn, apparently reduces fitness, why do GSTM1/GSTT1 polymorphisms still exist? Although one could argue that this may be attributable to fairly recent dramatic changes in environment or reproductive behaviour, clearly the rising prevalence of endometriosis outpaces remarkably the change in any GST allele frequency.

Genetic association studies attempt to identify genes or markers that are closely linked with the genes that confer increased disease risk through identification of differential genotypic frequencies in cases and controls. Their strengths and pitfalls have been well elucidated by many authors (Kidd, 1993Go; Cardon and Bell, 2001Go). Although the growing interest in this approach to nonmendelian complex diseases such as endometriosis is driven by successes in mapping mendelian diseases and by the increasingly faster and cheaper methods for genotyping more and more genetic markers, its technical simplicity, as well as its cookie-cutter conceptual simplicity may also play a role. The unawareness or ignorance of its explicit and implicit assumptions or lack of carefully thought-out study design may be an important reason as to why nonreplication is so rampant in genetic association studies.

Because there are over 36 000 protein-coding genes (Venter et al., 2001Go), 1.8 million (and counting) single nucleotide polymorphisms (SNPs) (http://snp.cshl.org/), and 2.91 billion base-pairs in the human genome (at which genetic variation could occur and have influence on phenotypic variation), the prior probability that a particular gene polymorphism may increase the risk of endometriosis is minuscule. This is especially true when even astronomically more combinations of genotypes and/or genetic models are considered, let alone in combination with environmental effects. Therefore, a small P value may not be that impressive when the prior probability is incorporated. Even if there is a prior belief that a particular gene polymorphism, like GSTM1 null genotype, may be biologically plausibly involved in the pathogenesis, it is still a speculation because biological plausibility ‘is too often not based on logic or data, but only on prior beliefs’ (Rothman and Greenland, 1998Go). Furthermore, the GST-endometriosis link also ignores the possibility of genetic redundancy (Tautz, 1992Go; Nowak et al., 1997Go) that may exist in the detoxification pathways.

As there are several known risk factors, such as age and smoking, for endometriosis (Eskenazi and Warner, 1997Go), failure to control for these risk factors may possibly yield spurious results, a fact known as Simpson’s paradox. In addition, because a positive finding in an association study only means association, not necessarily a causal relationship, it is possible that a gene demonstrated to be associated with endometriosis may well be responsible for a risk factor which, in turn, increases the risk of endometriosis. For example, younger age at menarche has been identified as a risk factor for endometriosis (Moen and Schei, 1997Go). But ages at menarche in sisters have been shown to be highly correlated (Salces et al., 2001Go). Body mass index, length of menstrual cycles and the amount of menses are also risk factors for endometriosis but may, too, be familially correlated (Salces et al., 2001Go, 2003Go). Without control for these risk factors, how can we be sure that the polymorphism of interest is an endometriosis susceptibility gene?

Failure to control for risk factors, or other genetic effects, in genetic association studies can also artificially distort the effect size of the gene polymorphism of interest when in reality it may only have a small effect on disease risk. A well-known tutorial example is college admission based on either academic achievements (‘brainy’) or athletic talents (‘sporty’). If in the general population being brainy and being sporty are assumed to be independent, then focusing on college students, who are either brainy or sporty, would lead to us to conclude, erroneously, that being brainy means less likely to be sporty (or vice versa), because being either is sufficient to be admitted to the college. This phenomenon, known as Berkson’s fallacy, could also happen when using hospital–based controls for association studies (Berkson, 1946Go).

As with other meta-analyses, the interpretation of this meta-analysis should be made within the context of its limitations. First, this analysis has assumed tacitly that all included studies measured the same thing. However, differences in study design and execution, in genotyping accuracy, in degree of population homogeneity, in composition of cases (percentage of stages III/IV patients), and in control selection could mean that different studies are measuring slightly different things. These differences may well attribute to the heterogeneity that has been observed. Second, this analysis, especially for GSTT1, was limited by the rather small number of studies, which could have yielded a lack of power for conducting analyses of publication bias. The small sample size also limited the ability to conduct a more meaningful subgroup analyses.

With the benefit of hindsight, of course, it is easy to be critical, because many studies were conducted without the benefit of more current molecular genetic technologies, using the cookie-cutter approach that is somewhat deceptively simple. However, the findings of these studies and their validities should be put into perspective from the vantage point of current criteria of sound genetic association studies.

Several recommendations on the future association studies of endometriosis can be made from this meta-analysis. First, a carefully thought-out study design is crucial for a successful association study. Second, it is necessary to make effort to control for known risk factors, preferably in the design stage. Third, larger sample sizes are certainly desirable. In fact, the possibility of gene–gene and gene–environment interactions and the need for control for confounding factors of environmental origins would require much larger sample sizes than studies without interaction/confounding. Fourth, special attention needs to be paid to select proper controls (see Holt and Weiss, 2000Go) and for controlling for population heterogeneity, such as using genomic control (Devlin and Roeder, 1999Go). Lastly, care should be exercised in genotyping and in checking for abnormality, such as the deviation from HWP.

In summary, this meta-analysis has found substantial heterogeneities among GSTM1/GSTT1 association studies and evidence for publication bias. The publication bias appears to be prominent and significant for GSTM1 studies, but is less so for GSTT1 studies. After correction for this bias, there is little evidence that women with GSTM1 null genotype have increased risk of developing endometriosis as compared with women with other genotypes. For GSTT1, the risk associated with the null genotype is 29% higher than other genotypes, and this estimate is highly susceptible to publication bias and should therefore be taken with a pinch of salt.


    Acknowledgements
 Top
 Abstract
 Introduction
 Materials and methods
 Results
 Discussion
 References
 
The author thanks Dr. Elena Semina for extracting relevant data from two Russian articles. He also thanks Dr. Yiqing Song and Dr. Krina Zondervan for their helpful and constructive comments on an earlier version of the manuscript. The funding from the Children’s Hospital of Wisconsin Foundation is gratefully acknowledged.


    References
 Top
 Abstract
 Introduction
 Materials and methods
 Results
 Discussion
 References
 
Arvanitis DA, Goumenou AG, Matalliotakis IM, Koumantakis EE and Spandidos DA (2001) Low-penetrance genes are associated with increased susceptibility to endometriosis. Fertil Steril 76,1202–1206.[CrossRef][ISI][Medline]

Arvanitis DA, Koumantakis GE, Goumenou AG, Matalliotakis IM, Koumantakis EE and Spandidos DA (2003) CYP1A1, CYP19, and GSTM1 polymorphisms increase the risk of endometriosis. Fertil Steril 79(Suppl. 1),702–709.

Baranov VS, Ivaschenko T, Bakay B, Aseev M, Belotserkovskaya R, Baranova H, Malet P, Perriot J, Mouraire P, Baskakov VN et al. (1996) Proportion of the GSTM1 0/0 genotype in some Slavic populations and its correlation with cystic fibrosis and some multifactorial diseases. Hum Genet 97,516–520.[ISI][Medline]

Baranov VS, Ivashchenko TE, Shved NIu, Iarmolinskata MI, Sel’kov SA, Gorbushin SM, Savitskii GA, Malet P, Kanis M, Bruhat M et al. (1999) [Genetic factors of predisposition to endometriosis and response to its treatment]. Genetika 35,243–248.[Medline]

Baranova H, Bothorishvilli R, Canis M, Albuisson E, Perriot S, Glowaczower E, Bruhat MA, Baranov V and Malet P (1997) Glutathione S-transferase M1 gene polymorphism and susceptibility to endometriosis in a French population. Mol Hum Reprod 3,775–780.[Abstract/Free Full Text]

Baranova H, Bothorishvilli R, Canis M, Albuisson E, Perriot S, Glowaczower E, Bruhat MA, Baranov V and Malet P (1999) Possible involvement of arylamine N-acetyltransferase 2, glutathione S-transferases M1 and T1 genes in the development of endometriosis. Mol Hum Reprod 5,636–641.[Abstract/Free Full Text]

Baujat B, Mahe C, Pignon JP and Hill C (2002) A graphical method for exploring heterogeneity in meta-analyses: application to a meta-analysis of 65 trials. Stat Med 21,2641–2652.[CrossRef][ISI][Medline]

Baxter SW, Thomas EJ and Campbell IG (2001) GSTM1 null polymorphism and susceptibility to endometriosis and ovarian cancer. Carcinogenesis 22,63–65.[Abstract/Free Full Text]

Begg CB and Mazumdar M (1994) Operating characteristics of a rank correlation test for publication bias. Biometrics 50,1088–1101.[CrossRef][ISI][Medline]

Berkson J (1946) Limitation of the application of fourfold tables to hospital data. Biometrics Bull 2,47–53.[CrossRef]

Bischoff FZ and Simpson JL (2000) Heritability and molecular genetic studies of endometriosis. Hum Reprod Update 6,37–44.[Abstract/Free Full Text]

Board PG (1981) Biochemical genetics of glutathione-S-transferase in man. Am J Hum Genet 33,36–43.[ISI][Medline]

Bofinger DP, Feng L, Chi LH, Love J, Stephen FD, Sutter TR, Osteen KG, Costich TG, Batt RE, Koury ST et al. (2001) Effect of TCDD exposure on CYP1A1 and CYP1B1 expression in explant cultures of human endometrium. Toxicol Sci 62,299–314.[Abstract/Free Full Text]

Cardon LR and Bell JI (2001) Association study designs for complex diseases. Nat Rev Genet 2,91–99.[CrossRef][ISI][Medline]

Copas J and Jackson D (2004) A bound for publication bias based on the fraction of unpublished studies. Biometrics 60,146–153.[CrossRef][ISI][Medline]

Cotton SC, Sharp L, Little J and Brockton N (2000) Glutathione S-transferase polymorphisms and colorectal cancer: a HuGE review. Am J Epidemiol 151,7–32.[Abstract/Free Full Text]

D’Hooghe TM, Debrock S, Meuleman C, Hill JA and Mwenda JM (2003) Future directions in endometriosis research. Obstet Gynecol Clin North Am 30,221–244.[CrossRef][ISI][Medline]

De Felip E, Porpora MG, di Domenico A, Ingelido AM, Cardelli M, Cosmi EV and Donnez J (2004) Dioxin-like compounds and endometriosis: a study on Italian and Belgian women of reproductive age. Toxicol Lett 150,203–209.[CrossRef][ISI][Medline]

DerSimonian R (1996) Meta-analysis in the design and monitoring of clinical trials. Stat Med 15,1237–1248; discussion 1249–1252.[CrossRef][ISI][Medline]

Devlin B and Roeder K (1999) Genomic control for association studies. Biometrics 55,997–1004.[CrossRef][ISI][Medline]

Dickersin K (1990) The existence of publication bias and risk factors for its occurrence. JAMA 263,1385–1389.[Abstract]

Ding Y, Lin RY, Wang XF, Ding JB, Ai XZ and Wen H (2004) [Relationship between endometriosis and glutathione S-transferase M1, T1 genes of the Uygurs and Hans in Xinjiang]. Zhonghua Fu Chan Ke Za Zhi 39,101–104.[Medline]

Duval S and Tweedie R (2000) Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 56,455–463.[CrossRef][ISI][Medline]

Egger M, Davey Smith G, Schneider M and Minder C (1997) Bias in meta-analysis detected by a simple, graphical test. BMJ 315,629–634.[Abstract/Free Full Text]

Eskenazi B and Warner ML (1997) Epidemiology of endometriosis. Obstet Gynecol Clin North Am 24,235–258.[CrossRef][ISI][Medline]

Fierens S, Mairesse H, Heilier JF, De Burbure C, Focant JF, Eppe G, De Pauw E and Bernard A (2003) Dioxin/polychlorinated biphenyl body burden, diabetes and endometriosis: findings in a population-based study in Belgium. Biomarkers 8,529–534.[CrossRef][ISI][Medline]

Freemantle N, Mason J and Eccles M (1999) Deriving treatment recommendations from evidence within randomized trials. The role and limitation of meta-analysis. Int J Technol Assess Health Care 15,304–315.[ISI][Medline]

Galbraith RF (1988) A note on graphical presentation of estimated odds ratios from several clinical trials. Stat Med 7,889–894.[ISI][Medline]

Garte S, Gaspari L, Alexandrie AK, Ambrosone C, Autrup H, Autrup JL, Baranova H, Bathum L, Benhamou S, Boffetta P et al. (2001) Metabolic gene polymorphism frequencies in control populations. Cancer Epidemiol Biomarkers Prev 10,1239–1248.[Abstract/Free Full Text]

Geisler SA and Olshan AF (2001) GSTM1, GSTT1, and the risk of squamous cell carcinoma of the head and neck: a mini-HuGE review. Am J Epidemiol 154,95–105.[Abstract/Free Full Text]