Meta-analysis in medical research: potentials and limitations

Meta-analysis, the statistical combination of results from several studies to produce a single estimate of a treatment effect or size of an association, continues to attract controversy. We illustrate and discuss the promises and limitations of meta-analysis. Meta-analysis of clinical trials can prevent delays in the introduction of effective treatments or lead to the timely identification of adverse effects. However, meta-analyses are liable to numerous biases, both at the level of the individual study and the selection of studies for inclusion in meta-analysis. The biases and confounding factors that threaten the validity of individual studies will also affect meta-analyses of observational studies. We argue that meta-analyses should only be performed within the framework of systematic reviews that have been prepared using methods that minimize bias and address the combinability of studies.

Multidimensional preventive home visit programs for community-dwelling older adults: a systematic review and meta-analysis of randomized controlled trials

BACKGROUND: Multidimensional preventive home visit programs aim at maintaining health and autonomy of older adults and preventing disability and subsequent nursing home admission, but results of randomized controlled trials (RCTs) have been inconsistent. Our objective was to systematically review RCTs examining the effect of home visit programs on mortality, nursing home admissions, and functional status decline. METHODS: Data sources were MEDLINE, EMBASE, Cochrane CENTRAL database, and references. Studies were reviewed to identify RCTs that compared outcome data of older participants in preventive home visit programs with control group outcome data. Publications reporting 21 trials were included. Data on study population, intervention characteristics, outcomes, and trial quality were double-extracted. We conducted random effects meta-analyses. RESULTS: Pooled effects estimates revealed statistically nonsignificant favorable, and heterogeneous effects on mortality (odds ratio [OR] 0.92, 95% confidence interval [CI], 0.80-1.05), functional status decline (OR 0.89, 95% CI, 0.77-1.03), and nursing home admission (OR 0.86, 95% CI, 0.68-1.10). A beneficial effect on mortality was seen in younger study populations (OR 0.74, 95% CI, 0.58-0.94) but not in older populations (OR 1.14, 95% CI, 0.90-1.43). Functional decline was reduced in programs including a clinical examination in the initial assessment (OR 0.64, 95% CI, 0.48-0.87) but not in other trials (OR 1.00, 95% CI, 0.88-1.14). There was no single factor explaining the heterogenous effects of trials on nursing home admissions. CONCLUSION: Multidimensional preventive home visits have the potential to reduce disability burden among older adults when based on multidimensional assessment with clinical examination. Effects on nursing home admissions are heterogeneous and likely depend on multiple factors including population factors, program characteristics, and health care setting.

An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary

OBJECTIVE: Meta-analysis of studies of the accuracy of diagnostic tests currently uses a variety of methods. Statistically rigorous hierarchical models require expertise and sophisticated software. We assessed whether any of the simpler methods can in practice give adequately accurate and reliable results. STUDY DESIGN AND SETTING: We reviewed six methods for meta-analysis of diagnostic accuracy: four simple commonly used methods (simple pooling, separate random-effects meta-analyses of sensitivity and specificity, separate meta-analyses of positive and negative likelihood ratios, and the Littenberg-Moses summary receiver operating characteristic [ROC] curve) and two more statistically rigorous approaches using hierarchical models (bivariate random-effects meta-analysis and hierarchical summary ROC curve analysis). We applied the methods to data from a sample of eight systematic reviews chosen to illustrate a variety of patterns of results. RESULTS: In each meta-analysis, there was substantial heterogeneity between the results of different studies. Simple pooling of results gave misleading summary estimates of sensitivity and specificity in some meta-analyses, and the Littenberg-Moses method produced summary ROC curves that diverged from those produced by more rigorous methods in some situations. CONCLUSION: The closely related hierarchical summary ROC curve or bivariate models should be used as the standard method for meta-analysis of diagnostic accuracy.

Survival and cardiac remodeling benefits in patients undergoing late percutaneous coronary intervention of the infarct-related artery: evidence from a meta-analysis of randomized controlled trials

Our purpose was to perform a systematic review and meta-analysis of randomized trials comparing percutaneous coronary intervention (PCI) of the infarct-related artery (IRA) with medical therapy in patients randomized >12 h after acute myocardial infarction (AMI).

Glycemic control and macrovascular disease in types 1 and 2 diabetes mellitus: Meta-analysis of randomized trials

Uncertainty persists concerning the effect of improved long-term glycemic control on macrovascular disease in diabetes mellitus (DM).

Self-monitoring of blood glucose in non-insulin treated patients with type 2 diabetes: a systematic review and meta-analysis

To assess the effect of self-monitoring of blood glucose (SMBG) on glycaemic control in non-insulin treated patients with type 2 diabetes by means of a systematic review and meta-analysis.

Sexual transmission of HIV according to viral load and antiretroviral therapy: systematic review and meta-analysis

OBJECTIVES: To synthesize the evidence on the risk of HIV transmission through unprotected sexual intercourse according to viral load and treatment with combination antiretroviral therapy (ART). DESIGN: Systematic review and meta-analysis. METHODS: We searched Medline, Embase and conference abstracts from 1996-2009. We included longitudinal studies of serodiscordant couples reporting on HIV transmission according to plasma viral load or use of ART and used random-effects Poisson regression models to obtain summary transmission rates [with 95% confidence intervals, (CI)]. If there were no transmission events we estimated an upper 97.5% confidence limit. RESULTS: We identified 11 cohorts reporting on 5021 heterosexual couples and 461 HIV-transmission events. The rate of transmission overall from ART-treated patients was 0.46 (95% CI 0.19-1.09) per 100 person-years, based on five events. The transmission rate from a seropositive partner with viral load below 400 copies/ml on ART, based on two studies, was zero with an upper 97.5% confidence limit of 1.27 per 100 person-years, and 0.16 (95% CI 0.02-1.13) per 100 person-years if not on ART, based on five studies and one event. There were insufficient data to calculate rates according to the presence or absence of sexually transmitted infections, condom use, or vaginal or anal intercourse. CONCLUSION: Studies of heterosexual discordant couples observed no transmission in patients treated with ART and with viral load below 400 copies/ml, but data were compatible with one transmission per 79 person-years. Further studies are needed to better define the risk of HIV transmission from patients on ART.

Individual patient data meta-analysis of diagnostic and prognostic studies in obstetrics, gynaecology and reproductive medicine

BACKGROUND: In clinical practice a diagnosis is based on a combination of clinical history, physical examination and additional diagnostic tests. At present, studies on diagnostic research often report the accuracy of tests without taking into account the information already known from history and examination. Due to this lack of information, together with variations in design and quality of studies, conventional meta-analyses based on these studies will not show the accuracy of the tests in real practice. By using individual patient data (IPD) to perform meta-analyses, the accuracy of tests can be assessed in relation to other patient characteristics and allows the development or evaluation of diagnostic algorithms for individual patients. In this study we will examine these potential benefits in four clinical diagnostic problems in the field of gynaecology, obstetrics and reproductive medicine. METHODS/DESIGN: Based on earlier systematic reviews for each of the four clinical problems, studies are considered for inclusion. The first authors of the included studies will be invited to participate and share their original data. After assessment of validity and completeness the acquired datasets are merged. Based on these data, a series of analyses will be performed, including a systematic comparison of the results of the IPD meta-analysis with those of a conventional meta-analysis, development of multivariable models for clinical history alone and for the combination of history, physical examination and relevant diagnostic tests and development of clinical prediction rules for the individual patients. These will be made accessible for clinicians. DISCUSSION: The use of IPD meta-analysis will allow evaluating accuracy of diagnostic tests in relation to other relevant information. Ultimately, this could increase the efficiency of the diagnostic work-up, e.g. by reducing the need for invasive tests and/or improving the accuracy of the diagnostic workup. This study will assess whether these benefits of IPD meta-analysis over conventional meta-analysis can be exploited and will provide a framework for future IPD meta-analyses in diagnostic and prognostic research.

The efficacy of psychological interventions for infertile patients: a meta-analysis examining mental health and pregnancy rate

BACKGROUND: Psychological interventions for infertile patients seek to improve mental health and increase pregnancy rates. The aim of the present meta-analysis was to examine if psychological interventions improve mental health and pregnancy rate among infertile patients. Thus, controlled studies were pooled investigating psychological interventions following the introduction of assisted reproductive treatments (ART). METHODS: The databases of Medline, PsycINFO, PSYNDEX, Web of Science and the Cochrane Library were searched to identify relevant articles published between 1978 and 2007 (384 articles). Included were prospective intervention studies on infertile patients (women and men) receiving psychological interventions independent of actual medical treatment. The outcome measures were mental health and pregnancy rate. A total of 21 controlled studies were ultimately included in a meta-analysis comparing the efficacy of psychological interventions. Effect sizes (ES) were calculated for psychological measures and risk ratios (RR) for pregnancy rate. RESULTS: The findings from controlled studies indicated no significant effect for psychological interventions regarding mental health (depression: ES 0.02, 99% CI: -0.19, 0.24; anxiety: ES 0.16, 99% CI: -0.10, 0.42; mental distress: ES 0.08, 99% CI: -0.10, 0.51). Nevertheless, there was evidence for the positive impact of psychological interventions on pregnancy rates (RR 1.42, 99% CI: 1.02, 1.96). Concerning pregnancy rates, significant effects for psychological interventions were only found for couples not receiving ART. CONCLUSIONS: Despite the absence of clinical effects on mental health measures, psychological interventions were found to improve some patients' chances of becoming pregnant. Psychological interventions represent an attractive treatment option, in particular, for infertile patients who are not receiving medical treatment.

Erythropoietin or Darbepoetin for patients with cancer--meta-analysis based on individual patient data

BACKGROUND: Erythropoiesis-stimulating agents (ESAs) reduce anemia in cancer patients and may improve quality of life, but there are concerns that ESAs might increase mortality. OBJECTIVES: Our objectives were to examine the effect of ESAs and identify factors that modify the effects of ESAs on overall survival, progression free survival, thromboembolic and cardiovascular events as well as need for transfusions and other important safety and efficacy outcomes in cancer patients. SEARCH STRATEGY: We searched the Cochrane Library, Medline, Embase and conference proceedings for eligible trials. Manufacturers of ESAs were contacted to identify additional trials. SELECTION CRITERIA: We included randomized controlled trials comparing epoetin or darbepoetin plus red blood cell transfusions (as necessary) versus red blood cell transfusions (as necessary) alone, to prevent or treat anemia in adult or pediatric cancer patients with or without concurrent antineoplastic therapy. DATA COLLECTION AND ANALYSIS: We performed a meta-analysis of randomized controlled trials comparing epoetin alpha, epoetin beta or darbepoetin alpha plus red blood cell transfusions versus transfusion alone, for prophylaxis or therapy of anemia while or after receiving anti-cancer treatment. Patient-level data were obtained and analyzed by independent statisticians at two academic departments, using fixed-effects and random-effects meta-analysis. Analyses were according to the intention-to-treat principle. Primary endpoints were on study mortality and overall survival during the longest available follow-up, regardless of anticancer treatment, and in patients receiving chemotherapy. Tests for interactions were used to identify differences in effects of ESAs on mortality across pre-specified subgroups. The present review reports only the results for the primary endpoint. MAIN RESULTS: A total of 13933 cancer patients from 53 trials were analyzed, 1530 patients died on-study and 4993 overall. ESAs increased on study mortality (combined hazard ratio [cHR] 1.17; 95% CI 1.06-1.30) and worsened overall survival (cHR 1.06; 95% CI 1.00-1.12), with little heterogeneity between trials (I(2) 0%, p=0.87 and I(2) 7.1%, p=0.33, respectively). Thirty-eight trials enrolled 10441 patients receiving chemotherapy. The cHR for on study mortality was 1.10 (95% CI 0.98-1.24) and 1.04; 95% CI 0.97-1.11) for overall survival. There was little evidence for a difference between trials of patients receiving different cancer treatments (P for interaction=0.42). AUTHORS' CONCLUSIONS: ESA treatment in cancer patients increased on study mortality and worsened overall survival. For patients undergoing chemotherapy the increase was less pronounced, but an adverse effect could not be excluded.

Recombinant human erythropoiesis-stimulating agents and mortality in patients with cancer: a meta-analysis of randomised trials

BACKGROUND: Erythropoiesis-stimulating agents reduce anaemia in patients with cancer and could improve their quality of life, but these drugs might increase mortality. We therefore did a meta-analysis of randomised controlled trials in which these drugs plus red blood cell transfusions were compared with transfusion alone for prophylaxis or treatment of anaemia in patients with cancer. METHODS: Data for patients treated with epoetin alfa, epoetin beta, or darbepoetin alfa were obtained and analysed by independent statisticians using fixed-effects and random-effects meta-analysis. Analyses were by intention to treat. Primary endpoints were mortality during the active study period and overall survival during the longest available follow-up, irrespective of anticancer treatment, and in patients given chemotherapy. Tests for interactions were used to identify differences in effects of erythropoiesis-stimulating agents on mortality across prespecified subgroups. FINDINGS: Data from a total of 13 933 patients with cancer in 53 trials were analysed. 1530 patients died during the active study period and 4993 overall. Erythropoiesis-stimulating agents increased mortality during the active study period (combined hazard ratio [cHR] 1.17, 95% CI 1.06-1.30) and worsened overall survival (1.06, 1.00-1.12), with little heterogeneity between trials (I(2) 0%, p=0.87 for mortality during the active study period, and I(2) 7.1%, p=0.33 for overall survival). 10 441 patients on chemotherapy were enrolled in 38 trials. The cHR for mortality during the active study period was 1.10 (0.98-1.24), and 1.04 (0.97-1.11) for overall survival. There was little evidence for a difference between trials of patients given different anticancer treatments (p for interaction=0.42). INTERPRETATION: Treatment with erythropoiesis-stimulating agents in patients with cancer increased mortality during active study periods and worsened overall survival. The increased risk of death associated with treatment with these drugs should be balanced against their benefits. FUNDING: German Federal Ministry of Education and Research, Medical Faculty of University of Cologne, and Oncosuisse (Switzerland).

Mortality of patients lost to follow-up in antiretroviral treatment programmes in resource-limited settings: systematic review and meta-analysis

BACKGROUND: The retention of patients in antiretroviral therapy (ART) programmes is an important issue in resource-limited settings. Loss to follow up can be substantial, but it is unclear what the outcomes are in patients who are lost to programmes. METHODS AND FINDINGS: We searched the PubMed, EMBASE, Latin American and Caribbean Health Sciences Literature (LILACS), Indian Medlars Centre (IndMed) and African Index Medicus (AIM) databases and the abstracts of three conferences for studies that traced patients lost to follow up to ascertain their vital status. Main outcomes were the proportion of patients traced, the proportion found to be alive and the proportion that had died. Where available, we also examined the reasons why some patients could not be traced, why patients found to be alive did not return to the clinic, and the causes of death. We combined mortality data from several studies using random-effects meta-analysis. Seventeen studies were eligible. All were from sub-Saharan Africa, except one study from India, and none were conducted in children. A total of 6420 patients (range 44 to 1343 patients) were included. Patients were traced using telephone calls, home visits and through social networks. Overall the vital status of 4021 patients could be ascertained (63%, range across studies: 45% to 86%); 1602 patients had died. The combined mortality was 40% (95% confidence interval 33%-48%), with substantial heterogeneity between studies (P<0.0001). Mortality in African programmes ranged from 12% to 87% of patients lost to follow-up. Mortality was inversely associated with the rate of loss to follow up in the programme: it declined from around 60% to 20% as the percentage of patients lost to the programme increased from 5% to 50%. Among patients not found, telephone numbers and addresses were frequently incorrect or missing. Common reasons for not returning to the clinic were transfer to another programme, financial problems and improving or deteriorating health. Causes of death were available for 47 deaths: 29 (62%) died of an AIDS defining illness. CONCLUSIONS: In ART programmes in resource-limited settings a substantial minority of adults lost to follow up cannot be traced, and among those traced 20% to 60% had died. Our findings have implications both for patient care and the monitoring and evaluation of programmes.

Lifestyle factors and colorectal cancer risk (1): systematic review and meta-analysis of associations with body mass index

OBJECTIVE: Excess body weight, defined by body mass index (BMI), may increase the risk of colorectal cancer. As a prerequisite to the determination of lifestyle attributable risks, we undertook a systematic review and meta-analysis of prospective observational studies to quantify colorectal cancer risk associated with increased BMI and explore for differences by gender, sub-site and study characteristics. METHOD: We searched MEDLINE and EMBASE (to December 2007), and other sources, selecting reports based on strict inclusion criteria. Random-effects meta-analyses and meta-regressions of study-specific incremental estimates were performed to determine the risk ratio (RR) and 95% confidence intervals (CIs) associated with a 5 kg/m(2) increase in BMI. RESULTS: We analysed 29 datasets from 28 articles, including 67,361 incident cases. Higher BMI was associated with colon (RR 1.24, 95% CIs: 1.20-1.28) and rectal (1.09, 1.05-1.14) cancers in men, and with colon cancer (1.09, 1.04-1.12) in women. Associations were stronger in men than in women for colon (P < 0.001) and rectal (P = 0.005) cancers. Associations were generally consistent across geographic populations. Study characteristics and adjustments accounted for only moderate variations of associations. CONCLUSION: Increasing BMI is associated with a modest increased risk of developing colon and rectal cancers, but this modest risk may translate to large attributable proportions in high-prevalence obese populations. Inter-gender differences point to potentially important mechanistic differences, which merit further research.