Grey literature in meta-analyses of randomized trials of health care interventions

BACKGROUND: The inclusion of grey literature (i.e. literature that has not been formally published) in systematic reviews may help to overcome some of the problems of publication bias, which can arise due to the selective availability of data. OBJECTIVES: To review systematically research studies, which have investigated the impact of grey literature in meta-analyses of randomized trials of health care interventions. SEARCH STRATEGY: We searched the Cochrane Methodology Register (The Cochrane Library Issue 3, 2005), MEDLINE (1966 to 20 May 2005), the Science Citation Index (June 2005) and contacted researchers who may have carried out relevant studies. SELECTION CRITERIA: A study was considered eligible for this review if it compared the effect of the inclusion and exclusion of grey literature on the results of a cohort of meta-analyses of randomized trials. DATA COLLECTION AND ANALYSIS: Data were extracted from each report independently by two reviewers. The main outcome measure was an estimate of the impact of trials from the grey literature on the pooled effect estimates of the meta-analyses. Information was also collected on the area of health care, the number of meta-analyses, the number of trials, the number of trial participants, the year of publication of the trials, the language and country of publication of the trials, the number and type of grey and published literature, and methodological quality. MAIN RESULTS: Five studies met the inclusion criteria. All five studies showed that published trials showed an overall greater treatment effect than grey trials. This difference was statistically significant in one of the five studies. Data could be combined for three of the five studies. This showed that, on average, published trials showed a 9% greater treatment effect than grey trials (ratio of odds ratios for grey versus published trials 1.09; 95% CI 1.03-1.16). Overall there were more published trials included in the meta-analyses than grey trials (median 224 (IQR 108-365) versus 45(IQR 40-102)). Published trials had more participants on average. The most common types of grey literature were abstracts (55%) and unpublished data (30%). There is limited evidence to show whether grey trials are of poorer methodological quality than published trials. AUTHORS' CONCLUSIONS: This review shows that published trials tend to be larger and show an overall greater treatment effect than grey trials. This has important implications for reviewers who need to ensure they identify grey trials, in order to minimise the risk of introducing bias into their review.

A unification of models for meta-analysis of diagnostic accuracy studies

Studies of diagnostic accuracy require more sophisticated methods for their meta-analysis than studies of therapeutic interventions. A number of different, and apparently divergent, methods for meta-analysis of diagnostic studies have been proposed, including two alternative approaches that are statistically rigorous and allow for between-study variability: the hierarchical summary receiver operating characteristic (ROC) model (Rutter and Gatsonis, 2001) and bivariate random-effects meta-analysis (van Houwelingen and others, 1993), (van Houwelingen and others, 2002), (Reitsma and others, 2005). We show that these two models are very closely related, and define the circumstances in which they are identical. We discuss the different forms of summary model output suggested by the two approaches, including summary ROC curves, summary points, confidence regions, and prediction regions.

Hylan versus hyaluronic acid for osteoarthritis of the knee: a systematic review and meta-analysis

OBJECTIVE: To compare the effectiveness and safety of intraarticular high-molecular hylan with standard preparations of hyaluronic acids in osteoarthritis of the knee. METHODS: We performed a systematic review and meta-analysis of randomized controlled trials comparing hylan with a hyaluronic acid in patients with knee osteoarthritis. Trials were identified by systematic searches of Central, Medline, EMBase, Cinahl, the Food and Drug Administration, and Science Citation Index supplemented by hand searches of conference proceedings and reference lists (last update November 2006). Literature screening and data extraction were performed in duplicate. Effect sizes were calculated from differences in means of pain-related outcomes between treatment and control groups at the end of the trial, divided by the pooled standard deviation. Trials were combined using random-effects meta-analysis. RESULTS: Thirteen trials with a pooled total of 2,085 patients contributed to the meta-analysis. The pooled effect size was -0.27 (95% confidence interval [95% CI] -0.55, 0.01), favoring hylan, but between-trial heterogeneity was high (I(2) = 88%). Trials with blinded patients, adequate concealment of allocation, and an intent-to-treat analysis had pooled effect sizes near null. The meta-analyses on safety revealed an increased risk associated with hylan for any local adverse events (relative risk [RR] 1.91; 95% CI 1.04, 3.49; I(2) = 28%) and for flares (RR 2.04; 95% CI 1.18, 3.53; I(2) = 0%). CONCLUSION: Given the likely lack of a superior effectiveness of hylan over hyaluronic acids and the increased risk of local adverse events associated with hylan, we discourage the use of intraarticular hylan in patients with knee osteoarthritis in clinical research or practice.

A meta-analysis of 16 randomized trials of sirolimus-eluting stents versus paclitaxel-eluting stents in patients with coronary artery disease

OBJECTIVES: Our purpose was to make a synthesis of the available evidence on the relative efficacy and safety of 2 drug-eluting stents (DES)--sirolimus-eluting stent (SES) and paclitaxel-eluting stent (PES)--in patients with coronary artery disease. BACKGROUND: It is not known whether there are differences in late outcomes between the 2 most commonly used DES: SES and PES. METHODS: Sixteen randomized trials of SES versus PES with a total number of 8,695 patients were included in this meta-analysis. A full set of individual outcome data from 5,562 patients was also available. Mean follow-up period ranged from 9 to 37 months. The primary efficacy end point was the need for reintervention (target lesion revascularization). The primary safety end point was stent thrombosis. Secondary end points were death and recurrent myocardial infarction (MI). RESULTS: No significant heterogeneity was found across trials. Compared with PES, SES significantly reduced the risk of reintervention (hazard ratio [HR] 0.74; 95% confidence interval [CI] 0.63 to 0.87, p < 0.001) and stent thrombosis (HR 0.66; 95% CI 0.46 to 0.94, p = 0.02) without significantly impacting on the risk of death (HR 0.92; 95% CI 0.74 to 1.13, p = 0.43) or MI (HR 0.84; 95% CI 0.69 to 1.03, p = 0.10). CONCLUSIONS: Sirolimus-eluting stents are superior to PES in terms of a significant reduction of the risk of reintervention and stent thrombosis. The risk of death was not significantly different between the 2 DES, but there was a trend toward a higher risk of MI with PES, especially after the first year from the procedure.

Meta-analysis: chondroitin for osteoarthritis of the knee or hip

BACKGROUND: Previous meta-analyses described moderate to large benefits of chondroitin in patients with osteoarthritis. However, recent large-scale trials did not find evidence of an effect. PURPOSE: To determine the effects of chondroitin on pain in patients with osteoarthritis. DATA SOURCES: The authors searched the Cochrane Central Register of Controlled Trials (1970 to 2006), MEDLINE (1966 to 2006), EMBASE (1980 to 2006), CINAHL (1970 to 2006), and conference proceedings; checked reference lists; and contacted authors. The last update of searches was performed on 30 November 2006. STUDY SELECTION: Studies were included if they were randomized or quasi-randomized, controlled trials that compared chondroitin with placebo or with no treatment in patients with osteoarthritis of the knee or hip. There were no language restrictions. DATA EXTRACTION: The authors extracted data in duplicate. Effect sizes were calculated from the differences in means of pain-related outcomes between treatment and control groups at the end of the trial, divided by the pooled SD. Trials were combined by using random-effects meta-analysis. DATA SYNTHESIS: 20 trials (3846 patients) contributed to the meta-analysis, which revealed a high degree of heterogeneity among the trials (I2 = 92%). Small trials, trials with unclear concealment of allocation, and trials that were not analyzed according to the intention-to-treat principle showed larger effects in favor of chondroitin than did the remaining trials. When the authors restricted the analysis to the 3 trials with large sample sizes and an intention-to-treat analysis, 40% of patients were included. This resulted in an effect size of -0.03 (95% CI, -0.13 to 0.07; I2 = 0%) and corresponded to a difference of 0.6 mm on a 10-cm visual analogue scale. A meta-analysis of 12 trials showed a pooled relative risk of 0.99 (CI, 0.76 to 1.31) for any adverse event. LIMITATIONS: For 9 trials, the authors had to use approximations to calculate effect sizes. Trial quality was generally low, heterogeneity among the trials made initial interpretation of results difficult, and exploring sources of heterogeneity in meta-regression and stratified analyses may be unreliable. CONCLUSIONS: Large-scale, methodologically sound trials indicate that the symptomatic benefit of chondroitin is minimal or nonexistent. Use of chondroitin in routine clinical practice should therefore be discouraged.

Immunogenicity and safety of aerosolized measles vaccine: Systematic review and meta-analysis

Aerosols are the most promising non-injectable method of measles vaccination studied so far and their efficacy is thought to be comparable to injected vaccine. We conducted a systematic review up to May 2006 to examine the immunogenicity and safety of aerosolized measles vaccine (Edmonston-Zagreb or Schwarz strains) 1 month or more after vaccination. Where possible we estimated pooled serological response rates and odds ratios (with 95% confidence intervals, CI) comparing aerosolized and subcutaneous vaccines in children in three age groups and adults. We included seven randomized trials, four non-randomized trials and six uncontrolled studies providing serological outcome data on 2887 individuals. In children below 10 months, the studies were heterogeneous. In four comparative studies, seroconversion rates were lower with aerosolized than with subcutaneous vaccine and in two of these the difference was unlikely to be due to chance. In children 10-36 months, the pooled seroconversion rate with aerosolized vaccine was 93.5% (89.4-97.7%) and 97.1% (92.4-100%) with subcutaneous vaccine (odds ratio 0.27, 0.04-1.62). In 5-15-year olds the studies were heterogeneous. In all comparative studies aerosolized vaccine was more immunogenic than subcutaneous. Reported side effects were mild. Aerosolized measles vaccine appears to be equally or more immunogenic than subcutaneous vaccine in children aged 10 months and older. Large randomized trials are needed to establish the efficacy and safety of aerosolized measles vaccine as primary and booster doses.

Body-mass index and incidence of cancer: a systematic review and meta-analysis of prospective observational studies

BACKGROUND: Excess bodyweight, expressed as increased body-mass index (BMI), is associated with the risk of some common adult cancers. We did a systematic review and meta-analysis to assess the strength of associations between BMI and different sites of cancer and to investigate differences in these associations between sex and ethnic groups. METHODS: We did electronic searches on Medline and Embase (1966 to November 2007), and searched reports to identify prospective studies of incident cases of 20 cancer types. We did random-effects meta-analyses and meta-regressions of study-specific incremental estimates to determine the risk of cancer associated with a 5 kg/m2 increase in BMI. FINDINGS: We analysed 221 datasets (141 articles), including 282,137 incident cases. In men, a 5 kg/m2 increase in BMI was strongly associated with oesophageal adenocarcinoma (RR 1.52, p<0.0001) and with thyroid (1.33, p=0.02), colon (1.24, p<0.0001), and renal (1.24, p <0.0001) cancers. In women, we recorded strong associations between a 5 kg/m2 increase in BMI and endometrial (1.59, p<0.0001), gallbladder (1.59, p=0.04), oesophageal adenocarcinoma (1.51, p<0.0001), and renal (1.34, p<0.0001) cancers. We noted weaker positive associations (RR <1.20) between increased BMI and rectal cancer and malignant melanoma in men; postmenopausal breast, pancreatic, thyroid, and colon cancers in women; and leukaemia, multiple myeloma, and non-Hodgkin lymphoma in both sexes. Associations were stronger in men than in women for colon (p<0.0001) cancer. Associations were generally similar in studies from North America, Europe and Australia, and the Asia-Pacific region, but we recorded stronger associations in Asia-Pacific populations between increased BMI and premenopausal (p=0.009) and postmenopausal (p=0.06) breast cancers. INTERPRETATION: Increased BMI is associated with increased risk of common and less common malignancies. For some cancer types, associations differ between sexes and populations of different ethnic origins. These epidemiological observations should inform the exploration of biological mechanisms that link obesity with cancer.

Risk of adverse effects of intensified treatment in insulin-dependent diabetes mellitus: a meta-analysis

While the benefits of intensified insulin treatment in insulin-dependent (Type 1) diabetes mellitus (IDDM) are well recognized, the risks have not been comprehensively characterized. We examined the risk of severe hypoglycaemia, ketoacidosis, and death in a meta-analysis of randomized controlled trials. The MEDLINE database, reference lists, and specialist journals were searched electronically or by hand to identify relevant studies with at least 6 months of follow-up and the monitoring of glycaemia by glycosylated haemoglobin measurements. Logistic regression was used for calculation of combined odds ratios and 95% confidence intervals (95% CI). The influence of covariates was examined by including covariate-by-treatment interaction terms. Methodological study quality was assessed and sensitivity analyses were performed. Fourteen trials were identified. These contributed 16 comparisons with 1028 patients allocated to intensified and 1039 allocated to conventional treatment. A total of 846 patients suffered at least one episode of severe hypoglycaemia, 175 patients experienced ketoacidosis and 26 patients died. The combined odds ratio (95% CI) for hypoglycaemia was 2.99 (2.45-3.64), for ketoacidosis 1.74 (1.27-2.38) and for death from all causes 1.40 (0.65-3.01). The risk of severe hypoglycaemia was determined by the degree of normalization of glycaemia achieved (p=0.005 for interaction term), with the results from the Diabetes Control and Complications Trial (DCCT) in line with the other trials. Ketoacidosis risk depended on the type of intensified treatment used. Odds ratios (95% CI) were 7.20 (2.95-17.58) for exclusive use of pumps, 1.13 (0.15-8.35) for multiple daily injections and 1.28 (0.90-1.83) for trials offering a choice between the two (p = 0.004 for interaction). Mortality was significantly (p = 0.007) increased for causes potentially associated with acute complications (7 vs 0 deaths, 5 deaths attributed to ketoacidosis, and 2 sudden deaths), and non-significantly (p = 0.16) decreased for macrovascular causes (3 vs 8 deaths). We conclude that there is a substantial risk of severe adverse effects associated with intensified insulin treatment. Mortality from acute metabolic causes is increased; however, this is largely counterbalanced by a reduction in cardiovascular mortality. The excess of severe hypoglycemia in the DCCT is not exceptional. Multiple daily injection schemes may be safer than treatment with insulin pumps.

Adjunctive corticosteroids for Pneumocystis jiroveci pneumonia in patients with HIV infection: a meta-analysis of randomised controlled trials

BACKGROUND: The objective of this study was to review the effects of adjunctive corticosteroids on overall mortality and the need for mechanical ventilation in HIV-infected patients with Pneumocystis jiroveci pneumonia (PCP) and substantial hypoxemia (arterial oxygen partial pressure <70 mmHg or alveolar-arterial gradient >35 mmHg on room air). METHODS: We conducted a systematic search of the literature for randomised trials published up to December 2004. Selected trials compared adjunctive corticosteroids with placebo or usual care in HIV-infected patients with PCP and reported mortality data. Two teams of reviewers independently evaluated the methodology and extracted data from each primary study. RESULTS: Six studies were included in the meta-analysis. Risk ratios for overall mortality for adjunctive corticosteroids were 0.54 (95% confidence interval [CI], 0.38-0.79) at 1 month and 0.67 (95% CI, 0.49-0.93) at 3-4 months of follow-up. Numbers needed to treat, to prevent 1 death, are 9 patients in a setting without highly active antiretroviral therapy (HAART) available and 22 patients with HAART available. Only the 3 largest trials provided data on the need for mechanical ventilation with a risk ratio of 0.37 (95% CI, 0.20-0.70) in favour of adjunctive corticosteroids. CONCLUSION: The number and size of trials investigating adjunctive corticosteroids for HIV-infected patients with PCP is small, but our results suggest a beneficial effect for patients with substantial hypoxemia.

Drug eluting and bare metal stents in people with and without diabetes: collaborative network meta-analysis

Objective To compare the effectiveness and safety of three types of stents (sirolimus eluting, paclitaxel eluting, and bare metal) in people with and without diabetes mellitus. Design Collaborative network meta-analysis. Data sources Electronic databases (Medline, Embase, the Cochrane Central Register of Controlled Trials), relevant websites, reference lists, conference abstracts, reviews, book chapters, and proceedings of advisory panels for the US Food and Drug Administration. Manufacturers and trialists provided additional data. Review methods Network meta-analysis with a mixed treatment comparison method to combine direct within trial comparisons between stents with indirect evidence from other trials while maintaining randomisation. Overall mortality was the primary safety end point, target lesion revascularisation the effectiveness end point. Results 35 trials in 3852 people with diabetes and 10 947 people without diabetes contributed to the analyses. Inconsistency of the network was substantial for overall mortality in people with diabetes and seemed to be related to the duration of dual antiplatelet therapy (P value for interaction 0.02). Restricting the analysis to trials with a duration of dual antiplatelet therapy of six months or more, inconsistency was reduced considerably and hazard ratios for overall mortality were near one for all comparisons in people with diabetes: sirolimus eluting stents compared with bare metal stents 0.88 (95% credibility interval 0.55 to 1.30), paclitaxel eluting stents compared with bare metal stents 0.91 (0.60 to 1.38), and sirolimus eluting stents compared with paclitaxel eluting stents 0.95 (0.63 to 1.43). In people without diabetes, hazard ratios were unaffected by the restriction. Both drug eluting stents were associated with a decrease in revascularisation rates compared with bare metal stents in people both with and without diabetes. Conclusion In trials that specified a duration of dual antiplatelet therapy of six months or more after stent implantation, drug eluting stents seemed safe and effective in people both with and without diabetes.