Efficacy of experimental treatments compared with standard treatments in non-inferiority trials: a meta-analysis of randomized controlled trials

Background There is concern that non-inferiority trials might be deliberately designed to conceal that a new treatment is less effective than a standard treatment. In order to test this hypothesis we performed a meta-analysis of non-inferiority trials to assess the average effect of experimental treatments compared with standard treatments. Methods One hundred and seventy non-inferiority treatment trials published in 121 core clinical journals were included. The trials were identified through a search of PubMed (1991 to 20 February 2009). Combined relative risk (RR) from meta-analysis comparing experimental with standard treatments was the main outcome measure. Results The 170 trials contributed a total of 175 independent comparisons of experimental with standard treatments. The combined RR for all 175 comparisons was 0.994 [95% confidence interval (CI) 0.978–1.010] using a random-effects model and 1.002 (95% CI 0.996–1.008) using a fixed-effects model. Of the 175 comparisons, experimental treatment was considered to be non-inferior in 130 (74%). The combined RR for these 130 comparisons was 0.995 (95% CI 0.983–1.006) and the point estimate favoured the experimental treatment in 58% (n = 76) and standard treatment in 42% (n = 54). The median non-inferiority margin (RR) pre-specified by trialists was 1.31 [inter-quartile range (IQR) 1.18–1.59]. Conclusion In this meta-analysis of non-inferiority trials the average RR comparing experimental with standard treatments was close to 1. The experimental treatments that gain a verdict of non-inferiority in published trials do not appear to be systematically less effective than the standard treatments. Importantly, publication bias and bias in the design and reporting of the studies cannot be ruled out and may have skewed the study results in favour of the experimental treatments. Further studies are required to examine the importance of such bias.

Helicobacter pylori infection and colorectal cancer risk: a meta-analysis

BACKGROUND: Several studies suggested an association between Helicobacter pylori infection and colorectal carcinoma or adenoma risk. However, different authors reported quite varying estimates. We carried out a systematic review and meta-analysis of published studies investigating this association and paid special attention to the possibility of publication bias and sources of heterogeneity between studies. Materials and METHODS: An extensive literature search and cross-referencing were performed to identify all published studies. Summary estimates were obtained using random-effects models. The presence of possible publication bias was assessed using different statistical approaches. RESULTS: In a meta-analysis of the 11 identified human studies, published between 1991 and 2002, a summary odds ratio of 1.4 (95% CI, 1.1-1.8) was estimated for the association between H. pylori infection and colorectal cancer risk. The graphical funnel plot appeared asymmetrical, but the formal statistical evaluations did not provide strong evidence of publication bias. The proportion of variation of study results because of heterogeneity was small (36.5%). CONCLUSIONS: The results of our meta-analysis are consistent with a possible small increase in risk of colorectal cancer because of H. pylori infection. However, the possibility of some publication bias cannot be ruled out, although it could not be statistically confirmed. Larger, better designed and better controlled studies are needed to clarify the situation.

Ozone and Mortality: A Meta-Analysis of Time-Series Studies and Comparison to a Multi-City Study (The National Morbidity, Mortality, and Air Pollution Study)

While many time-series studies of ozone and daily mortality identified positive associations,others yielded null or inconclusive results. We performed a meta-analysis of 144 effect estimates from 39 time-series studies, and estimated pooled effects by lags, age groups,cause-specific mortality, and concentration metrics. We compared results to estimates from the National Morbidity, Mortality, and Air Pollution Study (NMMAPS), a time-series study of 95 large U.S. cities from 1987 to 2000. Both meta-analysis and NMMAPS results provided strong evidence of a short-term association between ozone and mortality, with larger effects for cardiovascular and respiratory mortality, the elderly, and current day ozone exposure as compared to other single day lags. In both analyses, results were not sensitive to adjustment for particulate matter and model specifications. In the meta-analysis we found that a 10 ppb increase in daily ozone is associated with a 0.83 (95% confidence interval: 0.53, 1.12%) increase in total mortality, whereas the corresponding NMMAPS estimate is 0.25%(0.12, 0.39%). Meta-analysis results were consistently larger than those from NMMAPS,indicating publication bias. Additional publication bias is evident regarding the choice of lags in time-series studies, and the larger heterogeneity in posterior city-specific estimates in the meta-analysis, as compared with NMAMPS.

Risk of adverse effects of intensified treatment in insulin-dependent diabetes mellitus: a meta-analysis

While the benefits of intensified insulin treatment in insulin-dependent (Type 1) diabetes mellitus (IDDM) are well recognized, the risks have not been comprehensively characterized. We examined the risk of severe hypoglycaemia, ketoacidosis, and death in a meta-analysis of randomized controlled trials. The MEDLINE database, reference lists, and specialist journals were searched electronically or by hand to identify relevant studies with at least 6 months of follow-up and the monitoring of glycaemia by glycosylated haemoglobin measurements. Logistic regression was used for calculation of combined odds ratios and 95% confidence intervals (95% CI). The influence of covariates was examined by including covariate-by-treatment interaction terms. Methodological study quality was assessed and sensitivity analyses were performed. Fourteen trials were identified. These contributed 16 comparisons with 1028 patients allocated to intensified and 1039 allocated to conventional treatment. A total of 846 patients suffered at least one episode of severe hypoglycaemia, 175 patients experienced ketoacidosis and 26 patients died. The combined odds ratio (95% CI) for hypoglycaemia was 2.99 (2.45-3.64), for ketoacidosis 1.74 (1.27-2.38) and for death from all causes 1.40 (0.65-3.01). The risk of severe hypoglycaemia was determined by the degree of normalization of glycaemia achieved (p=0.005 for interaction term), with the results from the Diabetes Control and Complications Trial (DCCT) in line with the other trials. Ketoacidosis risk depended on the type of intensified treatment used. Odds ratios (95% CI) were 7.20 (2.95-17.58) for exclusive use of pumps, 1.13 (0.15-8.35) for multiple daily injections and 1.28 (0.90-1.83) for trials offering a choice between the two (p = 0.004 for interaction). Mortality was significantly (p = 0.007) increased for causes potentially associated with acute complications (7 vs 0 deaths, 5 deaths attributed to ketoacidosis, and 2 sudden deaths), and non-significantly (p = 0.16) decreased for macrovascular causes (3 vs 8 deaths). We conclude that there is a substantial risk of severe adverse effects associated with intensified insulin treatment. Mortality from acute metabolic causes is increased; however, this is largely counterbalanced by a reduction in cardiovascular mortality. The excess of severe hypoglycemia in the DCCT is not exceptional. Multiple daily injection schemes may be safer than treatment with insulin pumps.

Curing lights for orthodontic bonding: a systematic review and meta-analysis

INTRODUCTION Light cure of resin-based adhesives is the mainstay of orthodontic bonding. In recent years, alternatives to conventional halogen lights offering reduced curing time and the potential for lower attachment failure rates have emerged. The relative merits of curing lights in current use, including halogen-based lamps, light-emitting diodes (LEDs), and plasma arc lights, have not been analyzed systematically. In this study, we reviewed randomized controlled trials and controlled clinical trials to assess the risks of attachment failure and bonding time in orthodontic patients in whom brackets were cured with halogen lights, LEDs, or plasma arc systems. METHODS Multiple electronic database searches were undertaken, including MEDLINE, EMBASE, and the Cochrane Oral Health Group's Trials Register, CENTRAL. Language restrictions were not applied. Unpublished literature was searched on ClinicalTrials.gov, the National Research Register, Pro-Quest Dissertation Abstracts, and Thesis database. Search terms included randomized controlled trial, controlled clinical trial, random allocation, double blind method, single blind method, orthodontics, LED, halogen, bond, and bracket. Authors of primary studies were contacted as required, and reference lists of the included studies were screened. RESULTS Randomized controlled trials and clinical controlled trials directly comparing conventional halogen lights, LEDs, or plasma arc systems involving patients with full arch, fixed, or bonded orthodontic appliances (not banded) with follow-up periods of a minimum of 6 months were included. Using predefined forms, 2 authors undertook independent extraction of articles; disagreements were resolved by discussion. The assessment of the risk of bias of the randomized controlled trials was based on the Cochrane Risk of Bias tool. Ten studies met the inclusion criteria; 2 were excluded because of high risk of bias. In the comparison of bond failure risk with halogen lights and plasma arc lights, 1851 brackets were included in both groups. Little statistical heterogeneity was observed in this analysis (I(2) = 4.8%; P = 0.379). There was no statistical difference in bond failure risk between the groups (OR, 0.92; 95% CI, 0.68-1.23; prediction intervals, 0.54, 1.56). Similarly, no statistical difference in bond failure risk was observed in the meta-analysis comparing halogen lights and LEDs (OR, 0.96; 95% CI, 0.64-1.44; prediction intervals, 0.07, 13.32). The pooled estimates from both comparisons were OR, 0.93; 95% CI, 0.74-1.17; and prediction intervals, 0.69, 1.17. CONCLUSIONS There is no evidence to support the use of 1 light cure type over another based on risk of attachment failure.

The current prevalence of child sexual abuse worldwide: a systematic review and meta-analysis

OBJECTIVES Systematic reviews on prevalence estimates of child sexual abuse (CSA) worldwide included studies with adult participants referring on a period of abuse of about 50 years. Therefore we aimed to describe the current prevalence of CSA, taking into account geographical region, type of abuse, level of country development and research methods. METHODS We included studies published between 2002 and 2009 that reported CSA in children below 18 years. We performed a random effects meta-analysis and analyzed moderator variables by meta-regression. RESULTS Fifty-five studies from 24 countries were included. According to four predefined types of sexual abuse, prevalence estimates ranged from 8 to 31 % for girls and 3 to 17 % for boys. Nine girls and 3 boys out of 100 are victims of forced intercourse. Heterogeneity between primary studies was high in all analyses. CONCLUSIONS Our results based on most recent data confirm results from previous reviews with adults. Surveys in children offer most recent estimates of CSA. Reducing heterogeneity between studies might be possible by standardized measures to make data more meaningful in international comparisons.

Cancer, meta-analysis and reporting biases: the case of erythropoiesis-stimulating agents.

Reporting and publication bias is a well-known problem in meta-analysis and healthcare research. In 2002 we conducted a meta-analysis on the effects of erythropoiesis-stimulating agents (ESAs) on overall survival in cancer patients, which suggested some evidence for improved survival in patients receiving ESAs compared with controls. However, a meta-analysis of individual patient data conducted several years later showed the opposite of our first meta-analysis, that is, evidence for increased on-study mortality and reduced overall survival in cancer patients receiving ESAs. We aimed to determine whether the results of our first meta-analysis could have been affected by publication and reporting biases and, if so, whether timely access to clinical study reports and individual patient data could have prevented this. We conducted a hypothetical meta-analysis for overall survival including all studies and study data that could have been available in 2002, at the time when we conducted our first meta-analysis. Compared with our original meta-analysis, which suggested an overall survival benefit for cancer patients receiving ESAs [hazard ratio (HR) 0.81, 95% confidence interval (CI) 0.67‒0.99], our hypothetical meta-analysis based on the results of all studies conducted at the time of the first analysis did not show evidence for a beneficial effect of ESAs on overall survival (HR 0.97, 95% CI 0.83‒1.12). Thus we have to conclude that our first meta-analysis showed misleading overall survival benefits due to publication and reporting biases, which could have been prevented by timely access to clinical study reports and individual patient data. Unrestricted access to clinical study protocols including amendments, clinical study reports and individual patient data is needed to ensure timely detection of both beneficial and harmful effects of healthcare interventions.

Antibiotic prophylaxis for urinary tract infections after removal of urinary catheter: meta-analysis

Abstract Objective To determine whether antibiotic prophylaxis at the time of removal of a urinary catheter reduces the risk of subsequent symptomatic urinary tract infection. Design Systematic review and meta-analysis of studies published before November 2012 identified through PubMed, Embase, Scopus, and the Cochrane Library; conference abstracts for 2006-12 were also reviewed. Inclusion criteria Studies were included if they examined antibiotic prophylaxis administered to prevent symptomatic urinary tract infection after removal of a short term (≤14 days) urinary catheter. Results Seven controlled studies had symptomatic urinary tract infection after catheter removal as an endpoint; six were randomized controlled trials (five published; one in abstract form) and one was a non-randomized controlled intervention study. Five of these seven studies were in surgical patients. Studies were heterogeneous in the type and duration of antimicrobial prophylaxis and the period of observation. Overall, antibiotic prophylaxis was associated with benefit to the patient, with an absolute reduction in risk of urinary tract infection of 5.8% between intervention and control groups. The risk ratio was 0.45 (95% confidence interval 0.28 to 0.72). The number needed to treat to prevent one urinary tract infection was 17 (12 to 30). Conclusions Patients admitted to hospital who undergo short term urinary catheterization might benefit from antimicrobial prophylaxis when the catheter is removed as they experience fewer subsequent urinary tract infections. Potential disadvantages of more widespread antimicrobial prophylaxis (side effects and cost of antibiotics, development of antimicrobial resistance) might be mitigated by the identification of which patients are most likely to benefit from this approach.

Hormonal Contraception and the Risk of HIV Acquisition: An Individual Participant Data Meta-analysis.

BACKGROUND Observational studies of a putative association between hormonal contraception (HC) and HIV acquisition have produced conflicting results. We conducted an individual participant data (IPD) meta-analysis of studies from sub-Saharan Africa to compare the incidence of HIV infection in women using combined oral contraceptives (COCs) or the injectable progestins depot-medroxyprogesterone acetate (DMPA) or norethisterone enanthate (NET-EN) with women not using HC. METHODS AND FINDINGS Eligible studies measured HC exposure and incident HIV infection prospectively using standardized measures, enrolled women aged 15-49 y, recorded ≥15 incident HIV infections, and measured prespecified covariates. Our primary analysis estimated the adjusted hazard ratio (aHR) using two-stage random effects meta-analysis, controlling for region, marital status, age, number of sex partners, and condom use. We included 18 studies, including 37,124 women (43,613 woman-years) and 1,830 incident HIV infections. Relative to no HC use, the aHR for HIV acquisition was 1.50 (95% CI 1.24-1.83) for DMPA use, 1.24 (95% CI 0.84-1.82) for NET-EN use, and 1.03 (95% CI 0.88-1.20) for COC use. Between-study heterogeneity was mild (I2 < 50%). DMPA use was associated with increased HIV acquisition compared with COC use (aHR 1.43, 95% CI 1.23-1.67) and NET-EN use (aHR 1.32, 95% CI 1.08-1.61). Effect estimates were attenuated for studies at lower risk of methodological bias (compared with no HC use, aHR for DMPA use 1.22, 95% CI 0.99-1.50; for NET-EN use 0.67, 95% CI 0.47-0.96; and for COC use 0.91, 95% CI 0.73-1.41) compared to those at higher risk of bias (pinteraction = 0.003). Neither age nor herpes simplex virus type 2 infection status modified the HC-HIV relationship. CONCLUSIONS This IPD meta-analysis found no evidence that COC or NET-EN use increases women's risk of HIV but adds to the evidence that DMPA may increase HIV risk, underscoring the need for additional safe and effective contraceptive options for women at high HIV risk. A randomized controlled trial would provide more definitive evidence about the effects of hormonal contraception, particularly DMPA, on HIV risk.

A systematic review and meta-analysis of factors associated with anthelmintic resistance in sheep.

BACKGROUND Anthelmintic drugs have been widely used in sheep as a cost-effective means for gastro-intestinal nematode (GIN) control. However, growing anthelmintic resistance (AHR) has created a compelling need to identify evidence-based management recommendations that reduce the risk of further development and impact of AHR. OBJECTIVE To identify, critically assess, and synthesize available data from primary research on factors associated with AHR in sheep. METHODS Publications reporting original observational or experimental research on selected factors associated with AHR in sheep GINs and published after 1974, were identified through two processes. Three electronic databases (PubMed, Agricola, CAB) and Web of Science (a collection of databases) were searched for potentially relevant publications. Additional publications were identified through consultation with experts, manual search of references of included publications and conference proceedings, and information solicited from small ruminant practitioner list-serves. Two independent investigators screened abstracts for relevance. Relevant publications were assessed for risk of systematic bias. Where sufficient data were available, random-effects Meta-Analyses (MAs) were performed to estimate the pooled Odds Ratio (OR) and 95% Confidence Intervals (CIs) of AHR for factors reported in ≥2 publications. RESULTS Of the 1712 abstracts screened for eligibility, 131 were deemed relevant for full publication review. Thirty publications describing 25 individual studies (15 observational studies, 7 challenge trials, and 3 controlled trials) were included in the qualitative synthesis and assessed for systematic bias. Unclear (i.e. not reported, or unable to assess) or high risk of selection bias and confounding bias was found in 93% (14/15) and 60% (9/15) of the observational studies, respectively, while unclear risk of selection bias was identified in all of the trials. Ten independent studies were included in the quantitative synthesis, and MAs were performed for five factors. Only high frequency of treatment was a significant risk factor (OR=4.39; 95% CI=1.59, 12.14), while the remaining 4 variables were marginally significant: mixed-species grazing (OR=1.63; 95% CI=0.66, 4.07); flock size (OR=1.02; 95% CI=0.97, 1.07); use of long-acting drug formulations (OR=2.85; 95% CI=0.79, 10.24); and drench-and-shift pasture management (OR=4.08; 95% CI=0.75, 22.16). CONCLUSIONS While there is abundant literature on the topic of AHR in sheep GINs, few studies have explicitly investigated the association between putative risk or protective factors and AHR. Consequently, several of the current recommendations on parasite management are not evidence-based. Moreover, many of the studies included in this review had a high or unclear risk of systematic bias, highlighting the need to improve study design and/or reporting of future research carried out in this field.

Percutaneous coronary interventional strategies for treatment of in-stent restenosis: a network meta-analysis.

BACKGROUND Percutaneous coronary intervention (PCI) with drug-eluting stents is the standard of care for treatment of native coronary artery stenoses, but optimum treatment strategies for bare metal stent and drug-eluting stent in-stent restenosis (ISR) have not been established. We aimed to compare and rank percutaneous treatment strategies for ISR. METHODS We did a network meta-analysis to synthesise both direct and indirect evidence from relevant trials. We searched PubMed, the Cochrane Library Central Register of Controlled Trials, and Embase for randomised controlled trials published up to Oct 31, 2014, of different PCI strategies for treatment of any type of coronary ISR. The primary outcome was percent diameter stenosis at angiographic follow-up. This study is registered with PROSPERO, number CRD42014014191. FINDINGS We deemed 27 trials eligible, including 5923 patients, with follow-up ranging from 6 months to 60 months after the index intervention. Angiographic follow-up was available for 4975 (84%) of 5923 patients 6-12 months after the intervention. PCI with everolimus-eluting stents was the most effective treatment for percent diameter stenosis, with a difference of -9·0% (95% CI -15·8 to -2·2) versus drug-coated balloons (DCB), -9·4% (-17·4 to -1·4) versus sirolimus-eluting stents, -10·2% (-18·4 to -2·0) versus paclitaxel-eluting stents, -19·2% (-28·2 to -10·4) versus vascular brachytherapy, -23·4% (-36·2 to -10·8) versus bare metal stents, -24·2% (-32·2 to -16·4) versus balloon angioplasty, and -31·8% (-44·8 to -18·6) versus rotablation. DCB were ranked as the second most effective treatment, but without significant differences from sirolimus-eluting (-0·2% [95% CI -6·2 to 5·6]) or paclitaxel-eluting (-1·2% [-6·4 to 4·2]) stents. INTERPRETATION These findings suggest that two strategies should be considered for treatment of any type of coronary ISR: PCI with everolimus-eluting stents because of the best angiographic and clinical outcomes, and DCB because of its ability to provide favourable results without adding a new stent layer. FUNDING None.

At risk or not at risk? A meta-analysis of the prognostic accuracy of psychometric interviews for psychosis prediction

An accurate detection of individuals at clinical high risk (CHR) for psychosis is a prerequisite for effective preventive interventions. Several psychometric interviews are available, but their prognostic accuracy is unknown. We conducted a prognostic accuracy meta-analysis of psychometric interviews used to examine referrals to high risk services. The index test was an established CHR psychometric instrument used to identify subjects with and without CHR (CHR+ and CHR-). The reference index was psychosis onset over time in both CHR+ and CHR- subjects. Data were analyzed with MIDAS (STATA13). Area under the curve (AUC), summary receiver operating characteristic curves, quality assessment, likelihood ratios, Fagan's nomogram and probability modified plots were computed. Eleven independent studies were included, with a total of 2,519 help-seeking, predominately adult subjects (CHR+: N=1,359; CHR-: N=1,160) referred to high risk services. The mean follow-up duration was 38 months. The AUC was excellent (0.90; 95% CI: 0.87-0.93), and comparable to other tests in preventive medicine, suggesting clinical utility in subjects referred to high risk services. Meta-regression analyses revealed an effect for exposure to antipsychotics and no effects for type of instrument, age, gender, follow-up time, sample size, quality assessment, proportion of CHR+ subjects in the total sample. Fagan's nomogram indicated a low positive predictive value (5.74%) in the general non-help-seeking population. Albeit the clear need to further improve prediction of psychosis, these findings support the use of psychometric prognostic interviews for CHR as clinical tools for an indicated prevention in subjects seeking help at high risk services worldwide.

Diagnostic value of immunoassays for heparin-induced thrombocytopenia: a systematic review and meta-analysis.

Immunoassays are essential in the workup of patients with suspected heparin-induced thrombocytopenia. However, the diagnostic accuracy is uncertain with regard to different classes of assays, antibody specificities, thresholds, test variations, and manufacturers. We aimed to assess diagnostic accuracy measures of available immunoassays and to explore sources of heterogeneity. We performed comprehensive literature searches and applied strict inclusion criteria. Finally, 49 publications comprising 128 test evaluations in 15 199 patients were included in the analysis. Methodological quality according to the revised tool for quality assessment of diagnostic accuracy studies was moderate. Diagnostic accuracy measures were calculated with the unified model (comprising a bivariate random-effects model and a hierarchical summary receiver operating characteristics model). Important differences were observed between classes of immunoassays, type of antibody specificity, thresholds, application of confirmation step, and manufacturers. Combination of high sensitivity (>95%) and high specificity (>90%) was found in 5 tests only: polyspecific enzyme-linked immunosorbent assay (ELISA) with intermediate threshold (Genetic Testing Institute, Asserachrom), particle gel immunoassay, lateral flow immunoassay, polyspecific chemiluminescent immunoassay (CLIA) with a high threshold, and immunoglobulin G (IgG)-specific CLIA with low threshold. Borderline results (sensitivity, 99.6%; specificity, 89.9%) were observed for IgG-specific Genetic Testing Institute-ELISA with low threshold. Diagnostic accuracy appears to be inadequate in tests with high thresholds (ELISA; IgG-specific CLIA), combination of IgG specificity and intermediate thresholds (ELISA, CLIA), high-dose heparin confirmation step (ELISA), and particle immunofiltration assay. When making treatment decisions, clinicians should be a aware of diagnostic characteristics of the tests used and it is recommended they estimate posttest probabilities according to likelihood ratios as well as pretest probabilities using clinical scoring tools.

Is human herpesvirus 8 infection more common in men than in women? Systematic review and meta-analysis.

All forms of Kaposi sarcoma (KS) are more common in men than in women. It is unknown if this is due to a higher prevalence of human herpesvirus 8 (HHV-8), the underlying cause of KS, in men compared to women. We did a systematic review and meta-analysis to examine the association between HHV-8 seropositivity and gender in the general population. Studies in selected populations like for example, blood donors, hospital patients, and men who have sex with men were excluded. We searched Medline and Embase from January 1994 to February 2015. We included observational studies that recruited participants from the general population and reported HHV-8 seroprevalence for men and women or boys and girls. We used random-effects meta-analysis to pool odds ratios (OR) of the association between HHV-8 and gender. We used meta-regression to identify effect modifiers, including age, geographical region and type of HHV-8 antibody test. We included 22 studies, with 36,175 participants. Men from sub-Saharan Africa (SSA) (OR 1.21, 95% confidence interval [CI] 1.09-1.34), but not men from elsewhere (OR 0.94, 95% CI 0.83-1.06), were more likely to be HHV-8 seropositive than women (p value for interaction=0.010). There was no difference in HHV-8 seroprevalence between boys and girls from SSA (OR 0.90, 95% CI 0.72-1.13). The type of HHV-8 assay did not affect the overall results. A higher HHV-8 seroprevalence in men than women in SSA may partially explain why men have higher KS risk in this region. This article is protected by copyright. All rights reserved.