Reporting of noninferiority trials was incomplete in trial registries

Objective To examine the registration of noninferiority trials, with a focus on the reporting of study design and noninferiority margins. Study Design and Setting Cross-sectional study of registry records of noninferiority trials published from 2005 to 2009 and records of noninferiority trials in the International Standard Randomized Controlled Trial Number (ISRCTN) or ClinicalTrials.gov trial registries. The main outcome was the proportion of records that reported the noninferiority design and margin. Results We analyzed 87 registry records of published noninferiority trials and 149 registry records describing noninferiority trials. Thirty-five (40%) of 87 records from published trials described the trial as a noninferiority trial; only two (2%) reported the noninferiority margin. Reporting of the noninferiority design was more frequent in the ISRCTN registry (13 of 18 records, 72%) compared with ClinicalTrials.gov (22 of 69 records, 32%; P = 0.002). Among the 149 records identified in the registries, 13 (9%) reported the noninferiority margin. Only one of the industry-sponsored trial compared with 11 of the publicly funded trials reported the margin (P = 0.001). Conclusion Most registry records of noninferiority trials do not mention the noninferiority design and do not include the noninferiority margin. The registration of noninferiority trials is unsatisfactory and must be improved.

Learning from failure--rationale and design for a study about discontinuation of randomized trials (DISCO study)

Background Randomized controlled trials (RCTs) may be discontinued because of apparent harm, benefit, or futility. Other RCTs are discontinued early because of insufficient recruitment. Trial discontinuation has ethical implications, because participants consent on the premise of contributing to new medical knowledge, Research Ethics Committees (RECs) spend considerable effort reviewing study protocols, and limited resources for conducting research are wasted. Currently, little is known regarding the frequency and characteristics of discontinued RCTs. Methods/Design Our aims are, first, to determine the prevalence of RCT discontinuation for specific reasons; second, to determine whether the risk of RCT discontinuation for specific reasons differs between investigator- and industry-initiated RCTs; third, to identify risk factors for RCT discontinuation due to insufficient recruitment; fourth, to determine at what stage RCTs are discontinued; and fifth, to examine the publication history of discontinued RCTs. We are currently assembling a multicenter cohort of RCTs based on protocols approved between 2000 and 2002/3 by 6 RECs in Switzerland, Germany, and Canada. We are extracting data on RCT characteristics and planned recruitment for all included protocols. Completion and publication status is determined using information from correspondence between investigators and RECs, publications identified through literature searches, or by contacting the investigators. We will use multivariable regression models to identify risk factors for trial discontinuation due to insufficient recruitment. We aim to include over 1000 RCTs of which an anticipated 150 will have been discontinued due to insufficient recruitment. Discussion Our study will provide insights into the prevalence and characteristics of RCTs that were discontinued. Effective recruitment strategies and the anticipation of problems are key issues in the planning and evaluation of trials by investigators, Clinical Trial Units, RECs and funding agencies. Identification and modification of barriers to successful study completion at an early stage could help to reduce the risk of trial discontinuation, save limited resources, and enable RCTs to better meet their ethical requirements.

Grey literature in meta-analyses of randomized trials of health care interventions

BACKGROUND: The inclusion of grey literature (i.e. literature that has not been formally published) in systematic reviews may help to overcome some of the problems of publication bias, which can arise due to the selective availability of data. OBJECTIVES: To review systematically research studies, which have investigated the impact of grey literature in meta-analyses of randomized trials of health care interventions. SEARCH STRATEGY: We searched the Cochrane Methodology Register (The Cochrane Library Issue 3, 2005), MEDLINE (1966 to 20 May 2005), the Science Citation Index (June 2005) and contacted researchers who may have carried out relevant studies. SELECTION CRITERIA: A study was considered eligible for this review if it compared the effect of the inclusion and exclusion of grey literature on the results of a cohort of meta-analyses of randomized trials. DATA COLLECTION AND ANALYSIS: Data were extracted from each report independently by two reviewers. The main outcome measure was an estimate of the impact of trials from the grey literature on the pooled effect estimates of the meta-analyses. Information was also collected on the area of health care, the number of meta-analyses, the number of trials, the number of trial participants, the year of publication of the trials, the language and country of publication of the trials, the number and type of grey and published literature, and methodological quality. MAIN RESULTS: Five studies met the inclusion criteria. All five studies showed that published trials showed an overall greater treatment effect than grey trials. This difference was statistically significant in one of the five studies. Data could be combined for three of the five studies. This showed that, on average, published trials showed a 9% greater treatment effect than grey trials (ratio of odds ratios for grey versus published trials 1.09; 95% CI 1.03-1.16). Overall there were more published trials included in the meta-analyses than grey trials (median 224 (IQR 108-365) versus 45(IQR 40-102)). Published trials had more participants on average. The most common types of grey literature were abstracts (55%) and unpublished data (30%). There is limited evidence to show whether grey trials are of poorer methodological quality than published trials. AUTHORS' CONCLUSIONS: This review shows that published trials tend to be larger and show an overall greater treatment effect than grey trials. This has important implications for reviewers who need to ensure they identify grey trials, in order to minimise the risk of introducing bias into their review.

Publication and non-publication of clinical trials: longitudinal study of applications submitted to a research ethics committee

BACKGROUND: Not all clinical trials are published, which may distort the evidence that is available in the literature. We studied the publication rate of a cohort of clinical trials and identified factors associated with publication and nonpublication of results. METHODS: We analysed the protocols of randomized clinical trials of drug interventions submitted to the research ethics committee of University Hospital (Inselspital) Bern, Switzerland from 1988 to 1998. We identified full articles published up to 2006 by searching the Cochrane CENTRAL database (issue 02/2006) and by contacting investigators. We analyzed factors associated with the publication of trials using descriptive statistics and logistic regression models. RESULTS: 451 study protocols and 375 corresponding articles were analyzed. 233 protocols resulted in at least one publication, a publication rate of 52%. A total of 366 (81%) trials were commercially funded, 47 (10%) had non-commercial funding. 346 trials (77%) were multi-centre studies and 272 of these (79%) were international collaborations. In the adjusted logistic regression model non-commercial funding (Odds Ratio [OR] 2.42, 95% CI 1.14-5.17), multi-centre status (OR 2.09, 95% CI 1.03-4.24), international collaboration (OR 1.87, 95% CI 0.99-3.55) and a sample size above the median of 236 participants (OR 2.04, 95% CI 1.23-3.39) were associated with full publication. CONCLUSIONS: In this cohort of applications to an ethics committee in Switzerland, only about half of clinical drug trials were published. Large multi-centre trials with non-commercial funding were more likely to be published than other trials, but most trials were funded by industry.

Recombinant human erythropoiesis-stimulating agents and mortality in patients with cancer: a meta-analysis of randomised trials

BACKGROUND: Erythropoiesis-stimulating agents reduce anaemia in patients with cancer and could improve their quality of life, but these drugs might increase mortality. We therefore did a meta-analysis of randomised controlled trials in which these drugs plus red blood cell transfusions were compared with transfusion alone for prophylaxis or treatment of anaemia in patients with cancer. METHODS: Data for patients treated with epoetin alfa, epoetin beta, or darbepoetin alfa were obtained and analysed by independent statisticians using fixed-effects and random-effects meta-analysis. Analyses were by intention to treat. Primary endpoints were mortality during the active study period and overall survival during the longest available follow-up, irrespective of anticancer treatment, and in patients given chemotherapy. Tests for interactions were used to identify differences in effects of erythropoiesis-stimulating agents on mortality across prespecified subgroups. FINDINGS: Data from a total of 13 933 patients with cancer in 53 trials were analysed. 1530 patients died during the active study period and 4993 overall. Erythropoiesis-stimulating agents increased mortality during the active study period (combined hazard ratio [cHR] 1.17, 95% CI 1.06-1.30) and worsened overall survival (1.06, 1.00-1.12), with little heterogeneity between trials (I(2) 0%, p=0.87 for mortality during the active study period, and I(2) 7.1%, p=0.33 for overall survival). 10 441 patients on chemotherapy were enrolled in 38 trials. The cHR for mortality during the active study period was 1.10 (0.98-1.24), and 1.04 (0.97-1.11) for overall survival. There was little evidence for a difference between trials of patients given different anticancer treatments (p for interaction=0.42). INTERPRETATION: Treatment with erythropoiesis-stimulating agents in patients with cancer increased mortality during active study periods and worsened overall survival. The increased risk of death associated with treatment with these drugs should be balanced against their benefits. FUNDING: German Federal Ministry of Education and Research, Medical Faculty of University of Cologne, and Oncosuisse (Switzerland).

Better conduct of clinical trials: the control group in critical care trials

OBJECTIVE: To review trial design issues related to control groups. DESIGN: Review of the literature with specific reference to critical care trials. MAIN RESULTS AND CONCLUSIONS: Performing randomized controlled trials in the critical care setting presents specific problems: studies include patients with rapidly lethal conditions, the majority of intensive care patients suffer from syndromes rather than from well-definable diseases, the severity of such syndromes cannot be precisely assessed, and the treatment consists of interacting therapies. Interactions between physiology, pathophysiology, and therapies are at best marginally understood and may have a major impact on study design and interpretation of results. Selection of the right control group is crucial for the interpretation and clinical implementation of results. Studies comparing new interventions with current ones or different levels of current treatments have the problem of the necessity of defining "usual care." Usual care controls without any constraints typically include substantial heterogeneity. Constraints in the usual therapy may help to reduce some variation. Inclusion of unrestricted usual care groups may help to enhance safety. Practice misalignment is a novel problem in which patients receive a treatment that is the direct opposite of usual care, and occurs when fixed-dose interventions are used in situations where care is normally titrated. Practice misalignment should be considered in the design and interpretation of studies on titrated therapies.

Safety and efficacy of drug-eluting stents in women: a patient-level pooled analysis of randomised trials

BACKGROUND The safety and efficacy of drug-eluting stents (DES) in the treatment of coronary artery disease have been assessed in several randomised trials. However, none of these trials were powered to assess the safety and efficacy of DES in women because only a small proportion of recruited participants were women. We therefore investigated the safety and efficacy of DES in female patients during long-term follow-up. METHODS We pooled patient-level data for female participants from 26 randomised trials of DES and analysed outcomes according to stent type (bare-metal stents, early-generation DES, and newer-generation DES). The primary safety endpoint was a composite of death or myocardial infarction. The secondary safety endpoint was definite or probable stent thrombosis. The primary efficacy endpoint was target-lesion revascularisation. Analysis was by intention to treat. FINDINGS Of 43,904 patients recruited in 26 trials of DES, 11,557 (26·3%) were women (mean age 67·1 years [SD 10·6]). 1108 (9·6%) women received bare-metal stents, 4171 (36·1%) early-generation DES, and 6278 (54·3%) newer-generation DES. At 3 years, estimated cumulative incidence of the composite of death or myocardial infarction occurred in 132 (12·8%) women in the bare-metal stent group, 421 (10·9%) in the early-generation DES group, and 496 (9·2%) in the newer-generation DES group (p=0·001). Definite or probable stent thrombosis occurred in 13 (1·3%), 79 (2·1%), and 66 (1·1%) women in the bare-metal stent, early-generation DES, and newer-generation DES groups, respectively (p=0·01). The use of DES was associated with a significant reduction in the 3 year rates of target-lesion revascularisation (197 [18·6%] women in the bare-metal stent group, 294 [7·8%] in the early-generation DES group, and 330 [6·3%] in the newer-generation DES group, p<0·0001). Results did not change after adjustment for baseline characteristics in the multivariable analysis. INTERPRETATION The use of DES in women is more effective and safe than is use of bare-metal stents during long-term follow-up. Newer-generation DES are associated with an improved safety profile compared with early-generation DES, and should therefore be thought of as the standard of care for percutaneous coronary revascularisation in women. FUNDING Women in Innovation Initiative of the Society of Cardiovascular Angiography and Interventions.

Prediction of 1-year mortality in patients with acute coronary syndromes undergoing percutaneous coronary intervention: validation of the logistic clinical SYNTAX (Synergy Between Percutaneous Coronary Interventions With Taxus and Cardiac Surgery) score

OBJECTIVES This study sought to validate the Logistic Clinical SYNTAX (Synergy Between Percutaneous Coronary Intervention With Taxus and Cardiac Surgery) score in patients with non-ST-segment elevation acute coronary syndromes (ACS), in order to further legitimize its clinical application. BACKGROUND The Logistic Clinical SYNTAX score allows for an individualized prediction of 1-year mortality in patients undergoing contemporary percutaneous coronary intervention. It is composed of a "Core" Model (anatomical SYNTAX score, age, creatinine clearance, and left ventricular ejection fraction), and "Extended" Model (composed of an additional 6 clinical variables), and has previously been cross validated in 7 contemporary stent trials (>6,000 patients). METHODS One-year all-cause death was analyzed in 2,627 patients undergoing percutaneous coronary intervention from the ACUITY (Acute Catheterization and Urgent Intervention Triage Strategy) trial. Mortality predictions from the Core and Extended Models were studied with respect to discrimination, that is, separation of those with and without 1-year all-cause death (assessed by the concordance [C] statistic), and calibration, that is, agreement between observed and predicted outcomes (assessed with validation plots). Decision curve analyses, which weight the harms (false positives) against benefits (true positives) of using a risk score to make mortality predictions, were undertaken to assess clinical usefulness. RESULTS In the ACUITY trial, the median SYNTAX score was 9.0 (interquartile range 5.0 to 16.0); approximately 40% of patients had 3-vessel disease, 29% diabetes, and 85% underwent drug-eluting stent implantation. Validation plots confirmed agreement between observed and predicted mortality. The Core and Extended Models demonstrated substantial improvements in the discriminative ability for 1-year all-cause death compared with the anatomical SYNTAX score in isolation (C-statistics: SYNTAX score: 0.64, 95% confidence interval [CI]: 0.56 to 0.71; Core Model: 0.74, 95% CI: 0.66 to 0.79; Extended Model: 0.77, 95% CI: 0.70 to 0.83). Decision curve analyses confirmed the increasing ability to correctly identify patients who would die at 1 year with the Extended Model versus the Core Model versus the anatomical SYNTAX score, over a wide range of thresholds for mortality risk predictions. CONCLUSIONS Compared to the anatomical SYNTAX score alone, the Core and Extended Models of the Logistic Clinical SYNTAX score more accurately predicted individual 1-year mortality in patients presenting with non-ST-segment elevation acute coronary syndromes undergoing percutaneous coronary intervention. These findings support the clinical application of the Logistic Clinical SYNTAX score.

Impact of overlapping newer generation drug-eluting stents on clinical and angiographic outcomes: pooled analysis of five trials from the international Global RESOLUTE Program

BACKGROUND Overlapping first generation sirolimus- and paclitaxel-eluting stents are associated with persistent inflammation, fibrin deposition and delayed endothelialisation in preclinical models, and adverse angiographic and clinical outcomes--including death and myocardial infarction (MI)--in clinical studies. OBJECTIVES To establish as to whether there are any safety concerns with newer generation drug-eluting stents (DES). DESIGN Propensity score adjustment of baseline anatomical and clinical characteristics were used to compare clinical outcomes (Kaplan-Meier estimates) between patients implanted with overlapping DES (Resolute zotarolimus-eluting stent (R-ZES) or R-ZES/other DES) against no overlapping DES. Additionally, angiographic outcomes for overlapping R-ZES and everolimus-eluting stents were evaluated in the randomised RESOLUTE All-Comers Trial. SETTING Patient level data from five controlled studies of the RESOLUTE Global Clinical Program evaluating the R-ZES were pooled. Enrollment criteria were generally unrestrictive. PATIENTS 5130 patients. MAIN OUTCOME MEASURES 2-year clinical outcomes and 13-month angiographic outcomes. RESULTS 644 of 5130 patients (12.6%) in the RESOLUTE Global Clinical Program underwent overlapping DES implantation. Implantation of overlapping DES was associated with an increased frequency of MI and more complex/calcified lesion types at baseline. Adjusted in-hospital, 30-day and 2-year clinical outcomes indicated comparable cardiac death (2-year overlap vs non-overlap: 3.0% vs 2.1%, p=0.36), major adverse cardiac events (13.3% vs 10.7%, p=0.19), target-vessel MI (3.9% vs 3.4%, p=0.40), clinically driven target vessel revascularisation (7.7% vs 6.5%, p=0.32), and definite/probable stent thrombosis (1.4% vs 0.9%, p=0.28). 13-month adjusted angiographic outcomes were comparable between overlapping and non-overlapping DES. CONCLUSIONS Overlapping newer generation DES are safe and effective, with comparable angiographic and clinical outcomes--including repeat revascularisation--to non-overlapping DES.

Comparing Haemophilus influenzae type b conjugate vaccine schedules: a systematic review and meta-analysis of vaccine trials

BACKGROUND The optimal schedule and the need for a booster dose are unclear for Haemophilus influenzae type b (Hib) conjugate vaccines. We systematically reviewed relative effects of Hib vaccine schedules. METHODS We searched 21 databases to May 2010 or June 2012 and selected randomized controlled trials or quasi-randomized controlled trials that compared different Hib schedules (3 primary doses with no booster dose [3p+0], 3p+1 and 2p+1) or different intervals in primary schedules and between primary and booster schedules. Outcomes were clinical efficacy, nasopharyngeal carriage and immunological response. Results were combined in random-effects meta-analysis. RESULTS Twenty trials from 15 countries were included; 16 used vaccines conjugated to tetanus toxoid (polyribosylribitol phosphate conjugated to tetanus toxoid). No trials assessed clinical or carriage outcomes. Twenty trials examined immunological outcomes and found few relevant differences. Comparing polyribosylribitol phosphate conjugated to tetanus toxoid 3p+0 with 2p+0, there was no difference in seropositivity at the 1.0 μg/mL threshold by 6 months after the last primary dose (combined risk difference -0.02; 95% confidence interval: -0.10, 0.06). Only small differences were seen between schedules starting at different ages, with different intervals between primary doses, or with different intervals between primary and booster doses. Individuals receiving a booster were more likely to be seropositive than those at the same age who did not. CONCLUSIONS There is no clear evidence from trials that any 2p+1, 3p+0 or 3p+1 schedule of Hib conjugate vaccine is likely to provide better protection against Hib disease than other schedules. Until more data become available, scheduling is likely to be determined by epidemiological and programmatic considerations in individual settings.

Initiation and continuation of randomized trials after the publication of a trial stopped early for benefit asking the same study question: STOPIT-3 study design

BACKGROUND Randomized control trials (RCTs) stopped early for benefit (truncated RCTs) are increasingly common and, on average, overestimate the relative magnitude of benefit by approximately 30%. Investigators stop trials early when they consider it is no longer ethical to enroll patients in a control group. The goal of this systematic review is to determine how investigators of ongoing or planned RCTs respond to the publication of a truncated RCT addressing a similar question. METHODS/DESIGN We will conduct systematic reviews to update the searches of 210 truncated RCTs to identify similar trials ongoing at the time of publication, or started subsequently, to the truncated trials ('subsequent RCTs'). Reviewers will determine in duplicate the similarity between the truncated and subsequent trials. We will analyze the epidemiology, distribution, and predictors of subsequent RCTs. We will also contact authors of subsequent trials to determine reasons for beginning, continuing, or prematurely discontinuing their own trials, and the extent to which they rely on the estimates from truncated trials. DISCUSSION To the extent that investigators begin or continue subsequent trials they implicitly disagree with the decision to stop the truncated RCT because of an ethical mandate to administer the experimental treatment. The results of this study will help guide future decisions about when to stop RCTs early for benefit.

The Alexander Technique and musicians: a systematic review of controlled trials

BACKGROUND: Musculoskeletal disorders, stress and performance anxiety are common in musicians. Therefore, some use the Alexander Technique (AT), a psycho-physical method that helps to release unnecessary muscle tension and re-educates non-beneficial movement patterns through intentional inhibition of unwanted habitual behaviours. According to a recent review AT sessions may be effective for chronic back pain. This review aimed to evaluate the evidence for the effectiveness of AT sessions on musicians' performance, anxiety, respiratory function and posture. METHODS: The following electronic databases were searched up to February 2014 for relevant publications: PUBMED, Google Scholar, CINAHL, EMBASE, AMED, PsycINFO and RILM. The search criteria were "Alexander Technique" AND "music*". References were searched, and experts and societies of AT or musicians' medicine contacted for further publications. RESULTS: 237 citations were assessed. 12 studies were included for further analysis, 5 of which were randomised controlled trials (RCTs), 5 controlled but not randomised (CTs), and 2 mixed methods studies. Main outcome measures in RCTs and CTs were music performance, respiratory function, performance anxiety, body use and posture. Music performance was judged by external experts and found to be improved by AT in 1 of 3 RCTs; in 1 RCT comparing neurofeedback (NF) to AT, only NF caused improvements. Respiratory function was investigated in 2 RCTs, but not improved by AT training. Performance anxiety was mostly assessed by questionnaires and decreased by AT in 2 of 2 RCTs and in 2 of 2 CTs. CONCLUSIONS: A variety of outcome measures have been used to investigate the effectiveness of AT sessions in musicians. Evidence from RCTs and CTs suggests that AT sessions may improve performance anxiety in musicians. Effects on music performance, respiratory function and posture yet remain inconclusive. Future trials with well-established study designs are warranted to further and more reliably explore the potential of AT in the interest of musicians.

Aortic valve replacement and concomitant procedures with the Perceval valve: results of European trials.

BACKGROUND The Perceval (Sorin Group, Milan, Italy) is a self-anchoring sutureless aortic valve prosthesis. We report the short- to midterm results of combined aortic valve replacement (AVR) with concomitant procedures in elderly patients undergoing operation as part of 3 consecutive prospective multicenter European studies. METHODS From April 2007 to February 2013, 243 patients (mean age, 79.7 ± 5.1 years; female patients, 61%; median EuroSCORE, 9%) underwent AVR with concomitant procedures. The concomitant procedures were coronary artery bypass grafting (CABG) (182 cases), septal myectomy (21 cases), CABG + other procedures (18 cases), and 22 other procedures. Primary and secondary end points included implant feasibility and safety (for mortality and morbidity) and efficacy (New York Heart Association [NYHA] class improvement and hemodynamic results) of the prosthesis at the different follow-up periods. Data were expressed as mean ± standard deviation. Kaplan-Meier analysis was performed for survival analysis. RESULTS Mean aortic cross-clamp and extracorporeal circulation (ECC) times were 50.7 ± 22.8 minutes and 78.9 ± 32.3 minutes, respectively. Thirty-day mortality was 2.1%. Mean postoperative gradient and effective orifice area were 10.1 ± 4.7 mm Hg and 1.5 ± 0.4 cm(2) and 8.9 ± 5.6 mm Hg and 1.6 ± 0.4 cm(2), respectively, at 1 year. There were early explantations, 4 of which resulted from paravalvular leaks. One additional valve explantation resulted from aortic root bleeding, probably caused by excessively extensive decalcification. In the late period, there was 1 mild paravalvular leak and no intravalvular insufficiency. No migration, dislodgement, or degeneration of the valve occurred during follow-up. Median follow-up was 444 days. CONCLUSIONS These trials confirm the safety and efficacy of the Perceval sutureless aortic valve, especially in elderly patients requiring AVR + concomitant procedures. In this patient group, sutureless valves may be advantageous compared to transcatheter valve implantations as concomitant procedures other than percutaneous coronary artery angioplasty are not always possible in the latter.

Unique and shared techniques in cognitive-behavioural and short-term psychodynamic psychotherapy: a content analysis of randomised trials on depression

Randomised controlled trials (RCTs) of psychotherapeutic interventions assume that specific techniques are used in treatments, which are responsible for changes in the client's symptoms. This assumption also holds true for meta-analyses, where evidence for specific interventions and techniques is compiled. However, it has also been argued that different treatments share important techniques and that an upcoming consensus about useful treatment strategies is leading to a greater integration of treatments. This makes assumptions about the effectiveness of specific interventions ingredients questionable if the shared (common) techniques are more often used in interventions than are the unique techniques. This study investigated the unique or shared techniques in RCTs of cognitive-behavioural therapy (CBT) and short-term psychodynamic psychotherapy (STPP). Psychotherapeutic techniques were coded from 42 masked treatment descriptions of RCTs in the field of depression (1979-2010). CBT techniques were often used in studies identified as either CBT or STPP. However, STPP techniques were only used in STPP-identified studies. Empirical clustering of treatment descriptions did not confirm the original distinction of CBT versus STPP, but instead showed substantial heterogeneity within both approaches. Extraction of psychotherapeutic techniques from the treatment descriptions is feasible and could be used as a content-based approach to classify treatments in systematic reviews and meta-analyses.