Challenges and Recommendations for Placebo Controls in Randomized Trials in Physical and Rehabilitation Medicine A Report of the International Placebo Symposium Working Group

Compared with other specialties, the field of physical and rehabilitation medicine has not received the deserved recognition from clinicians and researchers in the scientific community. One of the reasons is the lack of sound evidence to support the traditional physical and rehabilitation medicine treatments. The best way to change this disadvantage is through a well conducted clinical research, such as standard placebo- or sham-controlled randomized clinical trials. Therefore, having placebo groups in clinical trials is essential to improve the level of evidence-based practice in physical and rehabilitation medicine that ultimately translates to better clinical care. To address the challenges for the use of placebo in physical and rehabilitation medicine and randomized clinical trials and to create useful recommendations, we convened a working group during the inaugural International Symposium in Placebo (February 2009, in Sao Paulo, Brazil) in which the following topics were discussed: (1) current status of randomized clinical trials in physical and rehabilitation medicine, (2) challenges for the use of placebo in physical and rehabilitation medicine, (3) bioethics, (4) use of placebo in acupuncture trials and for the treatment of low-back pain, (5) mechanisms of placebo, and (6) insights from other specialties. The current article represents the consensus report from the working group.

Prevalence, characteristics, and publication of discontinued randomized trials.

IMPORTANCE: The discontinuation of randomized clinical trials (RCTs) raises ethical concerns and often wastes scarce research resources. The epidemiology of discontinued RCTs, however, remains unclear. OBJECTIVES: To determine the prevalence, characteristics, and publication history of discontinued RCTs and to investigate factors associated with RCT discontinuation due to poor recruitment and with nonpublication. DESIGN AND SETTING: Retrospective cohort of RCTs based on archived protocols approved by 6 research ethics committees in Switzerland, Germany, and Canada between 2000 and 2003. We recorded trial characteristics and planned recruitment from included protocols. Last follow-up of RCTs was April 27, 2013. MAIN OUTCOMES AND MEASURES: Completion status, reported reasons for discontinuation, and publication status of RCTs as determined by correspondence with the research ethics committees, literature searches, and investigator surveys. RESULTS: After a median follow-up of 11.6 years (range, 8.8-12.6 years), 253 of 1017 included RCTs were discontinued (24.9% [95% CI, 22.3%-27.6%]). Only 96 of 253 discontinuations (37.9% [95% CI, 32.0%-44.3%]) were reported to ethics committees. The most frequent reason for discontinuation was poor recruitment (101/1017; 9.9% [95% CI, 8.2%-12.0%]). In multivariable analysis, industry sponsorship vs investigator sponsorship (8.4% vs 26.5%; odds ratio [OR], 0.25 [95% CI, 0.15-0.43]; P < .001) and a larger planned sample size in increments of 100 (-0.7%; OR, 0.96 [95% CI, 0.92-1.00]; P = .04) were associated with lower rates of discontinuation due to poor recruitment. Discontinued trials were more likely to remain unpublished than completed trials (55.1% vs 33.6%; OR, 3.19 [95% CI, 2.29-4.43]; P < .001). CONCLUSIONS AND RELEVANCE: In this sample of trials based on RCT protocols from 6 research ethics committees, discontinuation was common, with poor recruitment being the most frequently reported reason. Greater efforts are needed to ensure the reporting of trial discontinuation to research ethics committees and the publication of results of discontinued trials.

Impact of pharmacist care in the management of cardiovascular disease risk factors: a systematic review and meta-analysis of randomized trials.

BACKGROUND: Pharmacists may improve the clinical management of major risk factors for cardiovascular disease (CVD) prevention. A systematic review was conducted to determine the impact of pharmacist care on the management of CVD risk factors among outpatients. METHODS: The MEDLINE, EMBASE, CINAHL, and Cochrane Central Register of Controlled Trials databases were searched for randomized controlled trials that involved pharmacist care interventions among outpatients with CVD risk factors. Two reviewers independently abstracted data and classified pharmacists' interventions. Mean changes in blood pressure, total cholesterol, low-density lipoprotein cholesterol, and proportion of smokers were estimated using random effects models. RESULTS: Thirty randomized controlled trials (11 765 patients) were identified. Pharmacist interventions exclusively conducted by a pharmacist or implemented in collaboration with physicians or nurses included patient educational interventions, patient-reminder systems, measurement of CVD risk factors, medication management and feedback to physician, or educational intervention to health care professionals. Pharmacist care was associated with significant reductions in systolic/diastolic blood pressure (19 studies [10 479 patients]; -8.1 mm Hg [95% confidence interval {CI}, -10.2 to -5.9]/-3.8 mm Hg [95% CI,-5.3 to -2.3]); total cholesterol (9 studies [1121 patients]; -17.4 mg/L [95% CI,-25.5 to -9.2]), low-density lipoprotein cholesterol (7 studies [924 patients]; -13.4 mg/L [95% CI,-23.0 to -3.8]), and a reduction in the risk of smoking (2 studies [196 patients]; relative risk, 0.77 [95% CI, 0.67 to 0.89]). While most studies tended to favor pharmacist care compared with usual care, a substantial heterogeneity was observed. CONCLUSION: Pharmacist-directed care or in collaboration with physicians or nurses improve the management of major CVD risk factors in outpatients.

Two randomized trials of canakinumab in systemic juvenile idiopathic arthritis.

BACKGROUND: Interleukin-1 is pivotal in the pathogenesis of systemic juvenile idiopathic arthritis (JIA). We assessed the efficacy and safety of canakinumab, a selective, fully human, anti-interleukin-1β monoclonal antibody, in two trials. METHODS: In trial 1, we randomly assigned patients, 2 to 19 years of age, with systemic JIA and active systemic features (fever; ≥2 active joints; C-reactive protein, >30 mg per liter; and glucocorticoid dose, ≤1.0 mg per kilogram of body weight per day), in a double-blind fashion, to a single subcutaneous dose of canakinumab (4 mg per kilogram) or placebo. The primary outcome, termed adapted JIA ACR 30 response, was defined as improvement of 30% or more in at least three of the six core criteria for JIA, worsening of more than 30% in no more than one of the criteria, and resolution of fever. In trial 2, after 32 weeks of open-label treatment with canakinumab, patients who had a response and underwent glucocorticoid tapering were randomly assigned to continued treatment with canakinumab or to placebo. The primary outcome was time to flare of systemic JIA. RESULTS: At day 15 in trial 1, more patients in the canakinumab group had an adapted JIA ACR 30 response (36 of 43 [84%], vs. 4 of 41 [10%] in the placebo group; P<0.001). In trial 2, among the 100 patients (of 177 in the open-label phase) who underwent randomization in the withdrawal phase, the risk of flare was lower among patients who continued to receive canakinumab than among those who were switched to placebo (74% of patients in the canakinumab group had no flare, vs. 25% in the placebo group, according to Kaplan-Meier estimates; hazard ratio, 0.36; P=0.003). The average glucocorticoid dose was reduced from 0.34 to 0.05 mg per kilogram per day, and glucocorticoids were discontinued in 42 of 128 patients (33%). The macrophage activation syndrome occurred in 7 patients; infections were more frequent with canakinumab than with placebo. CONCLUSIONS: These two phase 3 studies show the efficacy of canakinumab in systemic JIA with active systemic features. (Funded by Novartis Pharma; ClinicalTrials.gov numbers, NCT00889863 and NCT00886769.).

Two randomized trials of canakinumab in systemic juvenile idiopathic arthritis.

BACKGROUND: Interleukin-1 is pivotal in the pathogenesis of systemic juvenile idiopathic arthritis (JIA). We assessed the efficacy and safety of canakinumab, a selective, fully human, anti-interleukin-1β monoclonal antibody, in two trials. METHODS: In trial 1, we randomly assigned patients, 2 to 19 years of age, with systemic JIA and active systemic features (fever; ≥2 active joints; C-reactive protein, >30 mg per liter; and glucocorticoid dose, ≤1.0 mg per kilogram of body weight per day), in a double-blind fashion, to a single subcutaneous dose of canakinumab (4 mg per kilogram) or placebo. The primary outcome, termed adapted JIA ACR 30 response, was defined as improvement of 30% or more in at least three of the six core criteria for JIA, worsening of more than 30% in no more than one of the criteria, and resolution of fever. In trial 2, after 32 weeks of open-label treatment with canakinumab, patients who had a response and underwent glucocorticoid tapering were randomly assigned to continued treatment with canakinumab or to placebo. The primary outcome was time to flare of systemic JIA. RESULTS: At day 15 in trial 1, more patients in the canakinumab group had an adapted JIA ACR 30 response (36 of 43 [84%], vs. 4 of 41 [10%] in the placebo group; P<0.001). In trial 2, among the 100 patients (of 177 in the open-label phase) who underwent randomization in the withdrawal phase, the risk of flare was lower among patients who continued to receive canakinumab than among those who were switched to placebo (74% of patients in the canakinumab group had no flare, vs. 25% in the placebo group, according to Kaplan-Meier estimates; hazard ratio, 0.36; P=0.003). The average glucocorticoid dose was reduced from 0.34 to 0.05 mg per kilogram per day, and glucocorticoids were discontinued in 42 of 128 patients (33%). The macrophage activation syndrome occurred in 7 patients; infections were more frequent with canakinumab than with placebo. CONCLUSIONS: These two phase 3 studies show the efficacy of canakinumab in systemic JIA with active systemic features. (Funded by Novartis Pharma; ClinicalTrials.gov numbers, NCT00889863 and NCT00886769.).

Learning from failure - rationale and design for a study about discontinuation of randomized trials (DISCO study).

BACKGROUND: Randomized controlled trials (RCTs) may be discontinued because of apparent harm, benefit, or futility. Other RCTs are discontinued early because of insufficient recruitment. Trial discontinuation has ethical implications, because participants consent on the premise of contributing to new medical knowledge, Research Ethics Committees (RECs) spend considerable effort reviewing study protocols, and limited resources for conducting research are wasted. Currently, little is known regarding the frequency and characteristics of discontinued RCTs. METHODS/DESIGN: Our aims are, first, to determine the prevalence of RCT discontinuation for specific reasons; second, to determine whether the risk of RCT discontinuation for specific reasons differs between investigator- and industry-initiated RCTs; third, to identify risk factors for RCT discontinuation due to insufficient recruitment; fourth, to determine at what stage RCTs are discontinued; and fifth, to examine the publication history of discontinued RCTs.We are currently assembling a multicenter cohort of RCTs based on protocols approved between 2000 and 2002/3 by 6 RECs in Switzerland, Germany, and Canada. We are extracting data on RCT characteristics and planned recruitment for all included protocols. Completion and publication status is determined using information from correspondence between investigators and RECs, publications identified through literature searches, or by contacting the investigators. We will use multivariable regression models to identify risk factors for trial discontinuation due to insufficient recruitment. We aim to include over 1000 RCTs of which an anticipated 150 will have been discontinued due to insufficient recruitment. DISCUSSION: Our study will provide insights into the prevalence and characteristics of RCTs that were discontinued. Effective recruitment strategies and the anticipation of problems are key issues in the planning and evaluation of trials by investigators, Clinical Trial Units, RECs and funding agencies. Identification and modification of barriers to successful study completion at an early stage could help to reduce the risk of trial discontinuation, save limited resources, and enable RCTs to better meet their ethical requirements.

Factors modifying drug and placebo responses in randomized trials for bipolar mania

Factors modifying drug and placebo responses in randomized trials for bipolar mania. Yildiz A, Vieta E, Tohen M, Baldessarini RJ. Source Department of Psychiatry, Dokuz Eylül University, Izmir, Turkey. agul_yildiz@hotmail.com Abstract Randomized placebo-controlled trials (RCTs) are standard for assessing efficacy and safety of treatments. We pursued preliminary indications that some factors are associated differentially with responses to placebo or drugs in RCTs for bipolar mania. We meta-analysed data from RCTs to assess influences of study-site count, subjects' age, sex distribution, diagnostic subgroups, clinical features, trial-completion rates, and publication year on mean difference (MD) in mania ratings between intake and final assessments. In 38 RCTs involving 3812 placebo-treated and 6988 drug-treated patients, symptomatic improvement was similar in placebo arms of trials of effective (6.77, 95% CI 5.77-7.76) and ineffective (7.61, 95% CI 5.47-8.75) drugs. Lesser placebo responses (MD) and greater drug-placebo differences (Hedges' g) were associated with fewer study sites, younger patients' age, and male sex. More patients with initial psychotic features and more trial completion in drug arms were associated with greater drug-associated improvement (MD) and drug-placebo contrast (Hedges' g), whereas more mixed-state diagnoses decreased both measures. Identifying modifying factors can support more efficient and cost-effective designs of therapeutic trials. In trials for mania, fewer sites may limit placebo response and enhance drug-placebo contrasts.

Méta-analyses d'essais randomisés sur données individuelles dans le traitement des cancers ORL non métastatiques : principes, résultats, perspectives [Individual patient data meta-analyses of randomized trials for the treatment of non-metastatic head and neck squamous cell carcinomas: Principles, results and perspectives].

Meta-analyses are considered as an important pillar of evidence-based medicine. The aim of this review is to describe the main principles of a meta-analysis and to use examples of head and neck oncology to demonstrate their clinical impact and methodological interest. The major role of individual patient data is outlined, as well as the superiority of individual patient data over meta-analyses based on published summary data. The major clinical breakthrough of head and neck meta-analyses are summarized, regarding concomitant chemotherapy, altered fractionated chemotherapy, new regimens of induction chemotherapy or the use of radioprotectants. Recent methodological developments are described, including network meta-analyses, the validation of surrogate markers. Lastly, the future of meta-analyses is discussed in the context of personalized medicine.

Premature Discontinuation of Randomized Trials in Critical and Emergency Care: A Retrospective Cohort Study.

OBJECTIVES: Randomized clinical trials that enroll patients in critical or emergency care (acute care) setting are challenging because of narrow time windows for recruitment and the inability of many patients to provide informed consent. To assess the extent that recruitment challenges lead to randomized clinical trial discontinuation, we compared the discontinuation of acute care and nonacute care randomized clinical trials. DESIGN: Retrospective cohort of 894 randomized clinical trials approved by six institutional review boards in Switzerland, Germany, and Canada between 2000 and 2003. SETTING: Randomized clinical trials involving patients in an acute or nonacute care setting. SUBJECTS AND INTERVENTIONS: We recorded trial characteristics, self-reported trial discontinuation, and self-reported reasons for discontinuation from protocols, corresponding publications, institutional review board files, and a survey of investigators. MEASUREMENTS AND MAIN RESULTS: Of 894 randomized clinical trials, 64 (7%) were acute care randomized clinical trials (29 critical care and 35 emergency care). Compared with the 830 nonacute care randomized clinical trials, acute care randomized clinical trials were more frequently discontinued (28 of 64, 44% vs 221 of 830, 27%; p = 0.004). Slow recruitment was the most frequent reason for discontinuation, both in acute care (13 of 64, 20%) and in nonacute care randomized clinical trials (7 of 64, 11%). Logistic regression analyses suggested the acute care setting as an independent risk factor for randomized clinical trial discontinuation specifically as a result of slow recruitment (odds ratio, 4.00; 95% CI, 1.72-9.31) after adjusting for other established risk factors, including nonindustry sponsorship and small sample size. CONCLUSIONS: Acute care randomized clinical trials are more vulnerable to premature discontinuation than nonacute care randomized clinical trials and have an approximately four-fold higher risk of discontinuation due to slow recruitment. These results highlight the need for strategies to reliably prevent and resolve slow patient recruitment in randomized clinical trials conducted in the critical and emergency care setting.

Biodegradable polymer drug-eluting stents reduce the risk of stent thrombosis at 4 years in patients undergoing percutaneous coronary intervention: a pooled analysis of individual patient data from the ISAR-TEST 3, ISAR-TEST 4, and LEADERS randomized trials

The efficacy of durable polymer drug-eluting stents (DES) is delivered at the expense of delayed healing of the stented vessel. Biodegradable polymer DES aim to avoid this shortcoming and may potentially improve long-term clinical outcomes, with benefit expected to accrue over time. We sought to compare long-term outcomes in patients treated with biodegradable polymer DES vs. durable polymer sirolimus-eluting stents (SES).

Learning from failure--rationale and design for a study about discontinuation of randomized trials (DISCO study)

Background Randomized controlled trials (RCTs) may be discontinued because of apparent harm, benefit, or futility. Other RCTs are discontinued early because of insufficient recruitment. Trial discontinuation has ethical implications, because participants consent on the premise of contributing to new medical knowledge, Research Ethics Committees (RECs) spend considerable effort reviewing study protocols, and limited resources for conducting research are wasted. Currently, little is known regarding the frequency and characteristics of discontinued RCTs. Methods/Design Our aims are, first, to determine the prevalence of RCT discontinuation for specific reasons; second, to determine whether the risk of RCT discontinuation for specific reasons differs between investigator- and industry-initiated RCTs; third, to identify risk factors for RCT discontinuation due to insufficient recruitment; fourth, to determine at what stage RCTs are discontinued; and fifth, to examine the publication history of discontinued RCTs. We are currently assembling a multicenter cohort of RCTs based on protocols approved between 2000 and 2002/3 by 6 RECs in Switzerland, Germany, and Canada. We are extracting data on RCT characteristics and planned recruitment for all included protocols. Completion and publication status is determined using information from correspondence between investigators and RECs, publications identified through literature searches, or by contacting the investigators. We will use multivariable regression models to identify risk factors for trial discontinuation due to insufficient recruitment. We aim to include over 1000 RCTs of which an anticipated 150 will have been discontinued due to insufficient recruitment. Discussion Our study will provide insights into the prevalence and characteristics of RCTs that were discontinued. Effective recruitment strategies and the anticipation of problems are key issues in the planning and evaluation of trials by investigators, Clinical Trial Units, RECs and funding agencies. Identification and modification of barriers to successful study completion at an early stage could help to reduce the risk of trial discontinuation, save limited resources, and enable RCTs to better meet their ethical requirements.

Grey literature in meta-analyses of randomized trials of health care interventions

BACKGROUND: The inclusion of grey literature (i.e. literature that has not been formally published) in systematic reviews may help to overcome some of the problems of publication bias, which can arise due to the selective availability of data. OBJECTIVES: To review systematically research studies, which have investigated the impact of grey literature in meta-analyses of randomized trials of health care interventions. SEARCH STRATEGY: We searched the Cochrane Methodology Register (The Cochrane Library Issue 3, 2005), MEDLINE (1966 to 20 May 2005), the Science Citation Index (June 2005) and contacted researchers who may have carried out relevant studies. SELECTION CRITERIA: A study was considered eligible for this review if it compared the effect of the inclusion and exclusion of grey literature on the results of a cohort of meta-analyses of randomized trials. DATA COLLECTION AND ANALYSIS: Data were extracted from each report independently by two reviewers. The main outcome measure was an estimate of the impact of trials from the grey literature on the pooled effect estimates of the meta-analyses. Information was also collected on the area of health care, the number of meta-analyses, the number of trials, the number of trial participants, the year of publication of the trials, the language and country of publication of the trials, the number and type of grey and published literature, and methodological quality. MAIN RESULTS: Five studies met the inclusion criteria. All five studies showed that published trials showed an overall greater treatment effect than grey trials. This difference was statistically significant in one of the five studies. Data could be combined for three of the five studies. This showed that, on average, published trials showed a 9% greater treatment effect than grey trials (ratio of odds ratios for grey versus published trials 1.09; 95% CI 1.03-1.16). Overall there were more published trials included in the meta-analyses than grey trials (median 224 (IQR 108-365) versus 45(IQR 40-102)). Published trials had more participants on average. The most common types of grey literature were abstracts (55%) and unpublished data (30%). There is limited evidence to show whether grey trials are of poorer methodological quality than published trials. AUTHORS' CONCLUSIONS: This review shows that published trials tend to be larger and show an overall greater treatment effect than grey trials. This has important implications for reviewers who need to ensure they identify grey trials, in order to minimise the risk of introducing bias into their review.