An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.

Premature Discontinuation of Randomized Trials in Critical and Emergency Care: A Retrospective Cohort Study.

OBJECTIVES Randomized clinical trials that enroll patients in critical or emergency care (acute care) setting are challenging because of narrow time windows for recruitment and the inability of many patients to provide informed consent. To assess the extent that recruitment challenges lead to randomized clinical trial discontinuation, we compared the discontinuation of acute care and nonacute care randomized clinical trials. DESIGN Retrospective cohort of 894 randomized clinical trials approved by six institutional review boards in Switzerland, Germany, and Canada between 2000 and 2003. SETTING Randomized clinical trials involving patients in an acute or nonacute care setting. SUBJECTS AND INTERVENTIONS We recorded trial characteristics, self-reported trial discontinuation, and self-reported reasons for discontinuation from protocols, corresponding publications, institutional review board files, and a survey of investigators. MEASUREMENTS AND MAIN RESULTS Of 894 randomized clinical trials, 64 (7%) were acute care randomized clinical trials (29 critical care and 35 emergency care). Compared with the 830 nonacute care randomized clinical trials, acute care randomized clinical trials were more frequently discontinued (28 of 64, 44% vs 221 of 830, 27%; p = 0.004). Slow recruitment was the most frequent reason for discontinuation, both in acute care (13 of 64, 20%) and in nonacute care randomized clinical trials (7 of 64, 11%). Logistic regression analyses suggested the acute care setting as an independent risk factor for randomized clinical trial discontinuation specifically as a result of slow recruitment (odds ratio, 4.00; 95% CI, 1.72-9.31) after adjusting for other established risk factors, including nonindustry sponsorship and small sample size. CONCLUSIONS Acute care randomized clinical trials are more vulnerable to premature discontinuation than nonacute care randomized clinical trials and have an approximately four-fold higher risk of discontinuation due to slow recruitment. These results highlight the need for strategies to reliably prevent and resolve slow patient recruitment in randomized clinical trials conducted in the critical and emergency care setting.

Reporting quality of randomised controlled trials published in prosthodontic and implantology journals

The purpose of this study was to examine the reporting quality of randomised controlled trials (RCTs) published in prosthodontic and implantology journals. Thirty issues of nine journals in prosthodontics and implant dentistry were searched for RCTs, covering the years 2005-2012: The Journal of Prosthetic Dentistry, Journal of Oral Rehabilitation, The International Journal of Prosthodontics, The International Journal of Periodontics & Restorative Dentistry, Clinical Oral Implants Research, Clinical Implant Dentistry & Related Research, The International Journal of Oral & Maxillofacial Implants, Implant Dentistry and Journal of Dentistry. The reporting quality was assessed using a modified Consolidated Standards of Reporting Trials (CONSORT) statement checklist. Data were analysed using descriptive statistics followed by univariable and multivariable examination of statistical associations (α = 0·05). A total of 147 RCTs were identified with a mean CONSORT score of 69·4 (s.d. = 9·7). Significant differences were found among journals with the Journal of Oral Rehabilitation achieving the highest score (80·6, s.d. = 5·5) followed by Clinical Oral Implants Research (73·7, s.d. = 8·3). Involvement of a statistician/methodologist was significantly associated with increased CONSORT scores. Overall, the reporting quality of RCTs in major prosthodontic and implantology journals requires improvement. This is of paramount importance considering that optimal reporting of RCTs is an important prerequisite for clinical decision-making.

Planning and reporting of quality-of-life outcomes in cancer trials.

BACKGROUND Information about the impact of cancer treatments on patients' quality of life (QoL) is of paramount importance to patients and treating oncologists. Cancer trials that do not specify QoL as an outcome or fail to report collected QoL data, omit crucial information for decision making. To estimate the magnitude of these problems, we investigated how frequently QoL outcomes were specified in protocols of cancer trials and subsequently reported. DESIGN Retrospective cohort study of RCT protocols approved by six research ethics committees in Switzerland, Germany, and Canada between 2000 and 2003. We compared protocols to corresponding publications, which were identified through literature searches and investigator surveys. RESULTS Of the 173 cancer trials, 90 (52%) specified QoL outcomes in their protocol, 2 (1%) as primary and 88 (51%) as secondary outcome. Of the 173 trials, 35 (20%) reported QoL outcomes in a corresponding publication (4 modified from the protocol), 18 (10%) were published but failed to report QoL outcomes in the primary or a secondary publication, and 37 (21%) were not published at all. Of the 83 (48%) trials that did not specify QoL outcomes in their protocol, none subsequently reported QoL outcomes. Failure to report pre-specified QoL outcomes was not associated with industry sponsorship (versus non-industry), sample size, and multicentre (versus single centre) status but possibly with trial discontinuation. CONCLUSIONS About half of cancer trials specified QoL outcomes in their protocols. However, only 20% reported any QoL data in associated publications. Highly relevant information for decision making is often unavailable to patients, oncologists, and health policymakers.

Clinical Perspectives from Randomized Phase 3 Trials on Prostate Cancer: An Analysis of the ClinicalTrials.gov Database

AbstractBackground It is not easy to overview pending phase 3 trials on prostate cancer (PCa), and awareness of these trials would benefit clinicians. Objective To identify all phase 3 trials on {PCa} registered in the ClinicalTrials.gov database with pending results. Design and setting On September 29, 2014, a database was established from the records for 175 538 clinical trials registered on ClinicalTrials.gov. A search of this database for the substring “prostat” identified 2951 prostate trials. Phase 3 trials accounted for 441 studies, of which 333 concerned only PCa. We selected only ongoing or completed trials with pending results, that is, for which the primary endpoint had not been published in a peer-reviewed medical journal. Results and limitations We identified 123 phase 3 trials with pending results. Trials were conducted predominantly in North America (n = 63; 51) and Europe (n = 47; 38). The majority were on nonmetastatic disease (n = 82; 67), with 37 (30) on metastatic disease and four trials (3) including both. In terms of intervention, systemic treatment was most commonly tested (n = 71; 58), followed by local treatment 34 (28), and both systemic and local treatment (n = 11; 9), with seven (6) trials not classifiable. The 71 trials on systemic treatment included androgen deprivation therapy (n = 34; 48), chemotherapy (n = 15; 21), immunotherapy (n = 9; 13), other systemic drugs (n = 9; 13), radiopharmaceuticals (n = 2; 3), and combinations (n = 2; 3). Local treatments tested included radiation therapy (n = 27; 79), surgery (n = 5; 15), and both (n = 2; 2). A limitation is that not every clinical trial is registered on ClinicalTrials.gov. Conclusion There are many {PCa} phase 3 trials with pending results, most of which address questions regarding systemic treatments for both nonmetastatic and metastatic disease. Radiation therapy and androgen deprivation therapy are the interventions most commonly tested for local and systemic treatment, respectively. Patient summary This report describes all phase 3 trials on prostate cancer registered in the ClinicalTrials.gov database with pending results. Most of these trials address questions regarding systemic treatments for both nonmetastatic and metastatic disease. Radiation therapy and androgen deprivation therapy are the interventions most commonly tested for local and systemic treatment, respectively.

Non-selective beta-blockers may reduce risk of hepatocellular carcinoma: a meta-analysis of randomized trials

BACKGROUND & AIMS Non-selective beta-blockers (NSBB) are used in patients with cirrhosis and oesophageal varices. Experimental data suggest that NSBB inhibit angiogenesis and reduce bacterial translocation, which may prevent hepatocellular carcinoma (HCC). We therefore assessed the effect of NSBB on HCC by performing a systematic review with meta-analyses of randomized trials. METHODS Electronic and manual searches were combined. Authors were contacted for unpublished data. Included trials assessed NSBB for patients with cirrhosis; the control group could receive any other intervention than NSBB. Fixed and random effects meta-analyses were performed with I(2) as a measure of heterogeneity. Subgroup, sensitivity, regression and sequential analyses were performed to evaluate heterogeneity, bias and the robustness of the results after adjusting for multiple testing. RESULTS Twenty-three randomized trials on 2618 patients with cirrhosis were included, of which 12 reported HCC incidence and 23 reported HCC mortality. The mean duration of follow-up was 26 months (range 8-82). In total, 47 of 694 patients randomized to NSBB developed HCC vs 65 of 697 controls (risk difference -0.026; 95% CI-0.052 to -0.001; number needed to treat 38 patients). There was no heterogeneity (I(2) = 7%) or evidence of small study effects (Eggers P = 0.402). The result was not confirmed in sequential analysis, which suggested that 3719 patients were needed to achieve the required information size. NSBB did not reduce HCC-related mortality (RD -0.011; 95% CI -0.040 to 0.017). CONCLUSIONS Non-selective beta-blockers may prevent HCC in patients with cirrhosis.

Three-year efficacy and safety of new- versus early-generation drug-eluting stents for unprotected left main coronary artery disease insights from the ISAR-LEFT MAIN and ISAR-LEFT MAIN 2 trials.

BACKGROUND In percutaneous coronary intervention (PCI) patients new-generation drug-eluting stent (DES) has reduced adverse events in comparison to early-generation DES. The aim of the current study was to investigate the long-term clinical efficacy and safety of new-generation DES versus early-generation DES for PCI of unprotected left main coronary artery (uLMCA) disease. METHODS The patient-level data from the ISAR-LEFT MAIN and ISAR-LEFT MAIN 2 randomized trials were pooled. The clinical outcomes of PCI patients assigned to new-generation DES (everolimus- or zotarolimus-eluting stent) versus early-generation DES (paclitaxel- or sirolimus-eluting stent) were studied. The primary endpoint was the composite of death, myocardial infarction (MI), target lesion revascularization and stroke (MACCE, major adverse cardiac and cerebrovascular event). RESULTS In total, 1257 patients were available. At 3 years, the risk of MACCE was comparable between patients assigned to new-generation DES or early-generation DES (28.2 versus 27.5 %, hazard ratio-HR 1.03, 95 % confidence intervals-CI 0.83-1.26; P = 0.86). Definite/probable stent thrombosis was low and comparable between new-generation DES and early-generation DES (0.8 versus 1.6 %, HR 0.52, 95 % CI 0.18-1.57; P = 0.25); in patients treated with new-generation DES no cases occurred beyond 30 days. Diabetes increased the risk of MACCE in patients treated with new-generation DES but not with early-generation DES (P interaction = 0.004). CONCLUSIONS At 3-year follow-up, a PCI with new-generation DES for uLMCA disease shows comparable efficacy to early-generation DES. Rates of stent thrombosis were low in both groups. Diabetes significantly impacts the risk of MACCE at 3 years in patients treated with new-generation DES for uLMCA disease. ClinicalTrials.gov Identifiers: NCT00133237; NCT00598637.

The CONSORT Statement: Application within and adaptations for orthodontic trials

High-quality randomized controlled trials (RCTs) are an integral part of evidence-based medicine. RCTs are the bricks and mortar of high-quality systematic reviews, which are important determinants of health care policy and clinical practice. For published research to be used most effectively, investigators and authors should follow the guidelines for accurate and transparent reporting of RCTs. The consolidated standards of reporting trials (CONSORT) statement and its extensions are among the most widely used reporting guidelines in biomedical research. CONSORT was adopted by the American Journal of Orthodontics and Dentofacial Orthopedics in 2004. Since 2011, this Journal has been actively implementing compliance with the CONSORT reporting guidelines. The objective of this explanatory article is to highlight the relevance and implications of the various CONSORT items to help authors to achieve CONSORT compliance in their research submissions of RCTs to this and other orthodontic journals.

Addressing missing participant outcome data in dental clinical trials

Missing outcome data are common in clinical trials and despite a well-designed study protocol, some of the randomized participants may leave the trial early without providing any or all of the data, or may be excluded after randomization. Premature discontinuation causes loss of information, potentially resulting in attrition bias leading to problems during interpretation of trial findings. The causes of information loss in a trial, known as mechanisms of missingness, may influence the credibility of the trial results. Analysis of trials with missing outcome data should ideally be handled with intention to treat (ITT) rather than per protocol (PP) analysis. However, true ITT analysis requires appropriate assumptions and imputation of missing data. Using a worked example from a published dental study, we highlight the key issues associated with missing outcome data in clinical trials, describe the most recognized approaches to handling missing outcome data, and explain the principles of ITT and PP analysis.

Clinical effectiveness of cognitive behavioral therapy for depression in routine care: A propensity score based comparison between randomized controlled trials and clinical practice

Background: The efficacy of cognitive behavioral therapy (CBT) for the treatment of depressive disorders has been demonstrated in many randomized controlled trials (RCTs). This study investigated whether for CBT similar effects can be expected under routine care conditions when the patients are comparable to those examined in RCTs. Method: N=574 CBT patients from an outpatient clinic were stepwise matched to the patients undergoing CBT in the National Institute of Mental Health Treatment of Depression Collaborative Research Program (TDCRP). First, the exclusion criteria of the RCT were applied to the naturalistic sample of the outpatient clinic. Second, propensity score matching (PSM) was used to adjust the remaining naturalistic sample on the basis of baseline covariate distributions. Matched samples were then compared regarding treatment effects using effect sizes, average treatment effect on the treated (ATT) and recovery rates. Results: CBT in the adjusted naturalistic subsample was as effective as in the RCT. However, treatments lasted significantly longer under routine care conditions. Limitations: The samples included only a limited amount of common predictor variables and stemmed from different countries. There might be additional covariates, which could potentially further improve the matching between the samples. Conclusions: CBT for depression in clinical practice might be equally effective as manual-based treatments in RCTs when they are applied to comparable patients. The fact that similar effects under routine conditions were reached with more sessions, however, points to the potential to optimize treatments in clinical practice with respect to their efficiency.

Total disc arthroplasty versus anterior cervical interbody fusion: use of the Spine Tango registry to supplement the evidence from randomized control trials.

BACKGROUND CONTEXT Several randomized controlled trials (RCTs) have compared patient outcomes of anterior (cervical) interbody fusion (AIF) with those of total disc arthroplasty (TDA). Because RCTs have known limitations with regard to their external validity, the comparative effectiveness of the two therapies in daily practice remains unknown. PURPOSE This study aimed to compare patient-reported outcomes after TDA versus AIF based on data from an international spine registry. STUDY DESIGN AND SETTING A retrospective analysis of registry data was carried out. PATIENT SAMPLE Inclusion criteria were degenerative disc or disc herniation of the cervical spine treated by single-level TDA or AIF, no previous surgery, and a Core Outcome Measures Index (COMI) completed at baseline and at least 3 months' follow-up. Overall, 987 patients were identified. OUTCOME MEASURES Neck and arm pain relief and COMI score improvement were the outcome measures. METHODS Three separate analyses were performed to compare TDA and AIF surgical outcomes: (1) mimicking an RCT setting, with admission criteria typical of those in published RCTs, a 1:1 matched analysis was carried out in 739 patients; (2) an analysis was performed on 248 patients outside the classic RCT spectrum, that is, with one or more typical RCT exclusion criteria; (3) a subgroup analysis of all patients with additional follow-up longer than 2 years (n=149). RESULTS Matching resulted in 190 pairs with an average follow-up of 17 months that had no residual significant differences for any patient characteristics. Small but statistically significant differences in outcome were observed in favor of TDA, which are potentially clinically relevant. Subgroup analyses of atypical patients and of patients with longer-term follow-up showed no significant differences in outcome between the treatments. CONCLUSIONS The results of this observational study were in accordance with those of the published RCTs, suggesting substantial pain reduction both after AIF and TDA, with slightly greater benefit after arthroplasty. The analysis of atypical patients suggested that, in patients outside the spectrum of clinical trials, both surgical interventions appeared to work to a similar extent to that shown for the cohort in the matched study. Also, in the longer-term perspective, both therapies resulted in similar benefits to the patients.

Bayesian doubly optimal group sequential designs for randomized clinical trials

When conducting a randomized comparative clinical trial, ethical, scientific or economic considerations often motivate the use of interim decision rules after successive groups of patients have been treated. These decisions may pertain to the comparative efficacy or safety of the treatments under study, cost considerations, the desire to accelerate the drug evaluation process, or the likelihood of therapeutic benefit for future patients. At the time of each interim decision, an important question is whether patient enrollment should continue or be terminated; either due to a high probability that one treatment is superior to the other, or a low probability that the experimental treatment will ultimately prove to be superior. The use of frequentist group sequential decision rules has become routine in the conduct of phase III clinical trials. In this dissertation, we will present a new Bayesian decision-theoretic approach to the problem of designing a randomized group sequential clinical trial, focusing on two-arm trials with time-to-failure outcomes. Forward simulation is used to obtain optimal decision boundaries for each of a set of possible models. At each interim analysis, we use Bayesian model selection to adaptively choose the model having the largest posterior probability of being correct, and we then make the interim decision based on the boundaries that are optimal under the chosen model. We provide a simulation study to compare this method, which we call Bayesian Doubly Optimal Group Sequential (BDOGS), to corresponding frequentist designs using either O'Brien-Fleming (OF) or Pocock boundaries, as obtained from EaSt 2000. Our simulation results show that, over a wide variety of different cases, BDOGS either performs at least as well as both OF and Pocock, or on average provides a much smaller trial. ^

Outcome-based adaptive randomization for binary data in clinical trials---Compare and contrast

Monte Carlo simulation has been conducted to investigate parameter estimation and hypothesis testing in some well known adaptive randomization procedures. The four urn models studied are Randomized Play-the-Winner (RPW), Randomized Pôlya Urn (RPU), Birth and Death Urn with Immigration (BDUI), and Drop-the-Loses Urn (DL). Two sequential estimation methods, the sequential maximum likelihood estimation (SMLE) and the doubly adaptive biased coin design (DABC), are simulated at three optimal allocation targets that minimize the expected number of failures under the assumption of constant variance of simple difference (RSIHR), relative risk (ORR), and odds ratio (OOR) respectively. Log likelihood ratio test and three Wald-type tests (simple difference, log of relative risk, log of odds ratio) are compared in different adaptive procedures. ^ Simulation results indicates that although RPW is slightly better in assigning more patients to the superior treatment, the DL method is considerably less variable and the test statistics have better normality. When compared with SMLE, DABC has slightly higher overall response rate with lower variance, but has larger bias and variance in parameter estimation. Additionally, the test statistics in SMLE have better normality and lower type I error rate, and the power of hypothesis testing is more comparable with the equal randomization. Usually, RSIHR has the highest power among the 3 optimal allocation ratios. However, the ORR allocation has better power and lower type I error rate when the log of relative risk is the test statistics. The number of expected failures in ORR is smaller than RSIHR. It is also shown that the simple difference of response rates has the worst normality among all 4 test statistics. The power of hypothesis test is always inflated when simple difference is used. On the other hand, the normality of the log likelihood ratio test statistics is robust against the change of adaptive randomization procedures. ^