An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES: To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING: We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS: Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION: Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.

A Psychosocial Approach to Understanding Causality Assessment in Early Phase Oncology Clinical Trials: A Phenomenological Study

Research Question: What are the psychosocial factors that affect causality assessment in early phase oncology clinical trials? Methods: Thirty-two qualitative interviews were explicated with the aid of “Naturalistic Decision Making”. Data explication consisted of phenomenological reduction, delineating and clustering meaning units, forming themes, and creating a composite summary. Participants were members of the National Cancer Institute of Canada’s Clinical Trial Group Investigative New Drug committee. Results: The process of assigning causality is extremely subjective and full of uncertainty. Physicians had no formal training, nor a tool to assist them with this process. Physicians were apprehensive about their decisions and felt pressure from their patients, as well as the pharmaceutical companies sponsoring the trial. Conclusions: There are many problem areas when attributing causality, all of which have serious consequences, but clinicians used a variety of methods to cope with these problem areas.

An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.

A simulation study using the hybrid statistic and the meta-analysis t-test for data with matched and unmatched subjects in the interim analysis of clinical trials

An interim analysis is usually applied in later phase II or phase III trials to find convincing evidence of a significant treatment difference that may lead to trial termination at an earlier point than planned at the beginning. This can result in the saving of patient resources and shortening of drug development and approval time. In addition, ethics and economics are also the reasons to stop a trial earlier. In clinical trials of eyes, ears, knees, arms, kidneys, lungs, and other clustered treatments, data may include distribution-free random variables with matched and unmatched subjects in one study. It is important to properly include both subjects in the interim and the final analyses so that the maximum efficiency of statistical and clinical inferences can be obtained at different stages of the trials. So far, no publication has applied a statistical method for distribution-free data with matched and unmatched subjects in the interim analysis of clinical trials. In this simulation study, the hybrid statistic was used to estimate the empirical powers and the empirical type I errors among the simulated datasets with different sample sizes, different effect sizes, different correlation coefficients for matched pairs, and different data distributions, respectively, in the interim and final analysis with 4 different group sequential methods. Empirical powers and empirical type I errors were also compared to those estimated by using the meta-analysis t-test among the same simulated datasets. Results from this simulation study show that, compared to the meta-analysis t-test commonly used for data with normally distributed observations, the hybrid statistic has a greater power for data observed from normally, log-normally, and multinomially distributed random variables with matched and unmatched subjects and with outliers. Powers rose with the increase in sample size, effect size, and correlation coefficient for the matched pairs. In addition, lower type I errors were observed estimated by using the hybrid statistic, which indicates that this test is also conservative for data with outliers in the interim analysis of clinical trials.^

Registration of clinical trials: Challenges for global regulation

In 2004 the International Committee of Medical Journal Editors (ICMJE) issued a statement indicating that from 1 July 2005 registration in a publicly accessible trials registry would be a condition of publication in an ICMJE member journal. The World Health Organisation is coordinating the International Clinical Trials Registry Platform (ICTRP) as a means of providing a standardised framework for registration. This article considers the practical challenges and opportunities that arise from these developments and considers the relevance of trial registration for women and minorities and for developing countries.

After 10 years of clinical trials with liraglutide, do we know whether it is beneficial in diabetes?

Type 2 diabetes remains an escalating world-wide problem, despite a range of treatments. The revelation that insulin secretion is under the control of a gut hormone, glucagon-like peptide 1 (GLP-1), led to a new paradigm in the management of type 2 diabetes. Liraglutide is a long acting GLP-1 receptor agonist used in the treatment of type 2 diabetes. The review considers the clinical trials with liraglutide. There are many comparator trials between liraglutide and other medicines for the treatment of type 2 diabetes, and these trials have shown that liraglutide lowers HbA1c and body weight, and is well tolerated. A large cardiovascular safety trial with liraglutide is presently being undertaken. After 10 years of clinical trials with liraglutide, we do not know whether liraglutide has cardiovascular safety in subjects with type 2 diabetes and high cardiovascular risk. Although this is not a requirement for registration by the Food and Drug Administration (FDA), in my opinion, they should reconsider this. We also do not presently know whether liraglutide has any beneficial effects on clinical cardiovascular outcomes.

Economic return of clinical trials performed under the pediatric exclusivity program.

CONTEXT: In 1997, Congress authorized the US Food and Drug Administration (FDA) to grant 6-month extensions of marketing rights through the Pediatric Exclusivity Program if industry sponsors complete FDA-requested pediatric trials. The program has been praised for creating incentives for studies in children and has been criticized as a "windfall" to the innovator drug industry. This critique has been a substantial part of congressional debate on the program, which is due to expire in 2007. OBJECTIVE: To quantify the economic return to industry for completing pediatric exclusivity trials. DESIGN AND SETTING: A cohort study of programs conducted for pediatric exclusivity. Nine drugs that were granted pediatric exclusivity were selected. From the final study reports submitted to the FDA (2002-2004), key elements of the clinical trial design and study operations were obtained, and the cost of performing each study was estimated and converted into estimates of after-tax cash outflows. Three-year market sales were obtained and converted into estimates of after-tax cash inflows based on 6 months of additional market protection. Net economic return (cash inflows minus outflows) and net return-to-costs ratio (net economic return divided by cash outflows) for each product were then calculated. MAIN OUTCOME MEASURES: Net economic return and net return-to-cost ratio. RESULTS: The indications studied reflect a broad representation of the program: asthma, tumors, attention-deficit/hyperactivity disorder, hypertension, depression/generalized anxiety disorder, diabetes mellitus, gastroesophageal reflux, bacterial infection, and bone mineralization. The distribution of net economic return for 6 months of exclusivity varied substantially among products (net economic return ranged from -$8.9 million to $507.9 million and net return-to-cost ratio ranged from -0.68 to 73.63). CONCLUSIONS: The economic return for pediatric exclusivity is variable. As an incentive to complete much-needed clinical trials in children, pediatric exclusivity can generate lucrative returns or produce more modest returns on investment.

The addition of arsenic trioxide to low-dose Ara-C in older patients with AML does not improve outcome

Most patients with acute myeloid leukaemia (AML) are older, with many unsuitable for conventional chemotherapy. Low-dose Ara-C (LDAC) is superior to best supportive care but is still inadequate. The combination of arsenic trioxide (ATO) and LDAC showed promise in an unrandomised study. We report a randomised trial of LDAC versus LDAC + ATO. Patients with AML according to WHO criteria or myelodysplastic syndrome with > 10% blasts, considered as unfit for conventional chemotherapy, were randomised between subcutaneous Ara-C (20mg b.d. for 10 days) and the same LDAC schedule with ATO (0.25 mg/kg) on days 1-5, 9 and 11, for at least four courses every 4 to 6 weeks. Overall 166 patients were entered; the trial was terminated on the advice of the DMC, as the projected benefit was not observed. Overall 14% of patients achieved complete remission (CR) and 7% CRi. Median survival was 5.5 months and 19 months for responders (CR: not reached; CRi: 14 months; non-responders: 4 months). There were no differences in response or survival between the arms. Grade 3/4 cardiac and liver toxicity, and supportive care requirements were greater in the ATO arm. This randomised comparison demonstrates that adding ATO to LDAC provides no benefit for older patients with AML. Leukemia (2011) 25, 1122-1127; doi:10.1038/leu.2011.59; published online 8 April 2011

Methodologic rigor of clinical trials on surgical management of eyes with coexisting cataract and glaucoma.

OBJECTIVE:

To assess the methodologic quality of published studies of the surgical management of coexisting cataract and glaucoma.

DESIGN:

Literature review and analysis.

METHOD:

We performed a systematic search of the literature to identify all English language articles pertaining to the surgical management of coexisting cataract and glaucoma in adults. Quality assessment was performed on all randomized controlled trials, nonrandomized controlled trials, and cohort studies. Overall quality scores and scores for individual methodologic domains were based on the evaluations of two experienced investigators who independently reviewed articles using an objective quality assessment form.

MAIN OUTCOME MEASURES:

Quality in each of five domains (representativeness, bias and confounding, intervention description, outcomes and follow-up, and statistical quality and interpretation) measured as the percentage of methodologic criteria met by each study.

RESULTS:

Thirty-six randomized controlled trials and 45 other studies were evaluated. The mean quality score for the randomized, controlled clinical trials was 63% (range, 11%-88%), and for the other studies the score was 45% (range, 3%-83%). The mean domain scores were 65% for description of therapy (range, 0%-100%), 62% for statistical analysis (range, 0%-100%), 58% for representativeness (range, 0%-94%), 49% for outcomes assessment (range, 0%-83%), and 30% for bias and confounding (range, 0%-83%). Twenty-five of the studies (31%) received a score of 0% in the bias and confounding domain for not randomizing patients, not masking the observers to treatment group, and not having equivalent groups at baseline.

CONCLUSIONS:

Greater methodologic rigor and more detailed reporting of study results, particularly in the area of bias and confounding, could improve the quality of published clinical studies assessing the surgical management of coexisting cataract and glaucoma.

A comparison of three different models for estimating relative risk in meta-analysis of clinical trials under unobserved heterogeneity

We focus on the comparison of three statistical models used to estimate the treatment effect in metaanalysis when individually pooled data are available. The models are two conventional models, namely a multi-level and a model based upon an approximate likelihood, and a newly developed model, the profile likelihood model which might be viewed as an extension of the Mantel-Haenszel approach. To exemplify these methods, we use results from a meta-analysis of 22 trials to prevent respiratory tract infections. We show that by using the multi-level approach, in the case of baseline heterogeneity, the number of clusters or components is considerably over-estimated. The approximate and profile likelihood method showed nearly the same pattern for the treatment effect distribution. To provide more evidence two simulation studies are accomplished. The profile likelihood can be considered as a clear alternative to the approximate likelihood model. In the case of strong baseline heterogeneity, the profile likelihood method shows superior behaviour when compared with the multi-level model. Copyright (C) 2006 John Wiley & Sons, Ltd.

A quantitative and qualitative evaluation of reports of clinical trials published in six Brazilian dental journals indexed in the Scientific Electronic Library Online (SciELO)

Introduction: Open access publishing is becoming increasingly popular within the biomedical sciences. SciELO, the Scientific Electronic Library Online, is a digital library covering a selected collection of Brazilian scientific journals many of which provide open access to full-text articles. This library includes a number of dental journals some of which may include reports of clinical trials in English, Portuguese and/or Spanish. Thus, SciELO could play an important role as a source of evidence for dental healthcare interventions especially if it yields a sizeable number of high quality reports. Objective: The aim of this study was to identify reports of clinical trials by handsearching of dental journals that are accessible through SciELO, and to assess the overall quality of these reports. Material and methods: Electronic versions of six Brazilian dental Journals indexed in SciELO were handsearched at www.scielo.br in September 2008. Reports of clinical trials were identified and classified as controlled clinical trials (CCTs - prospective, experimental studies comparing 2 or more healthcare interventions in human beings) or randomized controlled trials (RCTs - a random allocation method is clearly reported), according to Cochrane eligibility criteria. Criteria to assess methodological quality included: method of randomization, concealment of treatment allocation, blinded outcome assessment, handling of withdrawals and losses and whether an intention-to-treat analysis had been carried out. Results: The search retrieved 33 CCTs and 43 RCTs. A majority of the reports provided no description of either the method of randomization (75.3%) or concealment of the allocation sequence (84.2%). Participants and outcome assessors were reported as blinded in only 31.2% of the reports. Withdrawals and losses were only clearly described in 6.5% of the reports and none mentioned an intention-to-treat analysis or any similar procedure. Conclusions: The results of this study indicate that a substantial number of reports of trials and systematic reviews are available in the dental journals listed in SciELO, and that these could provide valuable evidence for clinical decision making. However, it is clear that the quality of a number of these reports is of some concern and that improvement in the conduct and reporting of these trials could be achieved if authors adhered to internationally accepted guidelines, e. g. the CONSORT statement.