A practical approach to a multi-level analysis with a sparse binary outcome within a large surgical trial

Objectives: To assess the potential source of variation that surgeon may add to patient outcome in a clinical trial of surgical procedures. Methods: Two large (n = 1380) parallel multicentre randomized surgical trials were undertaken to compare laparoscopically assisted hysterectomy with conventional methods of abdominal and vaginal hysterectomy; involving 43 surgeons. The primary end point of the trial was the occurrence of at least one major complication. Patients were nested within surgeons giving the data set a hierarchical structure. A total of 10% of patients had at least one major complication, that is, a sparse binary outcome variable. A linear mixed logistic regression model (with logit link function) was used to model the probability of a major complication, with surgeon fitted as a random effect. Models were fitted using the method of maximum likelihood in SAS((R)). Results: There were many convergence problems. These were resolved using a variety of approaches including; treating all effects as fixed for the initial model building; modelling the variance of a parameter on a logarithmic scale and centring of continuous covariates. The initial model building process indicated no significant 'type of operation' across surgeon interaction effect in either trial, the 'type of operation' term was highly significant in the abdominal trial, and the 'surgeon' term was not significant in either trial. Conclusions: The analysis did not find a surgeon effect but it is difficult to conclude that there was not a difference between surgeons. The statistical test may have lacked sufficient power, the variance estimates were small with large standard errors, indicating that the precision of the variance estimates may be questionable.

Refinement of the Clinical Scenario Evaluation Framework for Assessment of Competing Development Strategies with an Application to Multiple Sclerosis

When competing strategies for development programs, clinical trial designs, or data analysis methods exist, the alternatives need to be evaluated in a systematic way to facilitate informed decision making. Here we describe a refinement of the recently proposed clinical scenario evaluation framework for the assessment of competing strategies. The refinement is achieved by subdividing key elements previously proposed into new categories, distinguishing between quantities that can be estimated from preexisting data and those that cannot and between aspects under the control of the decision maker from those that are determined by external constraints. The refined framework is illustrated by an application to a design project for an adaptive seamless design for a clinical trial in progressive multiple sclerosis.

Randomized controlled trial of full and brief cognitive-behaviour therapy and wait-list for paediatric obsessive-compulsive disorder

Background: Reviews and practice guidelines for paediatric obsessive-compulsive disorder (OCD) recommend cognitive-behaviour therapy (CBT) as the psychological treatment of choice, but note that it has not been sufficiently evaluated for children and adolescents and that more randomized controlled trials are needed. The aim of this trial was to evaluate effectiveness and optimal delivery of CBT, emphasizing cognitive interventions. Methods: A total of 96 children and adolescents with OCD were randomly allocated to the three conditions each of approximately 12 weeks duration: full CBT (average therapist contact: 12 sessions) and brief CBT (average contact: 5 sessions, with use of therapist-guided workbooks), and wait-list/delayed treatment. The primary outcome measure was the child version of the semi-structured interviewer-based Yale-Brown Obsessive Compulsive Scale. Clinical Trial registration: http://www.controlled-trials.com/ISRCTN/; unique identifier: ISRCTN29092580. Results: There was statistically significant symptomatic improvement in both treatment groups compared with the wait-list group, with no significant differences in outcomes between the two treatment groups. Controlled treatment effect sizes in intention-to-treat analyses were 2.2 for full CBT and 1.6 for brief CBT. Improvements were maintained at follow-up an average of 14 weeks later. Conclusions: The findings demonstrate the benefits of CBT emphasizing cognitive interventions for children and adolescents with OCD and suggest that relatively lower therapist intensity delivery with use of therapist-guided workbooks is an efficient mode of delivery.

A comparison of methods for treatment selection in seamless phase II/III clinical trials incorporating information on short-term endpoints

In an adaptive seamless phase II/III clinical trial interim analysis, data are used for treatment selection, enabling resources to be focused on comparison of more effective treatment(s) with a control. In this paper, we compare two methods recently proposed to enable use of short-term endpoint data for decision-making at the interim analysis. The comparison focuses on the power and the probability of correctly identifying the most promising treatment. We show that the choice of method depends on how well short-term data predict the best treatment, which may be measured by the correlation between treatment effects on short- and long-term endpoints.

Improving mood with psychoanalytic and cognitive therapies (IMPACT): a pragmatic effectiveness superiority trial to investigate whether specialised psychological treatment reduces the risk for relapse in adolescents with moderate to severe unipolar depression: study protocol for a randomised controlled trial

Background Up to 70% of adolescents with moderate to severe unipolar major depression respond to psychological treatment plus Fluoxetine (20-50 mg) with symptom reduction and improved social function reported by 24 weeks after beginning treatment. Around 20% of non responders appear treatment resistant and 30% of responders relapse within 2 years. The specific efficacy of different psychological therapies and the moderators and mediators that influence risk for relapse are unclear. The cost-effectiveness and safety of psychological treatments remain poorly evaluated. Methods/Design Improving Mood with Psychoanalytic and Cognitive Therapies, the IMPACT Study, will determine whether Cognitive Behavioural Therapy or Short Term Psychoanalytic Therapy is superior in reducing relapse compared with Specialist Clinical Care. The study is a multicentre pragmatic effectiveness superiority randomised clinical trial: Cognitive Behavioural Therapy consists of 20 sessions over 30 weeks, Short Term Psychoanalytic Psychotherapy 30 sessions over 30 weeks and Specialist Clinical Care 12 sessions over 20 weeks. We will recruit 540 patients with 180 randomised to each arm. Patients will be reassessed at 6, 12, 36, 52 and 86 weeks. Methodological aspects of the study are systematic recruitment, explicit inclusion criteria, reliability checks of assessments with control for rater shift, research assessors independent of treatment team and blind to randomization, analysis by intention to treat, data management using remote data entry, measures of quality assurance, advanced statistical analysis, manualised treatment protocols, checks of adherence and competence of therapists and assessment of cost-effectiveness. We will also determine whether time to recovery and/or relapse are moderated by variations in brain structure and function and selected genetic and hormone biomarkers taken at entry. Discussion The objective of this clinical trial is to determine whether there are specific effects of specialist psychotherapy that reduce relapse in unipolar major depression in adolescents and thereby costs of treatment to society. We also anticipate being able to utilise psychotherapy experience, neuroimaging, genetic and hormone measures to reveal what techniques and their protocols may work best for which patients.