A practical approach to a multi-level analysis with a sparse binary outcome within a large surgical trial

Objectives: To assess the potential source of variation that surgeon may add to patient outcome in a clinical trial of surgical procedures. Methods: Two large (n = 1380) parallel multicentre randomized surgical trials were undertaken to compare laparoscopically assisted hysterectomy with conventional methods of abdominal and vaginal hysterectomy; involving 43 surgeons. The primary end point of the trial was the occurrence of at least one major complication. Patients were nested within surgeons giving the data set a hierarchical structure. A total of 10% of patients had at least one major complication, that is, a sparse binary outcome variable. A linear mixed logistic regression model (with logit link function) was used to model the probability of a major complication, with surgeon fitted as a random effect. Models were fitted using the method of maximum likelihood in SAS((R)). Results: There were many convergence problems. These were resolved using a variety of approaches including; treating all effects as fixed for the initial model building; modelling the variance of a parameter on a logarithmic scale and centring of continuous covariates. The initial model building process indicated no significant 'type of operation' across surgeon interaction effect in either trial, the 'type of operation' term was highly significant in the abdominal trial, and the 'surgeon' term was not significant in either trial. Conclusions: The analysis did not find a surgeon effect but it is difficult to conclude that there was not a difference between surgeons. The statistical test may have lacked sufficient power, the variance estimates were small with large standard errors, indicating that the precision of the variance estimates may be questionable.

Refinement of the Clinical Scenario Evaluation Framework for Assessment of Competing Development Strategies with an Application to Multiple Sclerosis

When competing strategies for development programs, clinical trial designs, or data analysis methods exist, the alternatives need to be evaluated in a systematic way to facilitate informed decision making. Here we describe a refinement of the recently proposed clinical scenario evaluation framework for the assessment of competing strategies. The refinement is achieved by subdividing key elements previously proposed into new categories, distinguishing between quantities that can be estimated from preexisting data and those that cannot and between aspects under the control of the decision maker from those that are determined by external constraints. The refined framework is illustrated by an application to a design project for an adaptive seamless design for a clinical trial in progressive multiple sclerosis.

Randomized controlled trial of full and brief cognitive-behaviour therapy and wait-list for paediatric obsessive-compulsive disorder

Background: Reviews and practice guidelines for paediatric obsessive-compulsive disorder (OCD) recommend cognitive-behaviour therapy (CBT) as the psychological treatment of choice, but note that it has not been sufficiently evaluated for children and adolescents and that more randomized controlled trials are needed. The aim of this trial was to evaluate effectiveness and optimal delivery of CBT, emphasizing cognitive interventions. Methods: A total of 96 children and adolescents with OCD were randomly allocated to the three conditions each of approximately 12 weeks duration: full CBT (average therapist contact: 12 sessions) and brief CBT (average contact: 5 sessions, with use of therapist-guided workbooks), and wait-list/delayed treatment. The primary outcome measure was the child version of the semi-structured interviewer-based Yale-Brown Obsessive Compulsive Scale. Clinical Trial registration: http://www.controlled-trials.com/ISRCTN/; unique identifier: ISRCTN29092580. Results: There was statistically significant symptomatic improvement in both treatment groups compared with the wait-list group, with no significant differences in outcomes between the two treatment groups. Controlled treatment effect sizes in intention-to-treat analyses were 2.2 for full CBT and 1.6 for brief CBT. Improvements were maintained at follow-up an average of 14 weeks later. Conclusions: The findings demonstrate the benefits of CBT emphasizing cognitive interventions for children and adolescents with OCD and suggest that relatively lower therapist intensity delivery with use of therapist-guided workbooks is an efficient mode of delivery.

A comparison of methods for treatment selection in seamless phase II/III clinical trials incorporating information on short-term endpoints

In an adaptive seamless phase II/III clinical trial interim analysis, data are used for treatment selection, enabling resources to be focused on comparison of more effective treatment(s) with a control. In this paper, we compare two methods recently proposed to enable use of short-term endpoint data for decision-making at the interim analysis. The comparison focuses on the power and the probability of correctly identifying the most promising treatment. We show that the choice of method depends on how well short-term data predict the best treatment, which may be measured by the correlation between treatment effects on short- and long-term endpoints.

Improving mood with psychoanalytic and cognitive therapies (IMPACT): a pragmatic effectiveness superiority trial to investigate whether specialised psychological treatment reduces the risk for relapse in adolescents with moderate to severe unipolar depression: study protocol for a randomised controlled trial

Background Up to 70% of adolescents with moderate to severe unipolar major depression respond to psychological treatment plus Fluoxetine (20-50 mg) with symptom reduction and improved social function reported by 24 weeks after beginning treatment. Around 20% of non responders appear treatment resistant and 30% of responders relapse within 2 years. The specific efficacy of different psychological therapies and the moderators and mediators that influence risk for relapse are unclear. The cost-effectiveness and safety of psychological treatments remain poorly evaluated. Methods/Design Improving Mood with Psychoanalytic and Cognitive Therapies, the IMPACT Study, will determine whether Cognitive Behavioural Therapy or Short Term Psychoanalytic Therapy is superior in reducing relapse compared with Specialist Clinical Care. The study is a multicentre pragmatic effectiveness superiority randomised clinical trial: Cognitive Behavioural Therapy consists of 20 sessions over 30 weeks, Short Term Psychoanalytic Psychotherapy 30 sessions over 30 weeks and Specialist Clinical Care 12 sessions over 20 weeks. We will recruit 540 patients with 180 randomised to each arm. Patients will be reassessed at 6, 12, 36, 52 and 86 weeks. Methodological aspects of the study are systematic recruitment, explicit inclusion criteria, reliability checks of assessments with control for rater shift, research assessors independent of treatment team and blind to randomization, analysis by intention to treat, data management using remote data entry, measures of quality assurance, advanced statistical analysis, manualised treatment protocols, checks of adherence and competence of therapists and assessment of cost-effectiveness. We will also determine whether time to recovery and/or relapse are moderated by variations in brain structure and function and selected genetic and hormone biomarkers taken at entry. Discussion The objective of this clinical trial is to determine whether there are specific effects of specialist psychotherapy that reduce relapse in unipolar major depression in adolescents and thereby costs of treatment to society. We also anticipate being able to utilise psychotherapy experience, neuroimaging, genetic and hormone measures to reveal what techniques and their protocols may work best for which patients.

The double triangular test in practice

The double triangular test was introduced twenty years ago, and the purpose of this paper is to review applications that have been made since then. In fact, take-up of the method was rather slow until the late 1990s, but in recent years several clinical trial reports have been published describing its use in a wide range of therapeutic areas. The core of this paper is a detailed account of five trials that have been published since 2000 in which the method was applied to studies of pancreatic cancer, breast cancer, myocardial infarction, epilepsy and bedsores. Before those accounts are given, the method is described and the history behind its evolution is presented. The future potential of the method for sequential case-control and equivalence trials is also discussed. Copyright © 2004 John Wiley & Sons, Ltd.

Point estimates and confidence regions for sequential trials involving selection

A number of authors have proposed clinical trial designs involving the comparison of several experimental treatments with a control treatment in two or more stages. At the end of the first stage, the most promising experimental treatment is selected, and all other experimental treatments are dropped from the trial. Provided it is good enough, the selected experimental treatment is then compared with the control treatment in one or more subsequent stages. The analysis of data from such a trial is problematic because of the treatment selection and the possibility of stopping at interim analyses. These aspects lead to bias in the maximum-likelihood estimate of the advantage of the selected experimental treatment over the control and to inaccurate coverage for the associated confidence interval. In this paper, we evaluate the bias of the maximum-likelihood estimate and propose a bias-adjusted estimate. We also propose an approach to the construction of a confidence region for the vector of advantages of the experimental treatments over the control based on an ordering of the sample space. These regions are shown to have accurate coverage, although they are also shown to be necessarily unbounded. Confidence intervals for the advantage of the selected treatment are obtained from the confidence regions and are shown to have more accurate coverage than the standard confidence interval based upon the maximum-likelihood estimate and its asymptotic standard error.

A practical comparison of group-sequential and adaptive designs

Sequential methods provide a formal framework by which clinical trial data can be monitored as they accumulate. The results from interim analyses can be used either to modify the design of the remainder of the trial or to stop the trial as soon as sufficient evidence of either the presence or absence of a treatment effect is available. The circumstances under which the trial will be stopped with a claim of superiority for the experimental treatment, must, however, be determined in advance so as to control the overall type I error rate. One approach to calculating the stopping rule is the group-sequential method. A relatively recent alternative to group-sequential approaches is the adaptive design method. This latter approach provides considerable flexibility in changes to the design of a clinical trial at an interim point. However, a criticism is that the method by which evidence from different parts of the trial is combined means that a final comparison of treatments is not based on a sufficient statistic for the treatment difference, suggesting that the method may lack power. The aim of this paper is to compare two adaptive design approaches with the group-sequential approach. We first compare the form of the stopping boundaries obtained using the different methods. We then focus on a comparison of the power of the different trials when they are designed so as to be as similar as possible. We conclude that all methods acceptably control type I error rate and power when the sample size is modified based on a variance estimate, provided no interim analysis is so small that the asymptotic properties of the test statistic no longer hold. In the latter case, the group-sequential approach is to be preferred. Provided that asymptotic assumptions hold, the adaptive design approaches control the type I error rate even if the sample size is adjusted on the basis of an estimate of the treatment effect, showing that the adaptive designs allow more modifications than the group-sequential method.

A score test for binary data with patient non-compliance

A score test is developed for binary clinical trial data, which incorporates patient non-compliance while respecting randomization. It is assumed in this paper that compliance is all-or-nothing, in the sense that a patient either accepts all of the treatment assigned as specified in the protocol, or none of it. Direct analytic comparisons of the adjusted test statistic for both the score test and the likelihood ratio test are made with the corresponding test statistics that adhere to the intention-to-treat principle. It is shown that no gain in power is possible over the intention-to-treat analysis, by adjusting for patient non-compliance. Sample size formulae are derived and simulation studies are used to demonstrate that the sample size approximation holds. Copyright © 2003 John Wiley & Sons, Ltd.

Estimation following selection of the largest of two normal means

This paper considers the problem of estimation when one of a number of populations, assumed normal with known common variance, is selected on the basis of it having the largest observed mean. Conditional on selection of the population, the observed mean is a biased estimate of the true mean. This problem arises in the analysis of clinical trials in which selection is made between a number of experimental treatments that are compared with each other either with or without an additional control treatment. Attempts to obtain approximately unbiased estimates in this setting have been proposed by Shen [2001. An improved method of evaluating drug effect in a multiple dose clinical trial. Statist. Medicine 20, 1913–1929] and Stallard and Todd [2005. Point estimates and confidence regions for sequential trials involving selection. J. Statist. Plann. Inference 135, 402–419]. This paper explores the problem in the simple setting in which two experimental treatments are compared in a single analysis. It is shown that in this case the estimate of Stallard and Todd is the maximum-likelihood estimate (m.l.e.), and this is compared with the estimate proposed by Shen. In particular, it is shown that the m.l.e. has infinite expectation whatever the true value of the mean being estimated. We show that there is no conditionally unbiased estimator, and propose a new family of approximately conditionally unbiased estimators, comparing these with the estimators suggested by Shen.

Virtual reality Post Traumatic Stress Disorder (PTSD) exposure therapy results with active duty Iraq war combatants

Post Traumatic Stress Disorder (PTSD) is reported to be caused by traumatic events that are outside the range of usual human experience including (but not limited to) military combat, violent personal assault, being kidnapped or taken hostage and terrorist attacks. Initial data suggests that at least 1 out of 6 Iraq War veterans are exhibiting symptoms of depression, anxiety and PTSD. Virtual Reality (VR) delivered exposure therapy for PTSD has been used with reports of positive outcomes. The aim of the current paper is to present the rationale and brief description of a Virtual Iraq PTSD VR therapy application and present initial findings from its use with PTSD patients. Thus far, Virtual Iraq consists of a series of customizable virtual scenarios designed to represent relevant Middle Eastern VR contexts for exposure therapy, including a city and desert road convoy environment. User-centered design feedback needed to iteratively evolve the system was gathered from returning Iraq War veterans in the USA and from a system deployed in Iraq and tested by an Army Combat Stress Control Team. Results from an open clinical trial at San Diego Naval Medical Center of the first 18 treatment completers indicate that 14 no longer meet PTSD diagnostic criteria at post-treatment, with only one not maintaining treatment gains at 3 month follow-up. Clinical tests are also currently underway at Ft. Lewis, Emory University, Weill Cornell Medical College, Walter Reed Army Medical Center and 10 other sites. Other sites are preparing to use the application for a variety of PTSD and VR research purposes.

Multivariate analysis of the Fugl-Meyer outcome measures assessing the effectiveness of GENTLE/S robot-mediated stroke therapy

Background: Robot-mediated therapies offer entirely new approaches to neurorehabilitation. In this paper we present the results obtained from trialling the GENTLE/S neurorehabilitation system assessed using the upper limb section of the Fugl-Meyer ( FM) outcome measure. Methods: We demonstrate the design of our clinical trial and its results analysed using a novel statistical approach based on a multivariate analytical model. This paper provides the rational for using multivariate models in robot-mediated clinical trials and draws conclusions from the clinical data gathered during the GENTLE/S study. Results: The FM outcome measures recorded during the baseline ( 8 sessions), robot-mediated therapy ( 9 sessions) and sling-suspension ( 9 sessions) was analysed using a multiple regression model. The results indicate positive but modest recovery trends favouring both interventions used in GENTLE/S clinical trial. The modest recovery shown occurred at a time late after stroke when changes are not clinically anticipated. Conclusion: This study has applied a new method for analysing clinical data obtained from rehabilitation robotics studies. While the data obtained during the clinical trial is of multivariate nature, having multipoint and progressive nature, the multiple regression model used showed great potential for drawing conclusions from this study. An important conclusion to draw from this paper is that this study has shown that the intervention and control phase both caused changes over a period of 9 sessions in comparison to the baseline. This might indicate that use of new challenging and motivational therapies can influence the outcome of therapies at a point when clinical changes are not expected. Further work is required to investigate the effects arising from early intervention, longer exposure and intensity of the therapies. Finally, more function-oriented robot-mediated therapies or sling-suspension therapies are needed to clarify the effects resulting from each intervention for stroke recovery.

Phytocannabinoids as novel therapeutic agents in CNS disorders

The Cannabis sativa herb contains over 100 phytocannabinoid (pCB) compounds and has been used for thousands of years for both recreational and medicinal purposes. In the past two decades, characterisation of the body's endogenous cannabinoid (CB) (endocannabinoid, eCB) system (ECS) has highlighted activation of central CB1 receptors by the major pCB, Δ9-tetrahydrocannabinol (Δ9-THC) as the primary mediator of the psychoactive, hyperphagic and some of the potentially therapeutic properties of ingested cannabis. Whilst Δ9-THC is the most prevalent and widely studied pCB, it is also the predominant psychotropic component of cannabis, a property that likely limits its widespread therapeutic use as an isolated agent. In this regard, research focus has recently widened to include other pCBs including cannabidiol (CBD), cannabigerol (CBG), Δ9tetrahydrocannabivarin (Δ9-THCV) and cannabidivarin (CBDV), some of which show potential as therapeutic agents in preclinical models of CNS disease. Moreover, it is becoming evident that these non-Δ9-THC pCBs act at a wide range of pharmacological targets, not solely limited to CB receptors. Disorders that could be targeted include epilepsy, neurodegenerative diseases, affective disorders and the central modulation of feeding behaviour. Here, we review pCB effects in preclinical models of CNS disease and, where available, clinical trial data that support therapeutic effects. Such developments may soon yield the first non-Δ9-THC pCB-based medicines.

Modeling data with structural and temporal correlation using lower level and higher level multilevel models

Novel imaging techniques are playing an increasingly important role in drug development, providing insight into the mechanism of action of new chemical entities. The data sets obtained by these methods can be large with complex inter-relationships, but the most appropriate statistical analysis for handling this data is often uncertain - precisely because of the exploratory nature of the way the data are collected. We present an example from a clinical trial using magnetic resonance imaging to assess changes in atherosclerotic plaques following treatment with a tool compound with established clinical benefit. We compared two specific approaches to handle the correlations due to physical location and repeated measurements: two-level and four-level multilevel models. The two methods identified similar structural variables, but higher level multilevel models had the advantage of explaining a greater proportion of variation, and the modeling assumptions appeared to be better satisfied.

Virtual reality Post Traumatic Stress Disorder (PTSD) exposure therapy results with active duty OIF/OEF service members

Posttraumatic stress disorder (PTSD) is reported to be caused by exposure to traumatic events including (but not limited to) military combat, violent personal assault, being kidnapped or taken hostage and terrorist attacks. Initial data suggest that at least 1 out of 6 Iraq War veterans are exhibiting symptoms of depression, anxiety and PTSD. Virtual reality (VR) delivered exposure therapy for PTSD has been used with reports of positive outcomes. The aim of the current paper, is to present the rationale and brief description of a Virtual Iraq/Afghanistan PTSD VR therapy application and present initial findings from its use with PTSD patients. Thus far, Virtual Iraq/Afghanistan consists of a series of customizable virtual scenarios designed to represent relevant Middle Eastern VR contexts for exposure therapy, including a city and desert road convoy environment. User-centered design feedback, needed to iteratively evolve the system, was gathered from returning Iraq War veterans in the USA and from a system deployed in Iraq and tested by an Army Combat Stress Control Team. Results from an open clinical trial at San Diego Naval Medical Center of the first 20 treatment completers indicate that 16 no longer met PTSD screening criteria at post-treatment, with only one not maintaining treatment gains at 3 month follow-up.