BENCHMARKING AND IMPLEMENTATION OF A NEW INDEPENDENT MONTE CARLO DOSE CALCULATION QUALITY ASSURANCE AUDIT TOOL FOR CLINICAL TRIALS

Introduction Commercial treatment planning systems employ a variety of dose calculation algorithms to plan and predict the dose distributions a patient receives during external beam radiation therapy. Traditionally, the Radiological Physics Center has relied on measurements to assure that institutions participating in the National Cancer Institute sponsored clinical trials administer radiation in doses that are clinically comparable to those of other participating institutions. To complement the effort of the RPC, an independent dose calculation tool needs to be developed that will enable a generic method to determine patient dose distributions in three dimensions and to perform retrospective analysis of radiation delivered to patients who enrolled in past clinical trials. Methods A multi-source model representing output for Varian 6 MV and 10 MV photon beams was developed and evaluated. The Monte Carlo algorithm, know as the Dose Planning Method (DPM), was used to perform the dose calculations. The dose calculations were compared to measurements made in a water phantom and in anthropomorphic phantoms. Intensity modulated radiation therapy and stereotactic body radiation therapy techniques were used with the anthropomorphic phantoms. Finally, past patient treatment plans were selected and recalculated using DPM and contrasted against a commercial dose calculation algorithm. Results The multi-source model was validated for the Varian 6 MV and 10 MV photon beams. The benchmark evaluations demonstrated the ability of the model to accurately calculate dose for the Varian 6 MV and the Varian 10 MV source models. The patient calculations proved that the model was reproducible in determining dose under similar conditions described by the benchmark tests. Conclusions The dose calculation tool that relied on a multi-source model approach and used the DPM code to calculate dose was developed, validated, and benchmarked for the Varian 6 MV and 10 MV photon beams. Several patient dose distributions were contrasted against a commercial algorithm to provide a proof of principal to use as an application in monitoring clinical trial activity.

Long-term outcomes of biodegradable versus durable polymer drug-eluting stents in patients with acute ST-segment elevation myocardial infarction: a pooled analysis of individual patient data from three randomised trials

Aims: Arterial plaque rupture and thrombus characterise ST-elevation myocardial infarction (STEMI) and may aggravate delayed arterial healing following durable polymer drug-eluting stent (DP-DES) implantation. Biodegradable polymer (BP) may improve biocompatibility. We compared long-term outcomes in STEMI patients receiving BP-DES vs. durable polymer sirolimus-eluting stents (DP-SES). Methods and results: We pooled individual patient-level data from three randomised clinical trials (ISAR-TEST-3, ISAR-TEST-4 and LEADERS) comparing outcomes from BP-DES with DP-SES at four years. The primary endpoint (MACE) comprised cardiac death, MI, or target lesion revascularisation (TLR). Secondary endpoints were TLR, cardiac death or MI, and definite or probable stent thrombosis. Of 497 patients with STEMI, 291 received BP-DES and 206 DP-SES. At four years, MACE was significantly reduced following treatment with BP-DES (hazard ratio [HR] 0.59, 95% CI: 0.39-0.90; p=0.01) driven by reduced TLR (HR 0.54, 95% CI: 0.30-0.98; p=0.04). Trends towards reduction were seen for cardiac death or MI (HR 0.63, 95% CI: 0.37-1.05; p=0.07) and definite or probable stent thrombosis (3.6% vs. 7.1%; HR 0.49, 95% CI: 0.22-1.11; p=0.09). Conclusions: In STEMI, BP-DES demonstrated superior clinical outcomes to DP-SES at four years. Trends towards reduced cardiac death or myocardial infarction and reduced stent thrombosis require corroboration in specifically powered trials.

Initiation and continuation of randomized trials after the publication of a trial stopped early for benefit asking the same study question: STOPIT-3 study design

BACKGROUND Randomized control trials (RCTs) stopped early for benefit (truncated RCTs) are increasingly common and, on average, overestimate the relative magnitude of benefit by approximately 30%. Investigators stop trials early when they consider it is no longer ethical to enroll patients in a control group. The goal of this systematic review is to determine how investigators of ongoing or planned RCTs respond to the publication of a truncated RCT addressing a similar question. METHODS/DESIGN We will conduct systematic reviews to update the searches of 210 truncated RCTs to identify similar trials ongoing at the time of publication, or started subsequently, to the truncated trials ('subsequent RCTs'). Reviewers will determine in duplicate the similarity between the truncated and subsequent trials. We will analyze the epidemiology, distribution, and predictors of subsequent RCTs. We will also contact authors of subsequent trials to determine reasons for beginning, continuing, or prematurely discontinuing their own trials, and the extent to which they rely on the estimates from truncated trials. DISCUSSION To the extent that investigators begin or continue subsequent trials they implicitly disagree with the decision to stop the truncated RCT because of an ethical mandate to administer the experimental treatment. The results of this study will help guide future decisions about when to stop RCTs early for benefit.

Phase I clinical trials in 56 patients with thyroid cancer: the M. D. Anderson Cancer Center experience.

INTRODUCTION: Thyroid cancer is the most common endocrine malignancy. The outcomes of patients with relapsed thyroid cancer treated on early-phase clinical trials have not been systematically analyzed. PATIENTS AND METHODS: We reviewed the records of consecutive patients with metastatic thyroid cancer referred to the Phase I Clinical Trials Program from March 2006 to April 2008. Best response was assessed by Response Evaluation Criteria in Solid Tumors. RESULTS: Fifty-six patients were identified. The median age was 55 yr (range 35-79 yr). Of 49 patients evaluable for response, nine (18.4%) had a partial response, and 16 (32.7%) had stable disease for 6 months or longer. The median progression-free survival was 1.12 yr. With a median follow-up of 15.6 months, the 1-yr survival rate was 81%. In univariate analysis, factors predicting shorter survival were anaplastic histology (P = 0.0002) and albumin levels less than 3.5 g/dl (P = 0.05). Among 26 patients with tumor decreases, none died (median follow-up 1.3 yr), whereas 52% of patients with any tumor increase died by 1 yr (P = 0.0001). The median time to failure in our phase I clinical trials was 11.5 months vs. 4.1 months for the previous treatment (P = 0.04). CONCLUSION: Patients with advanced thyroid cancer treated on phase I clinical trials had high rates of partial response and prolonged stable disease. Time to failure was significantly longer on the first phase I trial compared with the prior conventional treatment. Patients with any tumor decrease had significantly longer survival than those with any tumor increase.

Is paromomycin an effective and safe treatment against cutaneous leishmaniasis? A meta-analysis of 14 randomized controlled trials.

BACKGROUND: High cost, poor compliance, and systemic toxicity have limited the use of pentavalent antimony compounds (SbV), the treatment of choice for cutaneous leishmaniasis (CL). Paromomycin (PR) has been developed as an alternative to SbV, but existing data are conflicting. METHODOLOGY/PRINCIPAL FINDINGS: We searched PubMed, Scopus, and Cochrane Central Register of Controlled Trials, without language restriction, through August 2007, to identify randomized controlled trials that compared the efficacy or safety between PR and placebo or SbV. Primary outcome was clinical cure, defined as complete healing, disappearance, or reepithelialization of all lesions. Data were extracted independently by two investigators, and pooled using a random-effects model. Fourteen trials including 1,221 patients were included. In placebo-controlled trials, topical PR appeared to have therapeutic activity against the old world and new world CL, with increased local reactions, when used with methylbenzethonium chloride (MBCL) compared to when used alone (risk ratio [RR] for clinical cure, 2.58 versus 1.01: RR for local reactions, 1.60 versus 1.07). In SbV-controlled trials, the efficacy of topical PR was not significantly different from that of intralesional SbV in the old world CL (RR, 0.70; 95% confidence interval, 0.26-1.89), whereas topical PR was inferior to parenteral SbV in treating the new world CL (0.67; 0.54-0.82). No significant difference in efficacy was found between parenteral PR and parenteral SbV in the new world CL (0.88; 0.56-1.38). Systemic side effects were fewer with topical or parenteral PR than parenteral SbV. CONCLUSIONS/SIGNIFICANCE: Topical PR with MBCL could be a therapeutic alternative to SbV in selected cases of the old world CL. Development of new formulations with better efficacy and tolerability remains to be an area of future research.

BAYESIAN PHASE I DOSE FINDING IN CANCER TRIALS

This dissertation explores phase I dose-finding designs in cancer trials from three perspectives: the alternative Bayesian dose-escalation rules, a design based on a time-to-dose-limiting toxicity (DLT) model, and a design based on a discrete-time multi-state (DTMS) model. We list alternative Bayesian dose-escalation rules and perform a simulation study for the intra-rule and inter-rule comparisons based on two statistical models to identify the most appropriate rule under certain scenarios. We provide evidence that all the Bayesian rules outperform the traditional ``3+3'' design in the allocation of patients and selection of the maximum tolerated dose. The design based on a time-to-DLT model uses patients' DLT information over multiple treatment cycles in estimating the probability of DLT at the end of treatment cycle 1. Dose-escalation decisions are made whenever a cycle-1 DLT occurs, or two months after the previous check point. Compared to the design based on a logistic regression model, the new design shows more safety benefits for trials in which more late-onset toxicities are expected. As a trade-off, the new design requires more patients on average. The design based on a discrete-time multi-state (DTMS) model has three important attributes: (1) Toxicities are categorized over a distribution of severity levels, (2) Early toxicity may inform dose escalation, and (3) No suspension is required between accrual cohorts. The proposed model accounts for the difference in the importance of the toxicity severity levels and for transitions between toxicity levels. We compare the operating characteristics of the proposed design with those from a similar design based on a fully-evaluated model that directly models the maximum observed toxicity level within the patients' entire assessment window. We describe settings in which, under comparable power, the proposed design shortens the trial. The proposed design offers more benefit compared to the alternative design as patient accrual becomes slower.

Cancer patients' attitudes toward cancer trials

Background. Accurate measurement of attitudes toward participation in cancer treatment trials (CTs) and cancer prevention trials (CPTs) across varied groups could assist health researchers and educators when addressing attitudinal barriers to participation in these trials. ^ Methods. The Attitudes toward Cancer Trials Scales (ACTS) instrument development was based on a conceptual model developed from research literature, clinical practice experience, and empirical testing of items with a sample of 312 respondents. The ACTS contains two scales, the Cancer Trials (CT) scale (4 components; 18 items) and the Cancer Prevention Trials (CPT) scale (3 components; 16 items). Cronbach's alpha values for the CT and CPT scales, respectively, were 0.86 and 0.89. These two scales along with sociodemographic and cancer trial history variables were distributed in a mail survey of former patients of a large cancer research center. The disproportionate stratified probability sampling procedure yielded 925 usable responses (54% response rate). ^ Results. Prevalence of favorable attitudes toward CTs and CPTs was 66% and 69%, respectively. There were no significant differences in mean scale scores by cancer site or gender, but African Americans had more favorable attitudes toward CTs than European Americans. Multiple regression analysis indicated that older age, lower education level, and prior CT participation history were associated with more favorable attitudes toward CTs. Prior CT participation and prior CPT participation were associated with more favorable attitudes toward CPTs. Results also provided evidence of reliability and construct validity for both scales. ^ Conclusions. Middle age, higher education, and European American ethnicity are associated with less positive attitudes about participating in cancer treatment trials. Availability of a psychometrically sound instrument to measure attitudes may facilitate a better understanding decision making regarding participation in CTs and CPTs. It is this author's intention that the ACTS' scales will be used by other investigators to measure attitudes toward CTs and CPTs in various groups of persons, and that the many issues regarding participation in trials might become more explicit. ^

Effect of nonnormal random components on level and power in group-randomized trials

The use of group-randomized trials is particularly widespread in the evaluation of health care, educational, and screening strategies. Group-randomized trials represent a subset of a larger class of designs often labeled nested, hierarchical, or multilevel and are characterized by the randomization of intact social units or groups, rather than individuals. The application of random effects models to group-randomized trials requires the specification of fixed and random components of the model. The underlying assumption is usually that these random components are normally distributed. This research is intended to determine if the Type I error rate and power are affected when the assumption of normality for the random component representing the group effect is violated. ^ In this study, simulated data are used to examine the Type I error rate, power, bias and mean squared error of the estimates of the fixed effect and the observed intraclass correlation coefficient (ICC) when the random component representing the group effect possess distributions with non-normal characteristics, such as heavy tails or severe skewness. The simulated data are generated with various characteristics (e.g. number of schools per condition, number of students per school, and several within school ICCs) observed in most small, school-based, group-randomized trials. The analysis is carried out using SAS PROC MIXED, Version 6.12, with random effects specified in a random statement and restricted maximum likelihood (REML) estimation specified. The results from the non-normally distributed data are compared to the results obtained from the analysis of data with similar design characteristics but normally distributed random effects. ^ The results suggest that the violation of the normality assumption for the group component by a skewed or heavy-tailed distribution does not appear to influence the estimation of the fixed effect, Type I error, and power. Negative biases were detected when estimating the sample ICC and dramatically increased in magnitude as the true ICC increased. These biases were not as pronounced when the true ICC was within the range observed in most group-randomized trials (i.e. 0.00 to 0.05). The normally distributed group effect also resulted in bias ICC estimates when the true ICC was greater than 0.05. However, this may be a result of higher correlation within the data. ^

Standardized definitions and clinical endpoints in trials investigating endovascular repair of aortic dissections.

OBJECTIVES Endovascular therapy is a rapidly expanding option for the treatment of patients with aortic dissection (AD) and various studies have been published. These trials, however, are often difficult to interpret and compare because they do not utilize uniform clinical endpoint definitions. METHODS The DEFINE Group is a collaborative effort of an ad hoc multidisciplinary team from various specialties involved in AD therapy in Europe and the United States. DEFINE's goal was to arrive at a broad based consensus for baseline and endpoint definitions in trials for endovascular therapy of various vascular pathologies. In this project, which started in December 2006, the individual team members reviewed the existing pertinent literature. Following this, a series of telephone conferences and face-to-face meetings were held to agree upon definitions. Input was also obtained from regulatory (United States Food and Drug Administration) and industry (device manufacturers with an interest in peripheral endovascular revascularization) stakeholders, respectively. RESULTS These efforts resulted in the present document containing proposed baseline and endpoint definitions for clinical and morphological outcomes. Although the consensus has inevitably included certain arbitrary consensus choices and compromises, adherence to these proposed standard definitions would provide consistency across future trials, thereby facilitating evaluation of clinical effectiveness and safety of various endovascular revascularization techniques. CONCLUSIONS This current document is based on a broad based consensus involving relevant stakeholders from the medical community, industry and regulatory bodies. It is proposed that the consensus document may have value for study design of future clinical trials in endovascular AD therapy as well as for regulatory purposes.

Poor Reliability between Cochrane Reviewers and Blinded External Reviewers When Applying the Cochrane Risk of Bias Tool in Physical Therapy Trials

OBJECTIVES To test the inter-rater reliability of the RoB tool applied to Physical Therapy (PT) trials by comparing ratings from Cochrane review authors with those of blinded external reviewers. METHODS Randomized controlled trials (RCTs) in PT were identified by searching the Cochrane Database of Systematic Reviews for meta-analysis of PT interventions. RoB assessments were conducted independently by 2 reviewers blinded to the RoB ratings reported in the Cochrane reviews. Data on RoB assessments from Cochrane reviews and other characteristics of reviews and trials were extracted. Consensus assessments between the two reviewers were then compared with the RoB ratings from the Cochrane reviews. Agreement between Cochrane and blinded external reviewers was assessed using weighted kappa (κ). RESULTS In total, 109 trials included in 17 Cochrane reviews were assessed. Inter-rater reliability on the overall RoB assessment between Cochrane review authors and blinded external reviewers was poor (κ  =  0.02, 95%CI: -0.06, 0.06]). Inter-rater reliability on individual domains of the RoB tool was poor (median κ  = 0.19), ranging from κ  =  -0.04 ("Other bias") to κ  =  0.62 ("Sequence generation"). There was also no agreement (κ  =  -0.29, 95%CI: -0.81, 0.35]) in the overall RoB assessment at the meta-analysis level. CONCLUSIONS Risk of bias assessments of RCTs using the RoB tool are not consistent across different research groups. Poor agreement was not only demonstrated at the trial level but also at the meta-analysis level. Results have implications for decision making since different recommendations can be reached depending on the group analyzing the evidence. Improved guidelines to consistently apply the RoB tool and revisions to the tool for different health areas are needed.

Predictors of adverse events among patients undergoing primary percutaneous coronary intervention: insights from a pooled analysis of the COMFORTABLE AMI and EXAMINATION trials

Aims: The aim of this study was to identify predictors of adverse events among patients with ST-elevation myocardial infarction (STEMI) undergoing contemporary primary percutaneous coronary intervention (PCI). Methods and results: Individual data of 2,655 patients from two primary PCI trials (EXAMINATION, N=1,504; COMFORTABLE AMI, N=1,161) with identical endpoint definitions and event adjudication were pooled. Predictors of all-cause death or any reinfarction and definite stent thrombosis (ST) and target lesion revascularisation (TLR) outcomes at one year were identified by multivariable Cox regression analysis. Killip class III or IV was the strongest predictor of all-cause death or any reinfarction (OR 5.11, 95% CI: 2.48-10.52), definite ST (OR 7.74, 95% CI: 2.87-20.93), and TLR (OR 2.88, 95% CI: 1.17-7.06). Impaired left ventricular ejection fraction (OR 4.77, 95% CI: 2.10-10.82), final TIMI flow 0-2 (OR 1.93, 95% CI: 1.05-3.54), arterial hypertension (OR 1.69, 95% CI: 1.11-2.59), age (OR 1.68, 95% CI: 1.41-2.01), and peak CK (OR 1.25, 95% CI: 1.02-1.54) were independent predictors of all-cause death or any reinfarction. Allocation to treatment with DES was an independent predictor of a lower risk of definite ST (OR 0.35, 95% CI: 0.16-0.74) and any TLR (OR 0.34, 95% CI: 0.21-0.54). Conclusions: Killip class remains the strongest predictor of all-cause death or any reinfarction among STEMI patients undergoing primary PCI. DES use independently predicts a lower risk of TLR and definite ST compared with BMS. The COMFORTABLE AMI trial is registered at: http://www.clinicaltrials.gov/ct2/show/NCT00962416. The EXAMINATION trial is registered at: http://www.clinicaltrials.gov/ct2/show/NCT00828087.

The Alexander Technique and musicians: a systematic review of controlled trials

BACKGROUND: Musculoskeletal disorders, stress and performance anxiety are common in musicians. Therefore, some use the Alexander Technique (AT), a psycho-physical method that helps to release unnecessary muscle tension and re-educates non-beneficial movement patterns through intentional inhibition of unwanted habitual behaviours. According to a recent review AT sessions may be effective for chronic back pain. This review aimed to evaluate the evidence for the effectiveness of AT sessions on musicians' performance, anxiety, respiratory function and posture. METHODS: The following electronic databases were searched up to February 2014 for relevant publications: PUBMED, Google Scholar, CINAHL, EMBASE, AMED, PsycINFO and RILM. The search criteria were "Alexander Technique" AND "music*". References were searched, and experts and societies of AT or musicians' medicine contacted for further publications. RESULTS: 237 citations were assessed. 12 studies were included for further analysis, 5 of which were randomised controlled trials (RCTs), 5 controlled but not randomised (CTs), and 2 mixed methods studies. Main outcome measures in RCTs and CTs were music performance, respiratory function, performance anxiety, body use and posture. Music performance was judged by external experts and found to be improved by AT in 1 of 3 RCTs; in 1 RCT comparing neurofeedback (NF) to AT, only NF caused improvements. Respiratory function was investigated in 2 RCTs, but not improved by AT training. Performance anxiety was mostly assessed by questionnaires and decreased by AT in 2 of 2 RCTs and in 2 of 2 CTs. CONCLUSIONS: A variety of outcome measures have been used to investigate the effectiveness of AT sessions in musicians. Evidence from RCTs and CTs suggests that AT sessions may improve performance anxiety in musicians. Effects on music performance, respiratory function and posture yet remain inconclusive. Future trials with well-established study designs are warranted to further and more reliably explore the potential of AT in the interest of musicians.

Robust meta-analytic-predictive priors in clinical trials with historical control information.

Historical information is always relevant for clinical trial design. Additionally, if incorporated in the analysis of a new trial, historical data allow to reduce the number of subjects. This decreases costs and trial duration, facilitates recruitment, and may be more ethical. Yet, under prior-data conflict, a too optimistic use of historical data may be inappropriate. We address this challenge by deriving a Bayesian meta-analytic-predictive prior from historical data, which is then combined with the new data. This prospective approach is equivalent to a meta-analytic-combined analysis of historical and new data if parameters are exchangeable across trials. The prospective Bayesian version requires a good approximation of the meta-analytic-predictive prior, which is not available analytically. We propose two- or three-component mixtures of standard priors, which allow for good approximations and, for the one-parameter exponential family, straightforward posterior calculations. Moreover, since one of the mixture components is usually vague, mixture priors will often be heavy-tailed and therefore robust. Further robustness and a more rapid reaction to prior-data conflicts can be achieved by adding an extra weakly-informative mixture component. Use of historical prior information is particularly attractive for adaptive trials, as the randomization ratio can then be changed in case of prior-data conflict. Both frequentist operating characteristics and posterior summaries for various data scenarios show that these designs have desirable properties. We illustrate the methodology for a phase II proof-of-concept trial with historical controls from four studies. Robust meta-analytic-predictive priors alleviate prior-data conflicts ' they should encourage better and more frequent use of historical data in clinical trials.