An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES: To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING: We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS: Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION: Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications

OBJECTIVE: To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN: Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING: Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES: 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS: Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS: Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Harmonization of immune biomarker assays for clinical studies.

Assays that measure a patient's immune response play an increasingly important role in the development of immunotherapies. The inherent complexity of these assays and independent protocol development between laboratories result in high data variability and poor reproducibility. Quality control through harmonization--based on integration of laboratory-specific protocols with standard operating procedures and assay performance benchmarks--is one way to overcome these limitations. Harmonization guidelines can be widely implemented to address assay performance variables. This process enables objective interpretation and comparison of data across clinical trial sites and also facilitates the identification of relevant immune biomarkers, guiding the development of new therapies.

Combination of transient lymphodepletion with busulfan and fludarabine and peptide vaccination in a phase I clinical trial for patients with advanced melanoma.

Taking advantage of homeostatic mechanisms to boost tumor-specific cellular immunity is raising increasing interest in the development of therapeutic strategies in the treatment of melanoma. Here, we have explored the potential of combining homeostatic proliferation, after transient immunosuppression, and antigenic stimulation of Melan-A/Mart-1 specific CD8 T-cells. In an effort to develop protocols that could be readily applicable to the clinic, we have designed a phase I clinical trial, involving lymphodepleting chemotherapy with Busulfan and Fludarabine, reinfusion of Melan-A specific CD8 T-cell containing peripheral blood mononuclear cells (exempt of growth factors), and Melan-A peptide vaccination. Six patients with advanced melanoma were enrolled in this outpatient regimen that demonstrated good feasibility combined with low toxicity. Consistent depletion of lymphocytes with persistent increased CD4/CD8 ratios was induced, although the proportion of circulating CD4 regulatory T-cells remained mostly unchanged. The study of the immune reconstitution period showed a steady recovery of whole T-cell numbers overtime. However, expansion of Melan-A specific CD8 T-cells, as measured in peripheral blood, was mostly inconsistent, accompanied with marginal phenotypic changes, despite vaccination with Melan-A/Mart-1 peptide. On the clinical level, 1 patient presented a partial but objective antitumor response following the beginning of the protocol, even though a direct effect of Busulfan/Fludarabine cannot be completely ruled out. Overall, these data provide further ground for the development of immunotherapeutic approaches to be both effective against melanoma and applicable in clinic.