Interim analysis of clinical trials: Simulation studies of fractional Brownian motion

Interim clinical trial monitoring procedures were motivated by ethical and economic considerations. Classical Brownian motion (Bm) techniques for statistical monitoring of clinical trials were widely used. Conditional power argument and α-spending function based boundary crossing probabilities are popular statistical hypothesis testing procedures under the assumption of Brownian motion. However, it is not rare that the assumptions of Brownian motion are only partially met for trial data. Therefore, I used a more generalized form of stochastic process, called fractional Brownian motion (fBm), to model the test statistics. Fractional Brownian motion does not hold Markov property and future observations depend not only on the present observations but also on the past ones. In this dissertation, we simulated a wide range of fBm data, e.g., H = 0.5 (that is, classical Bm) vs. 0.5< H <1, with treatment effects vs. without treatment effects. Then the performance of conditional power and boundary-crossing based interim analyses were compared by assuming that the data follow Bm or fBm. Our simulation study suggested that the conditional power or boundaries under fBm assumptions are generally higher than those under Bm assumptions when H > 0.5 and also matches better with the empirical results. ^

A simulation study using the hybrid statistic and the meta-analysis t-test for data with matched and unmatched subjects in the interim analysis of clinical trials

An interim analysis is usually applied in later phase II or phase III trials to find convincing evidence of a significant treatment difference that may lead to trial termination at an earlier point than planned at the beginning. This can result in the saving of patient resources and shortening of drug development and approval time. In addition, ethics and economics are also the reasons to stop a trial earlier. In clinical trials of eyes, ears, knees, arms, kidneys, lungs, and other clustered treatments, data may include distribution-free random variables with matched and unmatched subjects in one study. It is important to properly include both subjects in the interim and the final analyses so that the maximum efficiency of statistical and clinical inferences can be obtained at different stages of the trials. So far, no publication has applied a statistical method for distribution-free data with matched and unmatched subjects in the interim analysis of clinical trials. In this simulation study, the hybrid statistic was used to estimate the empirical powers and the empirical type I errors among the simulated datasets with different sample sizes, different effect sizes, different correlation coefficients for matched pairs, and different data distributions, respectively, in the interim and final analysis with 4 different group sequential methods. Empirical powers and empirical type I errors were also compared to those estimated by using the meta-analysis t-test among the same simulated datasets. Results from this simulation study show that, compared to the meta-analysis t-test commonly used for data with normally distributed observations, the hybrid statistic has a greater power for data observed from normally, log-normally, and multinomially distributed random variables with matched and unmatched subjects and with outliers. Powers rose with the increase in sample size, effect size, and correlation coefficient for the matched pairs. In addition, lower type I errors were observed estimated by using the hybrid statistic, which indicates that this test is also conservative for data with outliers in the interim analysis of clinical trials.^

DUI client characteristics - an interim analysis of the random assignment process. Interim report.

National Highway Traffic Safety Administration, Office of Driver and Pedestrian Programs, Washington, D.C.

First interim analysis of multiple offender treatment effectiveness. Interim report.

National Highway Traffic Safety Administration, Office of Driver and Pedestrian Programs, Washington, D.C.

First interim analysis of first offender treatment effectiveness. Interim report.

National Highway Traffic Safety Administration, Office of Driver and Pedestrian Programs, Washington, D.C.

Short term rehabilitation (STR) study. Interim analysis of STR performance and effectiveness. 12-month analyses. Interim report.

National Highway Traffic Safety Administration, Office of Driver and Pedestrian Programs, Washington, D.C.

An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES: To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING: We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS: Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION: Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.

An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.

Efficacy and effectiveness of an rVSV-vectored vaccine expressing Ebola surface glycoprotein: interim results from the Guinea ring vaccination cluster-randomised trial.

BACKGROUND A recombinant, replication-competent vesicular stomatitis virus-based vaccine expressing a surface glycoprotein of Zaire Ebolavirus (rVSV-ZEBOV) is a promising Ebola vaccine candidate. We report the results of an interim analysis of a trial of rVSV-ZEBOV in Guinea, west Africa. METHODS For this open-label, cluster-randomised ring vaccination trial, suspected cases of Ebola virus disease in Basse-Guinée (Guinea, west Africa) were independently ascertained by Ebola response teams as part of a national surveillance system. After laboratory confirmation of a new case, clusters of all contacts and contacts of contacts were defined and randomly allocated 1:1 to immediate vaccination or delayed (21 days later) vaccination with rVSV-ZEBOV (one dose of 2 × 10(7) plaque-forming units, administered intramuscularly in the deltoid muscle). Adults (age ≥18 years) who were not pregnant or breastfeeding were eligible for vaccination. Block randomisation was used, with randomly varying blocks, stratified by location (urban vs rural) and size of rings (≤20 vs >20 individuals). The study is open label and masking of participants and field teams to the time of vaccination is not possible, but Ebola response teams and laboratory workers were unaware of allocation to immediate or delayed vaccination. Taking into account the incubation period of the virus of about 10 days, the prespecified primary outcome was laboratory-confirmed Ebola virus disease with onset of symptoms at least 10 days after randomisation. The primary analysis was per protocol and compared the incidence of Ebola virus disease in eligible and vaccinated individuals in immediate vaccination clusters with the incidence in eligible individuals in delayed vaccination clusters. This trial is registered with the Pan African Clinical Trials Registry, number PACTR201503001057193. FINDINGS Between April 1, 2015, and July 20, 2015, 90 clusters, with a total population of 7651 people were included in the planned interim analysis. 48 of these clusters (4123 people) were randomly assigned to immediate vaccination with rVSV-ZEBOV, and 42 clusters (3528 people) were randomly assigned to delayed vaccination with rVSV-ZEBOV. In the immediate vaccination group, there were no cases of Ebola virus disease with symptom onset at least 10 days after randomisation, whereas in the delayed vaccination group there were 16 cases of Ebola virus disease from seven clusters, showing a vaccine efficacy of 100% (95% CI 74·7-100·0; p=0·0036). No new cases of Ebola virus disease were diagnosed in vaccinees from the immediate or delayed groups from 6 days post-vaccination. At the cluster level, with the inclusion of all eligible adults, vaccine effectiveness was 75·1% (95% CI -7·1 to 94·2; p=0·1791), and 76·3% (95% CI -15·5 to 95·1; p=0·3351) with the inclusion of everyone (eligible or not eligible for vaccination). 43 serious adverse events were reported; one serious adverse event was judged to be causally related to vaccination (a febrile episode in a vaccinated participant, which resolved without sequelae). Assessment of serious adverse events is ongoing. INTERPRETATION The results of this interim analysis indicate that rVSV-ZEBOV might be highly efficacious and safe in preventing Ebola virus disease, and is most likely effective at the population level when delivered during an Ebola virus disease outbreak via a ring vaccination strategy. FUNDING WHO, with support from the Wellcome Trust (UK); Médecins Sans Frontières; the Norwegian Ministry of Foreign Affairs through the Research Council of Norway; and the Canadian Government through the Public Health Agency of Canada, Canadian Institutes of Health Research, International Development Research Centre, and Department of Foreign Affairs, Trade and Development.

Altering heavy vehicle air suspension dynamic forces by modifying air lines

An experimental programme in 2007 used three air suspended heavy vehicles travelling over typical urban roads to determine whether dynamic axle-to-chassis forces could be reduced by using larger-than-standard diameter longitudinal air lines. This paper presents methodology, interim analysis and partial results from that programme. Alterations to dynamic measures derived from axle-to-chassis forces for the case of standard-sized longitudinal air lines vs. the test case where larger longitudinal air lines were fitted are presented and discussed. This leads to conclusions regarding the possibility that dynamic loadings between heavy vehicle suspensions and chassis may be reduced by fitting larger longitudinal air lines to air-suspended heavy vehicles. Reductions in the shock and vibration loads to heavy vehicle suspension components could lead to lighter and more economical chassis and suspensions. This could therefore lead to reduced tare and increased payloads without an increase in gross vehicle mass.

Phase III study of matrix metalloproteinase inhibitor prinomastat in non-small-cell lung cancer

Purpose: Matrix metalloproteinases (MMPs) degrade extracellular proteins and facilitate tumor growth, invasion, metastasis, and angiogenesis. This trial was undertaken to determine the effect of prinomastat, an inhibitor of selected MMPs, on the survival of patients with advanced non-small-cell lung cancer (NSCLC), when given in combination with gemcitabine-cisplatin chemotherapy. Patients and Methods: Chemotherapy-naive patients were randomly assigned to receive prinomastat 15 mg or placebo twice daily orally continuously, in combination with gemcitabine 1,250 mg/m2 days 1 and 8 plus cisplatin 75 mg/m2 day 1, every 21 days for up to six cycles. The planned sample size was 420 patients. Results: Study results at an interim analysis and lack of efficacy in another phase III trial prompted early closure of this study. There were 362 patients randomized (181 on prinomastat and 181 on placebo). One hundred thirty-four patients had stage IIIB disease with T4 primary tumor, 193 had stage IV disease, and 34 had recurrent disease (one enrolled patient was ineligible with stage IIIA disease). Overall response rates for the two treatment arms were similar (27% for prinomastat v 26% for placebo; P = .81). There was no difference in overall survival or time to progression; for prinomastat versus placebo patients, the median overall survival times were 11.5 versus 10.8 months (P = .82), 1-year survival rates were 43% v 38% (P = .45), and progression-free survival times were 6.1 v 5.5 months (P = .11), respectively. The toxicities of prinomastat were arthralgia, stiffness, and joint swelling. Treatment interruption was required in 38% of prinomastat patients and 12% of placebo patients. Conclusion: Prinomastat does not improve the outcome of chemotherapy in advanced NSCLC. © 2005 by American Society of Clinical Oncology.

Crizotinib versus chemotherapy in advanced ALK-positive lung cancer

BACKGROUND: In single-group studies, chromosomal rearrangements of the anaplastic lymphoma kinase gene (ALK ) have been associated with marked clinical responses to crizotinib, an oral tyrosine kinase inhibitor targeting ALK. Whether crizotinib is superior to standard chemotherapy with respect to efficacy is unknown. METHODS: We conducted a phase 3, open-label trial comparing crizotinib with chemotherapy in 347 patients with locally advanced or metastatic ALK-positive lung cancer who had received one prior platinum-based regimen. Patients were randomly assigned to receive oral treatment with crizotinib (250 mg) twice daily or intravenous chemotherapy with either pemetrexed (500 mg per square meter of body-surface area) or docetaxel (75 mg per square meter) every 3 weeks. Patients in the chemotherapy group who had disease progression were permitted to cross over to crizotinib as part of a separate study. The primary end point was progression-free survival. RESULTS: The median progression-free survival was 7.7 months in the crizotinib group and 3.0 months in the chemotherapy group (hazard ratio for progression or death with crizotinib, 0.49; 95% confidence interval [CI], 0.37 to 0.64; P<0.001). The response rates were 65% (95% CI, 58 to 72) with crizotinib, as compared with 20% (95% CI, 14 to 26) with chemotherapy (P<0.001). An interim analysis of overall survival showed no significant improvement with crizotinib as compared with chemotherapy (hazard ratio for death in the crizotinib group, 1.02; 95% CI, 0.68 to 1.54; P=0.54). Common adverse events associated with crizotinib were visual disorder, gastrointestinal side effects, and elevated liver aminotransferase levels, whereas common adverse events with chemotherapy were fatigue, alopecia, and dyspnea. Patients reported greater reductions in symptoms of lung cancer and greater improvement in global quality of life with crizotinib than with chemotherapy. CONCLUSIONS: Crizotinib is superior to standard chemotherapy in patients with previously treated, advanced non-small-cell lung cancer with ALK rearrangement. (Funded by Pfizer; ClinicalTrials.gov number, NCT00932893.) Copyright © 2013 Massachusetts Medical Society.

Early stopping by using stochastic curtailment in a three-arm sequential trial

Summary. Interim analysis is important in a large clinical trial for ethical and cost considerations. Sometimes, an interim analysis needs to be performed at an earlier than planned time point. In that case, methods using stochastic curtailment are useful in examining the data for early stopping while controlling the inflation of type I and type II errors. We consider a three-arm randomized study of treatments to reduce perioperative blood loss following major surgery. Owing to slow accrual, an unplanned interim analysis was required by the study team to determine whether the study should be continued. We distinguish two different cases: when all treatments are under direct comparison and when one of the treatments is a control. We used simulations to study the operating characteristics of five different stochastic curtailment methods. We also considered the influence of timing of the interim analyses on the type I error and power of the test. We found that the type I error and power between the different methods can be quite different. The analysis for the perioperative blood loss trial was carried out at approximately a quarter of the planned sample size. We found that there is little evidence that the active treatments are better than a placebo and recommended closure of the trial.