Decision-theoretic designs for dose-finding clinical trials with multiple outcomes

A decision-theoretic framework is proposed for designing sequential dose-finding trials with multiple outcomes. The optimal strategy is solvable theoretically via backward induction. However, for dose-finding studies involving k doses, the computational complexity is the same as the bandit problem with k-dependent arms, which is computationally prohibitive. We therefore provide two computationally compromised strategies, which is of practical interest as the computational complexity is greatly reduced: one is closely related to the continual reassessment method (CRM), and the other improves CRM and approximates to the optimal strategy better. In particular, we present the framework for phase I/II trials with multiple outcomes. Applications to a pediatric HIV trial and a cancer chemotherapy trial are given to illustrate the proposed approach. Simulation results for the two trials show that the computationally compromised strategy can perform well and appear to be ethical for allocating patients. The proposed framework can provide better approximation to the optimal strategy if more extensive computing is available.

Efficacy and safety of autologous platelet rich plasma for the treatment of vascular ulcers in primary care: Phase III study

Background: Vascular ulcers are commonly seen in daily practice at all levels of care and have great impact at personal, professional and social levels with a high cost in terms of human and material resources. Given that the application of autologous platelet rich plasma has been shown to decrease healing times in various different studies in the hospital setting, we considered that it would be interesting to assess the efficacy and feasibility of this treatment in primary care. The objectives of this study are to assess the potential efficacy and safety of autologous platelet rich plasma for the treatment of venous ulcers compared to the conventional treatment (moist wound care) in primary care patients with chronic venous insufficiency (C, clinical class, E, aetiology, A, anatomy and P, pathophysiology classification C6). Design: We will conduct a phase III, open-label, parallel-group, multicentre, randomized study. The subjects will be 150 patients aged between 40 and 100 years of age with an at least 2-month history of a vascular venous ulcer assigned to ten primary care centres. For the treatment with autologous platelet rich plasma, all the following tasks will be performed in the primary care setting: blood collection, centrifugation, separation of platelet rich plasma, activation of coagulation adding calcium chloride and application of the PRP topically after gelification. The control group will receive standard moist wound care. The outcome variables to be measured at baseline, and at weeks 5 and 9 later include: reduction in the ulcer area, Chronic Venous Insufficiency Quality of Life Questionnaire score, and percentage of patients who require wound care only once a week. Discussion: The results of this study will be useful to improve the protocol for using platelet rich plasma in chronic vascular ulcers and to favour wider use of this treatment in primary care.

Risk communication in clinical trials: a cognitive experiment and a survey.

BACKGROUND: A Royal Statistical Society Working Party recently recommended that "Greater use should be made of numerical, as opposed to verbal, descriptions of risk" in first-in-man clinical trials. This echoed the view of many clinicians and psychologists about risk communication. As the clinical trial industry expands rapidly across the globe, it is important to understand risk communication in Asian countries. METHODS: We conducted a cognitive experiment about participation in a hypothetical clinical trial of a pain relief medication and a survey in cancer and arthritis patients in Singapore. In part 1 of the experiment, the patients received information about the risk of side effects in one of three formats (frequency, percentage and verbal descriptor) and in one of two sequences (from least to most severe and from most to least severe), and were asked about their willingness to participate. In part 2, the patients received information about the risk in all three formats, in the same sequence, and were again asked about their willingness to participate. A survey of preference for risk presentation methods and usage of verbal descriptors immediately followed. RESULTS: Willingness to participate and the likelihood of changing one's decision were not affected by the risk presentation methods. Most patients indicated a preference for the frequency format, but patients with primary school or no formal education were indifferent. While the patients used the verbal descriptors "very common", "common" and "very rare" in ways similar to the European Commission's Guidelines, their usage of the descriptors "uncommon" and "rare" was substantially different from the EU's. CONCLUSION: In this sample of Asian cancer and arthritis patients, risk presentation format had no impact on willingness to participate in a clinical trial. However, there is a clear preference for the frequency format. The lay use of verbal descriptors was substantially different from the EU's.

Quantifying data quality for clinical trials using electronic data capture.

BACKGROUND: Historically, only partial assessments of data quality have been performed in clinical trials, for which the most common method of measuring database error rates has been to compare the case report form (CRF) to database entries and count discrepancies. Importantly, errors arising from medical record abstraction and transcription are rarely evaluated as part of such quality assessments. Electronic Data Capture (EDC) technology has had a further impact, as paper CRFs typically leveraged for quality measurement are not used in EDC processes. METHODS AND PRINCIPAL FINDINGS: The National Institute on Drug Abuse Treatment Clinical Trials Network has developed, implemented, and evaluated methodology for holistically assessing data quality on EDC trials. We characterize the average source-to-database error rate (14.3 errors per 10,000 fields) for the first year of use of the new evaluation method. This error rate was significantly lower than the average of published error rates for source-to-database audits, and was similar to CRF-to-database error rates reported in the published literature. We attribute this largely to an absence of medical record abstraction on the trials we examined, and to an outpatient setting characterized by less acute patient conditions. CONCLUSIONS: Historically, medical record abstraction is the most significant source of error by an order of magnitude, and should be measured and managed during the course of clinical trials. Source-to-database error rates are highly dependent on the amount of structured data collection in the clinical setting and on the complexity of the medical record, dependencies that should be considered when developing data quality benchmarks.

Missing data in randomized clinical trials for weight loss: scope of the problem, state of the field, and performance of statistical methods.

BACKGROUND: Dropouts and missing data are nearly-ubiquitous in obesity randomized controlled trails, threatening validity and generalizability of conclusions. Herein, we meta-analytically evaluate the extent of missing data, the frequency with which various analytic methods are employed to accommodate dropouts, and the performance of multiple statistical methods. METHODOLOGY/PRINCIPAL FINDINGS: We searched PubMed and Cochrane databases (2000-2006) for articles published in English and manually searched bibliographic references. Articles of pharmaceutical randomized controlled trials with weight loss or weight gain prevention as major endpoints were included. Two authors independently reviewed each publication for inclusion. 121 articles met the inclusion criteria. Two authors independently extracted treatment, sample size, drop-out rates, study duration, and statistical method used to handle missing data from all articles and resolved disagreements by consensus. In the meta-analysis, drop-out rates were substantial with the survival (non-dropout) rates being approximated by an exponential decay curve (e(-lambdat)) where lambda was estimated to be .0088 (95% bootstrap confidence interval: .0076 to .0100) and t represents time in weeks. The estimated drop-out rate at 1 year was 37%. Most studies used last observation carried forward as the primary analytic method to handle missing data. We also obtained 12 raw obesity randomized controlled trial datasets for empirical analyses. Analyses of raw randomized controlled trial data suggested that both mixed models and multiple imputation performed well, but that multiple imputation may be more robust when missing data are extensive. CONCLUSION/SIGNIFICANCE: Our analysis offers an equation for predictions of dropout rates useful for future study planning. Our raw data analyses suggests that multiple imputation is better than other methods for handling missing data in obesity randomized controlled trials, followed closely by mixed models. We suggest these methods supplant last observation carried forward as the primary method of analysis.

What leads Indians to participate in clinical trials? A meta-analysis of qualitative studies.

BACKGROUND: With the globalization of clinical trials, large developing nations have substantially increased their participation in multi-site studies. This participation has raised ethical concerns, among them the fear that local customs, habits and culture are not respected while asking potential participants to take part in study. This knowledge gap is particularly noticeable among Indian subjects, since despite the large number of participants, little is known regarding what factors affect their willingness to participate in clinical trials. METHODS: We conducted a meta-analysis of all studies evaluating the factors and barriers, from the perspective of potential Indian participants, contributing to their participation in clinical trials. We searched both international as well as Indian-specific bibliographic databases, including Pubmed, Cochrane, Openjgate, MedInd, Scirus and Medknow, also performing hand searches and communicating with authors to obtain additional references. We enrolled studies dealing exclusively with the participation of Indians in clinical trials. Data extraction was conducted by three researchers, with disagreement being resolved by consensus. RESULTS: Six qualitative studies and one survey were found evaluating the main themes affecting the participation of Indian subjects. Themes included Personal health benefits, Altruism, Trust in physicians, Source of extra income, Detailed knowledge, Methods for motivating participants as factors favoring, while Mistrust on trial organizations, Concerns about efficacy and safety of trials, Psychological reasons, Trial burden, Loss of confidentiality, Dependency issues, Language as the barriers. CONCLUSION: We identified factors that facilitated and barriers that have negative implications on trial participation decisions in Indian subjects. Due consideration and weightage should be assigned to these factors while planning future trials in India.

Standardizing clinical trials workflow representation in UML for international site comparison.

BACKGROUND: With the globalization of clinical trials, a growing emphasis has been placed on the standardization of the workflow in order to ensure the reproducibility and reliability of the overall trial. Despite the importance of workflow evaluation, to our knowledge no previous studies have attempted to adapt existing modeling languages to standardize the representation of clinical trials. Unified Modeling Language (UML) is a computational language that can be used to model operational workflow, and a UML profile can be developed to standardize UML models within a given domain. This paper's objective is to develop a UML profile to extend the UML Activity Diagram schema into the clinical trials domain, defining a standard representation for clinical trial workflow diagrams in UML. METHODS: Two Brazilian clinical trial sites in rheumatology and oncology were examined to model their workflow and collect time-motion data. UML modeling was conducted in Eclipse, and a UML profile was developed to incorporate information used in discrete event simulation software. RESULTS: Ethnographic observation revealed bottlenecks in workflow: these included tasks requiring full commitment of CRCs, transferring notes from paper to computers, deviations from standard operating procedures, and conflicts between different IT systems. Time-motion analysis revealed that nurses' activities took up the most time in the workflow and contained a high frequency of shorter duration activities. Administrative assistants performed more activities near the beginning and end of the workflow. Overall, clinical trial tasks had a greater frequency than clinic routines or other general activities. CONCLUSIONS: This paper describes a method for modeling clinical trial workflow in UML and standardizing these workflow diagrams through a UML profile. In the increasingly global environment of clinical trials, the standardization of workflow modeling is a necessary precursor to conducting a comparative analysis of international clinical trials workflows.

So different, yet so similar: meta-analysis and policy modeling of willingness to participate in clinical trials among Brazilians and Indians.

BACKGROUND: With the global expansion of clinical trials and the expectations of the rise of the emerging economies known as BRICs (Brazil, Russia, India and China), the understanding of factors that affect the willingness to participate in clinical trials of patients from those countries assumes a central role in the future of health research. METHODS: We conducted a systematic review and meta-analysis (SRMA) of willingness to participate in clinical trials among Brazilian patients and then we compared it with Indian patients (with results of another SRMA previously conducted by our group) through a system dynamics model. RESULTS: Five studies were included in the SRMA of Brazilian patients. Our main findings are 1) the major motivation for Brazilian patients to participate in clinical trials is altruism, 2) monetary reimbursement is the least important factor motivating Brazilian patients, 3) the major barrier for Brazilian patients to not participate in clinical trials is the fear of side effects, and 4) Brazilian patients are more likely willing to participate in clinical trials than Indians. CONCLUSION: Our study provides important insights for investigators and sponsors for planning trials in Brazil (and India) in the future. Ignoring these results may lead to unnecessary fund/time spending. More studies are needed to validate our results and for better understanding of this poorly studied theme.

Economic return of clinical trials performed under the pediatric exclusivity program.

CONTEXT: In 1997, Congress authorized the US Food and Drug Administration (FDA) to grant 6-month extensions of marketing rights through the Pediatric Exclusivity Program if industry sponsors complete FDA-requested pediatric trials. The program has been praised for creating incentives for studies in children and has been criticized as a "windfall" to the innovator drug industry. This critique has been a substantial part of congressional debate on the program, which is due to expire in 2007. OBJECTIVE: To quantify the economic return to industry for completing pediatric exclusivity trials. DESIGN AND SETTING: A cohort study of programs conducted for pediatric exclusivity. Nine drugs that were granted pediatric exclusivity were selected. From the final study reports submitted to the FDA (2002-2004), key elements of the clinical trial design and study operations were obtained, and the cost of performing each study was estimated and converted into estimates of after-tax cash outflows. Three-year market sales were obtained and converted into estimates of after-tax cash inflows based on 6 months of additional market protection. Net economic return (cash inflows minus outflows) and net return-to-costs ratio (net economic return divided by cash outflows) for each product were then calculated. MAIN OUTCOME MEASURES: Net economic return and net return-to-cost ratio. RESULTS: The indications studied reflect a broad representation of the program: asthma, tumors, attention-deficit/hyperactivity disorder, hypertension, depression/generalized anxiety disorder, diabetes mellitus, gastroesophageal reflux, bacterial infection, and bone mineralization. The distribution of net economic return for 6 months of exclusivity varied substantially among products (net economic return ranged from -$8.9 million to $507.9 million and net return-to-cost ratio ranged from -0.68 to 73.63). CONCLUSIONS: The economic return for pediatric exclusivity is variable. As an incentive to complete much-needed clinical trials in children, pediatric exclusivity can generate lucrative returns or produce more modest returns on investment.

Utility of a molecular prescreening program in advanced colorectal cancer for enrollment on biomarker-selected clinical trials.

BACKGROUND: Incorporation of multiple enrichment biomarkers into prospective clinical trials is an active area of investigation, but the factors that determine clinical trial enrollment following a molecular prescreening program have not been assessed. PATIENTS AND METHODS: Patients with 5-fluorouracil-refractory metastatic colorectal cancer at the MD Anderson Cancer Center were offered screening in the Assessment of Targeted Therapies Against Colorectal Cancer (ATTACC) program to identify eligibility for companion phase I or II clinical trials with a therapy targeted to an aberration detected in the patient, based on testing by immunohistochemistry, targeted gene sequencing panels, and CpG island methylation phenotype assays. RESULTS: Between August 2010 and December 2013, 484 patients were enrolled, 458 (95%) had a biomarker result, and 157 (32%) were enrolled on a clinical trial (92 on biomarker-selected and 65 on nonbiomarker selected). Of the 458 patients with a biomarker result, enrollment on biomarker-selected clinical trials was ninefold higher for predefined ATTACC-companion clinical trials as opposed to nonpredefined biomarker-selected clinical trials, 17.9% versus 2%, P < 0.001. Factors that correlated positively with trial enrollment in multivariate analysis were higher performance status, older age, lack of standard of care therapy, established patient at MD Anderson, and the presence of an eligible biomarker for an ATTACC-companion study. Early molecular screening did result in a higher rate of patients with remaining standard of care therapy enrolling on ATTACC-companion clinical trials, 45.1%, in contrast to nonpredefined clinical trials, 22.7%; odds ratio 3.1, P = 0.002. CONCLUSIONS: Though early molecular prescreening for predefined clinical trials resulted in an increase rate of trial enrollment of nonrefractory patients, the majority of patients enrolled on clinical trials were refractory to standard of care therapy. Within molecular prescreening programs, tailoring screening for preidentified and open clinical trials, temporally linking screening to treatment and optimizing both patient and physician engagement are efforts likely to improve enrollment on biomarker-selected clinical trials. CLINICAL TRIALS NUMBER: The study NCT number is NCT01196130.

Complete longitudinal analyses of the randomized, placebo-controlled, phase III trial of sunitinib in patients with gastrointestinal stromal tumor following imatinib failure.

PURPOSE: To analyze final long-term survival and clinical outcomes from the randomized phase III study of sunitinib in gastrointestinal stromal tumor patients after imatinib failure; to assess correlative angiogenesis biomarkers with patient outcomes. EXPERIMENTAL DESIGN: Blinded sunitinib or placebo was given daily on a 4-week-on/2-week-off treatment schedule. Placebo-assigned patients could cross over to sunitinib at disease progression/study unblinding. Overall survival (OS) was analyzed using conventional statistical methods and the rank-preserving structural failure time (RPSFT) method to explore cross-over impact. Circulating levels of angiogenesis biomarkers were analyzed. RESULTS: In total, 243 patients were randomized to receive sunitinib and 118 to placebo, 103 of whom crossed over to open-label sunitinib. Conventional statistical analysis showed that OS converged in the sunitinib and placebo arms (median 72.7 vs. 64.9 weeks; HR, 0.876; P = 0.306) as expected, given the cross-over design. RPSFT analysis estimated median OS for placebo of 39.0 weeks (HR, 0.505, 95% CI, 0.262-1.134; P = 0.306). No new safety concerns emerged with extended sunitinib treatment. No consistent associations were found between the pharmacodynamics of angiogenesis-related plasma proteins during sunitinib treatment and clinical outcome. CONCLUSIONS: The cross-over design provided evidence of sunitinib clinical benefit based on prolonged time to tumor progression during the double-blind phase of this trial. As expected, following cross-over, there was no statistical difference in OS. RPSFT analysis modeled the absence of cross-over, estimating a substantial sunitinib OS benefit relative to placebo. Long-term sunitinib treatment was tolerated without new adverse events.

Stopping rules for phase II studies

This paper, the second in a series of three papers concerned with the statistical aspects of interim analyses in clinical trials, is concerned with stopping rules in phase II clinical trials. Phase II trials are generally small-scale studies, and may include one or more experimental treatments with or without a control. A common feature is that the results primarily determine the course of further clinical evaluation of a treatment rather than providing definitive evidence of treatment efficacy. This means that there is more flexibility available in the design and analysis of such studies than in phase III trials. This has led to a range of different approaches being taken to the statistical design of stopping rules for such trials. This paper briefly describes and compares the different approaches. In most cases the stopping rules can be described and implemented easily without knowledge of the detailed statistical and computational methods used to obtain the rules.

A quantitative and qualitative evaluation of reports of clinical trials published in six Brazilian dental journals indexed in the Scientific Electronic Library Online (SciELO)

Introduction: Open access publishing is becoming increasingly popular within the biomedical sciences. SciELO, the Scientific Electronic Library Online, is a digital library covering a selected collection of Brazilian scientific journals many of which provide open access to full-text articles. This library includes a number of dental journals some of which may include reports of clinical trials in English, Portuguese and/or Spanish. Thus, SciELO could play an important role as a source of evidence for dental healthcare interventions especially if it yields a sizeable number of high quality reports. Objective: The aim of this study was to identify reports of clinical trials by handsearching of dental journals that are accessible through SciELO, and to assess the overall quality of these reports. Material and methods: Electronic versions of six Brazilian dental Journals indexed in SciELO were handsearched at www.scielo.br in September 2008. Reports of clinical trials were identified and classified as controlled clinical trials (CCTs - prospective, experimental studies comparing 2 or more healthcare interventions in human beings) or randomized controlled trials (RCTs - a random allocation method is clearly reported), according to Cochrane eligibility criteria. Criteria to assess methodological quality included: method of randomization, concealment of treatment allocation, blinded outcome assessment, handling of withdrawals and losses and whether an intention-to-treat analysis had been carried out. Results: The search retrieved 33 CCTs and 43 RCTs. A majority of the reports provided no description of either the method of randomization (75.3%) or concealment of the allocation sequence (84.2%). Participants and outcome assessors were reported as blinded in only 31.2% of the reports. Withdrawals and losses were only clearly described in 6.5% of the reports and none mentioned an intention-to-treat analysis or any similar procedure. Conclusions: The results of this study indicate that a substantial number of reports of trials and systematic reviews are available in the dental journals listed in SciELO, and that these could provide valuable evidence for clinical decision making. However, it is clear that the quality of a number of these reports is of some concern and that improvement in the conduct and reporting of these trials could be achieved if authors adhered to internationally accepted guidelines, e. g. the CONSORT statement.

An alternative approach to deal with the absence of clinical trials: a proportional meta-analysis of case series studies

PURPOSE: Systematic reviews are criticized for frequently offering inconsistent evidences and absence of straightforward recommendations. Their value seems to be depreciated when the conclusions are uncertain. To describe an alternative approach of evaluating case series studies in health care when there is absence of clinical trials. METHODS: We provide illustrations from recent experiences. Proportional meta-analysis was performed on surgical outcomes: (a) case series studies, (b) use of cryoablation or radiofrequency ablation, and (c) patients with small renal cell carcinoma. The statistically significant difference between both interventions studied was defined if their combined 95% confidential interval (CI) did not overlap. RESULTS: As demonstrated by the example, this analysis is an alternative approach to provide some evidence of the intervention´s effects under evaluation and plotting all available case series in the absence of clinical trials for the health field. CONCLUSIONS: Although we are leading to a low level of evidence to determine efficacy, effectiveness and safety of interventions this alternative approach can help surgeons, physicians and health professionals for a provisionally decision in health care along with their clinical expertise and the patient´s wishes and circumstances in the absence of high-quality primary studies. It´s not a replacement for the gold standard randomized clinical trial, but an alternative analysis for clinical research.

Randomization in clinical trials in orthodontics: its significance in research design and methods to achieve it

Randomization is a key step in reducing selection bias during the treatment allocation phase in randomized clinical trials. The process of randomization follows specific steps, which include generation of the randomization list, allocation concealment, and implementation of randomization. The phenomenon in the dental and orthodontic literature of characterizing treatment allocation as random is frequent; however, often the randomization procedures followed are not appropriate. Randomization methods assign, at random, treatment to the trial arms without foreknowledge of allocation by either the participants or the investigators thus reducing selection bias. Randomization entails generation of random allocation, allocation concealment, and the actual methodology of implementing treatment allocation randomly and unpredictably. Most popular randomization methods include some form of restricted and/or stratified randomization. This article introduces the reasons, which make randomization an integral part of solid clinical trial methodology, and presents the main randomization schemes applicable to clinical trials in orthodontics.