Recruiting Participants for Randomized Controlled Trials of Music Therapy: A Practical Illustration

Background: Failure to recruit sufficient numbers of participants to randomized controlled trials is a common and serious problem. This problem may be additionally acute in music therapy research.

Objective: To use the experience of conducting a large randomized controlled trial of music therapy for young people with emotional and behavioral difficulties to illustrate the strategies that can be used to optimize recruitment; to report on the success or otherwise of those strategies; and to draw general conclusions about the most effective approaches.

Methods: Review of the methodological literature, and a narrative account and realist analysis of the recruitment process.

Results: The strategies adopted led to the achievement of the recruitment target of 250 subjects, but only with an extension to the recruitment period. In the pre-protocol stage of the research, these strategies included the engagement of non-music therapy clinical investigators, and extensive consultation with clinical stakeholders. In the protocol development and initial recruitment stages, they involved a search of systematic reviews of factors leading to under-recruitment and of interventions to promote recruitment, and the incorporation of their insights into the research protocol and practices. In the latter stages of recruitment, various stakeholders including clinicians, senior managers and participant representatives were consulted in an attempt to uncover the reasons for the low recruitment levels that the research was experiencing.

Conclusions: The primary mechanisms to promote recruitment are education, facilitation, audit and feedback, and time allowed. The primary contextual factors affecting the effectiveness of these mechanisms are professional culture and organizational support.

Ataluren for the treatment of nonsense-mutation cystic fibrosis: a randomised, double-blind, placebo-controlled phase 3 trial

Background: Ataluren was developed to restore functional protein production in genetic disorders caused by nonsense mutations, which are the cause of cystic fibrosis in 10% of patients. This trial was designed to assess the efficacy and safety of ataluren in patients with nonsense-mutation cystic fibrosis. 

Methods: This randomised, double-blind, placebo-controlled, phase 3 study enrolled patients from 36 sites in 11 countries in North America and Europe. Eligible patients with nonsense-mutation cystic fibrosis (aged ≥6 years; abnormal nasal potential difference; sweat chloride >40 mmol/L; forced expiratory volume in 1 s [FEV₁] ≥40% and ≤90%) were randomly assigned by interactive response technology to receive oral ataluren (10 mg/kg in morning, 10 mg/kg midday, and 20 mg/kg in evening) or matching placebo for 48 weeks. Randomisation used a block size of four, stratified by age, chronic inhaled antibiotic use, and percent-predicted FEV₁. The primary endpoint was relative change in percent-predicted FEV₁ from baseline to week 48, analysed in all patients with a post-baseline spirometry measurement. This study is registered with ClinicalTrials.gov, number NCT00803205. 

Findings: Between Sept 8, 2009, and Nov 30, 2010, 238 patients were randomly assigned, of whom 116 in each treatment group had a valid post-baseline spirometry measurement. Relative change from baseline in percent-predicted FEV₁ did not differ significantly between ataluren and placebo at week 48 (-2·5% vs -5·5%; difference 3·0% [95% CI -0·8 to 6·3]; p=0·12). The number of pulmonary exacerbations did not differ significantly between treatment groups (rate ratio 0·77 [95% CI 0·57-1·05]; p=0·0992). However, post-hoc analysis of the subgroup of patients not using chronic inhaled tobramycin showed a 5·7% difference (95% CI 1·5-10·1) in relative change from baseline in percent-predicted FEV₁ between the ataluren and placebo groups at week 48 (-0·7% [-4·0 to 2·1] vs -6·4% [-9·8 to -3·7]; nominal p=0·0082), and fewer pulmonary exacerbations in the ataluern group (1·42 events [0·9-1·9] vs 2·18 events [1·6-2·7]; rate ratio 0·60 [0·42-0·86]; nominal p=0·0061). Safety profiles were generally similar for ataluren and placebo, except for the occurrence of increased creatinine concentrations (ie, acute kidney injury), which occurred in 18 (15%) of 118 patients in the ataluren group compared with one (<1%) of 120 patients in the placebo group. No life-threatening adverse events or deaths were reported in either group. I

nterpretation: Although ataluren did not improve lung function in the overall population of nonsense-mutation cystic fibrosis patients who received this treatment, it might be beneficial for patients not taking chronic inhaled tobramycin. 

Funding: PTC Therapeutics, Cystic Fibrosis Foundation, US Food and Drug Administration's Office of Orphan Products Development, and the National Institutes of Health. 

Patient-reported outcomes in randomised controlled trials on age-related macular degeneration

BACKGROUND/AIMS: The purpose of this systematic review was to identify the frequency and type of patient-reported outcome measures (PROMs) used in recent randomised controlled trials (RCTs) for age-related macular degeneration (AMD).

METHODS: The authors conducted a systematic search between January 2010 and November 2013 in MEDLINE, EMBASE, Scopus, Cochrane Library (Central) and the clinical trials registries (http://www.controlled-trials.com and http://www.ClinicalTrials.gov) according to defined inclusion criteria (RCTs on AMD in English). Two independent reviewers evaluated studies for inclusion. One reviewer extracted data of included studies, and a second masked reviewer assessed 10% to confirm accuracy in data collection. Reference lists of included papers and appendices of relevant Cochrane systematic reviews were scanned to identify other relevant RCTs. Information collected on extracted outcomes was analysed using descriptive statistics.

RESULTS: Literature and registry search yielded 3816 abstracts of journal articles and 493 records from trial registries. A total of 177 RCTs were deemed to have met inclusion criteria. Of the 858 outcomes reported, 38 outcomes were identified as PROMs (4.4%). Of the 177 RCTs examined, PROMs were used in 25 trials (14.1%). The National Eye Institute Visual Function Questionnaire-25 was the most frequently used PROM instrument (64% of RCTs with PROMs included).

CONCLUSIONS: This review highlights that a small proportion of AMD RCTs included PROMs as outcome measures and that there was a variety in the instruments used.

Design characteristic of randomised controlled trials for geographic atrophy in age-related macular degeneration: selection of outcomes and sample size calculation

PurposeThe selection of suitable outcomes and sample size calculation are critical factors in the design of a randomised controlled trial (RCT). The goal of this study was to identify the range of outcomes and information on sample size calculation in RCTs on geographic atrophy (GA).MethodsWe carried out a systematic review of age-related macular degeneration (AMD) RCTs. We searched MEDLINE, EMBASE, Scopus, Cochrane Library, www.controlled-trials.com, and www.ClinicalTrials.gov. Two independent reviewers screened records. One reviewer collected data and the second reviewer appraised 10% of collected data. We scanned references lists of selected papers to include other relevant RCTs.ResultsLiterature and registry search identified 3816 abstracts of journal articles and 493 records from trial registries. From a total of 177 RCTs on all types of AMD, 23 RCTs on GA were included. Eighty-one clinical outcomes were identified. Visual acuity (VA) was the most frequently used outcome, presented in 18 out of 23 RCTs and followed by the measures of lesion area. For sample size analysis, 8 GA RCTs were included. None of them provided sufficient Information on sample size calculations.ConclusionsThis systematic review illustrates a lack of standardisation in terms of outcome reporting in GA trials and issues regarding sample size calculation. These limitations significantly hamper attempts to compare outcomes across studies and also perform meta-analyses.

Individual Participant Data (IPD) Meta-analyses of Randomised Controlled Trials: Guidance on Their Use

Jayne Tierney and colleagues offer guidance on how to spot a well-designed and well-conducted individual participant data meta-analysis.

Summary Points 

• Systematic reviews are most commonly based on aggregate data extracted from publications or obtained from trial investigators. 

• Systematic reviews involving the central collection and analysis of individual participant data (IPD) usually are larger-scale, international, collaborative projects that can bring about substantial improvements to the quantity and quality of data, give greater scope in the analyses, and provide more detailed and robust results. 

• The process of collecting, checking, and analysing IPD is more complex than for aggregate data, and not all IPD meta-analyses are done to the same standard, making it difficult for researchers, clinicians, patients, policy makers, funders, and publishers to judge their quality. 

• Following our step-by-step guide will help reviewers and users of IPD meta-analyses to understand them better and recognise those that are well designed and conducted and so help ensure that policy, practice, and research are informed by robust evidence about the effects of interventions.

Biomarker responses to folic acid intervention in healthy adults: a meta-analysis of randomized controlled trials

BACKGROUND: The task of revising dietary folate recommendations for optimal health is complicated by a lack of data quantifying the biomarker response that reliably reflects a given folate intake.

OBJECTIVE: We conducted a dose-response meta-analysis in healthy adults to quantify the typical response of recognized folate biomarkers to a change in folic acid intake.

DESIGN: Electronic and bibliographic searches identified 19 randomized controlled trials that supplemented with folic acid and measured folate biomarkers before and after the intervention in apparently healthy adults aged ≥18 y. For each biomarker response, the regression coefficient (β) for individual studies and the overall pooled β were calculated by using random-effects meta-analysis.

RESULTS: Folate biomarkers (serum/plasma and red blood cell folate) increased in response to folic acid in a dose-response manner only up to an intake of 400 μg/d. Calculation of the overall pooled β for studies in the range of 50 to 400 μg/d indicated that a doubling of folic acid intake resulted in an increase in serum/plasma folate by 63% (71% for microbiological assay; 61% for nonmicrobiological assay) and red blood cell folate by 31% (irrespective of whether microbiological or other assay was used). Studies that used the microbiological assay indicated lower heterogeneity compared with studies using nonmicrobiological assays for determining serum/plasma (I(2) = 13.5% compared with I(2) = 77.2%) and red blood cell (I(2) = 45.9% compared with I(2) = 70.2%) folate.

CONCLUSIONS: Studies administering >400 μg folic acid/d show no dose-response relation and thus will not yield meaningful results for consideration when generating dietary folate recommendations. The calculated folate biomarker response to a given folic acid intake may be more robust with the use of a microbiological assay rather than alternative methods for blood folate measurement.

Exploring the Findings from Three Randomised Controlled Trials of Bookgifting Programmes

Aims: This paper explores the effects from three similar bookgifting programmes on improving reading outcomes of early years’ children, their parents and teachers.
Methods: The paper draws on research data produced by the Centre for Effective Education during three randomised controlled trial (RCT) evaluations of bookgifting programmes (N=1694 participant families in total). The three studies used pre and post test measures to identify effects across a total of 15 social, cognitive and behavioural reading outcomes.
Results: The overall average effect across the 15 outcomes from data provided by 1694 participant families, was d=0.07. This is a relatively small overall effect and there was an overall pattern of small positive effects of this scale across the wide range of the reading outcomes assessed. However, only one significant effect was identified in the 15 outcomes assessed across all three studies.
Conclusions: The review of these three studies suggests that the RCTs struggle to identify significant effects in these low exposure and low cost bookgifting interventions. Furthermore, it is recommended that future RCT studies of this type of programme require very large sample sizes in the scale of 1000’s rather than 100’s to generate enough study power. Or alternatively, these programmes could be evaluated as a component part of more intensive reading interventions.

Effects of Prochlorperazine on Normal Vestibular Ocular and Perceptual Responses: A Randomised, Double-Blind, Crossover, Placebo-Controlled Study

Background: The present study investigated whether prochlorperazine affects vestibular-ocular reflex (VOR) and vestibulo-perceptual function. Methods: We studied 12 healthy naïve subjects 3 hours after a single dose of oral prochlorperazine 5mg in a randomised, placebo-controlled, double-blind, cross-over study in healthy young subjects. Two rotational tests in yaw were used: 1) a Threshold task investigating perceptual motion detection and nystagmic thresholds (acceleration steps of 0.5deg/s/s) and 2) Suprathreshold responses to velocity steps of 90deg/s in which vestibulo-ocular (VO) and vestibulo-perceptual (VP) time constants of decay, as well as VOR gain, were measured. Results: Prochlorperazine had no effect upon any measure of nystagmic or perceptual vestibular function compared to placebo. This lack of effects on vestibular-mediated motion perception suggests that the drug is likely to act more as an antiemetic than as an anti-vertiginous agent.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications

OBJECTIVE: To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN: Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING: Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES: 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS: Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS: Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Complete longitudinal analyses of the randomized, placebo-controlled, phase III trial of sunitinib in patients with gastrointestinal stromal tumor following imatinib failure.

PURPOSE: To analyze final long-term survival and clinical outcomes from the randomized phase III study of sunitinib in gastrointestinal stromal tumor patients after imatinib failure; to assess correlative angiogenesis biomarkers with patient outcomes. EXPERIMENTAL DESIGN: Blinded sunitinib or placebo was given daily on a 4-week-on/2-week-off treatment schedule. Placebo-assigned patients could cross over to sunitinib at disease progression/study unblinding. Overall survival (OS) was analyzed using conventional statistical methods and the rank-preserving structural failure time (RPSFT) method to explore cross-over impact. Circulating levels of angiogenesis biomarkers were analyzed. RESULTS: In total, 243 patients were randomized to receive sunitinib and 118 to placebo, 103 of whom crossed over to open-label sunitinib. Conventional statistical analysis showed that OS converged in the sunitinib and placebo arms (median 72.7 vs. 64.9 weeks; HR, 0.876; P = 0.306) as expected, given the cross-over design. RPSFT analysis estimated median OS for placebo of 39.0 weeks (HR, 0.505, 95% CI, 0.262-1.134; P = 0.306). No new safety concerns emerged with extended sunitinib treatment. No consistent associations were found between the pharmacodynamics of angiogenesis-related plasma proteins during sunitinib treatment and clinical outcome. CONCLUSIONS: The cross-over design provided evidence of sunitinib clinical benefit based on prolonged time to tumor progression during the double-blind phase of this trial. As expected, following cross-over, there was no statistical difference in OS. RPSFT analysis modeled the absence of cross-over, estimating a substantial sunitinib OS benefit relative to placebo. Long-term sunitinib treatment was tolerated without new adverse events.