Patient-reported outcomes in randomised controlled trials on age-related macular degeneration

BACKGROUND/AIMS: The purpose of this systematic review was to identify the frequency and type of patient-reported outcome measures (PROMs) used in recent randomised controlled trials (RCTs) for age-related macular degeneration (AMD).

METHODS: The authors conducted a systematic search between January 2010 and November 2013 in MEDLINE, EMBASE, Scopus, Cochrane Library (Central) and the clinical trials registries (http://www.controlled-trials.com and http://www.ClinicalTrials.gov) according to defined inclusion criteria (RCTs on AMD in English). Two independent reviewers evaluated studies for inclusion. One reviewer extracted data of included studies, and a second masked reviewer assessed 10% to confirm accuracy in data collection. Reference lists of included papers and appendices of relevant Cochrane systematic reviews were scanned to identify other relevant RCTs. Information collected on extracted outcomes was analysed using descriptive statistics.

RESULTS: Literature and registry search yielded 3816 abstracts of journal articles and 493 records from trial registries. A total of 177 RCTs were deemed to have met inclusion criteria. Of the 858 outcomes reported, 38 outcomes were identified as PROMs (4.4%). Of the 177 RCTs examined, PROMs were used in 25 trials (14.1%). The National Eye Institute Visual Function Questionnaire-25 was the most frequently used PROM instrument (64% of RCTs with PROMs included).

CONCLUSIONS: This review highlights that a small proportion of AMD RCTs included PROMs as outcome measures and that there was a variety in the instruments used.

Design characteristic of randomised controlled trials for geographic atrophy in age-related macular degeneration: selection of outcomes and sample size calculation

PurposeThe selection of suitable outcomes and sample size calculation are critical factors in the design of a randomised controlled trial (RCT). The goal of this study was to identify the range of outcomes and information on sample size calculation in RCTs on geographic atrophy (GA).MethodsWe carried out a systematic review of age-related macular degeneration (AMD) RCTs. We searched MEDLINE, EMBASE, Scopus, Cochrane Library, www.controlled-trials.com, and www.ClinicalTrials.gov. Two independent reviewers screened records. One reviewer collected data and the second reviewer appraised 10% of collected data. We scanned references lists of selected papers to include other relevant RCTs.ResultsLiterature and registry search identified 3816 abstracts of journal articles and 493 records from trial registries. From a total of 177 RCTs on all types of AMD, 23 RCTs on GA were included. Eighty-one clinical outcomes were identified. Visual acuity (VA) was the most frequently used outcome, presented in 18 out of 23 RCTs and followed by the measures of lesion area. For sample size analysis, 8 GA RCTs were included. None of them provided sufficient Information on sample size calculations.ConclusionsThis systematic review illustrates a lack of standardisation in terms of outcome reporting in GA trials and issues regarding sample size calculation. These limitations significantly hamper attempts to compare outcomes across studies and also perform meta-analyses.

Individual Participant Data (IPD) Meta-analyses of Randomised Controlled Trials: Guidance on Their Use

Jayne Tierney and colleagues offer guidance on how to spot a well-designed and well-conducted individual participant data meta-analysis.

Summary Points 

• Systematic reviews are most commonly based on aggregate data extracted from publications or obtained from trial investigators. 

• Systematic reviews involving the central collection and analysis of individual participant data (IPD) usually are larger-scale, international, collaborative projects that can bring about substantial improvements to the quantity and quality of data, give greater scope in the analyses, and provide more detailed and robust results. 

• The process of collecting, checking, and analysing IPD is more complex than for aggregate data, and not all IPD meta-analyses are done to the same standard, making it difficult for researchers, clinicians, patients, policy makers, funders, and publishers to judge their quality. 

• Following our step-by-step guide will help reviewers and users of IPD meta-analyses to understand them better and recognise those that are well designed and conducted and so help ensure that policy, practice, and research are informed by robust evidence about the effects of interventions.

Exploring the Findings from Three Randomised Controlled Trials of Bookgifting Programmes

Aims: This paper explores the effects from three similar bookgifting programmes on improving reading outcomes of early years’ children, their parents and teachers.
Methods: The paper draws on research data produced by the Centre for Effective Education during three randomised controlled trial (RCT) evaluations of bookgifting programmes (N=1694 participant families in total). The three studies used pre and post test measures to identify effects across a total of 15 social, cognitive and behavioural reading outcomes.
Results: The overall average effect across the 15 outcomes from data provided by 1694 participant families, was d=0.07. This is a relatively small overall effect and there was an overall pattern of small positive effects of this scale across the wide range of the reading outcomes assessed. However, only one significant effect was identified in the 15 outcomes assessed across all three studies.
Conclusions: The review of these three studies suggests that the RCTs struggle to identify significant effects in these low exposure and low cost bookgifting interventions. Furthermore, it is recommended that future RCT studies of this type of programme require very large sample sizes in the scale of 1000’s rather than 100’s to generate enough study power. Or alternatively, these programmes could be evaluated as a component part of more intensive reading interventions.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications

OBJECTIVE: To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN: Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING: Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES: 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS: Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS: Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Donepezil for the symptomatic treatment of patients with mild to moderate Alzheimer's disease: a meta-analysis of individual patient data from randomised controlled trials

Background: The objective was to evaluate the efficacy and tolerability of donepezil (5 and 10 mg/day) compared with placebo in alleviating manifestations of mild to moderate Alzheimer's disease (AD). Method: A systematic review of individual patient data from Phase II and III double-blind, randomised, placebo-controlled studies of up to 24 weeks and completed by 20 December 1999. The main outcome measures were the ADAS-cog, the CIBIC-plus, and reports of adverse events. Results: A total of 2376 patients from ten trials were randomised to either donepezil 5 mg/day (n = 821), 10 mg/day (n = 662) or placebo (n = 893). Cognitive performance was better in patients receiving donepezil than in patients receiving placebo. At 12 weeks the differences in ADAS-cog scores were 5 mg/day-placebo: - 2.1 [95% confidence interval (CI), - 2.6 to - 1.6; p < 0.001], 10 mg/day-placebo: - 2.5 ( - 3.1 to - 2.0; p < 0.001). The corresponding results at 24 weeks were - 2.0 ( - 2.7 to - 1.3; p < 0.001) and - 3.1 ( - 3.9 to - 2.4; p < 0.001). The difference between the 5 and 10 mg/day doses was significant at 24 weeks (p = 0.005). The odds ratios (OR) of improvement on the CIBIC-plus at 12 weeks were: 5 mg/day-placebo 1.8 (1.5 to 2.1; p < 0.001), 10 mg/day-placebo 1.9 (1.5 to 2.4; p < 0.001). The corresponding values at 24 weeks were 1.9 (1.5 to 2.4; p = 0.001) and 2.1 (1.6 to 2.8; p < 0.001). Donepezil was well tolerated; adverse events were cholinergic in nature and generally of mild severity and brief in duration. Conclusion: Donepezil (5 and 10 mg/day) provides meaningful benefits in alleviating deficits in cognitive and clinician-rated global function in AD patients relative to placebo. Increased improvements in cognition were indicated for the higher dose. Copyright © 2004 John Wiley & Sons, Ltd.

Diet rich in high glucoraphanin broccoli reduces plasma LDL cholesterol: evidence from randomised controlled trials

Cruciferous-rich diets have been associated with reduction in plasma LDL-cholesterol (LDL-C), which may be due to the action of isothiocyanates derived from glucosinolates that accumulate in these vegetables. This study tests the hypothesis that a diet rich in high glucoraphanin (HG) broccoli will reduce plasma LDL-C. METHODS AND RESULTS: One hundred and thirty volunteers were recruited to two independent double-blind, randomly allocated parallel dietary intervention studies, and were assigned to consume either 400 g standard broccoli or 400 g HG broccoli per week for 12 weeks. Plasma lipids were quantified before and after the intervention. In study 1 (37 volunteers), the HG broccoli diet reduced plasma LDL-C by 7.1% (95% CI: -1.8%, -12.3%, p = 0.011), whereas standard broccoli reduced LDL-C by 1.8% (95% CI +3.9%, -7.5%, ns). In study 2 (93 volunteers), the HG broccoli diet resulted in a reduction of 5.1% (95% CI: -2.1%, -8.1%, p = 0.001), whereas standard broccoli reduced LDL-C by 2.5% (95% CI: +0.8%, -5.7%, ns). When data from the two studies were combined the reduction in LDL-C by the HG broccoli was significantly greater than standard broccoli (p = 0.031). CONCLUSION: Evidence from two independent human studies indicates that consumption of high glucoraphanin broccoli significantly reduces plasma LDL-C

An investigation of the shortcomings of the CONSORT 2010 statement for the reporting of group sequential randomised controlled trials: a methodological systematic review

Background It can be argued that adaptive designs are underused in clinical research. We have explored concerns related to inadequate reporting of such trials, which may influence their uptake. Through a careful examination of the literature, we evaluated the standards of reporting of group sequential (GS) randomised controlled trials, one form of a confirmatory adaptive design. Methods We undertook a systematic review, by searching Ovid MEDLINE from the 1st January 2001 to 23rd September 2014, supplemented with trials from an audit study. We included parallel group, confirmatory, GS trials that were prospectively designed using a Frequentist approach. Eligible trials were examined for compliance in their reporting against the CONSORT 2010 checklist. In addition, as part of our evaluation, we developed a supplementary checklist to explicitly capture group sequential specific reporting aspects, and investigated how these are currently being reported. Results Of the 284 screened trials, 68(24%) were eligible. Most trials were published in “high impact” peer-reviewed journals. Examination of trials established that 46(68%) were stopped early, predominantly either for futility or efficacy. Suboptimal reporting compliance was found in general items relating to: access to full trials protocols; methods to generate randomisation list(s); details of randomisation concealment, and its implementation. Benchmarking against the supplementary checklist, GS aspects were largely inadequately reported. Only 3(7%) trials which stopped early reported use of statistical bias correction. Moreover, 52(76%) trials failed to disclose methods used to minimise the risk of operational bias, due to the knowledge or leakage of interim results. Occurrence of changes to trial methods and outcomes could not be determined in most trials, due to inaccessible protocols and amendments. Discussion and Conclusions There are issues with the reporting of GS trials, particularly those specific to the conduct of interim analyses. Suboptimal reporting of bias correction methods could potentially imply most GS trials stopping early are giving biased results of treatment effects. As a result, research consumers may question credibility of findings to change practice when trials are stopped early. These issues could be alleviated through a CONSORT extension. Assurance of scientific rigour through transparent adequate reporting is paramount to the credibility of findings from adaptive trials. Our systematic literature search was restricted to one database due to resource constraints.

Systematic review of randomised controlled trials of sildenafil (Viagra®) in the treatment of male erectile dysfunction.

Background: Sildenafil (Viagra®), a new oral drug for the treatment of erectile dysfunction, was licensed for use across Europe in 1998. Aim: To examine the effectiveness and safety of sildenafil as an oral treatment for erectile dysfunction. Design of study: Systematic review and meta-analysis.
Setting: All published or unpublished randomised controlled trials comparing sildenafil with a placebo or alternative therapies. Method: Published studies were sought by computerised searches of electronic databases using the keywords ‘sildenafil’ and ‘Viagra’. A hand search was also done of the British Medical Journal, Lancet, Journal of the American
Medical Association, New England Journal of Medicine, British Journal of General Practice, Drug, Inpharma and Scrip. An assessment of quality of all identified studies and data extraction was undertaken independently by two researchers. Results were combined in a meta-analysis where appropriate, using RevMan version 3. Results: Twenty-one trials were identified. All trials showed a statistically significant improvement in erectile or sexual function in patients using sildenafil compared with a placebo. A meta-analysis of 16 trials reporting a global efficacy response showed that men were 3.57 (95% CI = 2.93–4.43) times as likely to have improved erections on sildenafil compared with those on a placebo. The number needed to treat to have one man with improved erections was two. The drug has a relatively safe side-effect profile. Conclusions: Available research shows that sildenafil is an effective treatment for male erectile dysfunction. Many trial participants had some baseline erectile function and it is probable that in clinical practice, where the erectile function tends to be more impaired, the number needed to treat may be higher.

Randomised controlled trials and 'unexpected' adverse events associated with newly released drugs : improvements in pharmacovigilance systems are necessary for real-time identification of patient safety risks

Adverse drug events are one of the major causes of morbidity in developed countries, yet the drugs involved in these events have been trialled and approved on the basis of randomised controlled trials (RCTs), regarded as the study design that will produce the best evidence.

Though the focus on adverse drug events has been primarily on processes and outcomes associated with the use of these approved drugs, attention needs to be directed to the way in which the RCT study design is structured. The implementation of controls to achieve internal validity in RCTs may be the very controls that reduce external validity, and contribute to the levels of adverse drug events associated with the release of a new drug to the wider patient population.

An examination of these controls, and the effects they can have on patient safety, underscore the importance of knowing about how the clinical trials of a drug are undertaken, rather than relying only on the recorded outcomes.

As the majority of new drugs are likely to be prescribed to older patients who have one or more comorbidities in addition to that targeted by a new drug, and as the RCTs of those drugs typically under-represent the elderly and exclude patients with multiple comorbidities, timely assessment of drug safety signals is essential.

It is unlikely that regulatory jurisdictions will undertake a reassessment of safety issues for drugs that are already approved. Instead, reliance has been placed on adverse drug event reporting systems. Such systems have a very low reporting rate, and most adverse drug events remain unreported, to the eventual cost to patients and healthcare systems.

This makes it essential for near real-time systems that can pick up safety signals as they occur, so that modifications to the product information (or removal of the drug) can be implemented.

Physical activity for cancer survivors : a meta-analysis of randomised controlled trials

Objective To systematically evaluate the effects of physical activity in adult patients after completion of main treatment related to cancer. Design Meta-analysis of randomised controlled trials with data extraction and quality assessment performed independently by two researchers. Data sources Pubmed, CINAHL, and Google Scholar from the earliest possible year to September 2011. References from meta-analyses and reviews. Study selection Randomised controlled trials that assessed the effects of physical activity in adults who had completed their main cancer treatment, except hormonal treatment. Results There were 34 randomised controlled trials, of which 22 (65%) focused on patients with breast cancer, and 48 outcomes in our meta-analysis. Twenty two studies assessed aerobic exercise, and four also included resistance or strength training. The median duration of physical activity was 13 weeks (range 3-60 weeks). Most control groups were considered sedentary or were assigned no exercise. Based on studies on patients with breast cancer, physical activity was associated with improvements in insulin-like growth factor-I, bench press, leg press, fatigue, depression, and quality of life. When we combined studies on different types of cancer, we found significant improvements in body mass index (BMI), body weight, peak oxygen consumption, peak power output, distance walked in six minutes, right handgrip strength, and quality of life. Sources of study heterogeneity included age, study quality, study size, and type and duration of physical activity. Publication bias did not alter our conclusions. Conclusions Physical activity has positive effects on physiology, body composition, physical functions, psychological outcomes, and quality of life in patients after treatment for breast cancer. When patients with cancer other than breast cancer were also included, physical activity was associated with reduced BMI and body weight, increased peak oxygen consumption and peak power output, and improved quality of life.

Sucrose and lollypops to reduce immunisation pain in toddlers and young children: two pilot randomised controlled trials

Aims To evaluate the feasibility, acceptability and preliminary efficacy of sweet taste in reducing pain in toddlers and pre-school children during immunisation and to use the results to inform a sample size estimation for future full-scale trials. Background Sweet solutions reduce procedural pain in newborn infants and in infants beyond the newborn period. It is unclear if sweet taste continues to reduce procedural pain in children older than one year of age. Design Two parallel design pilot randomised controlled trials (RCTs). Methods Children attending an Immunisation Drop-in Clinic at a children's hospital in Australia participated in one of two pilot RCTs: 1) a double-blinded RCT of 33% sucrose compared to water in toddlers receiving their 12- or 18-month immunisation or 2) a non-blinded RCT of lollypop compared to standard care (active distraction using bubble and pin wheel blowing) in pre-school children aged 3-5 years. Primary outcomes included cry incidence and duration and pain score using the FLACC. Results Interventions, standard care and all aspects of the study were acceptable to children, parents and immunisation nurses. More toddlers in the sucrose group received their 12-month immunisation and more injections (n=35) compared to toddlers randomised to water (n=26). There were no significant differences in crying time or pain scores between intervention and control groups in either pilot RCT. Conclusion The study interventions are acceptable to children and parents. Full-scale trials would be feasible to conduct. Implications for clinical practice Toddlers receiving their 12-month immunisation should be the focus of future full-scale RCTs.

The impact of whole-of-diet interventions on depression and anxiety: a systematic review of randomised controlled trials

Non-pharmacological approaches to the treatment of depression and anxiety are of increasing importance, with emerging evidence supporting a role for lifestyle factors in the development of these disorders. Observational evidence supports a relationship between habitual diet quality and depression. Less is known about the causative effects of diet on mental health outcomes. Therefore a systematic review was undertaken of randomised controlled trials of dietary interventions that used depression and/or anxiety outcomes and sought to identify characteristics of programme success.

Randomised controlled trials in child health in developing countries: trends and lessons over 11 years.

Using a uniform systematic approach annually, we reviewed 1553 publications from randomised controlled trials in child health in developing countries published between July 2002 and June 2013. There were annual increases in such publications, from 38 in the 12 months to July 2003 to over 200 in each of 2012 and 2013. These trials involved children in 76 developing countries. Studies of nutrition (366 publications, 23.6%) and malaria (336 publications, 21%) predominated. 79% of nutrition trials have been of micronutrients (288 publications), with comparatively few publications related to macronutrient interventions or complimentary feeding (48 publications) or measures to improve breast feeding (20 publications). Trials of malaria have involved a comprehensive range of treatment and preventive strategies and have heralded the implementation of new interventions as routine health strategies, and reductions in malaria in each affected country in the world in the last decade. There have been a relatively small number of trials of interventions for treatment or prevention of acute respiratory infection (98 publications, 6.3%), neonatal health (64 publications, 4.1%) and tuberculosis in children (26 publications, 1.7%). In the last 5 years there has been increasing focus on non-communicable diseases such as asthma and allergy, obesity, diabetes and cardiac disease, and behavioural-developmental disorders. Mental health conditions have received little attention (21 publications, 1.4% of publications). There is increasing research activity and capacity in child health in developing countries. Some areas have been the subject of a large amount of research, and have led to the design and implementation of effective public health interventions and reduced disease burdens, while in other areas comprehensive approaches and the systematic application of research findings have been lacking.