Scientific standards for human intervention trials evaluating health benefits of foods, and their application to infants, children and adolescents

Associations between the consumption of particular foods and health outcomes may be indicated by observational studies. However, intervention trials that evaluate the health benefits of foods provide the strongest evidence to support dietary recommendations for health. Thus, it is important that these trials are carried out safely, and to high scientific standards. Accepted standards for the reporting of the health benefits of pharmaceutical and other medical interventions have been provided by the Consolidated Standards of Reporting Trials (CONSORT) statement. However, there are no generally accepted standards for trials to evaluate the health benefits of foods. Trials with foods differ from medical trials in issues related to safety, ethics, research governance and practical implementation. Furthermore, these important issues can deter the conduct of both medical and nutrition trials in infants, children and adolescents. This paper provides standards for the planning, design, conduct, statistical analysis and interpretation of human intervention trials to evaluate the health benefits of foods that are based on the CONSORT guidelines, and outlines the key issues that need to be addressed in trials in participants in the paediatric age range.

The statistical significance of randomized controlled trial results is frequently fragile: A case for a Fragility Index

Objectives

A P-value <0.05 is one metric used to evaluate the results of a randomized controlled trial (RCT). We wondered how often statistically significant results in RCTs may be lost with small changes in the numbers of outcomes.

Study Design and Setting

A review of RCTs in high-impact medical journals that reported a statistically significant result for at least one dichotomous or time-to-event outcome in the abstract. In the group with the smallest number of events, we changed the status of patients without an event to an event until the P-value exceeded 0.05. We labeled this number the Fragility Index; smaller numbers indicated a more fragile result.

Results

The 399 eligible trials had a median sample size of 682 patients (range: 15-112,604) and a median of 112 events (range: 8-5,142); 53% reported a P-value <0.01. The median Fragility Index was 8 (range: 0-109); 25% had a Fragility Index of 3 or less. In 53% of trials, the Fragility Index was less than the number of patients lost to follow-up.

Conclusion

The statistically significant results of many RCTs hinge on small numbers of events. The Fragility Index complements the P-value and helps identify less robust results. 

An efficacy and mechanism evaluation study of Levosimendan for the Prevention of Acute oRgan Dysfunction in Sepsis (LeoPARDS): Protocol for a randomized controlled trial

Background

Organ dysfunction consequent to infection (‘severe sepsis’) is the leading cause of admission to an intensive care unit (ICU). In both animal models and early clinical studies the calcium channel sensitizer levosimendan has been demonstrated to have potentially beneficial effects on organ function. The aims of the Levosimendan for the Prevention of Acute oRgan Dysfunction in Sepsis (LeoPARDS) trial are to identify whether a 24-hour infusion of levosimendan will improve organ dysfunction in adults who have septic shock and to establish the safety profile of levosimendan in this group of patients.

This is a multicenter, randomized, double-blind, parallel group, placebo-controlled trial. Adults fulfilling the criteria for systemic inflammatory response syndrome due to infection, and requiring vasopressor therapy, will be eligible for inclusion in the trial. Within 24 hours of meeting these inclusion criteria, patients will be randomized in a 1:1 ratio stratified by the ICU to receive either levosimendan (0.05 to 0.2 μg.kg^-1.min^-1 or placebo for 24 hours in addition to standard care. The primary outcome measure is the mean Sequential Organ Failure Assessment (SOFA) score while in the ICU. Secondary outcomes include: central venous oxygen saturations and cardiac output; incidence and severity of renal failure using the Acute Kidney Injury Network criteria; duration of renal replacement therapy; serum bilirubin; time to liberation from mechanical ventilation; 28-day, hospital, 3 and 6 month survival; ICU and hospital length-of-stay; and days free from catecholamine therapy. Blood and urine samples will be collected on the day of inclusion, at 24 hours, and on days 4 and 6 post-inclusion for investigation of the mechanisms by which levosimendan might improve organ function. Eighty patients will have additional blood samples taken to measure levels of levosimendan and its active metabolites OR-1896 and OR-1855. A total of 516 patients will be recruited from approximately 25 ICUs in the United Kingdom.

This trial will test the efficacy of levosimendan to reduce acute organ dysfunction in adult patients who have septic shock and evaluate its biological mechanisms of action.

Evaluating early administration of the hydroxymethylglutaryl-CoA reductase inhibitor simvastatin in the prevention and treatment of delirium in critically ill ventilated patients (MoDUS trial): Study protocol for a randomized controlled trial

Background: The incidence of delirium in ventilated patients is estimated at up to 82%, and it is associated with longer intensive care and hospital stays, and long-term cognitive impairment and mortality. The pathophysiology of delirium has been linked with inflammation and neuronal apoptosis. Simvastatin has pleiotropic properties; it penetrates the brain and, as well as reducing cholesterol, reduces inflammation when used at clinically relevant doses over the short term. This is a single centre randomised, controlled trial which aims to test the hypothesis that treatment with simvastatin will modify delirium incidence and outcomes. 

Methods/Design: The ongoing study will include 142 adults admitted to the Watford General Hospital Intensive Care Unit who require mechanical ventilation in the first 72 hours of admission. The primary outcome is the number of delirium- and coma-free days in the first 14 days. Secondary outcomes include incidence of delirium, delirium- and coma-free days in the first 28 days, days in delirium and in coma at 14 and 28 days, number of ventilator-free days at 28 days, length of critical care and hospital stay, mortality, cognitive decline and healthcare resource use. Informed consent will be taken from patient's consultee before randomisation to receive either simvastatin (80 mg) or placebo once daily. Daily data will be recorded until day 28 after randomisation or until discharge from the ICU if sooner. Surviving patients will be followed up on at six months from discharge. Plasma and urine samples will be taken to investigate the biological effect of simvastatin on systemic markers of inflammation, as related to the number of delirium- and coma-free days, and the potential of cholinesterase activity and beta-amyloid as predictors of the risk of delirium and long-term cognitive impairment. 

Discussion: This trial will test the efficacy of simvastatin on reducing delirium in the critically ill. If patients receiving the statin show a reduced number of days in delirium compared with the placebo group, the inflammatory theory implicated in the pathogenesis of delirium will be strengthened. 

Consensus on Outcome Measures for Glaucoma Effectiveness Trials: Results From a Delphi and Nominal Group Technique Approaches

PURPOSE: Comparing the relative effectiveness of interventions across glaucoma trials can be problematic due to differences in definitions of outcomes. We sought to identify a key set of clinical outcomes and reach consensus on how best to measure them from the perspective of glaucoma experts.

METHODS: A 2-round electronic Delphi survey was conducted. Round 1 involved 25 items identified from a systematic review. Round 2 was developed based on information gathered in round 1. A 10-point Likert scale was used to quantify importance and consensus of outcomes (7 outcomes) and ways of measuring them (44 measures). Experts were identified through 2 glaucoma societies membership-the UK and Eire Glaucoma Society and the European Glaucoma Society. A Nominal Group Technique (NGT) followed the Delphi process. Results were analyzed using descriptive statistics.

RESULTS: A total of 65 participants completed round 1 out of 320; of whom 56 completed round 2 (86%). Agreement on the importance of outcomes was reached on 48/51 items (94%). Intraocular pressure (IOP), visual field (VF), safety, and anatomic outcomes were classified as highly important. Regarding methods of measurement of IOP, "mean follow-up IOP" using Goldmann applanation tonometry achieved the highest importance, whereas for evaluating VFs "global index mean deviation/defect (MD)" and "rate of VF progression" were the most important. Retinal nerve fiber layer (RNFL) thickness measured by optical coherence tomography (OCT) was identified as highly important. The NGT results reached consensus on "change of IOP (mean of 3 consecutive measurements taken at fixed time of day) from baseline," change of VF-MD values (3 reliable VFs at baseline and follow-up visit) from baseline, and change of RNFL thickness (2 good quality OCT images) from baseline.

CONCLUSIONS: Consensus was reached among glaucoma experts on how best to measure IOP, VF, and anatomic outcomes in glaucoma randomized controlled trials.

Learning from the QUEST multicentre feasibility randomization trials in breast reconstruction after mastectomy

BACKGROUND: Breast reconstruction aims to improve health-related quality of life after mastectomy. However, evidence guiding patients and surgeons in shared decision-making concerning the optimal type or timing of surgery is lacking.

METHODS: QUEST comprised two parallel feasibility phase III randomized multicentre trials to assess the impact of the type and timing of latissimus dorsi breast reconstruction on health-related quality of life when postmastectomy radiotherapy is unlikely (QUEST A) or highly probable (QUEST B). The primary endpoint for the feasibility phase was the proportion of women who accepted randomization, and it would be considered feasible if patient acceptability rates exceeded 25 per cent of women approached. A companion QUEST Perspectives Study (QPS) of patients (both accepting and declining trial participation) and healthcare professionals assessed trial acceptability.

RESULTS: The QUEST trials opened in 15 UK centres. After 18 months of recruitment, 17 patients were randomized to QUEST A and eight to QUEST B, with overall acceptance rates of 19 per cent (17 of 88) and 22 per cent (8 of 36) respectively. The QPS recruited 56 patients and 51 healthcare professionals. Patient preference was the predominant reason for declining trial entry, given by 47 (53 per cent) of the 88 patients approached for QUEST A and 22 (61 per cent) of the 36 approached for QUEST B. Both trials closed to recruitment in December 2012, acknowledging the challenges of achieving satisfactory patient accrual.

CONCLUSION: Despite extensive efforts to overcome recruitment barriers, it was not feasible to reach timely recruitment targets within a feasibility study. Patient preferences for breast reconstruction types and timings were common, rendering patients unwilling to enter the trial.

Clinical end points for drug treatment trials in BCR-ABL1-negative classic myeloproliferative neoplasms: consensus statements from European LeukemiaNET (ELN) and Internation Working Group-Myeloproliferative Neoplasms Research and Treatment (IWG-MRT)

The discovery of somatic mutations, primarily JAK2V617F and CALR, in classic BCR-ABL1-negative myeloproliferative neoplasms (MPNs) has generated interest in the development of molecularly targeted therapies, whose accurate assessment requires a standardized framework. A working group, comprised of members from European LeukemiaNet (ELN) and International Working Group for MPN Research and Treatment (IWG-MRT), prepared consensus-based recommendations regarding trial design, patient selection and definition of relevant end points. Accordingly, a response able to capture the long-term effect of the drug should be selected as the end point of phase II trials aimed at developing new drugs for MPNs. A time-to-event, such as overall survival, or progression-free survival or both, as co-primary end points, should measure efficacy in phase III studies. New drugs should be tested for preventing disease progression in myelofibrosis patients with early disease in randomized studies, and a time to event, such as progression-free or event-free survival should be the primary end point. Phase III trials aimed at preventing vascular events in polycythemia vera and essential thrombocythemia should be based on a selection of the target population based on new prognostic factors, including JAK2 mutation. In conclusion, we recommended a format for clinical trials in MPNs that facilitates communication between academic investigators, regulatory agencies and drug companies.

Effect of providing free glasses on children's educational outcomes in China: cluster randomized controlled trial

Objective: To assess the effect of provision of free glasses on academic performance in rural Chinese children with myopia. Design: Cluster randomized, investigator masked, controlled trial.Setting 252 primary schools in two prefectures in western China, 2012-13. Participants: 3177 of 19 934 children in fourth and fifth grades (mean age 10.5 years) with visual acuity <6/12 in either eye without glasses correctable to >6/12 with glasses. 3052 (96.0%) completed the study.Interventions Children were randomized by school (84 schools per arm) to one of three interventions at the beginning of the school year: prescription for glasses only (control group), vouchers for free glasses at a local facility, or free glasses provided in class. Main outcome measures: Spectacle wear at endline examination and end of year score on a specially designed mathematics test, adjusted for baseline score and expressed in standard deviations. Results: Among 3177 eligible children, 1036 (32.6%) were randomized to control, 988 (31.1%) to vouchers, and 1153 (36.3%) to free glasses in class. All eligible children would benefit from glasses, but only 15% wore them at baseline. At closeout glasses wear was 41% (observed) and 68% (self reported) in the free glasses group, and 26% (observed) and 37% (self reported) in the controls. Effect on test score was 0.11 SD (95% confidence interval 0.01 to 0.21) when the free glasses group was compared with the control group. The adjusted effect of providing free glasses (0.10, 0.002 to 0.19) was greater than parental education (0.03, −0.04 to 0.09) or family wealth (0.01, −0.06 to 0.08). This difference between groups was significant, but was smaller than the prespecified 0.20 SD difference that the study was powered to detect. Conclusions: The provision of free glasses to Chinese children with myopia improves children’s performance on mathematics testing to a statistically significant degree, despite imperfect compliance, although the observed difference between groups was smaller than the study was originally designed to detect. Myopia is common and rarely corrected in this setting. Trial Registration: Current Controlled Trials ISRCTN03252665.

Methodologic rigor of clinical trials on surgical management of eyes with coexisting cataract and glaucoma.

OBJECTIVE:

To assess the methodologic quality of published studies of the surgical management of coexisting cataract and glaucoma.

DESIGN:

Literature review and analysis.

METHOD:

We performed a systematic search of the literature to identify all English language articles pertaining to the surgical management of coexisting cataract and glaucoma in adults. Quality assessment was performed on all randomized controlled trials, nonrandomized controlled trials, and cohort studies. Overall quality scores and scores for individual methodologic domains were based on the evaluations of two experienced investigators who independently reviewed articles using an objective quality assessment form.

MAIN OUTCOME MEASURES:

Quality in each of five domains (representativeness, bias and confounding, intervention description, outcomes and follow-up, and statistical quality and interpretation) measured as the percentage of methodologic criteria met by each study.

RESULTS:

Thirty-six randomized controlled trials and 45 other studies were evaluated. The mean quality score for the randomized, controlled clinical trials was 63% (range, 11%-88%), and for the other studies the score was 45% (range, 3%-83%). The mean domain scores were 65% for description of therapy (range, 0%-100%), 62% for statistical analysis (range, 0%-100%), 58% for representativeness (range, 0%-94%), 49% for outcomes assessment (range, 0%-83%), and 30% for bias and confounding (range, 0%-83%). Twenty-five of the studies (31%) received a score of 0% in the bias and confounding domain for not randomizing patients, not masking the observers to treatment group, and not having equivalent groups at baseline.

CONCLUSIONS:

Greater methodologic rigor and more detailed reporting of study results, particularly in the area of bias and confounding, could improve the quality of published clinical studies assessing the surgical management of coexisting cataract and glaucoma.

The Well London program - a cluster randomized trial of community engagement for improving health behaviors and mental wellbeing: baseline survey results

Background The Well London programme used community engagement, complemented by changes to the physical and social neighbourhood environment, to improve physical activity levels, healthy eating and mental wellbeing in the most deprived communities in London. The effectiveness of Well London is being evaluated in a pair-matched cluster randomised trial (CRT). The baseline survey data are reported here. Methods The CRT involved 20 matched pairs of intervention and control communities (defined as UK census lower super output areas; ranked in the 11% most deprived LSOAs in London by Index of Multiple Deprivation) across 20 London boroughs. The primary trial outcomes, sociodemographic information and environmental neighbourhood characteristics were assessed in three quantitative components within the Well London CRT at baseline: a cross-sectional, interviewer-administered adult household survey; a self-completed, school-based adolescent questionnaire; a fieldworker completed neighbourhood environmental audit. Baseline data collection occurred in 2008. Physical activity, healthy eating and mental wellbeing were assessed using standardised, validated questionnaire tools. Multiple imputation was used to account for missing data in the outcomes and other variables in the adult and adolescent surveys. Results There were 4107 adults and 1214 adolescent respondents in the baseline surveys. The intervention and control areas were broadly comparable with respect to the primary outcomes and key sociodemographic characteristics. The environmental characteristics of the intervention and control neighbourhoods were broadly similar. There was greater between cluster variation in the primary outcomes in the adult population compared to the adolescent population. Levels of healthy eating, smoking and self-reported anxiety/depression were similar in the Well London population and the national Health Survey for England. Levels of physical activity were higher in the Well London population but this is likely to be due to the different measurement tools used in the two surveys. Conclusions Randomisation of social interventions such as Well London is acceptable and feasible and in this study the intervention and control arms are well balanced with respect to the primary outcomes and key sociodemographic characteristics. The matched design has improved the statistical efficiency of the study amongst adults but less so amongst adolescents. Follow-up data collection will be completed 2012.

Impact of carotid plaque screening on smoking cessation and other cardiovascular risk factors: a randomized controlled trial.

BACKGROUND: Screening of peripheral atherosclerosis is increasingly used, but few trials have examined its clinical impact. We aimed to assess whether carotid plaque screening helps smokers to improve their health behaviors and cardiovascular risk factors. METHODS: We randomly assigned 536 smokers aged 40 to 70 years to carotid plaque ultrasonographic screening (US group) vs no screening (control group) in addition to individual counseling and nicotine replacement therapy for all participants. Smokers with at least 1 plaque received pictures of their plaques with a 7-minute structured explanation. The outcomes included biochemically validated smoking cessation at 12 months (primary outcome) and changes in cardiovascular risk factor levels and Framingham risk score. RESULTS: At baseline, participants (mean age, 51.1 years; 45.0% women) smoked an average of 20 cigarettes per day with a median duration of 32 years. The US group had a high prevalence of carotid plaques (57.9%). At 12 months, smoking cessation rates were high, but did not differ between the US and control groups (24.9% vs 22.1%; P = .45). In the US group, cessation rates did not differ according to the presence or absence of plaques. Control of cardiovascular risk factors (ie, blood pressure and low-density lipoprotein cholesterol and hemoglobin A(1c) levels in diabetic patients) and mean absolute risk change in Framingham risk score did not differ between the groups. The mean absolute risk change in Framingham risk score was +0.6 in the US group vs +0.3 in the control group (P = .56). CONCLUSION: In smokers, carotid plaque screening performed in addition to thorough smoking cessation counseling is not associated with increased rates of smoking cessation or control of cardiovascular risk factors. Trial Registration  clinicaltrials.gov Identifier: NCT00548665.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications

OBJECTIVE: To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN: Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING: Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES: 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS: Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS: Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

A safety run-in and randomized phase 2 study of cilengitide combined with chemoradiation for newly diagnosed glioblastoma (NABTT 0306).

BACKGROUND: Cilengitide is a selective integrin inhibitor that is well tolerated and has demonstrated biologic activity in patients with recurrent malignant glioma. The primary objectives of this randomized phase 2 trial were to determine the safety and efficacy of cilengitide when combined with radiation and temozolomide for patients with newly diagnosed glioblastoma multiforme and to select a dose for comparative clinical testing. METHODS: In total, 112 patients were accrued. Eighteen patients received standard radiation and temozolomide with cilengitide in a safety run-in phase followed by a randomized phase 2 trial with 94 patients assigned to either a 500 mg dose group or 2000 mg dose group. The trial was designed to estimate overall survival benefit compared with a New Approaches to Brain Tumor Therapy (NABTT) Consortium internal historic control and data from the published European Organization for Research and Treatment of Cancer (EORTC) trial EORTC 26981. RESULTS: Cilengitide at all doses studied was well tolerated with radiation and temozolomide. The median survival was 19.7 months for all patients, 17.4 months for the patients in the 500 mg dose group, 20.8 months for patients in the 2000 mg dose group, 30 months for patients who had methylated O6-methylguanine-DNA methyltransferase (MGMT) status, and 17.4 months for patients who had unmethylated MGMT status. For patients aged ≤70 years, the median survival and survival at 24 months was superior to what was observed in the EORTC trial (20.7 months vs 14.6 months and 41% vs 27%, respectively; P = .008). CONCLUSIONS: Cilengitide was well tolerated when combined with standard chemoradiation and may improve survival for patients newly diagnosed with glioblastoma multiforme regardless of MGMT methylation status. The authors concluded that, from an efficacy and safety standpoint, future trials of this agent in this population should use the 2000 mg dose. Cancer 2012. © 2012 American Cancer Society.

Internet-Based Brief Intervention to Prevent Unhealthy Alcohol Use among Young Men: A Randomized Controlled Trial.

Alcohol use is one of the leading modifiable morbidity and mortality risk factors among young adults. 2 parallel-group randomized controlled trial with follow-up at 1 and 6 months. Internet based study in a general population sample of young men with low-risk drinking, recruited between June 2012 and February 2013. Intervention: Internet-based brief alcohol primary prevention intervention (IBI). The IBI aims at preventing an increase in alcohol use: it consists of normative feedback, feedback on consequences, calorific value alcohol, computed blood alcohol concentration, indication that the reported alcohol use is associated with no or limited risks for health. Intervention group participants received the IBI. Control group (CG) participants completed only an assessment. Alcohol use (number of drinks per week), binge drinking prevalence. Analyses were conducted in 2014-2015. Of 4365 men invited to participate, 1633 did so; 896 reported low-risk drinking and were randomized (IBI: n = 451; CG: n = 445). At baseline, 1 and 6 months, the mean (SD) number of drinks/week was 2.4(2.2), 2.3(2.6), 2.5(3.0) for IBI, and 2.4(2.3), 2.8(3.7), 2.7(3.9) for CG. Binge drinking, absent at baseline, was reported by 14.4% (IBI) and 19.0% (CG) at 1 month and by 13.3% (IBI) and 13.0% (CG) at 6 months. At 1 month, beneficial intervention effects were observed on the number of drinks/week (p = 0.05). No significant differences were observed at 6 months. We found protective short term effects of a primary prevention IBI. Controlled-Trials.com ISRCTN55991918.

An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES: To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING: We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS: Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION: Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.