Scientific standards for human intervention trials evaluating health benefits of foods, and their application to infants, children and adolescents

Associations between the consumption of particular foods and health outcomes may be indicated by observational studies. However, intervention trials that evaluate the health benefits of foods provide the strongest evidence to support dietary recommendations for health. Thus, it is important that these trials are carried out safely, and to high scientific standards. Accepted standards for the reporting of the health benefits of pharmaceutical and other medical interventions have been provided by the Consolidated Standards of Reporting Trials (CONSORT) statement. However, there are no generally accepted standards for trials to evaluate the health benefits of foods. Trials with foods differ from medical trials in issues related to safety, ethics, research governance and practical implementation. Furthermore, these important issues can deter the conduct of both medical and nutrition trials in infants, children and adolescents. This paper provides standards for the planning, design, conduct, statistical analysis and interpretation of human intervention trials to evaluate the health benefits of foods that are based on the CONSORT guidelines, and outlines the key issues that need to be addressed in trials in participants in the paediatric age range.

The statistical significance of randomized controlled trial results is frequently fragile: A case for a Fragility Index

Objectives

A P-value <0.05 is one metric used to evaluate the results of a randomized controlled trial (RCT). We wondered how often statistically significant results in RCTs may be lost with small changes in the numbers of outcomes.

Study Design and Setting

A review of RCTs in high-impact medical journals that reported a statistically significant result for at least one dichotomous or time-to-event outcome in the abstract. In the group with the smallest number of events, we changed the status of patients without an event to an event until the P-value exceeded 0.05. We labeled this number the Fragility Index; smaller numbers indicated a more fragile result.

Results

The 399 eligible trials had a median sample size of 682 patients (range: 15-112,604) and a median of 112 events (range: 8-5,142); 53% reported a P-value <0.01. The median Fragility Index was 8 (range: 0-109); 25% had a Fragility Index of 3 or less. In 53% of trials, the Fragility Index was less than the number of patients lost to follow-up.

Conclusion

The statistically significant results of many RCTs hinge on small numbers of events. The Fragility Index complements the P-value and helps identify less robust results. 

An efficacy and mechanism evaluation study of Levosimendan for the Prevention of Acute oRgan Dysfunction in Sepsis (LeoPARDS): Protocol for a randomized controlled trial

Background

Organ dysfunction consequent to infection (‘severe sepsis’) is the leading cause of admission to an intensive care unit (ICU). In both animal models and early clinical studies the calcium channel sensitizer levosimendan has been demonstrated to have potentially beneficial effects on organ function. The aims of the Levosimendan for the Prevention of Acute oRgan Dysfunction in Sepsis (LeoPARDS) trial are to identify whether a 24-hour infusion of levosimendan will improve organ dysfunction in adults who have septic shock and to establish the safety profile of levosimendan in this group of patients.

This is a multicenter, randomized, double-blind, parallel group, placebo-controlled trial. Adults fulfilling the criteria for systemic inflammatory response syndrome due to infection, and requiring vasopressor therapy, will be eligible for inclusion in the trial. Within 24 hours of meeting these inclusion criteria, patients will be randomized in a 1:1 ratio stratified by the ICU to receive either levosimendan (0.05 to 0.2 μg.kg^-1.min^-1 or placebo for 24 hours in addition to standard care. The primary outcome measure is the mean Sequential Organ Failure Assessment (SOFA) score while in the ICU. Secondary outcomes include: central venous oxygen saturations and cardiac output; incidence and severity of renal failure using the Acute Kidney Injury Network criteria; duration of renal replacement therapy; serum bilirubin; time to liberation from mechanical ventilation; 28-day, hospital, 3 and 6 month survival; ICU and hospital length-of-stay; and days free from catecholamine therapy. Blood and urine samples will be collected on the day of inclusion, at 24 hours, and on days 4 and 6 post-inclusion for investigation of the mechanisms by which levosimendan might improve organ function. Eighty patients will have additional blood samples taken to measure levels of levosimendan and its active metabolites OR-1896 and OR-1855. A total of 516 patients will be recruited from approximately 25 ICUs in the United Kingdom.

This trial will test the efficacy of levosimendan to reduce acute organ dysfunction in adult patients who have septic shock and evaluate its biological mechanisms of action.

Evaluating early administration of the hydroxymethylglutaryl-CoA reductase inhibitor simvastatin in the prevention and treatment of delirium in critically ill ventilated patients (MoDUS trial): Study protocol for a randomized controlled trial

Background: The incidence of delirium in ventilated patients is estimated at up to 82%, and it is associated with longer intensive care and hospital stays, and long-term cognitive impairment and mortality. The pathophysiology of delirium has been linked with inflammation and neuronal apoptosis. Simvastatin has pleiotropic properties; it penetrates the brain and, as well as reducing cholesterol, reduces inflammation when used at clinically relevant doses over the short term. This is a single centre randomised, controlled trial which aims to test the hypothesis that treatment with simvastatin will modify delirium incidence and outcomes. 

Methods/Design: The ongoing study will include 142 adults admitted to the Watford General Hospital Intensive Care Unit who require mechanical ventilation in the first 72 hours of admission. The primary outcome is the number of delirium- and coma-free days in the first 14 days. Secondary outcomes include incidence of delirium, delirium- and coma-free days in the first 28 days, days in delirium and in coma at 14 and 28 days, number of ventilator-free days at 28 days, length of critical care and hospital stay, mortality, cognitive decline and healthcare resource use. Informed consent will be taken from patient's consultee before randomisation to receive either simvastatin (80 mg) or placebo once daily. Daily data will be recorded until day 28 after randomisation or until discharge from the ICU if sooner. Surviving patients will be followed up on at six months from discharge. Plasma and urine samples will be taken to investigate the biological effect of simvastatin on systemic markers of inflammation, as related to the number of delirium- and coma-free days, and the potential of cholinesterase activity and beta-amyloid as predictors of the risk of delirium and long-term cognitive impairment. 

Discussion: This trial will test the efficacy of simvastatin on reducing delirium in the critically ill. If patients receiving the statin show a reduced number of days in delirium compared with the placebo group, the inflammatory theory implicated in the pathogenesis of delirium will be strengthened. 

Consensus on Outcome Measures for Glaucoma Effectiveness Trials: Results From a Delphi and Nominal Group Technique Approaches

PURPOSE: Comparing the relative effectiveness of interventions across glaucoma trials can be problematic due to differences in definitions of outcomes. We sought to identify a key set of clinical outcomes and reach consensus on how best to measure them from the perspective of glaucoma experts.

METHODS: A 2-round electronic Delphi survey was conducted. Round 1 involved 25 items identified from a systematic review. Round 2 was developed based on information gathered in round 1. A 10-point Likert scale was used to quantify importance and consensus of outcomes (7 outcomes) and ways of measuring them (44 measures). Experts were identified through 2 glaucoma societies membership-the UK and Eire Glaucoma Society and the European Glaucoma Society. A Nominal Group Technique (NGT) followed the Delphi process. Results were analyzed using descriptive statistics.

RESULTS: A total of 65 participants completed round 1 out of 320; of whom 56 completed round 2 (86%). Agreement on the importance of outcomes was reached on 48/51 items (94%). Intraocular pressure (IOP), visual field (VF), safety, and anatomic outcomes were classified as highly important. Regarding methods of measurement of IOP, "mean follow-up IOP" using Goldmann applanation tonometry achieved the highest importance, whereas for evaluating VFs "global index mean deviation/defect (MD)" and "rate of VF progression" were the most important. Retinal nerve fiber layer (RNFL) thickness measured by optical coherence tomography (OCT) was identified as highly important. The NGT results reached consensus on "change of IOP (mean of 3 consecutive measurements taken at fixed time of day) from baseline," change of VF-MD values (3 reliable VFs at baseline and follow-up visit) from baseline, and change of RNFL thickness (2 good quality OCT images) from baseline.

CONCLUSIONS: Consensus was reached among glaucoma experts on how best to measure IOP, VF, and anatomic outcomes in glaucoma randomized controlled trials.

Learning from the QUEST multicentre feasibility randomization trials in breast reconstruction after mastectomy

BACKGROUND: Breast reconstruction aims to improve health-related quality of life after mastectomy. However, evidence guiding patients and surgeons in shared decision-making concerning the optimal type or timing of surgery is lacking.

METHODS: QUEST comprised two parallel feasibility phase III randomized multicentre trials to assess the impact of the type and timing of latissimus dorsi breast reconstruction on health-related quality of life when postmastectomy radiotherapy is unlikely (QUEST A) or highly probable (QUEST B). The primary endpoint for the feasibility phase was the proportion of women who accepted randomization, and it would be considered feasible if patient acceptability rates exceeded 25 per cent of women approached. A companion QUEST Perspectives Study (QPS) of patients (both accepting and declining trial participation) and healthcare professionals assessed trial acceptability.

RESULTS: The QUEST trials opened in 15 UK centres. After 18 months of recruitment, 17 patients were randomized to QUEST A and eight to QUEST B, with overall acceptance rates of 19 per cent (17 of 88) and 22 per cent (8 of 36) respectively. The QPS recruited 56 patients and 51 healthcare professionals. Patient preference was the predominant reason for declining trial entry, given by 47 (53 per cent) of the 88 patients approached for QUEST A and 22 (61 per cent) of the 36 approached for QUEST B. Both trials closed to recruitment in December 2012, acknowledging the challenges of achieving satisfactory patient accrual.

CONCLUSION: Despite extensive efforts to overcome recruitment barriers, it was not feasible to reach timely recruitment targets within a feasibility study. Patient preferences for breast reconstruction types and timings were common, rendering patients unwilling to enter the trial.

Clinical end points for drug treatment trials in BCR-ABL1-negative classic myeloproliferative neoplasms: consensus statements from European LeukemiaNET (ELN) and Internation Working Group-Myeloproliferative Neoplasms Research and Treatment (IWG-MRT)

The discovery of somatic mutations, primarily JAK2V617F and CALR, in classic BCR-ABL1-negative myeloproliferative neoplasms (MPNs) has generated interest in the development of molecularly targeted therapies, whose accurate assessment requires a standardized framework. A working group, comprised of members from European LeukemiaNet (ELN) and International Working Group for MPN Research and Treatment (IWG-MRT), prepared consensus-based recommendations regarding trial design, patient selection and definition of relevant end points. Accordingly, a response able to capture the long-term effect of the drug should be selected as the end point of phase II trials aimed at developing new drugs for MPNs. A time-to-event, such as overall survival, or progression-free survival or both, as co-primary end points, should measure efficacy in phase III studies. New drugs should be tested for preventing disease progression in myelofibrosis patients with early disease in randomized studies, and a time to event, such as progression-free or event-free survival should be the primary end point. Phase III trials aimed at preventing vascular events in polycythemia vera and essential thrombocythemia should be based on a selection of the target population based on new prognostic factors, including JAK2 mutation. In conclusion, we recommended a format for clinical trials in MPNs that facilitates communication between academic investigators, regulatory agencies and drug companies.

Effect of providing free glasses on children's educational outcomes in China: cluster randomized controlled trial

Objective: To assess the effect of provision of free glasses on academic performance in rural Chinese children with myopia. Design: Cluster randomized, investigator masked, controlled trial.Setting 252 primary schools in two prefectures in western China, 2012-13. Participants: 3177 of 19 934 children in fourth and fifth grades (mean age 10.5 years) with visual acuity <6/12 in either eye without glasses correctable to >6/12 with glasses. 3052 (96.0%) completed the study.Interventions Children were randomized by school (84 schools per arm) to one of three interventions at the beginning of the school year: prescription for glasses only (control group), vouchers for free glasses at a local facility, or free glasses provided in class. Main outcome measures: Spectacle wear at endline examination and end of year score on a specially designed mathematics test, adjusted for baseline score and expressed in standard deviations. Results: Among 3177 eligible children, 1036 (32.6%) were randomized to control, 988 (31.1%) to vouchers, and 1153 (36.3%) to free glasses in class. All eligible children would benefit from glasses, but only 15% wore them at baseline. At closeout glasses wear was 41% (observed) and 68% (self reported) in the free glasses group, and 26% (observed) and 37% (self reported) in the controls. Effect on test score was 0.11 SD (95% confidence interval 0.01 to 0.21) when the free glasses group was compared with the control group. The adjusted effect of providing free glasses (0.10, 0.002 to 0.19) was greater than parental education (0.03, −0.04 to 0.09) or family wealth (0.01, −0.06 to 0.08). This difference between groups was significant, but was smaller than the prespecified 0.20 SD difference that the study was powered to detect. Conclusions: The provision of free glasses to Chinese children with myopia improves children’s performance on mathematics testing to a statistically significant degree, despite imperfect compliance, although the observed difference between groups was smaller than the study was originally designed to detect. Myopia is common and rarely corrected in this setting. Trial Registration: Current Controlled Trials ISRCTN03252665.

Methodologic rigor of clinical trials on surgical management of eyes with coexisting cataract and glaucoma.

OBJECTIVE:

To assess the methodologic quality of published studies of the surgical management of coexisting cataract and glaucoma.

DESIGN:

Literature review and analysis.

METHOD:

We performed a systematic search of the literature to identify all English language articles pertaining to the surgical management of coexisting cataract and glaucoma in adults. Quality assessment was performed on all randomized controlled trials, nonrandomized controlled trials, and cohort studies. Overall quality scores and scores for individual methodologic domains were based on the evaluations of two experienced investigators who independently reviewed articles using an objective quality assessment form.

MAIN OUTCOME MEASURES:

Quality in each of five domains (representativeness, bias and confounding, intervention description, outcomes and follow-up, and statistical quality and interpretation) measured as the percentage of methodologic criteria met by each study.

RESULTS:

Thirty-six randomized controlled trials and 45 other studies were evaluated. The mean quality score for the randomized, controlled clinical trials was 63% (range, 11%-88%), and for the other studies the score was 45% (range, 3%-83%). The mean domain scores were 65% for description of therapy (range, 0%-100%), 62% for statistical analysis (range, 0%-100%), 58% for representativeness (range, 0%-94%), 49% for outcomes assessment (range, 0%-83%), and 30% for bias and confounding (range, 0%-83%). Twenty-five of the studies (31%) received a score of 0% in the bias and confounding domain for not randomizing patients, not masking the observers to treatment group, and not having equivalent groups at baseline.

CONCLUSIONS:

Greater methodologic rigor and more detailed reporting of study results, particularly in the area of bias and confounding, could improve the quality of published clinical studies assessing the surgical management of coexisting cataract and glaucoma.

The effects of blood pressure lowering on development of cognitive impairment and dementia in patients without apparent prior cerebrovascular disease

BACKGROUND: Hypertension and cognitive impairment are prevalent in older people. It is known that hypertension is a direct risk factor for vascular dementia and recent studies have suggested hypertension also impacts upon prevalence of Alzheimer's disease. The question is therefore whether treatment of hypertension lowers the rate of cognitive decline. OBJECTIVES: To assess the effects of blood pressure lowering treatments for the prevention of dementia and cognitive decline in patients with hypertension but no history of cerebrovascular disease. SEARCH STRATEGY: The trials were identified through a search of CDCIG's Specialised Register, CENTRAL, MEDLINE, EMBASE, PsycINFO and CINAHL on 27 April 2005. SELECTION CRITERIA: Randomized, double-blind, placebo controlled trials in which pharmacological or non-pharmacological interventions to lower blood pressure were given for at least six months. DATA COLLECTION AND ANALYSIS: Two independent reviewers assessed trial quality and extracted data. The following outcomes were assessed: incidence of dementia, cognitive change from baseline, blood pressure level, incidence and severity of side effects and quality of life. MAIN RESULTS: Three trials including 12,091 hypertensive subjects were identified. Average age was 72.8 years. Participants were recruited from industrialised countries. Mean blood pressure at entry across the studies was 170/84 mmHg. All trials instituted a stepped care approach to hypertension treatment, starting with a calcium-channel blocker, a diuretic or an angiotensin receptor blocker. The combined result of the three trials reporting incidence of dementia indicated no significant difference between treatment and placebo (Odds Ratio (OR) = 0.89, 95% CI 0.69, 1.16). Blood pressure reduction resulted in a 11% relative risk reduction of dementia in patients with no prior cerebrovascular disease but this effect was not statistically significant (p = 0.38) and there was considerable heterogeneity between the trials. The combined results from the two trials reporting change in Mini Mental State Examination (MMSE) did not indicate a benefit from treatment (Weighted Mean Difference (WMD) = 0.10, 95% CI -0.03, 0.23). Both systolic and diastolic blood pressure levels were reduced significantly in the two trials assessing this outcome (WMD = -7.53, 95% CI -8.28, -6.77 for systolic blood pressure, WMD = -3.87, 95% CI -4.25, -3.50 for diastolic blood pressure).Two trials reported adverse effects requiring discontinuation of treatment and the combined results indicated a significant benefit from placebo (OR = 1.18, 95% CI 1.06, 1.30). When analysed separately, however, more patients on placebo in SCOPE were likely to discontinue treatment due to side effects; the converse was true in SHEP 1991. Quality of life data could not be analysed in the three studies. There was difficulty with the control group in this review as many of the control subjects received antihypertensive treatment because their blood pressures exceeded pre-set values. In most cases the study became a comparison between the study drug against a usual antihypertensive regimen. AUTHORS' CONCLUSIONS: There was no convincing evidence from the trials identified that blood pressure lowering prevents the development of dementia or cognitive impairment in hypertensive patients with no apparent prior cerebrovascular disease. There were significant problems identified with analysing the data, however, due to the number of patients lost to follow-up and the number of placebo patients given active treatment. This introduced bias. More robust results may be obtained by analysing one year data to reduce differential drop-out or by conducting a meta-analysis using individual patient data.

Multicenter Randomized Controlled Trial of Withdrawal of Inhaled Corticosteroids in Cystic Fibrosis

Rationale: Lung inflammation and injury is critical in cystic fibrosis. An ideal antiinflammatory agent has not been identified but inhaled corticosteroids are widely used despite lack of evidence.

Objectives: To test the safety of withdrawal of inhaled corticosteroids with the hypothesis this would not be associated with an earlier onset of acute chest exacerbations.

Methods: Multicenter randomized double-blind placebo-controlled trial in 18 pediatric and adult UK centers. Eligibility criteria included age > 6.0 yr, FEV1 ? 40% predicted, and corticosteroid use > 3 mo. During the 2-mo run-in period, all patients received fluticasone; they then took either fluticasone or placebo for 6 mo.

Measurements and Main Results: Fluticasone group: n = 84, median age 14.6 yr, mean (SD) FEV1 76% (18); placebo group: n = 87, median age 15.8 yr, mean (SD) FEV1 76% (18). There was no difference in time to first exacerbation (primary outcome) with hazard ratio (95% confidence interval) of 1.07 (0.68 to 1.70) for fluticasone versus placebo. There was no effect of age, atopy, corticosteroid dose, FEV1, or Pseudomonas aeruginosa status. There was no change in lung function or differences in antibiotic or rescue bronchodilator use. Fewer patients in the fluticasone group withdrew from the study due to lung-related adverse events (9 vs. 15%); with a relative risk (95% confidence interval) of 0.59 (0.23–1.48) fluticasone versus placebo.

Conclusions: In this study population (applicable to 40% of patients with cystic fibrosis in the UK), it appears safe to consider stopping inhaled corticosteroids. Potential advantages will be to reduce the drug burden on patients, reduce adverse effects, and make financial savings.

Randomized controlled trial of interferential therapy and manipulative therapy for acute low back pain.

Study Design. A multi-center assessor-blinded randomized clinical trial was conducted. Objectives. To investigate the relative effectiveness of interferential therapy and manipulative therapy for patients with acute low back pain when used as sole treatments and in combination. Summary of Background Data. Both manipulative therapy and interferential therapy are commonly used treatments for low back pain. Evidence for the effectiveness of manipulative therapy is available only for the short term. There is no evidence for interferential therapy and no study has investigated the effectiveness of interferential therapy combined with manipulative therapy. Methods. Consenting subjects (n=240) were randomly assigned to receive a copy of the Back Book and either manipulative therapy (MT; n=80), interferential therapy (IFT; n=80) or combined manipulative therapy and interferential therapy (CT; n=80). Follow-up outcome questionnaires were posted at discharge, 6 and 12 months. Results. The groups were balanced at baseline for low back pain and demographic characteristics. All interventions were found to significantly reduce functional disability and pain and increase quality of life at discharge and to maintain these improvements at 6 and 12 months. No significant differences were found between groups for reported LBP recurrence, work absenteeism, medication consumption, exercise participation and healthcare use at 12 months. Conclusions. For acute low back pain, interferential therapy whether used in isolation or in combination with manipulative therapy was as effective as manipulative therapy alone (in addition to the Back Book).