Preferred Reporting Items for a Systematic Review and Meta-analysis of Individual Participant Data The PRISMA-IPD Statement

IMPORTANCE Systematic reviews and meta-analyses of individual participant data (IPD) aim to collect, check, and reanalyze individual-level data from all studies addressing a particular research question and are therefore considered a gold standard approach to evidence synthesis. They are likely to be used with increasing frequency as current initiatives to share clinical trial data gain momentum and may be particularly important in reviewing controversial therapeutic areas.

OBJECTIVE To develop PRISMA-IPD as a stand-alone extension to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Statement, tailored to the specific requirements of reporting systematic reviews and meta-analyses of IPD. Although developed primarily for reviews of randomized trials, many items will apply in other contexts, including reviews of diagnosis and prognosis.

DESIGN Development of PRISMA-IPD followed the EQUATOR Network framework guidance and used the existing standard PRISMA Statement as a starting point to draft additional relevant material. A web-based survey informed discussion at an international workshop that included researchers, clinicians, methodologists experienced in conducting systematic reviews and meta-analyses of IPD, and journal editors. The statement was drafted and iterative refinements were made by the project, advisory, and development groups. The PRISMA-IPD Development Group reached agreement on the PRISMA-IPD checklist and flow diagram by consensus.

FINDINGS Compared with standard PRISMA, the PRISMA-IPD checklist includes 3 new items that address (1) methods of checking the integrity of the IPD (such as pattern of randomization, data consistency, baseline imbalance, and missing data), (2) reporting any important issues that emerge, and (3) exploring variation (such as whether certain types of individual benefit more from the intervention than others). A further additional item was created by reorganization of standard PRISMA items relating to interpreting results. Wording was modified in 23 items to reflect the IPD approach.

CONCLUSIONS AND RELEVANCE PRISMA-IPD provides guidelines for reporting systematic reviews and meta-analyses of IPD.

Impact of smoking and smoking cessation on cardiovascular events and mortality among older adults: meta-analysis of individual participant data from prospective cohort studies of the CHANCES consortium

OBJECTIVE: To investigate the impact of smoking and smoking cessation on cardiovascular mortality, acute coronary events, and stroke events in people aged 60 and older, and to calculate and report risk advancement periods for cardiovascular mortality in addition to traditional epidemiological relative risk measures.

DESIGN: Individual participant meta-analysis using data from 25 cohorts participating in the CHANCES consortium. Data were harmonised, analysed separately employing Cox proportional hazard regression models, and combined by meta-analysis.

RESULTS: Overall, 503,905 participants aged 60 and older were included in this study, of whom 37,952 died from cardiovascular disease. Random effects meta-analysis of the association of smoking status with cardiovascular mortality yielded a summary hazard ratio of 2.07 (95% CI 1.82 to 2.36) for current smokers and 1.37 (1.25 to 1.49) for former smokers compared with never smokers. Corresponding summary estimates for risk advancement periods were 5.50 years (4.25 to 6.75) for current smokers and 2.16 years (1.38 to 2.39) for former smokers. The excess risk in smokers increased with cigarette consumption in a dose-response manner, and decreased continuously with time since smoking cessation in former smokers. Relative risk estimates for acute coronary events and for stroke events were somewhat lower than for cardiovascular mortality, but patterns were similar.

CONCLUSIONS: Our study corroborates and expands evidence from previous studies in showing that smoking is a strong independent risk factor of cardiovascular events and mortality even at older age, advancing cardiovascular mortality by more than five years, and demonstrating that smoking cessation in these age groups is still beneficial in reducing the excess risk.

Combining vitamin C and carotenoid biomarkers better predicts fruit and vegetable intake than individual biomarkers in dietary intervention studies

PURPOSE: The aim of this study was to determine whether combining potential biomarkers of fruit and vegetables is better at predicting FV intake within FV intervention studies than single biomarkers.

DESIGN: Data from a tightly controlled randomised FV intervention study (BIOFAV; all food provided and two meals/day on weekdays consumed under supervision) were used. A total of 30 participants were randomised to either 2, 5 or 8 portions FV/day for 4 weeks, and blood samples were collected at baseline and 4 weeks for plasma vitamin C and serum carotenoid analysis. The combined biomarker approach was also tested in three further FV intervention studies conducted by the same research team, with less strict dietary control (FV provided and no supervised meals).

RESULTS: The combined model containing all carotenoids and vitamin C was a better fit than either the vitamin C only (P < 0.001) model or the lutein only (P = 0.006) model in the BIOFAV study. The C-statistic was slightly lower in the lutein only model (0.85) and in the model based upon factor analysis (0.88), and much lower in the vitamin C model (0.68) compared with the full model (0.95). Results for the other studies were similar, although the differences between the models were less marked.

CONCLUSIONS: Although there was some variation between studies, which may relate to the level of dietary control or participant characteristics, a combined biomarker approach to assess overall FV consumption may more accurately predict FV intake within intervention studies than the use of a single biomarker. The generalisability of these findings to other populations and study designs remains to be tested. 

Investigating Intra-individual Dietary Changes and Radiocarbon Ages Using High Resolution δ13C, δ15N Isotope Ratios and 14C Ages Obtained From Dentine Increments

Ten medieval permanent teeth were subjected to incremental dentine sectioning and stable isotope analysis to investigate dietary changes in high resolution. In addition to this, eight increments were also selected for 14C measurements to examine possible intra-individual age differences. Results reveal the cessation of weaning, various dietary profiles and in some cases significantly different 14C ages obtained from a single tooth. This case study illustrates how 14C measurements can function as a proxy alongside the commonly used carbon and nitrogen stable isotope values to interpret the diet of past individuals

, Lexicographic Preferences in Discrete Choice Experiments: Consequences on Individual-Specific Willingness to Pay Estimates

In discrete choice experiments respondents are generally assumed to consider all of the attributes across each of the alternatives, and to choose their most preferred. However, results in this paper indicate that many respondents employ simplified lexicographic decision-making rules, whereby they have a ranking of the attributes, but their choice of an alternative is based solely on the level of their most important attribute(s). Not accounting for these simple decision-making heuristics introduces systemic errors and leads to biased point estimates, as they are a violation of the continuity axiom and a departure from the use of compensatory decision-making. In this paper the implications of lexicographic preferences are examined. In particular, using a mixed logit specification this paper investigates the sensitivity of individual-specific willingness to pay (WTP) estimates conditional on whether lexicographic decision-making rules are accounted for in the modelling of discrete choice responses. Empirical results are obtained from a discrete choice experiment that was carried out to address the value of a number of rural landscape attributes in Ireland

Duration-dependent effects of the BDNF Val66Met polymorphism on anodal tDCS induced motor cortex plasticity in older adults: a group and individual perspective

The brain derived neurotrophic factor (BDNF) Val66Met polymorphism and stimulation duration are thought to play an important role in modulating motor cortex plasticity induced by non-invasive brain stimulation (NBS). In the present study we sought to determine whether these factors interact or exert independent effects in older adults. Fifty-four healthy older adults (mean age = 66.85 years) underwent two counterbalanced sessions of 1.5 mA anodal transcranial direct current stimulation (atDCS), applied over left M1 for either 10 or 20 min. Single pulse transcranial magnetic stimulation (TMS) was used to assess corticospinal excitability (CSE) before and every 5 min for 30 min following atDCS. On a group level, there was an interaction between stimulation duration and BDNF genotype, with Met carriers (n = 13) showing greater post-intervention potentiation of CSE compared to Val66Val homozygotes homozygotes (n = 37) following 20 min (p = 0.002) but not 10 min (p = 0.219) of stimulation. Moreover, Met carriers, but not Val/Val homozygotes, exhibited larger responses to TMS (p = 0.046) after 20 min atDCS, than following 10 min atDCS. On an individual level, two-step cluster analysis revealed a considerable degree of inter-individual variability, with under half of the total sample (42%) showing the expected potentiation of CSE in response to atDCS across both sessions. Intra-individual variability in response to different durations of atDCS was also apparent, with one-third of the total sample (34%) exhibiting LTP-like effects in one session but LTD-like effects in the other session. Both the inter-individual (p = 0.027) and intra-individual (p = 0.04) variability was associated with BDNF genotype. In older adults, the BDNF Val66Met polymorphism along with stimulation duration appears to play a role in modulating tDCS-induced motor cortex plasticity. The results may have implications for the design of NBS protocols for healthy and diseased aged populations.

Adjuvant bisphosphonate treatment in early breast cancer: meta-analyses of individual patient data from randomised trials

BACKGROUND: Bisphosphonates have profound effects on bone physiology, and could modify the process of metastasis. We undertook collaborative meta-analyses to clarify the risks and benefits of adjuvant bisphosphonate treatment in breast cancer.

METHODS: We sought individual patient data from all unconfounded trials in early breast cancer that randomised between bisphosphonate and control. Primary outcomes were recurrence, distant recurrence, and breast cancer mortality. Primary subgroup investigations were site of first distant recurrence (bone or other), menopausal status (postmenopausal [combining natural and artificial] or not), and bisphosphonate class (aminobisphosphonate [eg, zoledronic acid, ibandronate, pamidronate] or other [ie, clodronate]). Intention-to-treat log-rank methods yielded bisphosphonate versus control first-event rate ratios (RRs).

FINDINGS: We received data on 18 766 women (18 206 [97%] in trials of 2-5 years of bisphosphonate) with median follow-up 5·6 woman-years, 3453 first recurrences, and 2106 subsequent deaths. Overall, the reductions in recurrence (RR 0·94, 95% CI 0·87-1·01; 2p=0·08), distant recurrence (0·92, 0·85-0·99; 2p=0·03), and breast cancer mortality (0·91, 0·83-0·99; 2p=0·04) were of only borderline significance, but the reduction in bone recurrence was more definite (0·83, 0·73-0·94; 2p=0·004). Among premenopausal women, treatment had no apparent effect on any outcome, but among 11 767 postmenopausal women it produced highly significant reductions in recurrence (RR 0·86, 95% CI 0·78-0·94; 2p=0·002), distant recurrence (0·82, 0·74-0·92; 2p=0·0003), bone recurrence (0·72, 0·60-0·86; 2p=0·0002), and breast cancer mortality (0·82, 0·73-0·93; 2p=0·002). Even for bone recurrence, however, the heterogeneity of benefit was barely significant by menopausal status (2p=0·06 for trend with menopausal status) or age (2p=0·03), and it was non-significant by bisphosphonate class, treatment schedule, oestrogen receptor status, nodes, tumour grade, or concomitant chemotherapy. No differences were seen in non-breast cancer mortality. Bone fractures were reduced (RR 0·85, 95% CI 0·75-0·97; 2p=0·02).

INTERPRETATION: Adjuvant bisphosphonates reduce the rate of breast cancer recurrence in the bone and improve breast cancer survival, but there is definite benefit only in women who were postmenopausal when treatment began.

FUNDING: Cancer Research UK, Medical Research Council.

Aromatase inhibitors versus tamoxifen in early breast cancer: patient-level meta-analysis of the randomised trials

BACKGROUND: The optimal ways of using aromatase inhibitors or tamoxifen as endocrine treatment for early breast cancer remains uncertain.

METHODS: We undertook meta-analyses of individual data on 31 920 postmenopausal women with oestrogen-receptor-positive early breast cancer in the randomised trials of 5 years of aromatase inhibitor versus 5 years of tamoxifen; of 5 years of aromatase inhibitor versus 2-3 years of tamoxifen then aromatase inhibitor to year 5; and of 2-3 years of tamoxifen then aromatase inhibitor to year 5 versus 5 years of tamoxifen. Primary outcomes were any recurrence of breast cancer, breast cancer mortality, death without recurrence, and all-cause mortality. Intention-to-treat log-rank analyses, stratified by age, nodal status, and trial, yielded aromatase inhibitor versus tamoxifen first-event rate ratios (RRs).

FINDINGS: In the comparison of 5 years of aromatase inhibitor versus 5 years of tamoxifen, recurrence RRs favoured aromatase inhibitors significantly during years 0-1 (RR 0·64, 95% CI 0·52-0·78) and 2-4 (RR 0·80, 0·68-0·93), and non-significantly thereafter. 10-year breast cancer mortality was lower with aromatase inhibitors than tamoxifen (12·1% vs 14·2%; RR 0·85, 0·75-0·96; 2p=0·009). In the comparison of 5 years of aromatase inhibitor versus 2-3 years of tamoxifen then aromatase inhibitor to year 5, recurrence RRs favoured aromatase inhibitors significantly during years 0-1 (RR 0·74, 0·62-0·89) but not while both groups received aromatase inhibitors during years 2-4, or thereafter; overall in these trials, there were fewer recurrences with 5 years of aromatase inhibitors than with tamoxifen then aromatase inhibitors (RR 0·90, 0·81-0·99; 2p=0·045), though the breast cancer mortality reduction was not significant (RR 0·89, 0·78-1·03; 2p=0·11). In the comparison of 2-3 years of tamoxifen then aromatase inhibitor to year 5 versus 5 years of tamoxifen, recurrence RRs favoured aromatase inhibitors significantly during years 2-4 (RR 0·56, 0·46-0·67) but not subsequently, and 10-year breast cancer mortality was lower with switching to aromatase inhibitors than with remaining on tamoxifen (8·7% vs 10·1%; 2p=0·015). Aggregating all three types of comparison, recurrence RRs favoured aromatase inhibitors during periods when treatments differed (RR 0·70, 0·64-0·77), but not significantly thereafter (RR 0·93, 0·86-1·01; 2p=0·08). Breast cancer mortality was reduced both while treatments differed (RR 0·79, 0·67-0·92), and subsequently (RR 0·89, 0·81-0·99), and for all periods combined (RR 0·86, 0·80-0·94; 2p=0·0005). All-cause mortality was also reduced (RR 0·88, 0·82-0·94; 2p=0·0003). RRs differed little by age, body-mass index, stage, grade, progesterone receptor status, or HER2 status. There were fewer endometrial cancers with aromatase inhibitors than tamoxifen (10-year incidence 0·4% vs 1·2%; RR 0·33, 0·21-0·51) but more bone fractures (5-year risk 8·2% vs 5·5%; RR 1·42, 1·28-1·57); non-breast-cancer mortality was similar.

INTERPRETATION: Aromatase inhibitors reduce recurrence rates by about 30% (proportionately) compared with tamoxifen while treatments differ, but not thereafter. 5 years of an aromatase inhibitor reduces 10-year breast cancer mortality rates by about 15% compared with 5 years of tamoxifen, hence by about 40% (proportionately) compared with no endocrine treatment.

FUNDING: Cancer Research UK, Medical Research Council.

Individual Participant Data (IPD) Meta-analyses of Randomised Controlled Trials: Guidance on Their Use

Jayne Tierney and colleagues offer guidance on how to spot a well-designed and well-conducted individual participant data meta-analysis.

Summary Points 

• Systematic reviews are most commonly based on aggregate data extracted from publications or obtained from trial investigators. 

• Systematic reviews involving the central collection and analysis of individual participant data (IPD) usually are larger-scale, international, collaborative projects that can bring about substantial improvements to the quantity and quality of data, give greater scope in the analyses, and provide more detailed and robust results. 

• The process of collecting, checking, and analysing IPD is more complex than for aggregate data, and not all IPD meta-analyses are done to the same standard, making it difficult for researchers, clinicians, patients, policy makers, funders, and publishers to judge their quality. 

• Following our step-by-step guide will help reviewers and users of IPD meta-analyses to understand them better and recognise those that are well designed and conducted and so help ensure that policy, practice, and research are informed by robust evidence about the effects of interventions.

How individual participant data meta-analyses have influenced trial design, conduct, and analysis

OBJECTIVES: To demonstrate how individual participant data (IPD) meta-analyses have impacted directly on the design and conduct of trials and highlight other advantages IPD might offer.

STUDY DESIGN AND SETTING: Potential examples of the impact of IPD meta-analyses on trials were identified at an international workshop, attended by individuals with experience in the conduct of IPD meta-analyses and knowledge of trials in their respective clinical areas. Experts in the field who did not attend were asked to provide any further examples. We then examined relevant trial protocols, publications, and Web sites to verify the impacts of the IPD meta-analyses. A subgroup of workshop attendees sought further examples and identified other aspects of trial design and conduct that may inform IPD meta-analyses.

RESULTS: We identified 52 examples of IPD meta-analyses thought to have had a direct impact on the design or conduct of trials. After screening relevant trial protocols and publications, we identified 28 instances where IPD meta-analyses had clearly impacted on trials. They have influenced the selection of comparators and participants, sample size calculations, analysis and interpretation of subsequent trials, and the conduct and analysis of ongoing trials, sometimes in ways that would not possible with systematic reviews of aggregate data. We identified additional potential ways that IPD meta-analyses could be used to influence trials.

CONCLUSIONS: IPD meta-analysis could be better used to inform the design, conduct, analysis, and interpretation of trials.

UK publicly funded Clinical Trials Units supported a controlled access approach to share individual participant data but highlighted concerns

OBJECTIVES: Evaluate current data sharing activities of UK publicly funded Clinical Trial Units (CTUs) and identify good practices and barriers.

STUDY DESIGN AND SETTING: Web-based survey of Directors of 45 UK Clinical Research Collaboration (UKCRC)-registered CTUs.

RESULTS: Twenty-three (51%) CTUs responded: Five (22%) of these had an established data sharing policy and eight (35%) specifically requested consent to use patient data beyond the scope of the original trial. Fifteen (65%) CTUs had received requests for data, and seven (30%) had made external requests for data in the previous 12 months. CTUs supported the need for increased data sharing activities although concerns were raised about patient identification, misuse of data, and financial burden. Custodianship of clinical trial data and requirements for a CTU to align its policy to their parent institutes were also raised. No CTUs supported the use of an open access model for data sharing.

CONCLUSION: There is support within the publicly funded UKCRC-registered CTUs for data sharing, but many perceived barriers remain. CTUs are currently using a variety of approaches and procedures for sharing data. This survey has informed further work, including development of guidance for publicly funded CTUs, to promote good practice and facilitate data sharing.