Viewing systematic reviews and meta-analysis in social research through different lenses

Systematic reviews and meta-analyses are used to combine results across studies to determine an overall effect. Meta-analysis is especially useful for combining evidence to inform social policy, but meta-analyses of applied social science research may encounter practical issues arising from the nature of the research domain. The current paper identifies potential resolutions to four issues that may be encountered in systematic reviews and meta-analyses in social research. The four issues are: scoping and targeting research questions appropriate for meta-analysis; selecting eligibility criteria where primary studies vary in research design and choice of outcome measures; dealing with inconsistent reporting in primary studies; and identifying sources of heterogeneity with multiple confounded moderators. The paper presents an overview of each issue with a review of potential resolutions, identified from similar issues encountered in meta-analysis in medical and biological sciences. The discussion aims to share and improve methodology in systematic reviews and meta-analysis by promoting cross-disciplinary communication, that is, to encourage 'viewing through different lenses'.

Plantar pressure in diabetic peripheral neuropathy patients with active foot ulceration, previous ulceration and no history of ulceration: A meta-analysis of observational studies

Aims Elevated dynamic plantar pressures are a consistent finding in diabetes patients with peripheral neuropathy with implications for plantar foot ulceration. This meta-analysis aimed to compare the plantar pressures of diabetes patients that had peripheral neuropathy and those with neuropathy with active or previous foot ulcers. Methods Published articles were identified from Medline via OVID, CINAHL, SCOPUS, INFORMIT, Cochrane Central EMBASE via OVID and Web of Science via ISI Web of Knowledge bibliographic databases. Observational studies reporting barefoot dynamic plantar pressure in adults with diabetic peripheral neuropathy, where at least one group had a history of plantar foot ulcers were included. Interventional studies, shod plantar pressure studies and studies not published in English were excluded. Overall mean peak plantar pressure (MPP) and pressure time integral (PTI) were primary outcomes. The six secondary outcomes were MPP and PTI at the rear foot, mid foot and fore foot. The protocol of the meta-analysis was published with PROPSERO, (registration number CRD42013004310). Results Eight observational studies were included. Overall MPP and PTI were greater in diabetic peripheral neuropathy patients with foot ulceration compared to those without ulceration (standardised mean difference 0.551, 95% CI 0.290–0.811, p<0.001; and 0.762, 95% CI 0.303–1.221, p = 0.001, respectively). Sub-group analyses demonstrated no significant difference in MPP for those with neuropathy with active ulceration compared to those without ulcers. A significant difference in MPP was found for those with neuropathy with a past history of ulceration compared to those without ulcers; (0.467, 95% CI 0.181– 0.753, p = 0.001). Statistical heterogeneity between studies was moderate. Conclusions Plantar pressures appear to be significantly higher in patients with diabetic peripheral neuropathy with a history of foot ulceration compared to those with diabetic neuropathy without a history of ulceration. More homogenous data is needed to confirm these findings.

Genetic determinants of heel bone properties: Genome-wide association meta-analysis and replication in the GEFOS/GENOMOS consortium

Quantitative ultrasound of the heel captures heel bone properties that independently predict fracture risk and, with bone mineral density (BMD) assessed by X-ray (DXA), may be convenient alternatives for evaluating osteoporosis and fracture risk. We performed a meta-analysis of genome-wide association (GWA) studies to assess the genetic determinants of heel broadband ultrasound attenuation (BUA; n 5 14 260), velocity of sound (VOS; n 5 15 514) and BMD (n 5 4566) in 13 discovery cohorts. Independent replication involved seven cohorts with GWA data (in silico n 5 11 452) and new genotyping in 15 cohorts (de novo n 5 24 902). In combined random effects, meta-analysis of the discovery and replication cohorts, nine single nucleotide polymorphisms (SNPs) had genome-wide significant (P < 5 3 108) associations with heel bone properties. Alongside SNPs within or near previously identified osteoporosis susceptibility genes including ESR1 (6q25.1: rs4869739, rs3020331, rs2982552), SPTBN1 (2p16.2: rs11898505), RSPO3 (6q22.33: rs7741021), WNT16 (7q31.31: rs2908007), DKK1 (10q21.1: rs7902708) and GPATCH1 (19q13.11: rs10416265), we identified a new locus on chromosome 11q14.2 (rs597319 close to TMEM135, a gene recently linked to osteoblastogenesis and longevity) significantly associated with both BUA and VOS (P < 8.23 3 1014). In meta-analyses involving 25 cohorts with up to 14 985 fracture cases, six of 10 SNPs associated with heel bone properties at P < 5 3 106 also had the expected direction of association with any fracture (P < 0.05), including threeSNPswithP < 0.005: 6q22.33 (rs7741021), 7q31.31 (rs2908007) and 10q21.1 (rs7902708). In conclusion, thisGWAstudy reveals the effect of several genescommon to central DXA-derivedBMDand heel ultrasound/DXAmeasures and points to anewgenetic locus with potential implications for better understanding of osteoporosis pathophysiology.

Assessing police classifications of sexual assault reports: A meta-analysis of false reporting rates

The objective of the study was to determine, through meta-analysis, the rate of confirmed false reports of sexual assault to police. The meta-analysis initially involved a search for relevant articles. The search revealed seven studies where researchers or their trained helpers evaluated reported sexual assault cases to determine the rate of confirmed false reports. The meta-analysis calculated an overall rate and tested for possible moderators of effect size. The meta-analytic rate of false reports of sexual assault was .052 (95% CIs .030, .089). The rates for the individual studies were heterogeneous, suggesting the possibility of moderators of rate. However, the four possible moderators examined, year of publication, whether the data set used had information in addition to police reports, whether the study was completed in the U.S. or elsewhere, and whether inter-rater reliabilities were reported, were all not significant. The meta-analysis of seven relevant studies shows that confirmed false allegations of sexual assault made to police occur at a significant rate. The total false reporting rate, including both confirmed and equivocal cases, would be greater than the 5 percent rate found here.

Genome-wide meta-analysis identifies five new susceptibility loci for cutaneous malignant melanoma

Thirteen common susceptibility loci have been reproducibly associated with cutaneous malignant melanoma (CMM). We report the results of an international 2-stage meta-analysis of CMM genome-wide association studies (GWAS). This meta-analysis combines 11 GWAS (5 previously unpublished) and a further three stage 2 data sets, totaling 15,990 CMM cases and 26,409 controls. Five loci not previously associated with CMM risk reached genome-wide significance (P < 5 × 10−8), as did 2 previously reported but unreplicated loci and all 13 established loci. Newly associated SNPs fall within putative melanocyte regulatory elements, and bioinformatic and expression quantitative trait locus (eQTL) data highlight candidate genes in the associated regions, including one involved in telomere biology.

Meta-analyses identify 13 loci associated with age at menopause and highlight DNA repair and immune pathways

To newly identify loci for age at natural menopause, we carried out a meta-analysis of 22 genome-wide association studies (GWAS) in 38,968 women of European descent, with replication in up to 14,435 women. In addition to four known loci, we identified 13 loci newly associated with age at natural menopause (at P < 5 x 10(-8)). Candidate genes located at these newly associated loci include genes implicated in DNA repair (EXO1, HELQ, UIMC1, FAM175A, FANCI, TLK1, POLG and PRIM1) and immune function (IL11, NLRP11 and PRRC2A (also known as BAT2)). Gene-set enrichment pathway analyses using the full GWAS data set identified exoDNase, NF-kappaB signaling and mitochondrial dysfunction as biological processes related to timing of menopause.

Genome-wide meta-analysis of common variant differences between men and women

The male-to-female sex ratio at birth is constant across world populations with an average of 1.06 (106 male to 100 female live births) for populations of European descent. The sex ratio is considered to be affected by numerous biological and environmental factors and to have a heritable component. The aim of this study was to investigate the presence of common allele modest effects at autosomal and chromosome X variants that could explain the observed sex ratio at birth. We conducted a large-scale genome-wide association scan (GWAS) meta-analysis across 51 studies, comprising overall 114 863 individuals (61 094 women and 53 769 men) of European ancestry and 2 623 828 common (minor allele frequency >0.05) single-nucleotide polymorphisms (SNPs). Allele frequencies were compared between men and women for directly-typed and imputed variants within each study. Forward-time simulations for unlinked, neutral, autosomal, common loci were performed under the demographic model for European populations with a fixed sex ratio and a random mating scheme to assess the probability of detecting significant allele frequency differences. We do not detect any genome-wide significant (P < 5 x 10(-8)) common SNP differences between men and women in this well-powered meta-analysis. The simulated data provided results entirely consistent with these findings. This large-scale investigation across ~115 000 individuals shows no detectable contribution from common genetic variants to the observed skew in the sex ratio. The absence of sex-specific differences is useful in guiding genetic association study design, for example when using mixed controls for sex-biased traits.

The genetic association between personality and major depression or bipolar disorder. A polygenic score analysis using genome-wide association data

The relationship between major depressive disorder (MDD) and bipolar disorder (BD) remains controversial. Previous research has reported differences and similarities in risk factors for MDD and BD, such as predisposing personality traits. For example, high neuroticism is related to both disorders, whereas openness to experience is specific for BD. This study examined the genetic association between personality and MDD and BD by applying polygenic scores for neuroticism, extraversion, openness to experience, agreeableness and conscientiousness to both disorders. Polygenic scores reflect the weighted sum of multiple single-nucleotide polymorphism alleles associated with the trait for an individual and were based on a meta-analysis of genome-wide association studies for personality traits including 13,835 subjects. Polygenic scores were tested for MDD in the combined Genetic Association Information Network (GAIN-MDD) and MDD2000+ samples (N=8921) and for BD in the combined Systematic Treatment Enhancement Program for Bipolar Disorder and Wellcome Trust Case-Control Consortium samples (N=6329) using logistic regression analyses. At the phenotypic level, personality dimensions were associated with MDD and BD. Polygenic neuroticism scores were significantly positively associated with MDD, whereas polygenic extraversion scores were significantly positively associated with BD. The explained variance of MDD and BD, approximately 0.1%, was highly comparable to the variance explained by the polygenic personality scores in the corresponding personality traits themselves (between 0.1 and 0.4%). This indicates that the proportions of variance explained in mood disorders are at the upper limit of what could have been expected. This study suggests shared genetic risk factors for neuroticism and MDD on the one hand and for extraversion and BD on the other.

Meta-analysis of genome-wide association for migraine in six population-based European cohorts

Migraine is a common neurological disorder with a genetically complex background. This paper describes a meta-analysis of genome-wide association (GWA) studies on migraine, performed by the Dutch-Icelandic migraine genetics (DICE) consortium, which brings together six population-based European migraine cohorts with a total sample size of 10,980 individuals (2446 cases and 8534 controls). A total of 32 SNPs showed marginal evidence for association at a P-value<10(-5). The best result was obtained for SNP rs9908234, which had a P-value of 8.00 x 10(-8). This top SNP is located in the nerve growth factor receptor (NGFR) gene. However, this SNP did not replicate in three cohorts from the Netherlands and Australia. Of the other 31 SNPs, 18 SNPs were tested in two replication cohorts, but none replicated. In addition, we explored previously identified candidate genes in the meta-analysis data set. This revealed a modest gene-based significant association between migraine and the metadherin (MTDH) gene, previously identified in the first clinic-based GWA study (GWAS) for migraine (Bonferroni-corrected gene-based P-value=0.026). This finding is consistent with the involvement of the glutamate pathway in migraine. Additional research is necessary to further confirm the involvement of glutamate.

WinBUGS code to run a network meta-analysis

WinBUGS code and data to reproduce our network meta-analysis from "Control strategies to prevent total hip replacement-related infections: a systematic review and mixed treatment comparison" published in BMJ Open.

Genetic influences on handedness: data from 25,732 Australian and Dutch twin families

Handedness refers to a consistent asymmetry in skill or preferential use between the hands and is related to lateralization within the brain of other functions such as language. Previous twin studies of handedness have yielded inconsistent results resulting from a general lack of statistical power to find significant effects. Here we present analyses from a large international collaborative study of handedness (assessed by writing/drawing or self report) in Australian and Dutch twins and their siblings (54,270 individuals from 25,732 families). Maximum likelihood analyses incorporating the effects of known covariates (sex, year of birth and birth weight) revealed no evidence of hormonal transfer, mirror imaging or twin specific effects. There were also no differences in prevalence between zygosity groups or between twins and their singleton siblings. Consistent with previous meta-analyses, additive genetic effects accounted for about a quarter (23.64%) of the variance (95%CI 20.17, 27.09%) with the remainder accounted for by non-shared environmental influences. The implications of these findings for handedness both as a primary phenotype and as a covariate in linkage and association analyses are discussed.

Effect of exercise referral schemes in primary care on physical activity and improving health outcomes: Systematic review and meta-analysis

Objective To assess the impact of exercise referral schemes on physical activity and health outcomes. Design Systematic review and meta-analysis. Data sources Medline, Embase, PsycINFO, Cochrane Library, ISI Web of Science, SPORTDiscus, and ongoing trial registries up to October 2009. We also checked study references. Study selection - Design: randomised controlled trials or non-randomised controlled (cluster or individual) studies published in peer review journals. - Population: sedentary individuals with or without medical diagnosis. - Exercise referral schemes defined as: clear referrals by primary care professionals to third party service providers to increase physical activity or exercise, physical activity or exercise programmes tailored to individuals, and initial assessment and monitoring throughout programmes. - Comparators: usual care, no intervention, or alternative exercise referral schemes. Results Eight randomised controlled trials met the inclusion criteria, comparing exercise referral schemes with usual care (six trials), alternative physical activity intervention (two), and an exercise referral scheme plus a self determination theory intervention (one). Compared with usual care, follow-up data for exercise referral schemes showed an increased number of participants who achieved 90-150 minutes of physical activity of at least moderate intensity per week (pooled relative risk 1.16, 95% confidence intervals 1.03 to 1.30) and a reduced level of depression (pooled standardised mean difference −0.82, −1.28 to −0.35). Evidence of a between group difference in physical activity of moderate or vigorous intensity or in other health outcomes was inconsistent at follow-up. We did not find any difference in outcomes between exercise referral schemes and the other two comparator groups. None of the included trials separately reported outcomes in individuals with specific medical diagnoses. Substantial heterogeneity in the quality and nature of the exercise referral schemes across studies might have contributed to the inconsistency in outcome findings. Conclusions Considerable uncertainty remains as to the effectiveness of exercise referral schemes for increasing physical activity, fitness, or health indicators, or whether they are an efficient use of resources for sedentary people with or without a medical diagnosis.

Comparison of treatment effect sizes associated with surrogate and final patient relevant outcomes in randomised controlled trials: meta-epidemiological study

Objective To quantify and compare the treatment effect and risk of bias of trials reporting biomarkers or intermediate outcomes (surrogate outcomes) versus trials using final patient relevant primary outcomes. Design Meta-epidemiological study. Data sources All randomised clinical trials published in 2005 and 2006 in six high impact medical journals: Annals of Internal Medicine, BMJ, Journal of the American Medical Association, Lancet, New England Journal of Medicine, and PLoS Medicine. Study selection Two independent reviewers selected trials. Data extraction Trial characteristics, risk of bias, and outcomes were recorded according to a predefined form. Two reviewers independently checked data extraction. The ratio of odds ratios was used to quantify the degree of difference in treatment effects between the trials using surrogate outcomes and those using patient relevant outcomes, also adjusted for trial characteristics. A ratio of odds ratios >1.0 implies that trials with surrogate outcomes report larger intervention effects than trials with patient relevant outcomes. Results 84 trials using surrogate outcomes and 101 using patient relevant outcomes were considered for analyses. Study characteristics of trials using surrogate outcomes and those using patient relevant outcomes were well balanced, except for median sample size (371 v 741) and single centre status (23% v 9%). Their risk of bias did not differ. Primary analysis showed trials reporting surrogate endpoints to have larger treatment effects (odds ratio 0.51, 95% confidence interval 0.42 to 0.60) than trials reporting patient relevant outcomes (0.76, 0.70 to 0.82), with an unadjusted ratio of odds ratios of 1.47 (1.07 to 2.01) and adjusted ratio of odds ratios of 1.46 (1.05 to 2.04). This result was consistent across sensitivity and secondary analyses. Conclusions Trials reporting surrogate primary outcomes are more likely to report larger treatment effects than trials reporting final patient relevant primary outcomes. This finding was not explained by differences in the risk of bias or characteristics of the two groups of trials.

Exercise and vascular function in child obesity: A meta-analysis

CONTEXT: Conduit artery flow-mediated dilation (FMD) is a noninvasive index of preclinical atherosclerosis in humans. Exercise interventions can improve FMD in both healthy and clinical populations. OBJECTIVE: This systematic review and meta-analysis aimed to summarize the effect of exercise training on FMD in overweight and obese children and adolescents as well as investigate the role of cardiorespiratory fitness (peak oxygen consumption [Vo2peak]) on effects observed. DATA SOURCES: PubMed, Medline, Embase, and Cinahl databases were searched from the earliest available date to February 2015. STUDY SELECTION: Studies of children and/or adolescents who were overweight or obese were included. DATA EXTRACTION: Standardized data extraction forms were used for patient and intervention characteristics, control/comparator groups, and key outcomes. Procedural quality of the studies was assessed using a modified version of the Physiotherapy Evidence Base Database scale. RESULTS: A meta-analysis involving 219 participants compared the mean difference of pre- versus postintervention vascular function (FMD) and Vo2peak between an exercise training intervention and a control condition. There was a significantly greater improvement in FMD (mean difference 1.54%, P < .05) and Vo2peak (mean difference 3.64 mL/kg/min, P < .05) after exercise training compared with controls. LIMITATIONS: Given the diversity of exercise prescriptions, participant characteristics, and FMD measurement protocols, varying FMD effect size was noted between trials. CONCLUSIONS: Exercise training improves vascular function in overweight and obese children, as indicated by enhanced FMD. Further research is required to establish the optimum exercise program for maintenance of healthy vascular function in this at-risk pediatric population.

Family-based interventions in preventing children and adolescents from using tobacco: A systematic review and meta-analysis

- Background Tobacco is the main preventable cause of death and disease worldwide. Adolescent smoking is increasing in many countries with poorer countries following the earlier experiences of affluent countries. Preventing adolescents starting smoking is crucial to decreasing tobacco-related illness. - Objective To assess effectiveness of family-based interventions alone and combined with school-based interventions to prevent children and adolescents from initiating tobacco use. - Data Sources 14 bibliographic databases and the Internet, journals hand-searched, experts consulted. - Study Eligibility Criteria, Participants, and Interventions Randomised controlled trials (RCTs) with children or adolescents and families, interventions to prevent starting tobacco use, follow-up ≥ 6 months. - Study Appraisal/Synthesis methods Abstracts/titles independently assessed and data independently entered by two authors. Risk-of-bias assessed with the Cochrane Risk-of-Bias tool. - Results Twenty-seven RCTs were included. Nine trials of never-smokers compared to a control provided data for meta-analysis. Family intervention trials had significantly fewer students who started smoking. Meta-analysis of twoRCTs of combined family and school interventions compared to school only, showed additional significant benefit. The common feature of effective high intensity interventions was encouraging authoritative parenting. - Limitations Only 14 RCTs provided data for meta-analysis (about 1/3 of participants). Of the 13 RCTs which did not provide data for meta-analysis eight compared a family intervention to no intervention and one found significant effects, and five compared a family + school intervention to a school intervention and none found additional significant effects. - Conclusions and Implications of Key Findings There is moderate quality evidence that family-based interventions prevent children and adolescents starting to smoke.