Using the contribution matrix to evaluate complex study limitations in a network meta-analysis: a case study of bipolar maintenance pharmacotherapy review.

BACKGROUND Limitations in the primary studies constitute one important factor to be considered in the grading of recommendations assessment, development, and evaluation (GRADE) system of rating quality of evidence. However, in the network meta-analysis (NMA), such evaluation poses a special challenge because each network estimate receives different amounts of contributions from various studies via direct as well as indirect routes and because some biases have directions whose repercussion in the network can be complicated. FINDINGS In this report we use the NMA of maintenance pharmacotherapy of bipolar disorder (17 interventions, 33 studies) and demonstrate how to quantitatively evaluate the impact of study limitations using netweight, a STATA command for NMA. For each network estimate, the percentage of contributions from direct comparisons at high, moderate or low risk of bias were quantified, respectively. This method has proven flexible enough to accommodate complex biases with direction, such as the one due to the enrichment design seen in some trials of bipolar maintenance pharmacotherapy. CONCLUSIONS Using netweight, therefore, we can evaluate in a transparent and quantitative manner how study limitations of individual studies in the NMA impact on the quality of evidence of each network estimate, even when such limitations have clear directions.

Is human herpesvirus 8 infection more common in men than in women? Systematic review and meta-analysis.

All forms of Kaposi sarcoma (KS) are more common in men than in women. It is unknown if this is due to a higher prevalence of human herpesvirus 8 (HHV-8), the underlying cause of KS, in men compared to women. We did a systematic review and meta-analysis to examine the association between HHV-8 seropositivity and gender in the general population. Studies in selected populations like for example, blood donors, hospital patients, and men who have sex with men were excluded. We searched Medline and Embase from January 1994 to February 2015. We included observational studies that recruited participants from the general population and reported HHV-8 seroprevalence for men and women or boys and girls. We used random-effects meta-analysis to pool odds ratios (OR) of the association between HHV-8 and gender. We used meta-regression to identify effect modifiers, including age, geographical region and type of HHV-8 antibody test. We included 22 studies, with 36,175 participants. Men from sub-Saharan Africa (SSA) (OR 1.21, 95% confidence interval [CI] 1.09-1.34), but not men from elsewhere (OR 0.94, 95% CI 0.83-1.06), were more likely to be HHV-8 seropositive than women (p value for interaction=0.010). There was no difference in HHV-8 seroprevalence between boys and girls from SSA (OR 0.90, 95% CI 0.72-1.13). The type of HHV-8 assay did not affect the overall results. A higher HHV-8 seroprevalence in men than women in SSA may partially explain why men have higher KS risk in this region. This article is protected by copyright. All rights reserved.

Cognitive-Behavioural Analysis System of Psychotherapy (CBASP), a drug, or their combination: differential therapeutics for persistent depressive disorder: a study protocol of an individual participant data network meta-analysis.

INTRODUCTION Despite important advances in psychological and pharmacological treatments of persistent depressive disorders in the past decades, their responses remain typically slow and poor, and differential responses among different modalities of treatments or their combinations are not well understood. Cognitive-Behavioural Analysis System of Psychotherapy (CBASP) is the only psychotherapy that has been specifically designed for chronic depression and has been examined in an increasing number of trials against medications, alone or in combination. When several treatment alternatives are available for a certain condition, network meta-analysis (NMA) provides a powerful tool to examine their relative efficacy by combining all direct and indirect comparisons. Individual participant data (IPD) meta-analysis enables exploration of impacts of individual characteristics that lead to a differentiated approach matching treatments to specific subgroups of patients. METHODS AND ANALYSIS We will search for all randomised controlled trials that compared CBASP, pharmacotherapy or their combination, in the treatment of patients with persistent depressive disorder, in Cochrane CENTRAL, PUBMED, SCOPUS and PsycINFO, supplemented by personal contacts. Individual participant data will be sought from the principal investigators of all the identified trials. Our primary outcomes are depression severity as measured on a continuous observer-rated scale for depression, and dropouts for any reason as a proxy measure of overall treatment acceptability. We will conduct a one-step IPD-NMA to compare CBASP, medications and their combinations, and also carry out a meta-regression to identify their prognostic factors and effect moderators. The model will be fitted in OpenBUGS, using vague priors for all location parameters. For the heterogeneity we will use a half-normal prior on the SD. ETHICS AND DISSEMINATION This study requires no ethical approval. We will publish the findings in a peer-reviewed journal. The study results will contribute to more finely differentiated therapeutics for patients suffering from this chronically disabling disorder. TRIAL REGISTRATION NUMBER CRD42016035886.

Hepatitis C in HIV-infected individuals: a systematic review and meta-analysis of estimated prevalence in Africa.

INTRODUCTION Although hepatitis C virus (HCV) screening is recommended for all HIV-infected patients initiating antiretroviral therapy, data on epidemiologic characteristics of HCV infection in resource-limited settings are scarce. METHODS We searched PubMed and EMBASE for studies assessing the prevalence of HCV infection among HIV-infected individuals in Africa and extracted data on laboratory methods used. Prevalence estimates from individual studies were combined for each country using random-effects meta-analysis. The importance of study design, population and setting as well as type of test (anti-HCV antibody tests and polymerase chain reactions) was examined with meta-regression. RESULTS Three randomized controlled trials, 28 cohort studies and 121 cross-sectional analyses with 108,180 HIV-infected individuals from 35 countries were included. The majority of data came from outpatient populations (55%), followed by blood donors (15%) and pregnant women (14%). Based on estimates from 159 study populations, anti-HCV positivity prevalence ranged between 3.3% (95% confidence interval (CI) 1.8-4.7) in Southern Africa and 42.3% (95% CI 4.1-80.5) in North Africa. Study design, type of setting and age distribution did not influence this prevalence significantly. The prevalence of replicating HCV infection, estimated from data of 29 cohorts, was 2.0% (95% CI 1.5-2.6). Ten studies from nine countries reported the HCV genotype of 74 samples, 53% were genotype 1, 24% genotype 2, 14% genotype 4 and 9% genotypes 3, 5 or 6. CONCLUSIONS The prevalence of anti-HCV antibodies is high in HIV-infected patients in Africa, but replicating HCV infection is rare and varies widely across countries.

The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study

OBJECTIVE: To examine whether excluding patients from the analysis of randomised trials are associated with biased estimates of treatment effects and higher heterogeneity between trials. DESIGN: Meta-epidemiological study based on a collection of meta-analyses of randomised trials. DATA SOURCES: 14 meta-analyses including 167 trials that compared therapeutic interventions with placebo or non-intervention control in patients with osteoarthritis of the hip or knee and used patient reported pain as an outcome. METHODS: Effect sizes were calculated from differences in means of pain intensity between groups at the end of follow-up, divided by the pooled standard deviation. Trials were combined by using random effects meta-analysis. Estimates of treatment effects were compared between trials with and trials without exclusions from the analysis, and the impact of restricting meta-analyses to trials without exclusions was assessed. RESULTS: 39 trials (23%) had included all patients in the analysis. In 128 trials (77%) some patients were excluded from the analysis. Effect sizes from trials with exclusions tended to be more beneficial than those from trials without exclusions (difference -0.13, 95% confidence interval -0.29 to 0.04). However, estimates of bias between individual meta-analyses varied considerably (tau(2)=0.07). Tests of interaction between exclusions from the analysis and estimates of treatment effects were positive in five meta-analyses. Stratified analyses indicated that differences in effect sizes between trials with and trials without exclusions were more pronounced in meta-analyses with high between trial heterogeneity, in meta-analyses with large estimated treatment benefits, and in meta-analyses of complementary medicine. Restriction of meta-analyses to trials without exclusions resulted in smaller estimated treatment benefits, larger P values, and considerable decreases in between trial heterogeneity. CONCLUSION: Excluding patients from the analysis in randomised trials often results in biased estimates of treatment effects, but the extent and direction of bias is unpredictable. Results from intention to treat analyses should always be described in reports of randomised trials. In systematic reviews, the influence of exclusions from the analysis on estimated treatment effects should routinely be assessed.

Association between variants of the leptin receptor gene (LEPR) and overweight: a systematic review and an analysis of the CoLaus study

Background Three non-synonymous single nucleotide polymorphisms (Q223R, K109R and K656N) of the leptin receptor gene (LEPR) have been tested for association with obesity-related outcomes in multiple studies, showing inconclusive results. We performed a systematic review and meta-analysis on the association of the three LEPR variants with BMI. In addition, we analysed 15 SNPs within the LEPR gene in the CoLaus study, assessing the interaction of the variants with sex. Methodology/Principal Findings We searched electronic databases, including population-based studies that investigated the association between LEPR variants Q223R, K109R and K656N and obesity- related phenotypes in healthy, unrelated subjects. We furthermore performed meta-analyses of the genotype and allele frequencies in case-control studies. Results were stratified by SNP and by potential effect modifiers. CoLaus data were analysed by logistic and linear regressions and tested for interaction with sex. The meta-analysis of published data did not show an overall association between any of the tested LEPR variants and overweight. However, the choice of a BMI cut-off value to distinguish cases from controls was crucial to explain heterogeneity in Q223R. Differences in allele frequencies across ethnic groups are compatible with natural selection of derived alleles in Q223R and K109R and of the ancient allele in K656N in Asians. In CoLaus, the rs10128072, rs3790438 and rs3790437 variants showed interaction with sex for their association with overweight, waist circumference and fat mass in linear regressions. Conclusions Our systematic review and analysis of primary data from the CoLaus study did not show an overall association between LEPR SNPs and overweight. Most studies were underpowered to detect small effect sizes. A potential effect modification by sex, population stratification, as well as the role of natural selection should be addressed in future genetic association studies.

Multiplicity of data in trial reports and the reliability of meta-analyses: empirical study

Objectives To examine the extent of multiplicity of data in trial reports and to assess the impact of multiplicity on meta-analysis results. Design Empirical study on a cohort of Cochrane systematic reviews. Data sources All Cochrane systematic reviews published from issue 3 in 2006 to issue 2 in 2007 that presented a result as a standardised mean difference (SMD). We retrieved trial reports contributing to the first SMD result in each review, and downloaded review protocols. We used these SMDs to identify a specific outcome for each meta-analysis from its protocol. Review methods Reviews were eligible if SMD results were based on two to ten randomised trials and if protocols described the outcome. We excluded reviews if they only presented results of subgroup analyses. Based on review protocols and index outcomes, two observers independently extracted the data necessary to calculate SMDs from the original trial reports for any intervention group, time point, or outcome measure compatible with the protocol. From the extracted data, we used Monte Carlo simulations to calculate all possible SMDs for every meta-analysis. Results We identified 19 eligible meta-analyses (including 83 trials). Published review protocols often lacked information about which data to choose. Twenty-four (29%) trials reported data for multiple intervention groups, 30 (36%) reported data for multiple time points, and 29 (35%) reported the index outcome measured on multiple scales. In 18 meta-analyses, we found multiplicity of data in at least one trial report; the median difference between the smallest and largest SMD results within a meta-analysis was 0.40 standard deviation units (range 0.04 to 0.91). Conclusions Multiplicity of data can affect the findings of systematic reviews and meta-analyses. To reduce the risk of bias, reviews and meta-analyses should comply with prespecified protocols that clearly identify time points, intervention groups, and scales of interest.

Does pet ownership in infancy lead to asthma or allergy at school age? Pooled analysis of individual participant data from 11 European birth cohorts

Objective To examine the associations between pet keeping in early childhood and asthma and allergies in children aged 6–10 years. Design Pooled analysis of individual participant data of 11 prospective European birth cohorts that recruited a total of over 22,000 children in the 1990s. Exposure definition Ownership of only cats, dogs, birds, rodents, or cats/dogs combined during the first 2 years of life. Outcome definition Current asthma (primary outcome), allergic asthma, allergic rhinitis and allergic sensitization during 6–10 years of age. Data synthesis Three-step approach: (i) Common definition of outcome and exposure variables across cohorts; (ii) calculation of adjusted effect estimates for each cohort; (iii) pooling of effect estimates by using random effects meta-analysis models. Results We found no association between furry and feathered pet keeping early in life and asthma in school age. For example, the odds ratio for asthma comparing cat ownership with “no pets” (10 studies, 11489 participants) was 1.00 (95% confidence interval 0.78 to 1.28) (I2 = 9%; p = 0.36). The odds ratio for asthma comparing dog ownership with “no pets” (9 studies, 11433 participants) was 0.77 (0.58 to 1.03) (I2 = 0%, p = 0.89). Owning both cat(s) and dog(s) compared to “no pets” resulted in an odds ratio of 1.04 (0.59 to 1.84) (I2 = 33%, p = 0.18). Similarly, for allergic asthma and for allergic rhinitis we did not find associations regarding any type of pet ownership early in life. However, we found some evidence for an association between ownership of furry pets during the first 2 years of life and reduced likelihood of becoming sensitized to aero-allergens. Conclusions Pet ownership in early life did not appear to either increase or reduce the risk of asthma or allergic rhinitis symptoms in children aged 6–10. Advice from health care practitioners to avoid or to specifically acquire pets for primary prevention of asthma or allergic rhinitis in children should not be given.

Efficacy of psychological therapy in schizophrenia: conclusions from meta-analyses

Over the past years, evidence for the efficacy of psychological therapies in schizophrenia has been summarized in a series of meta-analyses. The present contribution aims to provide a descriptive survey of the evidence for the efficacy of psychological therapies as derived from these meta-analyses and to supplement them by selected findings from an own recent meta-analysis. Relevant meta-analyses and randomized controlled trials were identified by searching several electronic databases and by hand searching of reference lists. In order to compare the findings of the existing meta-analyses, the reported effect sizes were extracted and transformed into a uniform effect size measure where possible. For the own meta-analysis, weighted mean effect size differences between comparison groups regarding various types of outcomes were estimated. Their significance was tested by confidence intervals, and heterogeneity tests were applied to examine the consistency of the effects. From the available meta-analyses, social skills training, cognitive remediation, psychoeducational coping-oriented interventions with families and relatives, as well as cognitive behavioral therapy of persistent positive symptoms emerge as effective adjuncts to pharmacotherapy. Social skills training consistently effectuates the acquisition of social skills, cognitive remediation leads to short-term improvements in cognitive functioning, family interventions decrease relapse and hospitalization rates, and cognitive behavioral therapy results in a reduction of positive symptoms. These benefits seem to be accompanied by slight improvements in social functioning. However, open questions remain as to the specific therapeutic ingredients, to the synergistic effects, to the indication, as well as to the generalizability of the findings to routine care.

A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints

Publication bias and related bias in meta-analysis is often examined by visually checking for asymmetry in funnel plots of treatment effect against its standard error. Formal statistical tests of funnel plot asymmetry have been proposed, but when applied to binary outcome data these can give false-positive rates that are higher than the nominal level in some situations (large treatment effects, or few events per trial, or all trials of similar sizes). We develop a modified linear regression test for funnel plot asymmetry based on the efficient score and its variance, Fisher's information. The performance of this test is compared to the other proposed tests in simulation analyses based on the characteristics of published controlled trials. When there is little or no between-trial heterogeneity, this modified test has a false-positive rate close to the nominal level while maintaining similar power to the original linear regression test ('Egger' test). When the degree of between-trial heterogeneity is large, none of the tests that have been proposed has uniformly good properties.

Disagreements in meta-analyses using outcomes measured on continuous or rating scales: observer agreement study

OBJECTIVE: To study the inter-observer variation related to extraction of continuous and numerical rating scale data from trial reports for use in meta-analyses. DESIGN: Observer agreement study. DATA SOURCES: A random sample of 10 Cochrane reviews that presented a result as a standardised mean difference (SMD), the protocols for the reviews and the trial reports (n=45) were retrieved. DATA EXTRACTION: Five experienced methodologists and five PhD students independently extracted data from the trial reports for calculation of the first SMD result in each review. The observers did not have access to the reviews but to the protocols, where the relevant outcome was highlighted. The agreement was analysed at both trial and meta-analysis level, pairing the observers in all possible ways (45 pairs, yielding 2025 pairs of trials and 450 pairs of meta-analyses). Agreement was defined as SMDs that differed less than 0.1 in their point estimates or confidence intervals. RESULTS: The agreement was 53% at trial level and 31% at meta-analysis level. Including all pairs, the median disagreement was SMD=0.22 (interquartile range 0.07-0.61). The experts agreed somewhat more than the PhD students at trial level (61% v 46%), but not at meta-analysis level. Important reasons for disagreement were differences in selection of time points, scales, control groups, and type of calculations; whether to include a trial in the meta-analysis; and data extraction errors made by the observers. In 14 out of the 100 SMDs calculated at the meta-analysis level, individual observers reached different conclusions than the originally published review. CONCLUSIONS: Disagreements were common and often larger than the effect of commonly used treatments. Meta-analyses using SMDs are prone to observer variation and should be interpreted with caution. The reliability of meta-analyses might be improved by having more detailed review protocols, more than one observer, and statistical expertise.

Critical appraisal of meta-analyses: an introductory guide for the practicing surgeon

ABSTRACT: Meta-analyses are an essential tool of clinical research. Meta-analyses of individual randomized controlled trials frequently constitute the highest possible level of scientific evidence for a given research question and allow surgeons to rapidly gain a comprehensive understanding of an important clinical issue. Moreover, meta-analyses often serve as cornerstones for evidence-based surgery, treatment guidelines, and knowledge transfer. Given the importance of meta-analyses to the medical (and surgical) knowledge base, it is of cardinal importance that surgeons have a basic grasp of the principles that guide a high-quality meta-analysis, and be able to weigh objectively the advantages and potential pitfalls of this clinical research tool. Unfortunately, surgeons are often ill-prepared to successfully conduct, critically appraise, and correctly interpret meta-analyses. The objective of this educational review is to provide surgeons with a brief introductory overview of the knowledge and skills required for understanding and critically appraising surgical meta-analyses as well as assessing their implications for their own surgical practice.

Combining follow-up and change data is valid in meta-analyses of continuous outcomes: a meta-epidemiological study

OBJECTIVE To investigate whether it is valid to combine follow-up and change data when conducting meta-analyses of continuous outcomes. STUDY DESIGN AND SETTING Meta-epidemiological study of randomized controlled trials in patients with osteoarthritis of the knee/hip, which assessed patient-reported pain. We calculated standardized mean differences (SMDs) based on follow-up and change data, and pooled within-trial differences in SMDs. We also derived pooled SMDs indicating the largest treatment effect within a trial (optimistic selection of SMDs) and derived pooled SMDs from the estimate indicating the smallest treatment effect within a trial (pessimistic selection of SMDs). RESULTS A total of 21 meta-analyses with 189 trials with 292 randomized comparisons in 41,256 patients were included. On average, SMDs were 0.04 standard deviation units more beneficial when follow-up values were used (difference in SMDs: -0.04; 95% confidence interval: -0.13, 0.06; P=0.44). In 13 meta-analyses (62%), there was a relevant difference in clinical and/or significance level between optimistic and pessimistic pooled SMDs. CONCLUSION On average, there is no relevant difference between follow-up and change data SMDs, and combining these estimates in meta-analysis is generally valid. Decision on which type of data to use when both follow-up and change data are available should be prespecified in the meta-analysis protocol.

Preterm birth, infant weight gain, and childhood asthma risk: A meta-analysis of 147,000 European children

BACKGROUND Preterm birth, low birth weight, and infant catch-up growth seem associated with an increased risk of respiratory diseases in later life, but individual studies showed conflicting results. OBJECTIVES We performed an individual participant data meta-analysis for 147,252 children of 31 birth cohort studies to determine the associations of birth and infant growth characteristics with the risks of preschool wheezing (1-4 years) and school-age asthma (5-10 years). METHODS First, we performed an adjusted 1-stage random-effect meta-analysis to assess the combined associations of gestational age, birth weight, and infant weight gain with childhood asthma. Second, we performed an adjusted 2-stage random-effect meta-analysis to assess the associations of preterm birth (gestational age <37 weeks) and low birth weight (<2500 g) with childhood asthma outcomes. RESULTS Younger gestational age at birth and higher infant weight gain were independently associated with higher risks of preschool wheezing and school-age asthma (P < .05). The inverse associations of birth weight with childhood asthma were explained by gestational age at birth. Compared with term-born children with normal infant weight gain, we observed the highest risks of school-age asthma in children born preterm with high infant weight gain (odds ratio [OR], 4.47; 95% CI, 2.58-7.76). Preterm birth was positively associated with an increased risk of preschool wheezing (pooled odds ratio [pOR], 1.34; 95% CI, 1.25-1.43) and school-age asthma (pOR, 1.40; 95% CI, 1.18-1.67) independent of birth weight. Weaker effect estimates were observed for the associations of low birth weight adjusted for gestational age at birth with preschool wheezing (pOR, 1.10; 95% CI, 1.00-1.21) and school-age asthma (pOR, 1.13; 95% CI, 1.01-1.27). CONCLUSION Younger gestational age at birth and higher infant weight gain were associated with childhood asthma outcomes. The associations of lower birth weight with childhood asthma were largely explained by gestational age at birth.