PEDro or Cochrane to Assess the Quality of Clinical Trials? A Meta-Epidemiological Study.

OBJECTIVE There is debate on how the methodological quality of clinical trials should be assessed. We compared trials of physical therapy (PT) judged to be of adequate quality based on summary scores from the Physiotherapy Evidence Database (PEDro) scale with trials judged to be of adequate quality by Cochrane Risk of Bias criteria. DESIGN Meta-epidemiological study within Cochrane Database of Systematic Reviews. METHODS Meta-analyses of PT trials were identified in the Cochrane Database of Systematic Reviews. For each trial PeDro and Cochrane assessments were extracted from the PeDro and Cochrane databases. Adequate quality was defined as adequate generation of random sequence, concealment of allocation, and blinding of outcome assessors (Cochrane criteria) or as trials with a PEDro summary score ≥5 or ≥6 points. We combined trials of adequate quality using random-effects meta-analysis. RESULTS Forty-one Cochrane reviews and 353 PT trials were included. All meta-analyses included trials with PEDro scores ≥5, 37 (90.2%) included trials with PEDro scores ≥6 and only 22 (53.7%) meta-analyses included trials of adequate quality according to the Cochrane criteria. Agreement between PeDro and Cochrane was poor for PeDro scores of ≥5 points (kappa = 0.12; 95% CI 0.07 to 0.16) and slight for ≥6 points (kappa 0.24; 95% CI 0.16-0.32). When combining effect sizes of trials deemed to be of adequate quality according to PEDro or Cochrane criteria, we found that a substantial difference in the combined effect size (≥0.15) was evident in 9 (22%) out of the 41 meta-analyses for PEDro cutoff ≥5 and 10 (24%) for cutoff ≥6. CONCLUSIONS The PeDro and Cochrane approaches lead to different sets of trials of adequate quality, and different combined treatment estimates from meta-analyses of these trials. A consistent approach to assessing RoB in trials of physical therapy should be adopted.

Detecting outlying studies in meta-regression models using a forward search algorithm.

When considering data from many trials, it is likely that some of them present a markedly different intervention effect or exert an undue influence on the summary results. We develop a forward search algorithm for identifying outlying and influential studies in meta-analysis models. The forward search algorithm starts by fitting the hypothesized model to a small subset of likely outlier-free studies and proceeds by adding studies into the set one-by-one that are determined to be closest to the fitted model of the existing set. As each study is added to the set, plots of estimated parameters and measures of fit are monitored to identify outliers by sharp changes in the forward plots. We apply the proposed outlier detection method to two real data sets; a meta-analysis of 26 studies that examines the effect of writing-to-learn interventions on academic achievement adjusting for three possible effect modifiers, and a meta-analysis of 70 studies that compares a fluoride toothpaste treatment to placebo for preventing dental caries in children. A simple simulated example is used to illustrate the steps of the proposed methodology, and a small-scale simulation study is conducted to evaluate the performance of the proposed method. Copyright © 2016 John Wiley & Sons, Ltd.

At risk or not at risk? A meta-analysis of the prognostic accuracy of psychometric interviews for psychosis prediction

An accurate detection of individuals at clinical high risk (CHR) for psychosis is a prerequisite for effective preventive interventions. Several psychometric interviews are available, but their prognostic accuracy is unknown. We conducted a prognostic accuracy meta-analysis of psychometric interviews used to examine referrals to high risk services. The index test was an established CHR psychometric instrument used to identify subjects with and without CHR (CHR+ and CHR-). The reference index was psychosis onset over time in both CHR+ and CHR- subjects. Data were analyzed with MIDAS (STATA13). Area under the curve (AUC), summary receiver operating characteristic curves, quality assessment, likelihood ratios, Fagan's nomogram and probability modified plots were computed. Eleven independent studies were included, with a total of 2,519 help-seeking, predominately adult subjects (CHR+: N=1,359; CHR-: N=1,160) referred to high risk services. The mean follow-up duration was 38 months. The AUC was excellent (0.90; 95% CI: 0.87-0.93), and comparable to other tests in preventive medicine, suggesting clinical utility in subjects referred to high risk services. Meta-regression analyses revealed an effect for exposure to antipsychotics and no effects for type of instrument, age, gender, follow-up time, sample size, quality assessment, proportion of CHR+ subjects in the total sample. Fagan's nomogram indicated a low positive predictive value (5.74%) in the general non-help-seeking population. Albeit the clear need to further improve prediction of psychosis, these findings support the use of psychometric prognostic interviews for CHR as clinical tools for an indicated prevention in subjects seeking help at high risk services worldwide.

Diagnostic value of immunoassays for heparin-induced thrombocytopenia: a systematic review and meta-analysis.

Immunoassays are essential in the workup of patients with suspected heparin-induced thrombocytopenia. However, the diagnostic accuracy is uncertain with regard to different classes of assays, antibody specificities, thresholds, test variations, and manufacturers. We aimed to assess diagnostic accuracy measures of available immunoassays and to explore sources of heterogeneity. We performed comprehensive literature searches and applied strict inclusion criteria. Finally, 49 publications comprising 128 test evaluations in 15 199 patients were included in the analysis. Methodological quality according to the revised tool for quality assessment of diagnostic accuracy studies was moderate. Diagnostic accuracy measures were calculated with the unified model (comprising a bivariate random-effects model and a hierarchical summary receiver operating characteristics model). Important differences were observed between classes of immunoassays, type of antibody specificity, thresholds, application of confirmation step, and manufacturers. Combination of high sensitivity (>95%) and high specificity (>90%) was found in 5 tests only: polyspecific enzyme-linked immunosorbent assay (ELISA) with intermediate threshold (Genetic Testing Institute, Asserachrom), particle gel immunoassay, lateral flow immunoassay, polyspecific chemiluminescent immunoassay (CLIA) with a high threshold, and immunoglobulin G (IgG)-specific CLIA with low threshold. Borderline results (sensitivity, 99.6%; specificity, 89.9%) were observed for IgG-specific Genetic Testing Institute-ELISA with low threshold. Diagnostic accuracy appears to be inadequate in tests with high thresholds (ELISA; IgG-specific CLIA), combination of IgG specificity and intermediate thresholds (ELISA, CLIA), high-dose heparin confirmation step (ELISA), and particle immunofiltration assay. When making treatment decisions, clinicians should be a aware of diagnostic characteristics of the tests used and it is recommended they estimate posttest probabilities according to likelihood ratios as well as pretest probabilities using clinical scoring tools.

The evidence from systematic reviews and meta-analyses published in orthodontic literature. Where do we stand?

AIM To analyse meta-analyses included in systematic reviews (SRs) published in leading orthodontic journals and the Cochrane Database of Systematic Reviews (CDSR) focusing on orthodontic literature and to assess the quality of the existing evidence. MATERIALS AND METHODS Electronic searching was undertaken to identify SRs published in five major orthodontic journals and the CDSR between January 2000 and June 2014. Quality assessment of the overall body of evidence from meta-analyses was conducted using the Grading of Recommendations Assessment, Development and Evaluation working group (GRADE) tool. RESULTS One hundred and fifty-seven SRs were identified; meta-analysis was present in 43 of these (27.4 per cent). The highest proportion of SRs that included a meta-analysis was found in Orthodontics and Craniofacial Research (6/13; 46.1 per cent), followed by the CDSR (12/33; 36.4 per cent) and the American Journal of Orthodontics and Dentofacial Orthopaedics (15/44; 34.1 per cent). Class II treatment was the most commonly addressed topic within SRs in orthodontics (n = 18/157; 11.5 per cent). The number of trials combined to produce a summary estimate was small for most meta-analyses with a median of 4 (range: 2-52). Only 21 per cent (n = 9) of included meta-analyses were considered to have a high/moderate quality of evidence according to GRADE, while the majority were of low or very low quality (n = 34; 79.0 per cent). CONCLUSIONS Overall, approximately one quarter of orthodontic SRs included quantitative synthesis, with a median of four trials per meta-analysis. The overall quality of evidence from the selected orthodontic SRs was predominantly low to very low indicating the relative lack of high quality of evidence from SRs to inform clinical practice guidelines.

Success factors of product innovation:an updated meta-analysis

Assessing factors that predict new product success (NPS) holds critical importance for companies, as research shows that despite considerable new product investment, success rates are generally below 25%. Over the decades, meta-analytical attempts have been made to summarize empirical findings on NPS factors. However, market environment changes such as increased global competition, as well as methodological advancements in meta-analytical research, present a timely opportunity to augment their results. Hence, a key objective of this research is to provide an updated and extended meta-analytic investigation of the factors affecting NPS. Using Henard and Szymanski's meta-analysis as the most comprehensive recent summary of empirical findings, this study updates their findings by analyzing articles published from 1999 through 2011, the period following the original meta-analysis. Based on 233 empirical studies (from 204 manuscripts) on NPS, with a total 2618 effect sizes, this study also takes advantage of more recent methodological developments by re-calculating effects of the meta-analysis employing a random effects model. The study's scope broadens by including overlooked but important additional variables, notably “country culture,” and discusses substantive differences between the updated meta-analysis and its predecessor. Results reveal generally weaker effect sizes than those reported by Henard and Szymanski in 2001, and provide evolutionary evidence of decreased effects of common success factors over time. Moreover, culture emerges as an important moderating factor, weakening effect sizes for individualistic countries and strengthening effects for risk-averse countries, highlighting the importance of further investigating culture's role in product innovation studies, and of tracking changes of success factors of product innovations. Finally, a sharp increase since 1999 in studies investigating product and process characteristics identifies a significant shift in research interest in new product development success factors. The finding that the importance of success factors generally declines over time calls for new theoretical approaches to better capture the nature of new product development (NPD) success factors. One might speculate that the potential to create competitive advantages through an understanding of NPD success factors is reduced as knowledge of these factors becomes more widespread among managers. Results also imply that managers attempting to improve success rates of NPDs need to consider national culture as this factor exhibits a strong moderating effect: Working in varied cultural contexts will result in differing antecedents of successful new product ventures.

The impact of statin use on fetal development:a meta-analysis

INTRODUCTION: Statin use inadvertently during pregnancy and proposed use of statins for the treatment of preeclampsia, led us to question the evidence behind their current contraindicated status. Several studies have evaluated the relationship between statin use in pregnancy with fetal outcome but their results have not been quantitatively assessed by meta-analysis. Our objective was to undertake a systematic review of all published clinical evidence to assess the effects of statin use in pregnancy on subsequent fetal wellbeing. METHODS: A comprehensive search strategy was performed of all electronic databases and the Merck reporting database for studies published from 1966 to 2014. Two reviewers independently screened citations and undertook study quality assessment and data extraction. We obtained summary estimates of adverse fetal events that were classified as potentially fatal, clinically significant morbidity or minor adverse event. We identified 602 titles and reviewed 30 articles for inclusion and exclusion criteria. Meta-analysis was performed on seven studies (3 cohort, 3 case-series and 1 case-control). RESULTS: Of the 922 cases of statin exposure in pregnancy, 27 exposures were associated with lethal or clinically significant fetal morbidity and 10 with minor adverse events. Statin exposure was limited to the first trimester in all but two cases. The pooled rate of lethal or clinically significant fetal abnormalities in pregnant women exposed to statins was 0.01 (95% CI 0.00-0.04), less than the European rate of 0.026 (95% CI 2.54- 2.57)EUROCAT. The rate of fetal abnormality for simvastatin was 0.03 (95% CI 0.00-0.08), atorvostatin 0.11 (95% CI 0.00-0.52), pravastatin 0.01 (95% CI 0.00-0.2) and lovastatin use 0.04 (95% CI 0.00-0.28). Systems based anomalies were also calculated, congenital heart disease was 0.8 (95% CI 0.02-0.12) compared with the background rate of 0.79 (95% CI 0.78- 0.80). CONCLUSIONS: The published data suggests that statins may not be teratogenic when given inadvertently during pregnancy and prospective studies such as The StAmP Trial may provide more data

Do selective cyclo-oxygenase-2 inhibitors and traditional non-steroidal anti-inflammatory drugs increase the risk of atherothrombosis? Meta-analysis of randomised trials

Objective: To assess the effects of selective cyclo-oxygenase-2 (COX 2) inhibitors and traditional non-steroidal anti-inflammatory drugs (NSAIDs) on the risk of vascular events. Design: Meta-analysis of published and unpublished tabular data from randomised trials, with indirect estimation of the effects of traditional NSAIDs. Data sources: Medline and Embase (January 1966 to April 2005); Food and Drug Administration records; and data on file from Novartis, Pfizer, and Merck. Review methods: Eligible studies were randomised trials that included a comparison of a selective COX 2 inhibitor versus placebo or a selective COX 2 inhibitor versus a traditional NSAID, of at least four weeks' duration, with information on serious vascular events (defined as myocardial infarction, stroke, or vascular death). Individual investigators and manufacturers provided information on the number of patients randomised, numbers of vascular events, and the person time of follow-up for each randomised group. Results: In placebo comparisons, allocation to a selective COX 2 inhibitor was associated with a 42% relative increase in the incidence of serious vascular events (1.2%/year v 0.9%/year; rate ratio 1.42, 95% confidence interval 1.13 to 1.78; P = 0.003), with no significant heterogeneity among the different selective COX 2 inhibitors. This was chiefly attributable to an increased risk of myocardial infarction (0.6%/year v 0.3%/year; 1.86, 1.33 to 2.59; P = 0.0003), with little apparent difference in other vascular outcomes. Among trials of at least one year's duration (mean 2.7 years), the rate ratio for vascular events was 1.45 (1.12 to 1.89; P = 0.005). Overall, the incidence of serious vascular events was similar between a selective COX 2 inhibitor and any traditional NSAID (1.0%/year v 0.9/%year; 1.16, 0.97 to 1.38; P = 0.1). However, statistical heterogeneity (P = 0.001) was found between trials of a selective COX 2 inhibitor versus naproxen (1.57, 1.21 to 2.03) and of a selective COX 2 inhibitor versus non-naproxen NSAIDs (0.88, 0.69 to 1.12). The summary rate ratio for vascular events, compared with placebo, was 0.92 (0.67 to 1.26) for naproxen, 1.51 (0.96 to 2.37) for ibuprofen, and 1.63 (1.12 to 2.37) for diclofenac. Conclusions: Selective COX 2 inhibitors are associated with a moderate increase in the risk of vascular events, as are high dose regimens of ibuprofen and diclofenac, but high dose naproxen is not associated with such an excess.

Exercise rehabilitation following intensive care unit discharge for recovery from critical illness: Executive summary of a Cochrane Collaboration systematic review

Skeletal muscle wasting and weakness are major complications of critical illness and underlie the profound physical and functional impairments experienced by survivors after discharge from the intensive care unit (ICU). Exercise-based rehabilitation has been shown to be beneficial when delivered during ICU admission. This review aimed to determine the effectiveness of exercise rehabilitation initiated after ICU discharge on primary outcomes of functional exercise capacity and health-related quality of life. We sought randomized controlled trials, quasi-randomized controlled trials, and controlled clinical trials comparing an exercise intervention commenced after ICU discharge vs. any other intervention or a control or ‘usual care’ programme in adult survivors of critical illness. Cochrane Central Register of Controlled Trials, Medical Literature Analysis and Retrieval System Online (MEDLINE), Excerpta Medica Database, and Cumulative Index to Nursing and Allied Health Literature databases were searched up to February 2015. Dual, independent screening of results, data extraction, and quality appraisal were performed. We included six trials involving 483 patients. Overall quality of evidence for both outcomes was very low. All studies evaluated functional exercise capacity, with three reporting positive effects in favour of the intervention. Only two studies evaluated health-related quality of life and neither reported differences between intervention and control groups. Meta-analyses of data were precluded due to variation in study design, types of interventions, and selection and reporting of outcome measurements. We were unable to determine an overall effect on functional exercise capacity or health-related quality of life of interventions initiated after ICU discharge for survivors of critical illness. Findings from ongoing studies are awaited. Future studies need to address methodological aspects of study design and conduct to enhance rigour, quality, and synthesis.

Performance of protective factors assessment in risk prediction for adults: systematic review and meta-analysis

Protective factors are neglected in risk assessment in adult psychiatric and criminal justice populations. This review investigated the predictive efficacy of selected tools that assess protective factors. Five databases were searched using comprehensive terms for records up to June 2014, resulting in 17 studies (n = 2,198). Results were combined in a multilevel meta-analysis using the R (R Core Team, R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing, 2015) metafor package (Viechtbauer, Journal of Statistical Software, 2010, 36, 1). Prediction of outcomes was poor relative to a reference category of violent offending, with the exception of prediction of discharge from secure units. There were no significant differences between the predictive efficacy of risk scales, protective scales, and summary judgments. Protective factor assessment may be clinically useful, but more development is required. Claims that use of these tools is therapeutically beneficial require testing.

Relationship between IL-10 gene -819C/T polymorphism and the risk of inflammatory bowel disease: a meta-analysis.

Background: The -819C/T polymorphism in interleukin 10 (IL-10) gene has been reported to be associated with inflammatory bowel disease (IBD) ,but the previous results are conflicting. Materials and Methods: The present study aimed at investigating the association between this polymorphism and risk of IBD using a meta-analysis.PubMed,Web of Science,EMBASE,google scholar and China National Knowledge Infrastructure (CNKI) databases were systematically searched to identify relevant publications from their inception to April 2016.Pooled odds ratio (OR) with 95% confidence interval (CI) was calculated using fixed- or random-effects models. Results: A total of 7 case-control studies containing 1890 patients and 2929 controls were enrolled into this meta-analysis, and our results showed no association between IL-10 gene -819C/T polymorphism and IBD risk(TT vs. CC:OR=0.81,95%CI 0.64- 1.04;CT vs. CC:OR=0.92,95%CI 0.81-1.05; Dominant model: OR=0.90,95%CI 0.80-1.02; Recessive model: OR=0.84,95%CI 0.66-1.06). In a subgroup analysis by nationality, the -819C/T polymorphism was not associated with IBD in both Asians and Caucasians. In the subgroup analysis stratified by IBD type, significant association was found in Crohn’s disease(CD)(CT vs. CC:OR=0.68,95%CI 0.48-0.97). Conclusion: In summary, the present meta-analysis suggests that the IL-10 gene -819C/T polymorphism may be associated with CD risk.

Last Instar Larvae And Pupae Of Ourocnemis Archytas And Anteros Formosus (lepidoptera: Riodinidae), With A Summary Of Known Host Plants For The Tribe Helicopini.

Last instar larvae and pupae of Ourocnemis archytas (Lepidoptera: Riodinidae) are described for the first time and compared with those of Anteros formosus, which are also described in detail. Last instars of both species present body covered with long white plumose setae, a row of orange balloon setae on the prothoracic shield, and clusters of perforated cupola organs (PCOs) near the spiracles; differences are the black cephalic capsule, the placement and format of balloon setae cluster, and the presence of enlarged black tips on some plumose setae. Pupae of O. archytas resemble that of Anteros, covered with the last instar setae and with no balloon setae. Characteristics of the immature stages of these two genera could be useful to establish the still unresolved relationship between them. A summary of the host plants of Helicopini is presented, showing a polyphagous pattern for Anteros, recorded in 21 host plant families, which contrasts with the specialized diet observed in Helicopis and Sarota. 

Ecosystem Engineering Effects On Species Diversity Across Ecosystems: A Meta-analysis.

Ecosystem engineering is increasingly recognized as a relevant ecological driver of diversity and community composition. Although engineering impacts on the biota can vary from negative to positive, and from trivial to enormous, patterns and causes of variation in the magnitude of engineering effects across ecosystems and engineer types remain largely unknown. To elucidate the above patterns, we conducted a meta-analysis of 122 studies which explored effects of animal ecosystem engineers on species richness of other organisms in the community. The analysis revealed that the overall effect of ecosystem engineers on diversity is positive and corresponds to a 25% increase in species richness, indicating that ecosystem engineering is a facilitative process globally. Engineering effects were stronger in the tropics than at higher latitudes, likely because new or modified habitats provided by engineers in the tropics may help minimize competition and predation pressures on resident species. Within aquatic environments, engineering impacts were stronger in marine ecosystems (rocky shores) than in streams. In terrestrial ecosystems, engineers displayed stronger positive effects in arid environments (e.g. deserts). Ecosystem engineers that create new habitats or microhabitats had stronger effects than those that modify habitats or cause bioturbation. Invertebrate engineers and those with lower engineering persistence (<1 year) affected species richness more than vertebrate engineers which persisted for >1 year. Invertebrate species richness was particularly responsive to engineering impacts. This study is the first attempt to build an integrative framework of engineering effects on species diversity; it highlights the importance of considering latitude, habitat, engineering functional group, taxon and persistence of their effects in future theoretical and empirical studies.

Anxiety-like Effects Of Meta-chlorophenylpiperazine In Paradoxically Sleep-deprived Mice.

Chlorophenylpiperazines (CPP) are psychotropic drugs used in nightclub parties and are frequently used in a state of sleep deprivation, a condition which can potentiate the effects of psychoactive drugs. This study aimed to investigate the effects of sleep deprivation and sleep rebound (RB) on anxiety-like measures in mCPP-treated mice using the open field test. We first optimized our procedure by performing dose-effect curves and examining different pretreatment times in naïve male Swiss mice. Subsequently, a separate cohort of mice underwent paradoxical sleep deprivation (PSD) for 24 or 48h. In the last experiment, immediately after the 24h-PSD period, mice received an injection of saline or mCPP, but their general activity was quantified in the open field only after the RB period (24 or 48h). The dose of 5mgmL(-1) of mCPP was the most effective at decreasing rearing behavior, with peak effects 15min after injection. PSD decreased locomotion and rearing behaviors, thereby inhibiting a further impairment induced by mCPP. Plasma concentrations of mCPP were significantly higher in PSD 48h animals compared to the non-PSD control group. Twenty-four hours of RB combined with mCPP administration produced a slight reduction in locomotion. Our results show that mCPP was able to significantly change the behavior of naïve, PSD, and RB mice. When combined with sleep deprivation, there was a higher availability of drug in plasma levels. Taken together, our results suggest that sleep loss can enhance the behavioral effects of the potent psychoactive drug, mCPP, even after a period of rebound sleep.

Rhinosinusitis: Evidence And Experience. A Summary.

81