Can decision making in general surgery be based on evidence? An empirical study of Cochrane Reviews

BACKGROUND: This empirical study analyzes the current status of Cochrane Reviews (CRs) and their strength of recommendation for evidence-based decision making in the field of general surgery. METHODS: Systematic literature search of the Cochrane Database of Systematic Reviews and the Cochrane Collaboration's homepage to identify available CRs on surgical topics. Quantitative and qualitative characteristics, utilization, and formulated treatment recommendations were evaluated by 2 independent reviewers. Association of review characteristics with treatment recommendation was analyzed using univariate and multivariate logistic regression models. RESULTS: Ninety-three CRs, including 1,403 primary studies and 246,473 patients, were identified. Mean number of included primary studies per CR was 15.1 (standard deviation [SD] 14.5) including 2,650 (SD 3,340) study patients. Two and a half (SD 8.3) nonrandomized trials were included per analyzed CR. Seventy-two (77%) CRs were published or updated in 2005 or later. Explicit treatment recommendations were given in 45 (48%). Presence of a treatment recommendation was associated with the number of included primary studies and the proportion of randomized studies. Utilization of surgical CRs remained low and showed large inter-country differences. The most surgical CRs were accessed in UK, USA, and Australia, followed by several Western and Eastern European countries. CONCLUSION: Only a minority of available CRs address surgical questions and their current usage is low. Instead of unsystematically increasing the number of surgical CRs it would be far more efficient to focus the review process on relevant surgical questions. Prioritization of CRs needs valid methods which should be developed by the scientific surgical community.

Updated method guidelines for cochrane musculoskeletal group systematic reviews and metaanalyses.

The Cochrane Musculoskeletal Group (CMSG), one of 53 groups of the not-for-profit, international Cochrane Collaboration, prepares, maintains, and disseminates systematic reviews of treatments for musculoskeletal diseases. It is important that authors conducting CMSG reviews and the readers of our reviews be aware of and use updated, state-of-the-art systematic review methodology. One hundred sixty reviews have been published. Previous method guidelines for systematic reviews of interventions in the musculoskeletal field published in 2006 have been substantially updated to incorporate methodological advances that are mandatory or highly desirable in Cochrane reviews and knowledge translation advances. The methodological advances include new guidance on searching, new risk-of-bias assessment, grading the quality of the evidence, the new Summary of Findings table, and comparative effectiveness using network metaanalysis. Method guidelines specific to musculoskeletal disorders are provided by CMSG editors for various aspects of undertaking a systematic review. These method guidelines will help improve the quality of reporting and ensure high standards of conduct as well as consistency across CMSG reviews.

Effect of standardized training on the reliability of the Cochrane risk of bias assessment tool: a study protocol

BACKGROUND The Cochrane risk of bias (RoB) tool has been widely embraced by the systematic review community, but several studies have reported that its reliability is low. We aim to investigate whether training of raters, including objective and standardized instructions on how to assess risk of bias, can improve the reliability of this tool. We describe the methods that will be used in this investigation and present an intensive standardized training package for risk of bias assessment that could be used by contributors to the Cochrane Collaboration and other reviewers. METHODS/DESIGN This is a pilot study. We will first perform a systematic literature review to identify randomized clinical trials (RCTs) that will be used for risk of bias assessment. Using the identified RCTs, we will then do a randomized experiment, where raters will be allocated to two different training schemes: minimal training and intensive standardized training. We will calculate the chance-corrected weighted Kappa with 95% confidence intervals to quantify within- and between-group Kappa agreement for each of the domains of the risk of bias tool. To calculate between-group Kappa agreement, we will use risk of bias assessments from pairs of raters after resolution of disagreements. Between-group Kappa agreement will quantify the agreement between the risk of bias assessment of raters in the training groups and the risk of bias assessment of experienced raters. To compare agreement of raters under different training conditions, we will calculate differences between Kappa values with 95% confidence intervals. DISCUSSION This study will investigate whether the reliability of the risk of bias tool can be improved by training raters using standardized instructions for risk of bias assessment. One group of inexperienced raters will receive intensive training on risk of bias assessment and the other will receive minimal training. By including a control group with minimal training, we will attempt to mimic what many review authors commonly have to do, that is-conduct risk of bias assessment in RCTs without much formal training or standardized instructions. If our results indicate that an intense standardized training does improve the reliability of the RoB tool, our study is likely to help improve the quality of risk of bias assessments, which is a central component of evidence synthesis.

In search of optimal compression therapy for venous leg ulcers: a meta-analysis of studies comparing diverse [corrected] bandages with specifically designed stockings

OBJECTIVE: In search of an optimal compression therapy for venous leg ulcers, a systematic review and meta-analysis was performed of randomized controlled trials (RCT) comparing compression systems based on stockings (MCS) with divers bandages. METHODS: RCT were retrieved from six sources and reviewed independently. The primary endpoint, completion of healing within a defined time frame, and the secondary endpoints, time to healing, and pain were entered into a meta-analysis using the tools of the Cochrane Collaboration. Additional subjective endpoints were summarized. RESULTS: Eight RCT (published 1985-2008) fulfilled the predefined criteria. Data presentation was adequate and showed moderate heterogeneity. The studies included 692 patients (21-178/study, mean age 61 years, 56% women). Analyzed were 688 ulcerated legs, present for 1 week to 9 years, sizing 1 to 210 cm(2). The observation period ranged from 12 to 78 weeks. Patient and ulcer characteristics were evenly distributed in three studies, favored the stocking groups in four, and the bandage group in one. Data on the pressure exerted by stockings and bandages were reported in seven and two studies, amounting to 31-56 and 27-49 mm Hg, respectively. The proportion of ulcers healed was greater with stockings than with bandages (62.7% vs 46.6%; P < .00001). The average time to healing (seven studies, 535 patients) was 3 weeks shorter with stockings (P = .0002). In no study performed bandages better than MCS. Pain was assessed in three studies (219 patients) revealing an important advantage of stockings (P < .0001). Other subjective parameters and issues of nursing revealed an advantage of MCS as well. CONCLUSIONS: Leg compression with stockings is clearly better than compression with bandages, has a positive impact on pain, and is easier to use.

The effectiveness of laceback ligatures during initial orthodontic alignment: a systematic review and meta-analysis

Lacebacks may be used to limit unwanted incisor proclination during initial orthodontic alignment; however, their use has not met with universal approval. This systematic review aims to appraise the evidence in relation to the effectiveness of lacebacks in controlling incisor position during initial alignment. Electronic database searches of published literature (MEDLINE via Ovid, Cochrane Central Register of Controlled Trials, LILACS, and IBECS) and unpublished literature were performed. Search terms used included randomized controlled trial, controlled clinical trial, random allocation, double blind method, orthodontics, and laceback. Data were extracted using custom forms. Risk of bias assessment was made using the Cochrane Collaboration risk of bias tool. The quality of the evidence was also assessed using GRADE. Mean differences in incisor inclination and antero-posterior changes in incisor and molar position during alignment were calculated. Two studies involving 97 participants were found to be at low risk of bias and were included in the quantitative synthesis. The random effects meta-analysis demonstrated that the use of lacebacks was associated with 0.5 mm greater posterior movement of the incisors during alignment; this finding was of limited clinical importance and statistically non-significant [95 per cent confidence interval (CI): -1.25, 0.25, P = 0.19]. Little difference (0.46 mm) was also found between laceback and non-laceback groups with regards to mesial molar movement (95 per cent CI: -0.33, 1.24, P = 0.26). According to the GRADE assessment, the overall quality of evidence relating to the use of lacebacks was high. There is no evidence to support the use of lacebacks for the control of the sagittal position of the incisors during initial orthodontic alignment.

Consensus on the Need for a Hierarchical List of Patient-reported Pain Outcomes for Metaanalyses of Knee Osteoarthritis Trials: An OMERACT Objective.

OBJECTIVE Although protocol registration for systematic reviews is still not mandatory, reviewers should be strongly encouraged to register the protocol to identify the methodological approach, including all outcomes of interest. This will minimize the likelihood of biased decisions in reviews, such as selective outcome reporting. A group of international experts convened to address issues regarding the need to develop hierarchical lists of outcome measurement instruments for a particular outcome for metaanalyses. METHODS Multiple outcome measurement instruments exist to measure the same outcome. Metaanalysis of knee osteoarthritis (OA) trials, and the assessment of pain as an outcome, was used as an exemplar to assess how Outcome Measures in Rheumatology (OMERACT), the Cochrane Collaboration, and other international initiatives might contribute in this area. The meeting began with formal presentations of background topics, empirical evidence from the literature, and a brief introduction to 2 existing hierarchical lists of pain outcome measurement instruments recommended for metaanalyses of knee OA trials. RESULTS After discussions, most participants agreed that there is a need to develop a methodology for generation of hierarchical lists of outcome measurement instruments to guide metaanalyses. Tools that could be used to steer development of such a prioritized list are the COSMIN checklist (Consensus-based Standards for the selection of health status Measurement Instruments) and the OMERACT Filter 2.0. CONCLUSION We list meta-epidemiological research agenda items that address the frequency of reported outcomes in trials, as well as methodologies to assess the best measurement properties (i.e., truth, discrimination, and feasibility).

Efficacy of patient-administered mechanical and/or chemical plaque control protocols in the management of peri-implant mucositis. A systematic review

AIM To systematically assess the efficacy of patient-administered mechanical and/or chemical plaque control protocols in the management of peri-implant mucositis (PM). MATERIAL AND METHODS Randomized (RCTs) and Controlled Clinical Trials (CCTs) were identified through an electronic search of three databases complemented by manual search. Identification, screening, eligibility and inclusion of studies was performed independently by two reviewers. Studies without professional intervention or with only mechanical debridement professionally administered were included. Quality assessment was performed by means of the Cochrane Collaboration's tool for assessing risk of bias. RESULTS Eleven RCTs with a follow-up from 3 to 24 months were included. Definition of PM was lacking or heterogeneously reported. Complete resolution of PM was not achieved in any study. One study reported 38% of patients with complete resolution of PM. Surrogate end-point outcomes of PM therapy were often reported. The choice of control interventions showed great variability. The efficacy of powered toothbrushes, a triclosan-containing toothpaste and adjunctive antiseptics remains to be established. High quality of methods and reporting was found in four studies. CONCLUSIONS Professionally- and patient-administered mechanical plaque control alone should be considered the standard of care in the management of PM. Therapy of PM is a prerequisite for the prevention of peri-implantitis.

Efficacy, Acceptability, and Tolerability of Antipsychotics in Treatment-Resistant Schizophrenia: A Network Meta-analysis.

Importance In treatment-resistant schizophrenia, clozapine is considered the standard treatment. However, clozapine use has restrictions owing to its many adverse effects. Moreover, an increasing number of randomized clinical trials (RCTs) of other antipsychotics have been published. Objective To integrate all the randomized evidence from the available antipsychotics used for treatment-resistant schizophrenia by performing a network meta-analysis. Data Sources MEDLINE, EMBASE, Biosis, PsycINFO, PubMed, Cochrane Central Register of Controlled Trials, World Health Organization International Trial Registry, and clinicaltrials.gov were searched up to June 30, 2014. Study Selection At least 2 independent reviewers selected published and unpublished single- and double-blind RCTs in treatment-resistant schizophrenia (any study-defined criterion) that compared any antipsychotic (at any dose and in any form of administration) with another antipsychotic or placebo. Data Extraction and Synthesis At least 2 independent reviewers extracted all data into standard forms and assessed the quality of all included trials with the Cochrane Collaboration's risk-of-bias tool. Data were pooled using a random-effects model in a Bayesian setting. Main Outcomes and Measures The primary outcome was efficacy as measured by overall change in symptoms of schizophrenia. Secondary outcomes included change in positive and negative symptoms of schizophrenia, categorical response to treatment, dropouts for any reason and for inefficacy of treatment, and important adverse events. Results Forty blinded RCTs with 5172 unique participants (71.5% men; mean [SD] age, 38.8 [3.7] years) were included in the analysis. Few significant differences were found in all outcomes. In the primary outcome (reported as standardized mean difference; 95% credible interval), olanzapine was more effective than quetiapine (-0.29; -0.56 to -0.02), haloperidol (-0. 29; -0.44 to -0.13), and sertindole (-0.46; -0.80 to -0.06); clozapine was more effective than haloperidol (-0.22; -0.38 to -0.07) and sertindole (-0.40; -0.74 to -0.04); and risperidone was more effective than sertindole (-0.32; -0.63 to -0.01). A pattern of superiority for olanzapine, clozapine, and risperidone was seen in other efficacy outcomes, but results were not consistent and effect sizes were usually small. In addition, relatively few RCTs were available for antipsychotics other than clozapine, haloperidol, olanzapine, and risperidone. The most surprising finding was that clozapine was not significantly better than most other drugs. Conclusions and Relevance Insufficient evidence exists on which antipsychotic is more efficacious for patients with treatment-resistant schizophrenia, and blinded RCTs-in contrast to unblinded, randomized effectiveness studies-provide little evidence of the superiority of clozapine compared with other second-generation antipsychotics. Future clozapine studies with high doses and patients with extremely treatment-refractory schizophrenia might be most promising to change the current evidence.

An Assessment of the Risk of Bias in Randomized Controlled Trial Reports Published in Prosthodontic and Implant Dentistry Journals

PURPOSE The objective of this study was to assess the risk of bias of randomized controlled trials (RCTs) published in prosthodontic and implant dentistry journals. MATERIALS AND METHODS The last 30 issues of 9 journals in the field of prosthodontic and implant dentistry (Clinical Implant Dentistry and Related Research, Clinical Oral Implants Research, Implant Dentistry, International Journal of Oral & Maxillofacial Implants, International Journal of Periodontics and Restorative Dentistry, International Journal of Prosthodontics, Journal of Dentistry, Journal of Oral Rehabilitation, and Journal of Prosthetic Dentistry) were hand-searched for RCTs. Risk of bias was assessed using the Cochrane Collaboration's risk of bias tool and analyzed descriptively. RESULTS From the 3,667 articles screened, a total of 147 RCTs were identified and included. The number of published RCTs increased with time. The overall distribution of a high risk of bias assessment varied across the domains of the Cochrane risk of bias tool: 8% for random sequence generation, 18% for allocation concealment, 41% for masking, 47% for blinding of outcome assessment, 7% for incomplete outcome data, 12% for selective reporting, and 41% for other biases. CONCLUSION The distribution of high risk of bias for RCTs published in the selected prosthodontic and implant dentistry journals varied among journals and ranged from 8% to 47%, which can be considered as substantial.

American Society of Clinical Oncology/American Society of Hematology clinical practice guideline update on the use of epoetin and darbepoetin in adult patients with cancer

Purpose To update American Society of Clinical Oncology/American Society of Hematology recommendations for use of erythropoiesis-stimulating agents (ESAs) in patients with cancer. Methods An Update Committee reviewed data published between January 2007 and January 2010. MEDLINE and the Cochrane Library were searched. Results The literature search yielded one new individual patient data analysis and four literature-based meta-analyses, two systematic reviews, and 13 publications reporting new results from randomized controlled trials not included in prior or new reviews. Recommendations For patients undergoing myelosuppressive chemotherapy who have a hemoglobin (Hb) level less than 10 g/dL, the Update Committee recommends that clinicians discuss potential harms (eg, thromboembolism, shorter survival) and benefits (eg, decreased transfusions) of ESAs and compare these with potential harms (eg, serious infections, immune-mediated adverse reactions) and benefits (eg, rapid Hb improvement) of RBC transfusions. Individual preferences for assumed risk should contribute to shared decisions on managing chemotherapy-induced anemia. The Committee cautions against ESA use under other circumstances. If used, ESAs should be administered at the lowest dose possible and should increase Hb to the lowest concentration possible to avoid transfusions. Available evidence does not identify Hb levels � 10 g/dL either as thresholds for initiating treatment or as targets for ESA therapy. Starting doses and dose modifications after response or nonresponse should follow US Food and Drug Administration–approved labeling. ESAs should be discontinued after 6 to 8 weeks in nonresponders. ESAs should be avoided in patients with cancer not receiving concurrent chemotherapy, except for those with lower risk myelodysplastic syndromes. Caution should be exercised when using ESAs with chemotherapeutic agents in diseases associated with increased risk of thromboembolic complications. Table 1 lists detailed recommendations. This guideline was developed through a collaboration between the American Society of Clinical Oncology and the American Society of Hematology and has been published jointly by invitation and consent in both Journal of Clinical Oncology and Blood.

All-cause mortality in treated HIV-infected adults with CD4 >=500/mm3 compared with the general population: evidence from a large European observational cohort collaboration{dagger}

Using data from a large European collaborative study, we aimed to identify the circumstances in which treated HIV-infected individuals will experience similar mortality rates to those of the general population.

Accuracy of immunological criteria for identifying virological failure in children on antiretroviral therapy - The IeDEA Southern Africa Collaboration

Objectives  To determine the diagnostic accuracy of World Health Organization (WHO) 2010 and 2006 as well as United States Department of Health and Human Services (DHHS) 2008 definitions of immunological failure for identifying virological failure (VF) in children on antiretroviral therapy (ART). Methods  Analysis of data from children (<16 years at ART initiation) at South African ART sites at which CD4 count/per cent and HIV-RNA monitoring are performed 6-monthly. Incomplete virological suppression (IVS) was defined as failure to achieve ≥1 HIV-RNA ≤400 copies/ml between 6 and 15 months on ART and viral rebound (VR) as confirmed HIV-RNA ≥5000 copies/ml in a child on ART for ≥18 months who had achieved suppression during the first year on treatment. Results  Among 3115 children [median (interquartile range) age 48 (20-84) months at ART initiation] on treatment for ≥1 year, sensitivity of immunological criteria for IVS was 10%, 6% and 26% for WHO 2006, WHO 2010 and DHHS 2008 criteria, respectively. The corresponding positive predictive values (PPV) were 31%, 20% and 20%. Diagnostic accuracy for VR was determined in 2513 children with ≥18 months of follow-up and virological suppression during the first year on ART with sensitivity of 5% (WHO 2006/2010) and 27% (DHHS 2008). PPV results were 42% (WHO 2010), 43% (WHO 2006) and 20% (DHHS 2008). Conclusion  Current immunological criteria are unable to correctly identify children failing ART virologically. Improved access to viral load testing is needed to reliably identify VF in children.

Virologic failure and second-line antiretroviral therapy in children in South Africa--the IeDEA Southern Africa collaboration

Background: With expanding pediatric antiretroviral therapy (ART) access, children will begin to experience treatment failure and require second-line therapy. We evaluated the probability and determinants of virologic failure and switching in children in South Africa. Methods: Pooled analysis of routine individual data from children who initiated ART in 7 South African treatment programs with 6-monthly viral load and CD4 monitoring produced Kaplan-Meier estimates of probability of virologic failure (2 consecutive unsuppressed viral loads with the second being >1000 copies/mL, after ≥24 weeks of therapy) and switch to second-line. Cox-proportional hazards models stratified by program were used to determine predictors of these outcomes. Results: The 3-year probability of virologic failure among 5485 children was 19.3% (95% confidence interval: 17.6 to 21.1). Use of nevirapine or ritonavir alone in the initial regimen (compared with efavirenz) and exposure to prevention of mother to child transmission regimens were independently associated with failure [adjusted hazard ratios (95% confidence interval): 1.77 (1.11 to 2.83), 2.39 (1.57 to 3.64) and 1.40 (1.02 to 1.92), respectively]. Among 252 children with ≥1 year follow-up after failure, 38% were switched to second-line. Median (interquartile range) months between failure and switch was 5.7 (2.9-11.0). Conclusions: Triple ART based on nevirapine or ritonavir as a single protease inhibitor seems to be associated with a higher risk of virologic failure. A low proportion of virologically failing children were switched.