Use of quality assessment tools in systematic reviews was varied and inconsistent

OBJECTIVES To assess the use of quality assessment tools among a cross-section of systematic reviews (SRs) and to further evaluate whether quality was used as a parameter in the decision to include primary studies within subsequent meta-analysis. STUDY DESIGN AND SETTING We searched PubMed for SRs (interventional, observational, and diagnostic) published in Core Clinical Journals between January 1 and March 31, 2014. RESULTS Three hundred nine SRs were identified. Quality assessment was undertaken in 222 (71.8%) with isolated use of the Cochrane risk of bias tool (26.1%, n = 58) and the Newcastle-Ottawa Scale (15.3%, n = 34) most common. A threshold level of primary study quality for subsequent meta-analysis was used in 12.9% (40 of 309) of reviews. Overall, fifty-four combinations of quality assessment tools were identified with a similar preponderance of tools used among observational and interventional reviews. Multiple tools were used in 11.7% (n = 36) of SRs overall. CONCLUSION We found that quality assessment tools were used in a majority of SRs; however, a threshold level of quality for meta-analysis was stipulated in just 12.9% (n = 40). This cross-sectional analysis provides further evidence of the need for more active or intuitive editorial processes to enhance the reporting of SRs.

Surgical adjunctive procedures for accelerating orthodontic treatment

BACKGROUND A range of surgical and non-surgical techniques have received increasing attention in recent years in an effort to reduce the duration of a course of orthodontic treatment. Various surgical techniques have been used; however, uncertainty exists in relation to the effectiveness of these procedures and the possible adverse effects related to them. OBJECTIVES To assess the effects of surgically assisted orthodontics on the duration and outcome of orthodontic treatment. SEARCH METHODS We searched the following electronic databases: the Cochrane Oral Health Group's Trials Register (to 10 September 2014), the Cochrane Central Register of Controlled Trials (CENTRAL) (The Cochrane Library 2014, Issue 8), MEDLINE via OVID (1946 to 10 September 2014), EMBASE via OVID (1980 to 10 September 2014), LILACS via BIREME (1980 to 10 September 2014), metaRegister of Controlled Trials (to 10 September 2014), ClinicalTrials.gov (to 10 September 2014), and the World Health Organization (WHO) International Clinical Trials Registry Platform (to 10 September 2014). We checked the reference lists of all trials identified for further studies. There were no restrictions regarding language or date of publication in the electronic searches. SELECTION CRITERIA Randomised controlled trials (RCTs) evaluating the effect of surgical adjunctive procedures for accelerating tooth movement compared with conventional treatment (no surgical adjunctive procedure). DATA COLLECTION AND ANALYSIS At least two review authors independently assessed the risk of bias in the trials and extracted data. We used the fixed-effect model and expressed results as mean differences (MD) with 95% confidence intervals (CI). We investigated heterogeneity with reference to both clinical and methodological factors. MAIN RESULTS We included four RCTs involving a total of 57 participants ranging in age from 11 to 33 years. The interventions evaluated were corticotomies to facilitate orthodontic space closure or alignment of an ectopic maxillary canine, with the effect of repeated surgical procedures assessed in one of these studies. The studies did not report directly on the primary outcome as prespecified in our protocol: duration of orthodontic treatment, number of visits during active treatment (scheduled and unscheduled) and duration of visits. The main outcome assessed within the trials was the rate of tooth movement, with periodontal effects assessed in one trial and pain assessed in one trial. A maximum of just three trials with small sample sizes were available for each comparison and outcome. We assessed all of the studies as being at unclear risk of bias.Tooth movement was found to be slightly quicker with surgically assisted orthodontics in comparison with conventional treatment over periods of one month (MD 0.61 mm; 95% CI 0.49 to 0.72; P value < 0.001) and three months (MD 2.03 mm, 95% CI 1.52 to 2.54; P value < 0.001). Our results and conclusions should be interpreted with caution given the small number of included studies. Information on adverse events was sought; however, no data were reported in the included studies. AUTHORS' CONCLUSIONS This review found that there is limited research concerning the effectiveness of surgical interventions to accelerate orthodontic treatment, with no studies directly assessing our prespecified primary outcome. The available evidence is of low quality, which indicates that further research is likely to change the estimate of the effect. Based on measured outcomes in the short-term, these procedures do appear to show promise as a means of accelerating tooth movement. It is therefore possible that these procedures may prove useful; however, further prospective research comprising assessment of the entirety of treatment with longer follow-up is required to confirm any possible benefit.

Interventions for hirsutism (excluding laser and photoepilation therapy alone)

BACKGROUND Hirsutism occurs in 5% to 10% of women of reproductive age when there is excessive terminal hair growth in androgen-sensitive areas (male pattern). It is a distressing disorder with a major impact on quality of life. The most common cause is polycystic ovary syndrome. There are many treatment options, but it is not clear which are most effective. OBJECTIVES To assess the effects of interventions (except laser and light-based therapies alone) for hirsutism. SEARCH METHODS We searched the Cochrane Skin Group Specialised Register, CENTRAL (2014, Issue 6), MEDLINE (from 1946), EMBASE (from 1974), and five trials registers, and checked reference lists of included studies for additional trials. The last search was in June 2014. SELECTION CRITERIA Randomised controlled trials (RCTs) in hirsute women with polycystic ovary syndrome, idiopathic hirsutism, or idiopathic hyperandrogenism. DATA COLLECTION AND ANALYSIS Two independent authors carried out study selection, data extraction, 'Risk of bias' assessment, and analyses. MAIN RESULTS We included 157 studies (sample size 30 to 80) comprising 10,550 women (mean age 25 years). The majority of studies (123/157) were 'high', 30 'unclear', and four 'low' risk of bias. Lack of blinding was the most frequent source of bias. Treatment duration was six to 12 months. Forty-eight studies provided no usable or retrievable data, i.e. lack of separate data for hirsute women, conference proceedings, and losses to follow-up above 40%.Primary outcomes, 'participant-reported improvement of hirsutism' and 'change in health-related quality of life', were addressed in few studies, and adverse events in only half. In most comparisons there was insufficient evidence to determine if the number of reported adverse events differed. These included known adverse events: gastrointestinal discomfort, breast tenderness, reduced libido, dry skin (flutamide and finasteride); irregular bleeding (spironolactone); nausea, diarrhoea, bloating (metformin); hot flushes, decreased libido, vaginal dryness, headaches (gonadotropin-releasing hormone (GnRH) analogues)).Clinician's evaluation of hirsutism and change in androgen levels were addressed in most comparisons, change in body mass index (BMI) and improvement of other clinical signs of hyperandrogenism in one-third of studies.The quality of evidence was moderate to very low for most outcomes.There was low quality evidence for the effect of two oral contraceptive pills (OCPs) (ethinyl estradiol + cyproterone acetate versus ethinyl estradiol + desogestrel) on change from baseline of Ferriman-Gallwey scores. The mean difference (MD) was -1.84 (95% confidence interval (CI) -3.86 to 0.18).There was very low quality evidence that flutamide 250 mg, twice daily, reduced Ferriman-Gallwey scores more effectively than placebo (MD -7.60, 95% CI -10.53 to -4.67 and MD -7.20, 95% CI -10.15 to -4.25). Participants' evaluations in one study with 20 participants confirmed these results (risk ratio (RR) 17.00, 95% CI 1.11 to 259.87).Spironolactone 100 mg daily was more effective than placebo in reducing Ferriman-Gallwey scores (MD -7.69, 95% CI -10.12 to -5.26) (low quality evidence). It showed similar effectiveness to flutamide in two studies (MD -1.90, 95% CI -5.01 to 1.21 and MD 0.49, 95% CI -1.99 to 2.97) (very low quality evidence), as well as to finasteride in two studies (MD 1.49, 95% CI -0.58 to 3.56 and MD 0.40, 95% CI -1.18 to 1.98) (low quality evidence).Although there was very low quality evidence of a difference in reduction of Ferriman-Gallwey scores for finasteride 5 mg to 7.5 mg daily versus placebo (MD -5.73, 95% CI -6.87 to -4.58), it was unlikely it was clinically meaningful. These results were reinforced by participants' assessments (RR 2.06, 95% CI 0.99 to 4.29 and RR 11.00, 95% CI 0.69 to 175.86). However, finasteride showed inconsistent results in comparisons with other treatments, and no firm conclusions could be reached.Metformin demonstrated no benefit over placebo in reduction of Ferriman-Gallwey scores (MD 0.05, 95% CI -1.02 to 1.12), but the quality of evidence was low. Results regarding the effectiveness of GnRH analogues were inconsistent, varying from minimal to important improvements.We were unable to pool data for OCPs with cyproterone acetate 20 mg to 100 mg due to clinical and methodological heterogeneity between studies. However, addition of cyproterone acetate to OCPs provided greater reductions in Ferriman-Gallwey scores.Two studies, comparing finasteride 5 mg and spironolactone 100 mg, did not show differences in participant assessments and reduction of Ferriman-Gallwey scores (low quality evidence). Ferriman-Gallwey scores from three studies comparing flutamide versus metformin could not be pooled (I² = 62%). One study comparing flutamide 250 mg twice daily with metformin 850 mg twice daily for 12 months, which reached a higher cumulative dosage than two other studies evaluating this comparison, showed flutamide to be more effective (MD -6.30, 95% CI -9.83 to -2.77) (very low quality evidence). Data showing reductions in Ferriman-Gallwey scores could not be pooled for four studies comparing finasteride with flutamide as the results were inconsistent (I² = 67%).Studies examining effects of hypocaloric diets reported reductions in BMI, but which did not result in reductions in Ferriman-Gallwey scores. Although certain cosmetic measures are commonly used, we did not identify any relevant RCTs. AUTHORS' CONCLUSIONS Treatments may need to incorporate pharmacological therapies, cosmetic procedures, and psychological support. For mild hirsutism there is evidence of limited quality that OCPs are effective. Flutamide 250 mg twice daily and spironolactone 100 mg daily appeared to be effective and safe, albeit the evidence was low to very low quality. Finasteride 5 mg daily showed inconsistent results in different comparisons, therefore no firm conclusions can be made. As the side effects of antiandrogens and finasteride are well known, these should be accounted for in any clinical decision-making. There was low quality evidence that metformin was ineffective for hirsutism and although GnRH analogues showed inconsistent results in reducing hirsutism they do have significant side effects.Further research should consist of well-designed, rigorously reported, head-to-head trials examining OCPs combined with antiandrogens or 5α-reductase inhibitor against OCP monotherapy, as well as the different antiandrogens and 5α-reductase inhibitors against each other. Outcomes should be based on standardised scales of participants' assessment of treatment efficacy, with a greater emphasis on change in quality of life as a result of treatment.

The evidence from systematic reviews and meta-analyses published in orthodontic literature. Where do we stand?

AIM To analyse meta-analyses included in systematic reviews (SRs) published in leading orthodontic journals and the Cochrane Database of Systematic Reviews (CDSR) focusing on orthodontic literature and to assess the quality of the existing evidence. MATERIALS AND METHODS Electronic searching was undertaken to identify SRs published in five major orthodontic journals and the CDSR between January 2000 and June 2014. Quality assessment of the overall body of evidence from meta-analyses was conducted using the Grading of Recommendations Assessment, Development and Evaluation working group (GRADE) tool. RESULTS One hundred and fifty-seven SRs were identified; meta-analysis was present in 43 of these (27.4 per cent). The highest proportion of SRs that included a meta-analysis was found in Orthodontics and Craniofacial Research (6/13; 46.1 per cent), followed by the CDSR (12/33; 36.4 per cent) and the American Journal of Orthodontics and Dentofacial Orthopaedics (15/44; 34.1 per cent). Class II treatment was the most commonly addressed topic within SRs in orthodontics (n = 18/157; 11.5 per cent). The number of trials combined to produce a summary estimate was small for most meta-analyses with a median of 4 (range: 2-52). Only 21 per cent (n = 9) of included meta-analyses were considered to have a high/moderate quality of evidence according to GRADE, while the majority were of low or very low quality (n = 34; 79.0 per cent). CONCLUSIONS Overall, approximately one quarter of orthodontic SRs included quantitative synthesis, with a median of four trials per meta-analysis. The overall quality of evidence from the selected orthodontic SRs was predominantly low to very low indicating the relative lack of high quality of evidence from SRs to inform clinical practice guidelines.

Effectiveness of non-steroidal anti-inflammatory drugs for the treatment of pain in knee and hip osteoarthritis: a network meta-analysis.

BACKGROUND Non-steroidal anti-inflammatory drugs (NSAIDs) are the backbone of osteoarthritis pain management. We aimed to assess the effectiveness of different preparations and doses of NSAIDs on osteoarthritis pain in a network meta-analysis. METHODS For this network meta-analysis, we considered randomised trials comparing any of the following interventions: NSAIDs, paracetamol, or placebo, for the treatment of osteoarthritis pain. We searched the Cochrane Central Register of Controlled Trials (CENTRAL) and the reference lists of relevant articles for trials published between Jan 1, 1980, and Feb 24, 2015, with at least 100 patients per group. The prespecified primary and secondary outcomes were pain and physical function, and were extracted in duplicate for up to seven timepoints after the start of treatment. We used an extension of multivariable Bayesian random effects models for mixed multiple treatment comparisons with a random effect at the level of trials. For the primary analysis, a random walk of first order was used to account for multiple follow-up outcome data within a trial. Preparations that used different total daily dose were considered separately in the analysis. To assess a potential dose-response relation, we used preparation-specific covariates assuming linearity on log relative dose. FINDINGS We identified 8973 manuscripts from our search, of which 74 randomised trials with a total of 58 556 patients were included in this analysis. 23 nodes concerning seven different NSAIDs or paracetamol with specific daily dose of administration or placebo were considered. All preparations, irrespective of dose, improved point estimates of pain symptoms when compared with placebo. For six interventions (diclofenac 150 mg/day, etoricoxib 30 mg/day, 60 mg/day, and 90 mg/day, and rofecoxib 25 mg/day and 50 mg/day), the probability that the difference to placebo is at or below a prespecified minimum clinically important effect for pain reduction (effect size [ES] -0·37) was at least 95%. Among maximally approved daily doses, diclofenac 150 mg/day (ES -0·57, 95% credibility interval [CrI] -0·69 to -0·46) and etoricoxib 60 mg/day (ES -0·58, -0·73 to -0·43) had the highest probability to be the best intervention, both with 100% probability to reach the minimum clinically important difference. Treatment effects increased as drug dose increased, but corresponding tests for a linear dose effect were significant only for celecoxib (p=0·030), diclofenac (p=0·031), and naproxen (p=0·026). We found no evidence that treatment effects varied over the duration of treatment. Model fit was good, and between-trial heterogeneity and inconsistency were low in all analyses. All trials were deemed to have a low risk of bias for blinding of patients. Effect estimates did not change in sensitivity analyses with two additional statistical models and accounting for methodological quality criteria in meta-regression analysis. INTERPRETATION On the basis of the available data, we see no role for single-agent paracetamol for the treatment of patients with osteoarthritis irrespective of dose. We provide sound evidence that diclofenac 150 mg/day is the most effective NSAID available at present, in terms of improving both pain and function. Nevertheless, in view of the safety profile of these drugs, physicians need to consider our results together with all known safety information when selecting the preparation and dose for individual patients. FUNDING Swiss National Science Foundation (grant number 405340-104762) and Arco Foundation, Switzerland.

Influence of EMS-physician presence on survival after out-of-hospital cardiopulmonary resuscitation: systematic review and meta-analysis

BACKGROUND Evidence suggests that EMS-physician-guided cardiopulmonary resuscitation (CPR) in out-of-hospital cardiac arrest (OOHCA) may be associated with improved outcomes, yet randomized controlled trials are not available. The goal of this meta-analysis was to determine the association between EMS-physician- versus paramedic-guided CPR and survival after OOHCA. METHODS AND RESULTS Studies that compared EMS-physician- versus paramedic-guided CPR in OOHCA published until June 2014 were systematically searched in MEDLINE, EMBASE and Cochrane databases. All studies were required to contain survival data. Data on study characteristics, methods, and as well as survival outcomes were extracted. A random-effects model was used for the meta-analysis due to a high degree of heterogeneity among the studies (I (2)  = 44 %). Return of spontaneous circulation [ROSC], survival to hospital admission, and survival to hospital discharge were the outcome measures. Out of 3,385 potentially eligible studies, 14 met the inclusion criteria. In the pooled analysis (n = 126,829), EMS-physician-guided CPR was associated with significantly improved outcomes compared to paramedic-guided CPR: ROSC 36.2 % (95 % confidence interval [CI] 31.0 - 41.7 %) vs. 23.4 % (95 % CI 18.5 - 29.2 %) (pooled odds ratio [OR] 1.89, 95 % CI 1.36 - 2.63, p < 0.001); survival to hospital admission 30.1 % (95 % CI 24.2 - 36.7 %) vs. 19.2 % (95 % CI 12.7 - 28.1 %) (pooled OR 1.78, 95 % CI 0.97 - 3.28, p = 0.06); and survival to discharge 15.1 % (95 % CI 14.6 - 15.7 %) vs. 8.4 % (95 % CI 8.2 - 8.5 %) (pooled OR 2.03, 95 % CI 1.48 - 2.79, p < 0.001). CONCLUSIONS This systematic review suggests that EMS-physician-guided CPR in out-of-hospital cardiac arrest is associated with improved survival outcomes.

Psychological therapies for panic disorder with or without agoraphobia in adults: a network meta-analysis.

BACKGROUND Panic disorder is characterised by the presence of recurrent unexpected panic attacks, discrete periods of fear or anxiety that have a rapid onset and include symptoms such as racing heart, chest pain, sweating and shaking. Panic disorder is common in the general population, with a lifetime prevalence of 1% to 4%. A previous Cochrane meta-analysis suggested that psychological therapy (either alone or combined with pharmacotherapy) can be chosen as a first-line treatment for panic disorder with or without agoraphobia. However, it is not yet clear whether certain psychological therapies can be considered superior to others. In order to answer this question, in this review we performed a network meta-analysis (NMA), in which we compared eight different forms of psychological therapy and three forms of a control condition. OBJECTIVES To assess the comparative efficacy and acceptability of different psychological therapies and different control conditions for panic disorder, with or without agoraphobia, in adults. SEARCH METHODS We conducted the main searches in the CCDANCTR electronic databases (studies and references registers), all years to 16 March 2015. We conducted complementary searches in PubMed and trials registries. Supplementary searches included reference lists of included studies, citation indexes, personal communication to the authors of all included studies and grey literature searches in OpenSIGLE. We applied no restrictions on date, language or publication status. SELECTION CRITERIA We included all relevant randomised controlled trials (RCTs) focusing on adults with a formal diagnosis of panic disorder with or without agoraphobia. We considered the following psychological therapies: psychoeducation (PE), supportive psychotherapy (SP), physiological therapies (PT), behaviour therapy (BT), cognitive therapy (CT), cognitive behaviour therapy (CBT), third-wave CBT (3W) and psychodynamic therapies (PD). We included both individual and group formats. Therapies had to be administered face-to-face. The comparator interventions considered for this review were: no treatment (NT), wait list (WL) and attention/psychological placebo (APP). For this review we considered four short-term (ST) outcomes (ST-remission, ST-response, ST-dropouts, ST-improvement on a continuous scale) and one long-term (LT) outcome (LT-remission/response). DATA COLLECTION AND ANALYSIS As a first step, we conducted a systematic search of all relevant papers according to the inclusion criteria. For each outcome, we then constructed a treatment network in order to clarify the extent to which each type of therapy and each comparison had been investigated in the available literature. Then, for each available comparison, we conducted a random-effects meta-analysis. Subsequently, we performed a network meta-analysis in order to synthesise the available direct evidence with indirect evidence, and to obtain an overall effect size estimate for each possible pair of therapies in the network. Finally, we calculated a probabilistic ranking of the different psychological therapies and control conditions for each outcome. MAIN RESULTS We identified 1432 references; after screening, we included 60 studies in the final qualitative analyses. Among these, 54 (including 3021 patients) were also included in the quantitative analyses. With respect to the analyses for the first of our primary outcomes, (short-term remission), the most studied of the included psychological therapies was CBT (32 studies), followed by BT (12 studies), PT (10 studies), CT (three studies), SP (three studies) and PD (two studies).The quality of the evidence for the entire network was found to be low for all outcomes. The quality of the evidence for CBT vs NT, CBT vs SP and CBT vs PD was low to very low, depending on the outcome. The majority of the included studies were at unclear risk of bias with regard to the randomisation process. We found almost half of the included studies to be at high risk of attrition bias and detection bias. We also found selective outcome reporting bias to be present and we strongly suspected publication bias. Finally, we found almost half of the included studies to be at high risk of researcher allegiance bias.Overall the networks appeared to be well connected, but were generally underpowered to detect any important disagreement between direct and indirect evidence. The results showed the superiority of psychological therapies over the WL condition, although this finding was amplified by evident small study effects (SSE). The NMAs for ST-remission, ST-response and ST-improvement on a continuous scale showed well-replicated evidence in favour of CBT, as well as some sparse but relevant evidence in favour of PD and SP, over other therapies. In terms of ST-dropouts, PD and 3W showed better tolerability over other psychological therapies in the short term. In the long term, CBT and PD showed the highest level of remission/response, suggesting that the effects of these two treatments may be more stable with respect to other psychological therapies. However, all the mentioned differences among active treatments must be interpreted while taking into account that in most cases the effect sizes were small and/or results were imprecise. AUTHORS' CONCLUSIONS There is no high-quality, unequivocal evidence to support one psychological therapy over the others for the treatment of panic disorder with or without agoraphobia in adults. However, the results show that CBT - the most extensively studied among the included psychological therapies - was often superior to other therapies, although the effect size was small and the level of precision was often insufficient or clinically irrelevant. In the only two studies available that explored PD, this treatment showed promising results, although further research is needed in order to better explore the relative efficacy of PD with respect to CBT. Furthermore, PD appeared to be the best tolerated (in terms of ST-dropouts) among psychological treatments. Unexpectedly, we found some evidence in support of the possible viability of non-specific supportive psychotherapy for the treatment of panic disorder; however, the results concerning SP should be interpreted cautiously because of the sparsity of evidence regarding this treatment and, as in the case of PD, further research is needed to explore this issue. Behaviour therapy did not appear to be a valid alternative to CBT as a first-line treatment for patients with panic disorder with or without agoraphobia.