Managing the production of a Cochrane systematic review

Undertaking a Cochrane systematic review can be an incredibly rewarding experience. It is however a challenging and time-consuming task. The Cochrane Handbook for Systematic Reviews of Interventions1 provides an essential resource to help reviewers navigate the often complex methodological issues of systematic review research. Additional guidelines have been developed for those undertaking reviews of public health topics,2 and Cochrane Centres throughout the world offer invaluable training opportunities. This emphasis on training and methodological rigour has helped Cochrane reviews become one of the most respected sources of synthesized research available. Even with the assistance available, however, many authors with good intentions register titles and prepare protocols but fail to publish the completed review. Data extracted from Cochrane’s Information Management System (Archie) in June 2010 showed that there were 1,301 titles registered more than two years ago that have not been published as a full review.3 Of these registered titles, 697 have had protocols published (25 are no longer active) while 604 have not even progressed to this stage (154 are no longer active). There are also 146 protocols that have been published for more than two years without being converted into completed reviews. These registered titles and protocols that have not yet progressed to a completed review represent a significant amount of time and energy invested by review authors, Cochrane editorial staff and, in some cases, external referees...

Methodological challenges in conducting a systematic review of community wide interventions to increase physical activity

Introduction: Evaluating the effectiveness of interventions designed to increase the physical activity in communities is often a difficult and complex task, requiring considerable expertise and investment, and often constrained by methodological limitations. These limitations, in turn, create additional challenges when these studies are used in systematic reviews as they hinder the confidence, precision and interpretation of results. The objective of this paper is to summarise the methodological challenges posed in conducting a systematic review of community-wide physical activity interventions to help inform those conducting future primary research and systematic reviews. Methods: We conducted a Cochrane systematic review of community-wide interventions to increase physical activity. We assessed the methodological quality of the included studies. We will investigate these in greater detail, particularly in relation to the potential impact on measures of effect, confidence in results, generalizability of results and general interpretation. Results: The systematic review was conducted and has been published in the Cochrane Library. A logic model was helpful in defining and interpreting the studies. Many studies of unsuitable study design were excluded; however several important methodological limitations of the primary studies evaluating community-wide physical activity interventions emerged. These included: - the failure to use validated tools to measure physical activity; - issues associated with pre and post test designs; - inadequate sampling of populations; - poor control groups; and - intervention and measurement protocols of inadequate duration. Although it is challenging to undertake rigorous evaluations of complex interventions, these issues result in significant uncertainty over the effectiveness of these interventions, and the possible factors required for a community-wide intervention to be successful. In particular, the combination of several of these limitations (e.g. un-validated tools, inadequate sampling, and short duration) is that studies may lack the sensitivity to detect any meaningful change. Multiple publications of findings for the same study also made interpretation difficult; however, interventions with parallel qualitative publications were helpful. Discussion: Evaluating community wide interventions to increase physical activity in a rigorous way is incredibly challenging. These findings reflect these challenges but have important ramifications for researchers conducting primary studies to determine the efficacy of such interventions, as well as for researchers conducting systematic reviews. This new review shows that the inadequacies of design and evaluation are continuing. It is hoped that the adoption of such suggestions may aid in the development of systematic reviews, but more importantly, in enabling translation of such findings into policy and practice.

Theory-based self-management programs for promoting recovery in community-dwelling stroke survivors : a systematic review

Background Post-stroke recovery is demanding. Increasing studies have examined the effectiveness of self-management programs for stroke survivors. However no systematic review has been conducted to summarize the effectiveness of theory-based stroke self-management programs. Objectives The aim is to present the best available research evidence about effectiveness of theory-based self-management programs on community-dwelling stroke survivors’ recovery. Inclusion criteria Types of participants All community-residing adults aged 18 years or above, and had a clinical diagnosis of stroke. Types of interventions Studies which examined effectiveness of a self-management program underpinned by a theoretical or conceptual framework for community-dwelling stroke survivors. Types of studies Randomized controlled trials. Types of outcomes Primary outcomes included health-related quality of life and self-management behaviors. Secondary outcomes included physical (activities of daily living), psychological (self-efficacy, depressive symptoms), and social outcomes (community reintegration, perceived social support). Search Strategy A three-step approach was adopted to identify all relevant published and unpublished studies in English or Chinese. Methodological quality The methodological quality of the included studies was assessed using the Joanna Briggs Institute critical appraisal checklist for experimental studies. Data Collection A standardized JBI data extraction form was used. There was no disagreement between the two reviewers on the data extraction results. Data Synthesis There were incomplete details about the number of participants and the results in two studies, which makes it impossible to perform meta-analysis. A narrative summary of the effectiveness of stroke self-management programs is presented. Results Three studies were included. The key issues of concern in methodological quality included insufficient information about random assignment, allocation concealment, reliability and validity of the measuring instruments, absence of intention-to-treat analysis, and small sample sizes. The three programs were designed based on the Stanford Chronic Disease Self-management program and were underpinned by the principles of self-efficacy. One study showed improvement in the intervention group in family and social roles three months after program completion, and work productivity at six months as measured by the Stroke Specific Quality of Life Scale (SSQOL). The intervention group also had an increased mean self-efficacy score in communicating with physicians six months after program completion. The mean changes from baseline in these variables were significantly different from the control group. No significant difference was found in time spent in aerobic exercise between the intervention and control groups at three and six months after program completion. Another study, using SSQOL, showed a significant interaction effect by treatment and time on family roles, fine motor tasks, self-care, and work productivity. However there was no significant interaction by treatment and time on self-efficacy. The third study showed improvement in quality of life, community participation, and depressive symptoms among the participants receiving the stroke self-management program, Stanford Chronic Disease Self-management program, or usual care six months after program completion. However, there was no significant difference between the groups. Conclusions There is inconclusive evidence about the effectiveness of theory-based stroke self-management programs on community-dwelling stroke survivors’ recovery. However the preliminary evidence suggests potential benefits in improving stroke survivors’ quality of life and self-efficacy.

Systematic Review Protocol : "Are community-based interventions effective in identifying and responding to emerging zoonotic infectious diseases?"

Review question/objective The objective of this review is to identify the effectiveness of surveillance systems and community-based interventions in identifying and responding to emerging and re-emerging zoonotic infections in Southeast Asia (SE Asia). More specifically the research questions are: 1. What is the effectiveness of community-based surveillance interventions designed to identify emerging zoonotic infectious diseases? 2. What is the effectiveness of non-pharmaceutical community-based interventions designed to prevent transmission of emerging zoonotic infectious diseases? 3. How do factors related to the emergence and management of emerging zoonotic infectious diseases impact the effectiveness of interventions designed to identify and respond to them?

Risk factors for hospital re-presentation among older adults following fragility fractures: Protocol for a systematic review

Background After being discharged from hospital following the acute management of a fragility fracture, older adults may re-present to hospital emergency departments in the post-discharge period. Early re-presentation to hospital, which includes hospital readmissions, and emergency department presentations without admission, may be considered undesirable for individuals, hospital institutions and society. The identification of modifiable risk factors for hospital re-representation following initial fracture management may prove useful for informing policy or practice initiatives that seek to minimise the need for older adults to re-present to hospital early after they have been discharged from their initial inpatient care. The purpose of this systematic review is to identify correlates of hospital re-presentation in older patients who have been discharged from hospital following clinical management of fragility fractures. Methods/Design The review will follow the PRISMA-P reporting guidelines for systematic reviews. Four electronic databases (Pubmed, CINAHL, Embase, and Scopus) will be searched. A suite of search terms will identify peer-reviewed articles that have examined the correlates of hospital re-presentation in older adults (mean age of 65 years or older) who have been discharged from hospital following treatment for fragility fractures. The Effective Public Health Practice Project Quality Assessment Tool for Quantitative Studies will be used to assess the quality of the studies. The strength of evidence will be assessed through best evidence synthesis. Clinical and methodological heterogeneity across studies are likely to impede meta-analyses. Discussion The best evidence synthesis will outline correlates of hospital re-presentations in this clinical group. This synthesis will take into account potential risks of bias for each study, while permitting inclusion of findings from a range of quantitative study designs. It is anticipated that findings from the review will be useful in identifying potentially modifiable risk factors that have relevance in policy, practice and research priorities to improve the management of patients with fragility fractures. Systematic Review Registration PROSPERO CRD42015019379

PTGS2 (Cyclooxygenase-2) expression and survival among colorectal cancer patients: A systematic review

Background: Studies have examined whether tumor expression of PTGS2 (also known as COX-2), an enzyme inhibited by nonsteroidal anti-inflammatory drugs such as aspirin, is associated with prognosis in patients with colorectal cancer. However, results to date have been mixed. Methods: Using terms for PTGS2 and colorectal cancer, the Medline, Embase, and Web of Science databases were systematically searched for studies published, in any language, until December 2011. Random effects meta-analyses were used to calculate pooled HRs [95% confidence intervals (CI)] for the association between PTGS2 expression and tumor recurrence, colorectal cancer-specific survival, and overall survival. Results: In total, 29 studies, which had prognostic data on 5,648 patients, met the inclusion criteria. PTGS2- positive patients were at an increased risk of tumor recurrence (n = 9 studies; HR, 2.79; 95% CI, 1.76-4.41; P <0.001) and had poorer colorectal cancer-specific survival (n = 7; HR, 1.36; 95% CI, 1.02-1.82; P = 0.04). However, there was funnel plot asymmetry, possibly due to publication bias, for the association with cancerspecific survival but less so for recurrence. PTGS2 expression was not associated with overall survival [(n= 16; pooled unadjusted HR, 1.30; 95% CI, 0.94-1.79; P=0.11) and (n=9; pooled adjusted HR, 1.02; 95% CI, 0.72-1.45; P = 0.91)]. Conclusions: PTGS2 expression was associated with an increased risk of tumor recurrence and poorer colorectal cancer-specific survival but not overall survival among patients with colorectal cancer. However, confounding by tumor characteristics such as tumor stage seems likely. Impact: There is insufficient evidence to recommend PTGS2 expression as a prognostic marker in patients with colorectal cancer. Furthermore, studies providing adjusted results are required. © 2013 AACR.

Criteria for the systematic review of health promotion and public health interventions

Systematic reviews of public health interventions are fraught with challenges. Complexity is inherent; this may be due to multi-component interventions, diverse study populations, multiple outcomes measured, mixed study designs utilized and the effect of context on intervention design, implementation and effectiveness. For policy makers and practitioners to use systematic reviews to implement effective public health programmes, systematic reviews must include this information, which seeks to answer the questions posed by decision makers, including recipients of programmes. This necessitates expanding the traditional evaluation of evidence to incorporate the assessment of theory, integrity of interventions, context and sustainability of the interventions and outcomes. Unfortunately however, the critical information required for judging both the quality of a public health intervention and whether or not an intervention is worthwhile or replicable is missing from most public health intervention studies. When the raw material is not available in primary studies the systematic review process becomes even more challenging. Systematic reviews, which highlight these critical gaps, may act to encourage better reporting in primary studies. This paper provides recommendations to reviewers on the issues to address within a public health systematic review and, indirectly, provides advice to researchers on the reporting requirements of primary studies for the production of high quality systematic reviews.

The cost-effectiveness of universal newborn screening for bilateral permanent congenital hearing impairment : systematic review

Objective - Universal newborn hearing screening for bilateral permanent congenital hearing impairment is standard practice in many developed economies, but until there is clear evidence of cost-effectiveness, it remains a controversial use of limited health care resources. We conducted a formal systematic review of studies of newborn hearing screening that considered both costs and outcomes to produce a summary of the available evidence and to determine whether there was a need for further research.

Methods - A search was conducted of medical and nursing databases and gray literature websites by the use of multiple keywords. The titles and abstracts of studies were examined for preliminary inclusion if reference was made to newborn hearing screening, and to both costs and outcomes. Studies of potential relevance were independently assessed by 2 health economists for final inclusion in the review. Studies that met inclusion criteria were appraised by the use of existing guidelines for observational studies, economic evaluations and decision analytic models, and reported in a narrative literature review.

Results - There were 22 distinct observational or modeled evaluations of which only 2 clearly compared universal newborn hearing screening to risk factor screening for bilateral permanent congenital hearing impairment. Of these, the single evaluation that examined long-term costs and outcomes found that universal newborn hearing screening could be cost-saving if early intervention led to a substantial reduction in future treatment costs and productivity losses.

Conclusions - There are only a small number of economic evaluations that have examined the long-term cost-effectiveness of universal newborn hearing screening. This is partly attributable to ongoing uncertainty about the benefits gained from the early detection and treatment of bilateral permanent congenital hearing impairment. There is a clear need for further research on long-term costs and outcomes to establish the cost-effectiveness of universal newborn hearing screening in relation to other approaches to screening, and to establish whether it is a good long term investment.

Satisfaction of newly graduated nurses enrolled in transition-to-practice programmes in their first year of employment: a systematic review

To investigate job satisfaction and confidence levels of graduate nurses during their first year of employment and the impact various training programmes have on these factors.

A systematic review of anti-inflammatories for mild to moderate carpal tunnel syndrome

The purpose of this study was to evaluate anti-inflammatory drugs in the medium- and long-term management of mild to moderate carpal tunnel syndrome (CTS). The authors conducted a systematic review of the literature on the effectiveness of steroidal and nonsteroidal anti-inflammatory drugs for mild and moderate cases of CTS. There were included only randomized, double-blind clinical trials. Six publications referring to five trials were included in the review. No study on nonsteroidal anti-inflammatory drugs met our inclusion criteria. Although neurophysiological studies have not shown great differences resulting from the application of corticosteroids, the symptomatic benefit provided by such drugs is clear. In the short term, local infiltration provides better results than systemic administration of corticosteroids. Over a 1-year period, however, this difference does not persist. Further double-blind randomized trials evaluating therapeutic efficacy for a longer follow-up period are required to provide stronger evidence for both steroidal and nonsteroidal anti-inflammatories. © 2009 by Lippincott Williams & Wilkins.

Physical exercise modulates peripheral levels of brain-derived neurotrophic factor (BDNF): A systematic review of experimental studies in the elderly

The objective of this study was to conduct a systematic review of studies that analyzed the effect of physical exercise on the peripheral levels of BDNF in elderly individuals. Method: We conducted a search in PsycINFO, Biological Abstracts, Pubmed, Web of Science, and Science Direct from 1990 to 2011, using the following keywords: physical exercise , physical activity , physical therapy , training , BDNF , neuroplasticity , neurotrophins , neuroplasticity proteins , aged , older , elderly The articles were considered for inclusion in the review if they were studies with elderly, assessed peripheral (serum and/or plasma) BDNF and evaluated an acute exercise or chronic exercise (training). Results: Five randomized controlled trial and one randomized non-controlled trial studies were analyzed. Five out of six studies reported a significantly higher BDNF response to aerobic acute exercise and to aerobic or strength training program in healthy elderly and elderly with different pathologies. Conclusion: It was not possible to establish a recommendation protocol for the type and intensity of physical exercise required to produce an increase in levels BDNF. However, physical exercise, particularly, moderate-intensity exercises seem to be more effective to promote increase the peripheral levels of BDNF in the elderly. © 2012 Elsevier B.V.

Effects of low doses of polyunsaturated fatty acids on the attention deficit/Hyperactivity disorder of children: A systematic review

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Potential Benefit of Singing for People with Parkinson’s Disease : A Systematic Review

Acknowledgements including sources of support This study was not supported by any particular grant or funding source. The senior author MSB, an epidemiologist with research experience in PD, wishes to thank clinician authors JB, RAA and SMB for their invaluable contributions. JB is a retired health professional with long-standing experience in community health. RAA and SMB are qualified and practising speech and language therapists and RAA specialises in adult neurological disorders. Additionally, we thank Dr Katherine Deane of the University of East Anglia for expert input regarding the Threats to Validity quality tool, on which she was the lead developer.

The effect of moderate gestational alcohol consumption during pregnancy on speech and language outcomes in children: a systematic review

Consensus has not been reached on safe alcohol consumption recommendations during pregnancy. The National Institutes for Care and Health Excellence (NICE) in the UK suggest that one to two drinks not more than twice per week is safe. However, the speech and language effects of even low levels of alcohol use among offspring are unknown. The aim of this study was to review systematically the evidence on studies of the effect of low to moderate levels of alcohol consumption during pregnancy (up to 70 grams of alcohol per week) compared to abstinence on speech and language outcomes in children.