The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration

Systematic reviews and meta-analyses are essential to summarize evidence relating to efficacy and safety of health care interventions accurately and reliably. The clarity and transparency of these reports, however, is not optimal. Poor reporting of systematic reviews diminishes their value to clinicians, policy makers, and other users. Since the development of the QUOROM (QUality Of Reporting Of Meta-analysis) Statement-a reporting guideline published in 1999-there have been several conceptual, methodological, and practical advances regarding the conduct and reporting of systematic reviews and meta-analyses. Also, reviews of published systematic reviews have found that key information about these studies is often poorly reported. Realizing these issues, an international group that included experienced authors and methodologists developed PRISMA ( Preferred Reporting Items for Systematic reviews and Meta-Analyses) as an evolution of the original QUOROM guideline for systematic reviews and meta-analyses of evaluations of health care interventions. The PRISMA Statement consists of a 27-item checklist and a four-phase flow diagram. The checklist includes items deemed essential for transparent reporting of a systematic review. In this Explanation and Elaboration document, we explain the meaning and rationale for each checklist item. For each item, we include an example of good reporting and, where possible, references to relevant empirical studies and methodological literature. The PRISMA Statement, this document, and the associated Web site (http://www.prisma-statement.org/) should be helpful resources to improve reporting of systematic reviews and metaanalyses.

Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement

Systematic reviews should build on a protocol that describes the rationale, hypothesis, and planned methods of the review; few reviews report whether a protocol exists. Detailed, well-described protocols can facilitate the understanding and appraisal of the review methods, as well as the detection of modifications to methods and selective reporting in completed reviews. We describe the development of a reporting guideline, the Preferred Reporting Items for Systematic reviews and Meta-Analyses for Protocols 2015 (PRISMA-P 2015). PRISMA-P consists of a 17-item checklist intended to facilitate the preparation and reporting of a robust protocol for the systematic review. Funders and those commissioning reviews might consider mandating the use of the checklist to facilitate the submission of relevant protocol information in funding applications. Similarly, peer reviewers and editors can use the guidance to gauge the completeness and transparency of a systematic review protocol submitted for publication in a journal or other medium.

The text and the tale: differences between scientific reports and scientists’ reportings on the eruption of Mount Chance, Montserrat

This article looks at the difference between scientists’ written reports and their oral accounts, explanations and stories. The subject of these discourses is the eruption of Mount Chance on Montserrat, a British Overseas Territory in the Eastern Caribbean, and its continued monitoring and reporting. Scientific notions of risk and uncertainty which feature in these texts and tales will subsequently be examined and critiqued. Further to this, this article will end by pointing out that, ironically, the latter - the tale – can in some cases be a more effective and approximate mode of communication with the public than the former – the text.

Complexity and Conundrums in Pollution Control:Improving Effectiveness in Regulatory Compliance

The last century has witnessed a dramatic increase in the wealth of European nations and the well being of their inhabitants. The focus has, however, largely been upon economic growth to the detriment of people and the environment. It is only in recent years that governments have taken cognisance of the impacts of our actions and there is a growing realisation that the causal factors must be identified and addressed as a matter of urgency. One of the key problem areas is pollution and as such environmental protection has become increasingly important as a mechanism for safeguarding the quality of air, water and land. This involves a range of activities from setting standards to monitoring and reporting on discharges and emissions, through to the enforcement of legislation. In theory, this is a simple challenge, in practice, it has proven to be an extremely complex equation that might only begin to be addressed through research. In this context it is strange, and alarming, to find that while it is an axiom of good practice that policy is informed by research there has been a dearth of investigation in this field. The purpose of this paper is, therefore, to consider the issue of pollution, how it impacts on the environment, what measures have been established in pursuit of reducing the number of incidences and, most significantly, which strategies might be employed to avoid or ameliorate detrimental impacts.

Child abuse and neglect: Training needs of student teachers

Increasing awareness of child abuse and neglect (CAN) raises questions about how well teachers are prepared for their role in child protection. This paper assesses and differentiates training needs of first-year students (n = 216) in Northern Ireland. Multiplechoice tests were used to assess knowledge of CAN statistics; recognising and reporting; policies, procedures, and legislative frameworks; and direct work with children. Considerable gaps in knowledge were found. Results between student groups varied and provide evidence of the need to develop pre-service child protection training. The importance of differentiation between student groups in terms of training content is emphasised.

Dissonances in self-reported health and mortality across denominational groups in Northern Ireland

Measures of self-reported health status are increasingly used in research and health policy. However, the inherent subjectivity of the responses gives rise to lingering concerns about their utility, especially across national and cultural boundaries. In this study we use religious denomination as a proxy for Scottish ancestry within Northern Ireland and demonstrate significant differences in levels of self-reported ill-health that are not fully reflected in mortality risks. These findings mirror the differences between Scotland and Northern Ireland previously shown in ecological studies and provide more definitive evidence that even within the United Kingdom factors other than morbidity levels influence the perception and reporting of health status. Possible explanations for the dissonance between morbidity and mortality levels are discussed and the reasons for a preference for socio-economic rather than cultural factors are described. (C) 2010 Elsevier Ltd. All rights reserved.

Bereavement Adjustment and Support among Caregivers

The objective of this study was to examine the influence of health status, demographics, duration of bereavement, caregiving experience, and the use of formal services on bereavement adjustment for caregivers. Participants were 151 bereaved family caregivers who participated in a telephone survey. The most frequently reported symptoms by caregivers were sleeplessness, followed by depression, and loss of appetite. One hundred thirty-five respondents (89%) felt that things were going reasonably well for themselves at the time of the interview, and 91 respondents (60%) had come to terms with their loved one's death. Hierarchical regression models revealed that being a younger caregiver, reporting poorer mental health status, and being the spouse of the care recipient were predictive of a greater number of reported depressive symptoms in bereavement. Poorer mental health status, being a spousal caregiver, and reporting negative consequences of caregiving on caregiver's health were predictive of poorer recovery in bereavement. Study results also revealed that relatives and friends played an important role in assisting the bereaved to manage the bereavement process. This article identifies factors associated with poor reactions in bereavement and that bereavement as a social process where family and friends play an important role in the recovery process.

How Outcomes Are Defined in Clinical Trials of Mechanically Ventilated Adults and Children

Systematic reviews have considerable potential to provide evidence-based data to aid clinical decision-making. However, there is growing recognition that trials involving mechanical ventilation lack consistency in the definition and measurement of ventilation outcomes, creating difficulties in combining data for meta-analyses. To address the inconsistency in outcome definitions, international standards for trial registration and clinical trial protocols published recommendations, effectively setting the “gold standard” for reporting trial outcomes. In this Critical Care Perspective, we review the problems resulting from inconsistent outcome definitions and inconsistent reporting of outcomes (outcome sets). We present data highlighting the variability of the most commonly reported ventilation outcome definitions. Ventilation outcomes reported in trials over the last 6 years typically fall into four domains: measures of ventilator dependence; adverse outcomes; mortality; and resource use. We highlight the need, first, for agreement on outcome definitions and, second, for a minimum core outcome set for trials involving mechanical ventilation. A minimum core outcome set would not restrict trialists from measuring additional outcomes, but would overcome problems of variability in outcome selection, measurement, and reporting, thereby enhancing comparisons across trials.

Performance management systems and Public Value Strategy: a case study

Purpose
This article aims to analyze the role of performance management systems (PMS) in supporting public value strategies.

Design/methodology/approach
This article draws on the public value dynamic model by Horner and Hutton (2010). It presents the results of a case study of implementation of a PMS model, the ‘Value Pyramid’ (VP).

Findings
The results stress the need for an improved conceptualization of PMS within public value strategy. Through experimentation using the VP, the case site was able to measure and visualize what it considered public value and reflect on the internal/external causes of both creation and destruction of public value.

Research limitations/implication
This article is limited to just one case study, although in-depth and longitudinal.

Originality/value
This article is one of the first attempting to understand the role of PMS within the public value strategy framework, answering the call of Benington and Moore (2010) to consider public value from an accounting perspective.

Doing Focus Groups and Interviews with Recent Migrants to Northern Ireland: A Dynamic Interplay of Ethics, Language and Access

This case describes a qualitative social science research project that was conducted in 2009 and that examined the experiences of recent migrants to Northern Ireland. While background to the research and key findings are presented, the topic forms a backdrop to the case. The following aspects of the study are presented: the theoretical context; formulating the research question, design and methodology; key methodological issues; data collection and analysis; project dissemination; and research funding and reporting. The case pays particular attention to the needs and impact of different groups including the researcher, the funding body, the researcher’s employer and the researched. The significance of access, language and ethics to this study are examined. Finally, the way in which the research unfolded in an often-unpredictable way throughout the implementation process is highlighted in the narrative.

Accuracy of LightCycler SeptiFast for the detection and identification of pathogens in the blood of patients with suspected sepsis: a systematic review and meta-analysis

Purpose: There is an urgent need to develop diagnostic tests to improve the detection of pathogens causing life-threatening infection (sepsis). SeptiFast is a CE-marked multi-pathogen real-time PCR system capable of detecting DNA sequences of bacteria and fungi present in blood samples within a few hours. We report here a systematic review and meta-analysis of diagnostic accuracy studies of SeptiFast in the setting of suspected sepsis.

Methods: A comprehensive search strategy was developed to identify studies that compared SeptiFast with blood culture in suspected sepsis. Methodological quality was assessed using QUADAS. Heterogeneity of studies was investigated using a coupled forest plot of sensitivity and specificity and a scatter plot in receiver operator characteristic space. Bivariate model method was used to estimate summary sensitivity and specificity.

Results: From 41 phase III diagnostic accuracy studies, summary sensitivity and specificity for SeptiFast compared with blood culture were 0.68 (95 % CI 0.63–0.73) and 0.86 (95 % CI 0.84–0.89) respectively. Study quality was judged to be variable with important deficiencies overall in design and reporting that could impact on derived diagnostic accuracy metrics.

Conclusions: SeptiFast appears to have higher specificity than sensitivity, but deficiencies in study quality are likely to render this body of work unreliable. Based on the evidence presented here, it remains difficult to make firm recommendations about the likely clinical utility of SeptiFast in the setting of suspected sepsis.

Rapid detection of health-care-associated bloodstream infection in critical care using multipathogen real-time polymerase chain reaction technology: a diagnostic accuracy study and systematic review

Background: There is growing interest in the potential utility of real-time polymerase chain reaction (PCR) in diagnosing bloodstream infection by detecting pathogen deoxyribonucleic acid (DNA) in blood samples within a few hours. SeptiFast (Roche Diagnostics GmBH, Mannheim, Germany) is a multipathogen probe-based system targeting ribosomal DNA sequences of bacteria and fungi. It detects and identifies the commonest pathogens causing bloodstream infection. As background to this study, we report a systematic review of Phase III diagnostic accuracy studies of SeptiFast, which reveals uncertainty about its likely clinical utility based on widespread evidence of deficiencies in study design and reporting with a high risk of bias. 

Objective: Determine the accuracy of SeptiFast real-time PCR for the detection of health-care-associated bloodstream infection, against standard microbiological culture. 

Design: Prospective multicentre Phase III clinical diagnostic accuracy study using the standards for the reporting of diagnostic accuracy studies criteria. 

Setting: Critical care departments within NHS hospitals in the north-west of England. 

Participants: Adult patients requiring blood culture (BC) when developing new signs of systemic inflammation. 

Main outcome measures: SeptiFast real-time PCR results at species/genus level compared with microbiological culture in association with independent adjudication of infection. Metrics of diagnostic accuracy were derived including sensitivity, specificity, likelihood ratios and predictive values, with their 95% confidence intervals (CIs). Latent class analysis was used to explore the diagnostic performance of culture as a reference standard. 

Results: Of 1006 new patient episodes of systemic inflammation in 853 patients, 922 (92%) met the inclusion criteria and provided sufficient information for analysis. Index test assay failure occurred on 69 (7%) occasions. Adult patients had been exposed to a median of 8 days (interquartile range 4–16 days) of hospital care, had high levels of organ support activities and recent antibiotic exposure. SeptiFast real-time PCR, when compared with culture-proven bloodstream infection at species/genus level, had better specificity (85.8%, 95% CI 83.3% to 88.1%) than sensitivity (50%, 95% CI 39.1% to 60.8%). When compared with pooled diagnostic metrics derived from our systematic review, our clinical study revealed lower test accuracy of SeptiFast real-time PCR, mainly as a result of low diagnostic sensitivity. There was a low prevalence of BC-proven pathogens in these patients (9.2%, 95% CI 7.4% to 11.2%) such that the post-test probabilities of both a positive (26.3%, 95% CI 19.8% to 33.7%) and a negative SeptiFast test (5.6%, 95% CI 4.1% to 7.4%) indicate the potential limitations of this technology in the diagnosis of bloodstream infection. However, latent class analysis indicates that BC has a low sensitivity, questioning its relevance as a reference test in this setting. Using this analysis approach, the sensitivity of the SeptiFast test was low but also appeared significantly better than BC. Blood samples identified as positive by either culture or SeptiFast real-time PCR were associated with a high probability (> 95%) of infection, indicating higher diagnostic rule-in utility than was apparent using conventional analyses of diagnostic accuracy. 

Conclusion: SeptiFast real-time PCR on blood samples may have rapid rule-in utility for the diagnosis of health-care-associated bloodstream infection but the lack of sensitivity is a significant limiting factor. Innovations aimed at improved diagnostic sensitivity of real-time PCR in this setting are urgently required. Future work recommendations include technology developments to improve the efficiency of pathogen DNA extraction and the capacity to detect a much broader range of pathogens and drug resistance genes and the application of new statistical approaches able to more reliably assess test performance in situation where the reference standard (e.g. blood culture in the setting of high antimicrobial use) is prone to error.

A review of behaviour change theories and techniques used in group based self-management programmes for chronic low back pain and arthritis

Background: Medical Research Council (MRC) guidelines recommend applying theory within complex interventions to explain how behaviour change occurs. Guidelines endorse self-management of chronic low back pain (CLBP) and osteoarthritis (OA), but evidence for its effectiveness is weak. Objective: This literature review aimed to determine the use of behaviour change theory and techniques within randomised controlled trials of group-based self-management programmes for chronic musculoskeletal pain, specifically CLBP and OA. Methods: A two-phase search strategy of electronic databases was used to identify systematic reviews and studies relevant to this area. Articles were coded for their use of behaviour change theory, and the number of behaviour change techniques (BCTs) was identified using a 93-item taxonomy, Taxonomy (v1). Results: 25 articles of 22 studies met the inclusion criteria, of which only three reported having based their intervention on theory, and all used Social Cognitive Theory. A total of 33 BCTs were coded across all articles with the most commonly identified techniques being '. instruction on how to perform the behaviour', '. demonstration of the behaviour', '. behavioural practice', '. credible source', '. graded tasks' and '. body changes'. Conclusion: Results demonstrate that theoretically driven research within group based self-management programmes for chronic musculoskeletal pain is lacking, or is poorly reported. Future research that follows recommended guidelines regarding the use of theory in study design and reporting is warranted.

Topical antihistamines and mast cell stabilisers for treating seasonal and perennial allergic conjunctivitis

BACKGROUND: Seasonal/perennial allergic conjunctivitis is the most common allergic conjunctivitis, usually with acute manifestations when a person is exposed to allergens and with typical signs and symptoms including itching, redness, and tearing. The clinical signs and symptoms of allergic conjunctivitis are mediated by the release of histamine by mast cells. Histamine antagonists (also called antihistamines) inhibit the action of histamine by blocking histamine H1 receptors, antagonising the vasoconstrictor, and to a lesser extent, the vasodilator effects of histamine. Mast cell stabilisers inhibit degranulation and consequently the release of histamine by interrupting the normal chain of intracellular signals. Topical treatments include eye drops with antihistamines, mast cell stabilisers, non-steroidal anti-inflammatory drugs, combinations of the previous treatments, and corticosteroids. Standard treatment is based on topical antihistamines alone or topical mast cell stabilisers alone or a combination of treatments. There is clinical uncertainty about the relative efficacy and safety of topical treatment.

OBJECTIVES: The objective of this review was to assess the effects of topical antihistamines and mast cell stabilisers, alone or in combination, for use in treating seasonal and perennial allergic conjunctivitis.

SEARCH METHODS: We searched CENTRAL (which contains the Cochrane Eyes and Vision Trials Register) (2014, Issue 7), Ovid MEDLINE, Ovid MEDLINE In-Process and Other Non-Indexed Citations, Ovid MEDLINE Daily, Ovid OLDMEDLINE (January 1946 to July 2014), EMBASE (January 1980 to July 2014), the metaRegister of Controlled Trials (mRCT) (www.controlled-trials.com), ClinicalTrials.gov (www.clinicaltrials.gov) and the World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP) (www.who.int/ictrp/search/en). We did not use any date or language restrictions in the electronic searches for trials. We last searched the electronic databases on 17 July 2014. We also searched the reference lists of review articles and relevant trial reports for details of further relevant publications.

SELECTION CRITERIA: We included randomised controlled trials (RCTs) comparing topical antihistamine and mast cell stabilisers, alone or in combination, with placebo, no treatment or to any other antihistamine or mast cell stabiliser, or both, that examined people with seasonal or perennial allergic conjunctivitis, or both. The primary outcome was any participant-reported evaluation (by questionnaire) of severity of four main ocular symptoms: itching, irritation, watering eye (tearing), and photophobia (dislike of light), both separately and, if possible, by an overall symptom score. We considered any follow-up time between one week and one year.

DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data and assessed risk of bias. Disagreements were resolved by discussion among review authors and the involvement of a third review author. We followed standard methodological approaches used by Cochrane.

MAIN RESULTS: We identified 30 trials with a total of 4344 participants randomised, with 17 different drugs or treatment comparisons. The following antihistamines and mast cell stabilisers were evaluated in at least one RCT: nedocromil sodium or sodium cromoglycate, olopatadine, ketotifen, azelastine, emedastine, levocabastine (or levocabastine), mequitazine, bepotastine besilate, combination of antazoline and tetryzoline, combination of levocabastine and pemirolast potassium. The most common comparison was azelastine versus placebo (nine studies).We observed a large variability in reporting outcomes. The quality of the studies and reporting was variable, but overall the risk of bias was low. Trials evaluated only short-term effects, with a range of treatment of one to eight weeks. Meta-analysis was only possible in one comparison (olopatadine versus ketotifen). There was some evidence to support that topical antihistamines and mast cell stabilisers reduce symptoms and signs of seasonal allergic conjunctivitis when compared with placebo. There were no reported serious adverse events related to the use of topical antihistamine and mast cell stabilisers treatment.

AUTHORS' CONCLUSIONS: It seems that all reported topical antihistamines and mast cell stabilisers reduce symptoms and signs of seasonal allergic conjunctivitis when compared with placebo in the short term. However, there is no long-term data on their efficacy. Direct comparisons of different antihistamines and mast cell stabilisers need to be interpreted with caution. Overall, topical antihistamines and mast cell stabilisers appear to be safe and well tolerated. We observed a large variability in outcomes reported. Poor quality of reporting challenged the synthesis of evidence.

Public Value as Performance: Politicians’ and Managers’ Perspectives on the Importance of Budgetary, Accruals and Non-Financial Information

Purpose
The study contributes to the literature on public value and performance examining politicians’ and managers’ perspectives by investigating the importance they attach to the different facets of performance information (i.e. budgetary, accrual based- and non-financial information (NFI)).

Design/methodology/approach
We survey politicians and managers in all Italian municipalities of at least 80,000 inhabitants.

Findings
Overall, NFI is more appreciated than financial information (FI). Moreover, budgetary accounting is preferred to accrual accounting. Politicians’ and managers’ preferences are generally aligned.

Research limitations/implications
NFI as a measure of public value is not alternative, but rather complementary, to FI. The latter remains a fundamental element of public sector accounting due to its role in resource allocation and control.

Practical implications
The preference for NFI over FI and of budgetary over accruals accounting suggests that the current predominant emphasis on (accrual-based) financial reporting might be misplaced.

Originality/value
Public value and performance are multi-faceted concepts. They can be captured by different types of information and evaluated according to different criteria, which will also depend on the category of stakeholders or users who assesses public performance. So far, most literature has considered the financial and non-financial facets of performance as virtually separate. Similarly, in the practice, financial management tends to be decoupled from non-financial performance management. However, this research shows that only by considering their joint interactions we can achieve an accurate representation of what public value really is.