Development of a pharmacy practice intervention: lessons from the literature

The development of health interventions is receiving increasing attention within the scientific literature. In the past, interventions were often based on the ISLAGIATT principle: that is, ‘It seemed like a good idea at the time’. However, such interventions were frequently ineffective because they were either delivered in part or not at all, demonstrating a lack of fidelity, or because little attention had been paid to their development, content, and mode of delivery. This commentary seeks to highlight the latest methodological advances in the field of intervention development, drawing on health psychology literature, together with guidance from key organisations and research consortia which are setting standards for development and reporting. Those working within pharmacy practice research can learn from the more systematic approach being advocated, and apply these methods to help generate evidence to support new services and professional roles.

Towards core outcome set (COS) development: a follow-up descriptive survey of outcomes in Cochrane reviews

BACKGROUND: A core outcome set (COS) can address problems of outcome heterogeneity and outcome reporting bias in trials and systematic reviews, including Cochrane reviews, helping to reduce waste. One of the aims of the international Core Outcome Measures in Effectiveness Trials (COMET) Initiative is to link the development and use of COS with the outcomes specified and reported in Cochrane reviews, including the outcomes listed in the summary of findings (SoF) tables. As part of this work, an earlier exploratory survey of the outcomes of newly published 2007 and 2011 Cochrane reviews was performed. This survey examined the use of COS, the variety of specified outcomes, and outcome reporting in Cochrane reviews by Cochrane Review Group (CRG). To examine changes over time and to explore outcomes that were repeatedly specified over time in Cochrane reviews by CRG, we conducted a follow-up survey of outcomes in 2013 Cochrane reviews.

METHODS: A descriptive survey of outcomes in Cochrane reviews that were first published in 2013. Outcomes specified in the methods sections and reported in the results section of the Cochrane reviews were examined by CRG. We also explored the uptake of SoF tables, the number of outcomes included in these, and the quality of the evidence for the outcomes.

RESULTS: Across the 50 CRGs, 375 Cochrane reviews that included at least one study specified a total of 3142 outcomes. Of these outcomes, 32 % (1008) were not reported in the results section of these reviews. For 23 % (233) of these non-reported outcomes, we did not find any reason in the text of the review for this non-report. Fifty-seven percent (216/375) of reviews included a SoF table.

CONCLUSIONS: The proportion of specified outcomes that were reported in Cochrane reviews had increased in 2013 (68 %) compared to 2007 (61 %) and 2011 (65 %). Importantly, 2013 Cochrane reviews that did not report specified outcomes were twice as likely to provide an explanation for why the outcome was not reported. There has been an increased uptake of SoF tables in Cochrane reviews. Outcomes that were repeatedly specified in Cochrane reviews by CRG in 2007, 2011, and 2013 may assist COS development.

Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation

Protocols of systematic reviews and meta-analyses allow for planning and documentation of review methods, act as a guard against arbitrary decision making during review conduct, enable readers to assess for the presence of selective reporting against completed reviews, and, when made publicly available, reduce duplication of efforts and potentially prompt collaboration. Evidence documenting the existence of selective reporting and excessive duplication of reviews on the same or similar topics is accumulating and many calls have been made in support of the documentation and public availability of review protocols. Several efforts have emerged in recent years to rectify these problems, including development of an international register for prospective reviews (PROSPERO) and launch of the first open access journal dedicated to the exclusive publication of systematic review products, including protocols (BioMed Central's Systematic Reviews). Furthering these efforts and building on the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines, an international group of experts has created a guideline to improve the transparency, accuracy, completeness, and frequency of documented systematic review and meta-analysis protocols--PRISMA-P (for protocols) 2015. The PRISMA-P checklist contains 17 items considered to be essential and minimum components of a systematic review or meta-analysis protocol.This PRISMA-P 2015 Explanation and Elaboration paper provides readers with a full understanding of and evidence about the necessity of each item as well as a model example from an existing published protocol. This paper should be read together with the PRISMA-P 2015 statement. Systematic review authors and assessors are strongly encouraged to make use of PRISMA-P when drafting and appraising review protocols.

Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement

Systematic reviews should build on a protocol that describes the rationale, hypothesis, and planned methods of the review; few reviews report whether a protocol exists. Detailed, well-described protocols can facilitate the understanding and appraisal of the review methods, as well as the detection of modifications to methods and selective reporting in completed reviews. We describe the development of a reporting guideline, the Preferred Reporting Items for Systematic reviews and Meta-Analyses for Protocols 2015 (PRISMA-P 2015). PRISMA-P consists of a 17-item checklist intended to facilitate the preparation and reporting of a robust protocol for the systematic review. Funders and those commissioning reviews might consider mandating the use of the checklist to facilitate the submission of relevant protocol information in funding applications. Similarly, peer reviewers and editors can use the guidance to gauge the completeness and transparency of a systematic review protocol submitted for publication in a journal or other medium.

Research-informed design, management and maintenance of infrastructure slopes: development of a multi-scalar approach

The UK’s transport infrastructure is one of the most heavily used in the world. The performance of these networks is critically dependent on the performance of cutting and embankment slopes which make up £20B of the £60B asset value of major highway infrastructure alone. The rail network in particular is also one of the oldest in the world: many of these slopes are suffering high incidents of instability (increasing with time). This paper describes the development of a fundamental understanding of earthwork material and system behaviour, through the systematic integration of research across a range of spatial and temporal scales. Spatially these range from microscopic studies of soil fabric, through elemental materials behaviour to whole slope modelling and monitoring and scaling up to transport networks. Temporally, historical and current weather event sequences are being used to understand and model soil deterioration processes, and climate change scenarios to examine their potential effects on slope performance in futures up to and including the 2080s. The outputs of this research are being mapped onto the different spatial and temporal scales of infrastructure slope asset management to inform the design of new slopes through to changing the way in which investment is made into aging assets. The aim ultimately is to help create a more reliable, cost effective, safer and more resilient transport system.

Does childhood bullying lead to the development of psychotic symptoms? A meta-analysis and review of prospective studies

Purpose: Researchers have demonstrated associations between trauma and psychosis. Childhood trauma, in particular, appears to be an important determinant. Recently, bullying has become considered a traumatic experience in its own right. This review aims to analyse research with prospective designs, which will enable conclusions about whether or not bullying causes psychosis.

Methods: A systematic review of the literature was carried out independently by two reviewers. Eligibility and quality assessment criteria were applied. A meta-analysis and narrative synthesis were then completed.

Results: Ten studies met inclusion criteria. Four used data from the same large database, and were combined as one. The majority provided confirmation that bullying appears to cause later development of psychosis. A meta-analysis yielded an unadjusted odds ratio (OR) of 2.148 [95% confidence interval (CI) 1.140–4.044].

Conclusions: The studies reviewed here suggest that bullying does predict the later development of psychotic symptoms. What is lacking from the literature is adequate investigation into other potential mediating factors. The current review highlights the significant role of bullying within this complex interaction. Potential mediating variables are explored, including a dose–response effect for the severity and frequency of victimization. Suggestions for targeting intervention are also suggested alongside clinical implications and recommendations for future research.

Interventions to improve the appropriate use of polypharmacy in older people: a Cochrane systematic review

Objective: To summarise the findings of an updated Cochrane review of interventions aimed at improving the appropriate use of polypharmacy in older people. Design: Cochrane systematic review. Multiple electronic databases were searched including MEDLINE, EMBASE and the Cochrane Central Register of Controlled Trials (from inception to November 2013). Hand searching of references was also performed. Randomised controlled trials (RCTs), controlled clinical trials, controlled before-and-after studies and interrupted time series analyses reporting on interventions targeting appropriate polypharmacy in older people in any healthcare setting were included if they used a validated measure of prescribing appropriateness. Evidence quality was assessed using the Cochrane risk of bias tool and GRADE (Grades of Recommendation, Assessment, Development and Evaluation).
Setting: All healthcare settings. 
Participants: Older people (≥65 years) with ≥1 long-term condition who were receiving polypharmacy (≥4 regular medicines).
Primary and secondary outcome measures: Primary outcomes were the change in prevalence of appropriate polypharmacy and hospital admissions. Medication-related problems (eg, adverse drug reactions), medication adherence and quality of life were included as secondary outcomes.
Results: 12 studies were included: 8 RCTs, 2 cluster RCTs and 2 controlled before-and-after studies. 1 study involved computerised decision support and 11 comprised pharmaceutical care approaches across various settings. Appropriateness was measured using validated tools, including the Medication Appropriateness Index, Beers’ criteria and Screening Tool of Older Person’s Prescriptions (STOPP)/ Screening Tool to Alert doctors to Right Treatment (START). The interventions demonstrated a reduction in inappropriate prescribing. Evidence of effect on hospital admissions and medication-related problems was conflicting. No differences in health-related quality of life were reported.
Conclusions: The included interventions demonstrated improvements in appropriate polypharmacy based on reductions in inappropriate prescribing. However, it remains unclear if interventions resulted in clinically significant improvements (eg, in terms of hospital admissions). Future intervention studies would benefit from available guidance on intervention development, evaluation and reporting to facilitate replication in clinical practice.

Dyslipidemia and Diabetic Macular Edema: A Systematic Review and Meta-Analysis

Topic: A systematic review and meta-analysis of dyslipidemia and diabetic macular edema (DME). 

Clinical Relevance: Diabetic macular edema causes impairment of vision in patients with diabetes, and dyslipidemia has been reported as a risk factor for its development. A systematic review with a meta-analysis was undertaken to examine the evidence of an association between dyslipidemia and DME. 

Methods: We defined eligibility criteria as randomized controlled trials (RCTs) and cohort, case-control, and cross-sectional studies reporting on the relationship between blood lipid levels and DME. We performed a literature search in MEDLINE, PubMed, and Embase from inception to September 2014. We used the NewcastleeOttawa scale to assess the quality of case-control, cross-sectional, and cohort studies, and the Cochrane risk of bias tool for RCTs. 

Results: The search strategy identified 4959 publications. After screening, we selected 21 articles for review (5 cross-sectional, 5 cohort, 7 case-control, and 4 RCTs). Meta-analysis of case-control studies revealed that mean levels of total serum cholesterol (TC), low-density lipoproteins (LDLs), and serum triglycerides (TGs) were significantly higher in patients with DME compared with those without DME (TC: 30.08; 95% confidence interval [CI], 21.14e39.02; P < 0.001; LDL: 18.62; 95% CI, 5.80e31.43; P < 0.05; TG: 24.82; 95% CI, 9.21e40.42; P < 0.05). Meta-analysis of RCTs did not show significant risk in worsening of hard exudates and severity of DME in the lipid-lowering group compared with placebo (hard exudates: relative risk, 1.00; 95% CI, 0.47e2.11; P ¼ 1.00; DME: relative risk, 1.18; 95% CI, 0.75e1.86; P ¼ 0.48). 

Conclusions: Despite evidence from the cohort studies and meta-analysis of the case-control studies suggesting a strong relationship between lipid levels and DME, this was not confirmed by the meta-analysis that included only prospective RCTs. Therefore, given the significant public health relevance of the topic, the relationship between lipid levels and DME deserves further investigation.

Development of a new welfare assessment protocol for practical application in long-term dog shelters

In many European shelters, dogs may spend many years confined. A poor environment and inappropriate management may lead to a low quality of life. The absence of harmonised European regulatory frameworks defining the minimum requirements for shelter facilities makes the definition of welfare standards for kennelled dogs challenging. Here, a new protocol was developed and tested to help identify the main welfare issues for shelter dogs. Twenty-six indicators were identified including management, resource and animal based measures. Accuracy and interobserver reliability were checked between four assessors. The protocol was applied in 29 shelters (n=1308 dogs) in six European countries. Overall prevalence of poor health conditions was below 10%. Test-retest reliability and validity of the protocol were investigated with encouraging results. A logistic regression was carried out to assess the potential of the protocol as a tool to identify welfare hazards in shelter environments. Inappropriate space allowance, for example, was found to be a risk factor potentially affecting the animal's cleanliness, skin condition and body condition. The protocol was designed to be concise and easy to implement. Systematic data collection could help identify welfare problems that are likely to arise in certain shelter designs and thus determine improvement in animal care standards.

Impact of non-pharmacological interventions on prevention and treatment of delirium in critically ill patients: protocol for a systematic review of quantitative and qualitative research

Background: Critically ill patients have an increased risk of developing delirium during their intensive care stay.To date, pharmacological interventions have not been shown to be effective for delirium management but non-pharmacological interventions have shown some promise. The aim of this systematic review is to identify effective non-pharmacological interventions for reducing the incidence or the duration of delirium in critically ill patients.

Methods: We will search MEDLINE, EMBASE, CINAHL, Web of Science, AMED, psycINFO and the Cochrane Library.We will include studies of critically ill adults and children. We will include randomised trials and controlled trials which measure the effectiveness of one or more non-pharmacological interventions in reducing incidence or duration ofdelirium in critically ill patients. We will also include qualitative studies that provide an insight into patients and their families’ experiences of delirium and non-pharmacological interventions. Two independent reviewers will assess studies for eligibility, extract data and appraise quality. We will conduct meta-analyses if possible or present results narratively.Qualitative studies will also be reviewed by two independent reviewers, and a specially designed quality assessment tool incorporating the CASP framework and the POPAY framework will be used to assess quality.

Discussion: Although non-pharmacological interventions have been studied in populations outside of intensive care units and multicomponent interventions have successfully reduced incidence and duration of delirium, no systematic review of non-pharmacological interventions specifically targeting delirium in critically ill patients have been undertaken to date. This systematic review will provide evidence for the development of a multicomponent intervention for delirium management of critically ill patients that can be tested in a subsequent multicentre randomised trial.

Risk factors (excluding hormone therapy) for endometrial hyperplasia: a systematic review.

Objective: To conduct a systematic review of risk factors associated with the development of Endometrial Hyperplasia (EH).

Data sources: Ovid MEDLINE, EMBASE and Web of Science databases were searched from inception to 30 June 2015.

Study eligibility: Fifteen observational studies that reported on EH risk in relation to lifestyle factors (n=14), medical history (n=11), reproductive and menstrual history (n=9) and measures of socio-economic status (n=2) were identified. Pooled relative risk estimates and corresponding 95% confidence intervals (CI) were able to be derived for EH and Body Mass Index (BMI), smoking, diabetes and hypertension, using random effects models comparing high versus low categories.

Results: The pooled relative risk for EH when comparing women with the highest versus lowest BMI was 1.82 (95% CI 1.22–2.71; n=7 studies, I2=90.4%). No significant associations were observed for EH risk for smokers compared with non-smokers (RR 0.88, 95% CI 0.66-1.17; n=3, I2=0.0%), hypertensive versus normotensive women (RR 1.51, 95% CI 0.72–3.15; n=5 studies, I2=79.1%), or diabetic versus non-diabetic women (RR 1.77, 95% CI 0.79–3.96; n=5 studies, I2=31.8%) respectively although the number of included studies was limited. There were mixed reports on the relationship between age and risk of EH. Too few studies reported on other factors to reach any conclusions in relation to EH risk.

Conclusions: A high BMI was associated with an increased risk of EH, providing additional rationale for women to maintain a normal body weight. No significant associations were detected for other factors and EH risk, however relatively few studies have been conducted and few of the available studies adequately adjusted for relevant confounders. Therefore, further aetiological studies of endometrial hyperplasia are warranted.

Systematic review of interventions to improve the psychological well-being of general practitioners

BACKGROUND: The health of doctors who work in primary care is threatened by workforce and workload issues. There is a need to find and appraise ways in which to protect their mental health, including how to achieve the broader, positive outcome of well-being. Our primary outcome was to evaluate systematically the research evidence regarding the effectiveness of interventions designed to improve General Practitioner (GP) well-being across two continua; psychopathology (mental ill-health focus) and 'languishing to flourishing' (positive mental health focus). In addition we explored the extent to which developments in well-being research may be integrated within existing approaches to design an intervention that will promote mental health and prevent mental illness among these doctors.

METHODS: Medline, Embase, Cinahl, PsychINFO, Cochrane Register of Trials and Web of Science were searched from inception to January 2015 for studies where General Practitioners and synonyms were the primary participants. Eligible interventions included mental ill-health prevention strategies (e.g. promotion of early help-seeking) and mental health promotion programmes (e.g. targeting the development of protective factors at individual and organizational levels). A control group was the minimum design requirement for study inclusion and primary outcomes had to be assessed by validated measures of well-being or mental ill-health. Titles and abstracts were assessed independently by two reviewers with 99 % agreement and full papers were appraised critically using validated tools.

RESULTS: Only four studies (with a total of 997 GPs) from 5392 titles met inclusion criteria. The studies reported statistically significant improvement in self-reported mental ill-health. Two interventions used cognitive-behavioural techniques, one was mindfulness-based and one fed-back GHQ scores and self-help information.

CONCLUSION: There is an urgent need for high quality, controlled studies in GP well-being. Research on improving GP well-being is limited by focusing mainly on stressors and not giving systematic attention to the development of positive mental health.

Physical rehabilitation interventions for adult patients during critical illness: an overview of systematic reviews

Background Physical rehabilitation interventions aim to ameliorate the effects of critical illness-associated muscle dysfunction in survivors. We conducted an overview of systematic reviews (SR) evaluating the effect of these interventions across the continuum of recovery.

Methods Six electronic databases (Cochrane Library, CENTRAL, DARE, Medline, Embase, and Cinahl) were searched. Two review authors independently screened articles for eligibility and conducted data extraction and quality appraisal. Reporting quality was assessed and the Grading of Recommendations Assessment, Development and Evaluation approach applied to summarise overall quality of evidence.

Results Five eligible SR were included in this overview, of which three included meta-analyses. Reporting quality of the reviews was judged as medium to high. Two reviews reported moderate-to-high quality evidence of the beneficial effects of physical therapy commencing during intensive care unit (ICU) admission in improving critical illness polyneuropathy/myopathy, quality of life, mortality and healthcare utilisation. These interventions included early mobilisation, cycle ergometry and electrical muscle stimulation. Two reviews reported very low to low quality evidence of the beneficial effects of electrical muscle stimulation delivered in the ICU for improving muscle strength, muscle structure and critical illness polyneuropathy/myopathy. One review reported that due to a lack of good quality randomised controlled trials and inconsistency in measuring outcomes, there was insufficient evidence to support beneficial effects from physical rehabilitation delivered post-ICU discharge.

Conclusions Patients derive short-term benefits from physical rehabilitation delivered during ICU admission. Further robust trials of electrical muscle stimulation in the ICU and rehabilitation delivered following ICU discharge are needed to determine the long-term impact on patient care. This overview provides recommendations for design of future interventional trials and SR.

Improving the wellbeing of staff who work in palliative care settings: a systematic review of psychosocial interventions

Background: Staff in palliative care settings perform emotionally demanding roles which may lead to psychological distress including stress and burnout. Therefore, interventions have been designed to address these occupational risks.

Aim: To investigate quantitative studies exploring the effectiveness of psychosocial interventions that attempt to improve psychological wellbeing of palliative care staff.

Design: A systematic review was conducted according to methodological guidance from UK Centre for Reviews and Dissemination.

Data sources: A search strategy was developed based on the initial scans of palliative care studies. Potentially eligible research articles were identified by searching the following databases: CINAHL, MEDLINE (Ovid), PsycINFO and Web of Science. Two reviewers independently screened studies against pre-set eligibility criteria. To assess quality, both researchers separately assessed the remaining studies using the Quality Assessment Tool for Quantitative Studies.

Results: A total of 1786 potentially eligible articles were identified – nine remained following screening and quality assessment. Study types included two randomised controlled trials, two non-randomised controlled trial designs, four one-group pre–post evaluations and one process evaluation. Studies took place in the United States and Canada (5), Europe (3) and Hong Kong (1). Interventions comprised a mixture of relaxation, education, support and cognitive training and targeted stress, fatigue, burnout, depression and satisfaction. The randomised controlled trial evaluations did not improve psychological wellbeing of palliative care staff. Only two of the quasi-experimental studies appeared to show improved staff wellbeing although these studies were methodologically weak.

Conclusion: There is an urgent need to address the lack of intervention development work and high-quality research in this area.

Systematic review of tools to measure outcomes for young children with autism spectrum disorder

BACKGROUND: The needs of children with autism spectrum disorder (ASD) are complex and this is reflected in the number and diversity of outcomes assessed and measurement tools used to collect evidence about children's progress. Relevant outcomes include improvement in core ASD impairments, such as communication, social awareness, sensory sensitivities and repetitiveness; skills such as social functioning and play; participation outcomes such as social inclusion; and parent and family impact.

OBJECTIVES: To examine the measurement properties of tools used to measure progress and outcomes in children with ASD up to the age of 6 years. To identify outcome areas regarded as important by people with ASD and parents.

METHODS: The MeASURe (Measurement in Autism Spectrum disorder Under Review) research collaboration included ASD experts and review methodologists. We undertook systematic review of tools used in ASD early intervention and observational studies from 1992 to 2013; systematic review, using the COSMIN checklist (Consensus-based Standards for the selection of health Measurement Instruments) of papers addressing the measurement properties of identified tools in children with ASD; and synthesis of evidence and gaps. The review design and process was informed throughout by consultation with stakeholders including parents, young people with ASD, clinicians and researchers.

RESULTS: The conceptual framework developed for the review was drawn from the International Classification of Functioning, Disability and Health, including the domains 'Impairments', 'Activity Level Indicators', 'Participation', and 'Family Measures'. In review 1, 10,154 papers were sifted - 3091 by full text - and data extracted from 184; in total, 131 tools were identified, excluding observational coding, study-specific measures and those not in English. In review 2, 2665 papers were sifted and data concerning measurement properties of 57 (43%) tools were extracted from 128 papers. Evidence for the measurement properties of the reviewed tools was combined with information about their accessibility and presentation. Twelve tools were identified as having the strongest supporting evidence, the majority measuring autism characteristics and problem behaviour. The patchy evidence and limited scope of outcomes measured mean these tools do not constitute a 'recommended battery' for use. In particular, there is little evidence that the identified tools would be good at detecting change in intervention studies. The obvious gaps in available outcome measurement include well-being and participation outcomes for children, and family quality-of-life outcomes, domains particularly valued by our informants (young people with ASD and parents).

CONCLUSIONS: This is the first systematic review of the quality and appropriateness of tools designed to monitor progress and outcomes of young children with ASD. Although it was not possible to recommend fully robust tools at this stage, the review consolidates what is known about the field and will act as a benchmark for future developments. With input from parents and other stakeholders, recommendations are made about priority targets for research.

FUTURE WORK: Priorities include development of a tool to measure child quality of life in ASD, and validation of a potential primary outcome tool for trials of early social communication intervention.

STUDY REGISTRATION: This study is registered as PROSPERO CRD42012002223.

FUNDING: The National Institute for Health Research Health Technology Assessment programme.