UK consensus project on quality in palliative day services: developing a quality indicator set using the RAND/UCLA appropriateness method

Introduction
Evaluating quality of palliative day services is essential for assessing care across diverse settings, and for monitoring quality improvement approaches.

Aim
To develop a set of quality indicators for assessment of all aspects (structure, process and outcome) of care in palliative day services.

Methods
Using a modified version of the RAND/UCLA appropriateness method (Fitch et al., 2001), a multidisciplinary panel of 16 experts independently completed a survey rating the appropriateness of 182 potential quality indicators previously identified during a systematic evidence review. Panel members then attended a one day, face-to-face meeting where indicators were discussed and subsequently re-rated. Panel members were also asked to rate the feasibility and necessity of measuring each indicator.

Results
71 indicators classified as inappropriate during the survey were removed based on median appropriateness ratings and level of agreement. Following the panel discussions, a further 60 were removed based on appropriateness and feasibility ratings, level of agreement and assessment of necessity. Themes identified during the panel discussion and findings of the evidence review were used to translate the remaining 51 indicators into a final set of 27.

Conclusion
The final indicator set included information on rationale and supporting evidence, methods of assessment, risk adjustment, and recommended performance levels. Further implementation work will test the suitability of this ‘toolkit’ for measurement and benchmarking. The final indicator set provides the basis for standardised assessment of quality across services, including care delivered in community and primary care settings.

Reference

• Fitch K, Bernstein SJ, Aguilar MD, et al. The RAND/UCLA Appropriateness Method User’s Manual. Santa Monica, CA: RAND Corporation; 2001. http://www.rand.org/pubs/monograph_reports/MR1269

The Evaluation of an Interdisciplinary Pain Protocol in Long Term Care

Objectives: To evaluate the effectiveness of (1) dissemination strategies to improve clinical practice behaviors (eg, frequency and documentation of pain assessments, use of pain medication) among health care team members, and (2) the implementation of the pain protocol in reducing pain in long term care (LTC) residents. Design: A controlled before-after design was used to evaluate the effectiveness of the pain protocol, whereas qualitative interviews and focus groups were used to obtain additional context-driven data. Setting: Four LTC facilities in southern Ontario, Canada; 2 for the intervention group and 2 for the control group. Participants: Data were collected from 200 LTC residents; 99 for the intervention and 101 for the control group. Intervention: Implementation of a pain protocol using a multifaceted approach, including a site working group or Pain Team, pain education and skills training, and other quality improvement activities. Measurements: Resident pain was measured using 3 assessment tools: the Pain Assessment Checklist for Seniors with Limited Ability to Communicate, the Pain Assessment in the Communicatively Impaired Elderly, and the Present Pain Intensity Scale. Clinical practice behaviors were measured using a number of process indicators; for example, use of pain assessment tools, documentation about pain management, and use of pain medications. A semistructured interview guide was used to collect qualitative data via focus groups and interviews. Results: Pain increased significantly more for the control group than the intervention group over the 1-year intervention period. There were significantly more positive changes over the intervention period in the intervention group compared with the control group for the following indicators: the use of a standardized pain assessment tool and completed admission/initial pain assessment. Qualitative findings highlight the importance of reminding staff to think about pain as a priority in caring for residents and to be mindful of it during daily activities. Using onsite champions, in this case advanced practice nurses and a Pain Team, were key to successfully implementing the pain protocol. Conclusions: These study findings indicate that the implementation of a pain protocol intervention improved the way pain was managed and provided pain relief for LTC residents.

Interventions to improve the appropriate use of polypharmacy for older people

Background
Inappropriate polypharmacy is a particular concern in older people and is associated with negative health outcomes. Choosing the best interventions to improve appropriate polypharmacy is a priority, hence interest in appropriate polypharmacy, where many medicines may be used to achieve better clinical outcomes for patients, is growing.

Objectives
This review sought to determine which interventions, alone or in combination, are effective in improving the appropriate use of polypharmacy and reducing medication-related problems in older people.

Search methods
In November 2013, for this first update, a range of literature databases including MEDLINE and EMBASE were searched, and handsearching of reference lists was performed. Search terms included 'polypharmacy', 'medication appropriateness' and 'inappropriate prescribing'.

Selection criteria
A range of study designs were eligible. Eligible studies described interventions affecting prescribing aimed at improving appropriate polypharmacy in people 65 years of age and older in which a validated measure of appropriateness was used (e.g. Beers criteria, Medication Appropriateness Index (MAI)).

Data collection and analysis
Two review authors independently reviewed abstracts of eligible studies, extracted data and assessed risk of bias of included studies. Study-specific estimates were pooled, and a random-effects model was used to yield summary estimates of effect and 95% confidence intervals (CIs). The GRADE (Grades of Recommendation, Assessment, Development and Evaluation) approach was used to assess the overall quality of evidence for each pooled outcome.

Main results
Two studies were added to this review to bring the total number of included studies to 12. One intervention consisted of computerised decision support; 11 complex, multi-faceted pharmaceutical approaches to interventions were provided in a variety of settings. Interventions were delivered by healthcare professionals, such as prescribers and pharmacists. Appropriateness of prescribing was measured using validated tools, including the MAI score post intervention (eight studies), Beers criteria (four studies), STOPP criteria (two studies) and START criteria (one study). Interventions included in this review resulted in a reduction in inappropriate medication usage. Based on the GRADE approach, the overall quality of evidence for all pooled outcomes ranged from very low to low. A greater reduction in MAI scores between baseline and follow-up was seen in the intervention group when compared with the control group (four studies; mean difference -6.78, 95% CI -12.34 to -1.22). Postintervention pooled data showed a lower summated MAI score (five studies; mean difference -3.88, 95% CI -5.40 to -2.35) and fewer Beers drugs per participant (two studies; mean difference -0.1, 95% CI -0.28 to 0.09) in the intervention group compared with the control group. Evidence of the effects of interventions on hospital admissions (five studies) and of medication-related problems (six studies) was conflicting.

Authors' conclusions
It is unclear whether interventions to improve appropriate polypharmacy, such as pharmaceutical care, resulted in clinically significant improvement; however, they appear beneficial in terms of reducing inappropriate prescribing.

Interventions to optimise prescribing for older people in care homes

There is a substantial body of evidence that prescribing for care home residents is suboptimal and requires improvement. Consequently, there is a need to identify effective interventions to optimise prescribing and resident outcomes in this context.

Hospital antibiotic use and its relationship to age-adjusted comorbidity and alcohol-based hand rub consumption

SUMMARY The objective of this study was to evaluate the effect of age-adjusted comorbidity and alcohol-based hand rub on monthly hospital antibiotic usage, retrospectively. A multivariate autoregressive integrated moving average (ARIMA) model was built to relate the monthly use of all antibiotics grouped together with age-adjusted comorbidity and alcohol-based hand rub over a 5-year period (April 2005-March 2010). The results showed that monthly antibiotic use was positively related to the age-adjusted comorbidity index (concomitant effect, coefficient 1·103, P = 0·0002), and negatively related to the use of alcohol-based hand rub (2-month delay, coefficient -0·069, P = 0·0533). Alcohol-based hand rub is considered a modifiable factor and as such can be identified as a target for quality improvement programmes. Time-series analysis may provide a suitable methodology for identifying possible predictive variables that explain antibiotic use in healthcare settings. Future research should examine the relationship between infection control practices and antibiotic use, identify other infection control predictive factors for hospital antibiotic use, and evaluate the impact of enhancing different infection control practices on antibiotic use in a healthcare setting.

Positioning Clinical Nurse Specialists and Nurse Practitioners as Change Champions to Implement a Pain Protocol in Long-Term Care

Pain management for older adults in long-term care (LTC) has been recognized as a problem internationally. The purpose of this study was to explore the role of a clinical nurse specialist (CNS) and nurse practitioner (NP) as change champions during the implementation of an evidence-based pain protocol in LTC. In this exploratory, multiple-case design study, we collected data from two LTC homes in Ontario, Canada. Three data sources were used: participant observation of an NP and a CNS for 18 hours each over a 3-week period; CNS and NP diaries recording strategies, barriers, and facilitators to the implementation process; and interviews with members of the interdisciplinary team to explore perceptions about the NP and CNS role in implementing the pain protocol. Data were analyzed using thematic content analysis. The NP and CNS used a variety of effective strategies to promote pain management changes in practice including educational outreach with team members, reminders to nursing staff to highlight the pain protocol and educate about practice changes, chart audits and feedback to the nursing staff, interdisciplinary working group meetings, ad hoc meetings with nursing staff, and resident assessment using advanced skills. The CNS and NP are ideal champions to implement pain management protocols and likely other quality improvement initiatives.

Barriers to Goals of Care Discussions With Seriously Ill Hospitalized Patients and Their Families: A Multicenter Survey of Clinicians

Importance: Seriously ill hospitalized patients have identified communication and decision making about goals of care as high priorities for quality improvement in end-of-life care. Interventions to improve care are more likely to succeed if tailored to existing barriers.

Objective: To determine, from the perspective of hospital-based clinicians, (1) barriers impeding communication and decision making about goals of care with seriously ill hospitalized patients and their families and (2) their own willingness and the acceptability for other clinicians to engage in this process.

Design, Setting, and Participants: Multicenter survey of medical teaching units of nurses, internal medicine residents, and staff physicians from participating units at 13 university-based hospitals from 5 Canadian provinces.

Main Outcomes and Measures: Importance of 21 barriers to goals of care discussions rated on a 7-point scale (1 = extremely unimportant; 7 = extremely important).

Results: Between September 2012 and March 2013, questionnaires were returned by 1256 of 1617 eligible clinicians, for an overall response rate of 77.7% (512 of 646 nurses [79.3%], 484 of 634 residents [76.3%], 260 of 337 staff physicians [77.2%]). The following family member-related and patient-related factors were consistently identified by all 3 clinician groups as the most important barriers to goals of care discussions: family members' or patients' difficulty accepting a poor prognosis (mean [SD] score, 5.8 [1.2] and 5.6 [1.3], respectively), family members' or patients' difficulty understanding the limitations and complications of life-sustaining treatments (5.8 [1.2] for both groups), disagreement among family members about goals of care (5.8 [1.2]), and patients' incapacity to make goals of care decisions (5.6 [1.2]). Clinicians perceived their own skills and system factors as less important barriers. Participants viewed it as acceptable for all clinician groups to engage in goals of care discussions-including a role for advance practice nurses, nurses, and social workers to initiate goals of care discussions and be a decision coach.

Conclusions and Relevance: Hospital-based clinicians perceive family member-related and patient-related factors as the most important barriers to goals of care discussions. All health care professionals were viewed as playing important roles in addressing goals of care. These findings can inform the design of future interventions to improve communication and decision making about goals of care.

An official American thoracic society research statement: Comparative effectiveness research in pulmonary, critical care, and sleep medicine

Background: Comparative effectiveness research (CER) is intended to inform decision making in clinical practice, and is central to patientcentered outcomes research (PCOR). Purpose: To summarize key aspects of CER definitions and provide examples highlighting the complementary nature of efficacy and CER studies in pulmonary, critical care, and sleep medicine. Methods: An ad hoc working group of the American Thoracic Society with experience in clinical trials, health services research, quality improvement, and behavioral sciences in pulmonary, critical care, and sleepmedicinewas convened. The group used an iterative consensus process, including a reviewbyAmerican Thoracic Society committees and assemblies. Results: The traditional efficacy paradigm relies on clinical trials with high internal validity to evaluate interventions in narrowly defined populations and in research settings. Efficacy studies address the question, "Can it work in optimal conditions?" The CER paradigm employs a wide range of study designs to understand the effects of interventions in clinical settings. CER studies address the question, "Does it work in practice?" The results of efficacy and CER studies may or may not agree. CER incorporates many attributes of outcomes research and health services research, while placing greater emphasis on meeting the expressed needs of nonresearcher stakeholders (e.g., patients, clinicians, and others). Conclusions: CER complements traditional efficacy research by placing greater emphasis on the effects of interventions in practice, and developing evidence to address the needs of the many stakeholders involved in health care decisions. Stakeholder engagement is an important component of CER. Copyright © 2013 by the American Thoracic Society.

Musculoskeletal (MSK) and Sport and Exercise Medicine (SEM) in General Practice (GP): A Novel GP-based MSK and SEM Clinic for Managing Musculoskeletal symptoms in a GP

Musculoskeletal (MSK) complaints are common within primary care (1) (2) (3) but some General Practitioners (GPs)/family physicians do not feel comfortable managing these symptoms (3), preferring to refer onto hospital specialists or Integrated Clinical Assessment and Treatment Services (ICATs). Long waiting times for hospital outpatient reviews are a major cause of patient inconvenience and complaints (4). We therefore aimed to establish a GP-ran MSK and sport and exercise medicine (SEM) clinic based within a Belfast GP surgery that would contribute to a sustainable improvement in managing these common conditions within primary care as well as reducing waiting times for patients with these conditions to see a specialist. This shift from hospital-based to community-based management is in-keeping with recent policy changes within the UK health-system, including Transforming Your Care within Northern Ireland (NI) (5). The GP-ran MSK and SEM clinic was held monthly within a Belfast GP practice, staffed by one GP with a specialist interest in MSK and SEM conditions and its performance was reviewed over a three month period. Parameters audited included cases seen, orthopaedic and x-ray referral rates and secondary care referrals comparing the GP practice’s performance to the same time period in the previous year as well as patient satisfaction questionnaires.

An audit of antimicrobial treatment of lower respiratory and urinary tract infections in a hospital setting

Objectives: To audit the quality of treatment of lower respiratory tract infections (LRTIs) and urinary tract infections (UTIs) and to identify targets for antibiotic stewardship. Methods: The audit involved collecting data on admitted patients, who were diagnosed with LRTIs or UTIs and subsequently received antibiotic treatment (January 2009-April 2009). Key findings: The percentage adherence rate for hospital antibiotic policy was 68.6% (24/35). Documentation of the CURB-65 score was found in 80% (16/20) of the patients' clinical notes, for which 46.2% (6/13) of patients were treated according to their CURB- 65 score. The percentages of delayed and missed doses for all antibiotics were 21.7% (254/1171) and 8.6% (101/1171), respectively. The percentage of patients switched from intravenous to oral antibiotics in accordance with the policy was 58.5% (31/53). The mean length of stay for patients switched in line with the guidelines was 6.9 days (range: 2-18 days) compared with 13.2 days (range: 4-28 days) for patients treated with intravenous antibiotics >24 h after the intravenous to oral switch criteria were fulfilled; this equates to on average an extra 6.3 days of hospitalisation (p=0.01). Conclusions: The study identified a number of targets for quality improvement including adherence to antibiotic policy, documentation of the CURB-65 score in patients' notes and treating patients accordingly, addressing the issue of missed and delayed doses, and maintaining adherence to the hospital intravenous-to-oral antibiotic switch policy. The findings suggest that the quality of antibiotic prescribing could be improved by measuring and addressing such performance indicators.

Establishing the validity of English GP Patient Survey items evaluating out-of-hours care

Background A 2014 national audit used the English General Practice Patient Survey (GPPS) to compare service users’ experience of out-of-hours general practitioner (GP) services, yet there is no published evidence on the validity of these GPPS items. Objectives Establish the construct and concurrent validity of GPPS items evaluating service users’ experience of GP out-of-hours care. Methods Cross-sectional postal survey of service users (n=1396) of six English out-of-hours providers. Participants reported on four GPPS items evaluating out-of-hours care (three items modified following cognitive interviews with service users), and 14 evaluative items from the Out-of-hours Patient Questionnaire (OPQ). Construct validity was assessed through correlations between any reliable (Cochran's α>0.7) scales, as suggested by a principal component analysis of the modified GPPS items, with the ‘entry access’ (four items) and ‘consultation satisfaction’ (10 items) OPQ subscales. Concurrent validity was determined by investigating whether each modified GPPS item was associated with thematically related items from the OPQ using linear regressions. Results The modified GPPS item-set formed a single scale (α=0.77), which summarised the two-component structure of the OPQ moderately well; explaining 39.7% of variation in the ‘entry access’ scores (r=0.63) and 44.0% of variation in the ‘consultation satisfaction’ scores (r=0.66), demonstrating acceptable construct validity. Concurrent validity was verified as each modified GPPS item was highly associated with a distinct set of related items from the OPQ. Conclusions Minor modifications are required for the English GPPS items evaluating out-of-hours care to improve comprehension by service users. A modified question set was demonstrated to comprise a valid measure of service users’ overall satisfaction with out-of-hours care received. This demonstrates the potential for the use of as few as four items in benchmarking providers and assisting services in identifying, implementing and assessing quality improvement initiatives.

Preconception counselling resource for women with diabetes

Women with diabetes need to plan for pregnancy if they are to reduce their risk of poor pregnancy outcome. While care providers have focused on setting up specialist pre-pregnancy planning clinics to help women prepare for pregnancy, the majority of women do not attend, entering pregnancy unprepared. A major barrier to accessing this care, and a consequence of poor preconception counselling, is a lack of knowledge as to the need to plan and the reasons why. This project addressed an urgent need to raise awareness of the importance of planning for pregnancy among women with diabetes and among the healthcare professionals (HCPs) caring for them. Focus groups with the target groups informed the development of a preconception counselling resource for women with diabetes. Originally produced as a DVD (Diabetes UK funding), this resource has been embedded in routine care in Northern Ireland (NI) since 2010. A subsequent service evaluation of pregnancy planning indicators undertaken across all five antenatal-metabolic clinics in NI indicated that women who viewed the resource were better prepared for pregnancy. In order to increase the positive impact of the resource and to ensure longer term sustainability the DVD was converted to a website, http://www.womenwithdiabetes.net (Public Health Agency NI funding). The evaluation also highlighted that women with type 2 diabetes were a hard to reach group. As these women are often cared for outside of specialist clinics, it is pertinent that all HCPs caring for women with diabetes are aware of the importance of preconception counselling. Funding also supported the development of an e-learning continuing professional development (CPD) resource within the website. The e-learning resource has since been embedded into existing CPD programmes and is an important tool to ensure that all HCPs caring for women with diabetes are empowered to provide preconception counselling at every opportunity.

Improving allied health professionals' research implementation behaviours for children with cerebral palsy: protocol for a before-after study

BACKGROUND: Cerebral palsy is a permanent disorder of posture and movement caused by disturbances in the developing brain. It affects approximately 1 in every 500 children in developed countries and is the most common form of childhood physical disability. People with cerebral palsy may also have problems with speech, vision and hearing, intellectual difficulties and epilepsy. Health and therapy services are frequently required throughout life, and this care should be effective and evidence informed; however, accessing and adopting new research findings into day-to-day clinical practice is often delayed.

METHODS/DESIGN: This 3-year study employs a before and after design to evaluate if a multi-strategy intervention can improve research implementation among allied health professionals (AHPs) who work with children and young people with cerebral palsy and to establish if children's health outcomes can be improved by routine clinical assessment. The intervention comprises (1) knowledge brokering with AHPs, (2) access to an online research evidence library, (3) provision of negotiated evidence-based training and education, and (4) routine use of evidence-based measures with children and young people aged 3-18 years with cerebral palsy. The study is being implemented in four organisations, with a fifth organisation acting as a comparison site, across four Australian states. Effectiveness will be assessed using questionnaires completed by AHPs at baseline, 6, 12 and 24 months, and by monitoring the extent of use of evidence-based measures. Children's health outcomes will be evaluated by longitudinal analyses.

DISCUSSION: Government, policy makers and service providers all seek evidence-based information to support decision-making about how to distribute scarce resources, and families are seeking information to support intervention choices. This study will provide knowledge about what constitutes an efficient, evidence-informed service and which allied health interventions are implemented for children with cerebral palsy.

TRIAL REGISTRATION: Trial is not a controlled healthcare intervention and is not registered.

Task sharing within a managed clinical network to improve child health in Malawi

BACKGROUND: Eighty per cent of Malawi's 8 million children live in rural areas, and there is an extensive tiered health system infrastructure from village health clinics to district hospitals which refers patients to one of the four central hospitals. The clinics and district hospitals are staffed by nurses, non-physician clinicians and recently qualified doctors. There are 16 paediatric specialists working in two of the four central hospitals which serve the urban population as well as accepting referrals from district hospitals. In order to provide expert paediatric care as close to home as possible, we describe our plan to task share within a managed clinical network and our hypothesis that this will improve paediatric care and child health.

PRESENTATION OF THE HYPOTHESIS: Managed clinical networks have been found to improve equity of care in rural districts and to ensure that the correct care is provided as close to home as possible. A network for paediatric care in Malawi with mentoring of non-physician clinicians based in a district hospital by paediatricians based at the central hospitals will establish and sustain clinical referral pathways in both directions. Ultimately, the plan envisages four managed paediatric clinical networks, each radiating from one of Malawi's four central hospitals and covering the entire country. This model of task sharing within four hub-and-spoke networks may facilitate wider dissemination of scarce expertise and improve child healthcare in Malawi close to the child's home.

TESTING THE HYPOTHESIS: Funding has been secured to train sufficient personnel to staff all central and district hospitals in Malawi with teams of paediatric specialists in the central hospitals and specialist non-physician clinicians in each government district hospital. The hypothesis will be tested using a natural experiment model. Data routinely collected by the Ministry of Health will be corroborated at the district. This will include case fatality rates for common childhood illness, perinatal mortality and process indicators. Data from different districts will be compared at baseline and annually until 2020 as the specialists of both cadres take up posts.

IMPLICATIONS OF THE HYPOTHESIS: If a managed clinical network improves child healthcare in Malawi, it may be a potential model for the other countries in sub-Saharan Africa with similar cadres in their healthcare system and face similar challenges in terms of scarcity of specialists.