Improving the care of children with advanced cancer by using an electronic patient-reported feedback intervention : results from the PediQUEST randomized controlled trial.

This study aimed to determine whether feeding back patient-reported outcomes (PROs) to providers and families of children with advanced cancer improves symptom distress and health-related quality of life (HRQoL).

Understanding feedback report uptake: process evaluation findings from a 13-month feedback intervention in long-term care settings

BACKGROUND: Long-term care settings provide care to a large proportion of predominantly older, highly disabled adults across the United States and Canada. Managing and improving quality of care is challenging, in part because staffing is highly dependent on relatively non-professional health care aides and resources are limited. Feedback interventions in these settings are relatively rare, and there has been little published information about the process of feedback intervention. Our objectives were to describe the key components of uptake of the feedback reports, as well as other indicators of participant response to the intervention. METHODS: We conducted this project in nine long-term care units in four facilities in Edmonton, Canada. We used mixed methods, including observations during a 13-month feedback report intervention with nine post-feedback survey cycles, to conduct a process evaluation of a feedback report intervention in these units. We included all facility-based direct care providers (staff) in the feedback report distribution and survey administration. We conducted descriptive analyses of the data from observations and surveys, presenting this in tabular and graphic form. We constructed a short scale to measure uptake of the feedback reports. Our analysis evaluated feedback report uptake by provider type over the 13 months of the intervention. RESULTS: We received a total of 1,080 survey responses over the period of the intervention, which varied by type of provider, facility, and survey month. Total number of reports distributed ranged from 103 in cycle 12 to 229 in cycle 3, although the method of delivery varied widely across the period, from 12% to 65% delivered directly to individuals and 15% to 84% left for later distribution. The key elements of feedback uptake, including receiving, reading, understanding, discussing, and reporting a perception that the reports were useful, varied by survey cycle and provider type, as well as by facility. Uptake, as we measured it, was consistently high overall, but varied widely by provider type and time period. CONCLUSIONS: We report detailed process data describing the aspects of uptake of a feedback report during an intensive, longitudinal feedback intervention in long-term care facilities. Uptake is a complex process for which we used multiple measures. We demonstrate the feasibility of conducting a complex longitudinal feedback intervention in relatively resource-poor long-term care facilities to a wider range of provider types than have been included in prior feedback interventions.

An Audit and Feedback Intervention for Reducing Antibiotic Prescribing in General Dental Practice : The RAPiD Cluster Randomised Controlled Trial

Funding: This study was conducted as part of the TRiaDS programme of implementation research which is funded by NHS Education for Scotland (NES). The Health Services Research Unit which is funded by the Chief Scientist Office of the Scottish Government Health and Social Care Directorates supported the study. The funder had no influence over the design, conduct, analysis and write up of the study.

Implementation of an audit with feedback knowledge translation intervention to promote medication error reporting in health care: a protocol.

BACKGROUND: Health professionals strive to deliver high-quality care in an inherently complex and error-prone environment. Underreporting of medical errors challenges attempts to understand causative factors and impedes efforts to implement preventive strategies. Audit with feedback is a knowledge translation strategy that has potential to modify health professionals' medical error reporting behaviour. However, evidence regarding which aspects of this complex, multi-dimensional intervention work best is lacking. The aims of the Safe Medication Audit Reporting Translation (SMART) study are to: 1. Implement and refine a reporting mechanism to feed audit data on medication errors back to nurses 2. Test the feedback reporting mechanism to determine its utility and effect 3. Identify characteristics of organisational context associated with error reporting in response to feedback METHODS/DESIGN: A quasi-experimental design, incorporating two pairs of matched wards at an acute care hospital, is used. Randomisation occurs at the ward level; one ward from each pair is randomised to receive the intervention. A key stakeholder reference group informs the design and delivery of the feedback intervention. Nurses on the intervention wards receive the feedback intervention (feedback of analysed audit data) on a quarterly basis for 12 months. Data for the feedback intervention come from medication documentation point-prevalence audits and weekly reports on routinely collected medication error data. Weekly reports on these data are obtained for the control wards. A controlled interrupted time series analysis is used to evaluate the effect of the feedback intervention. Self-report data are also collected from nurses on all four wards at baseline and at completion of the intervention to elicit their perceptions of the work context. Additionally, following each feedback cycle, nurses on the intervention wards are invited to complete a survey to evaluate the feedback and to establish their intentions to change their reporting behaviour. To assess sustainability of the intervention, at 6 months following completion of the intervention a point-prevalence chart audit is undertaken and a report of routinely collected medication errors for the previous 6 months is obtained. This intervention will have wider application for delivery of feedback to promote behaviour change for other areas of preventable error and adverse events.

Pharmacist-led feedback workshops increase appropriate prescribing of antimicrobials

Objectives To investigate whether and how structured feedback sessions can increase rates of appropriate antimicrobial prescribing by junior doctors.

Methods This was a mixed-methods study, with a conceptual orientation towards complexity and systems thinking. Fourteen junior doctors, in their first year of training, were randomized to intervention (feedback) and 21 to control (routine practice) groups in a single UK teaching hospital. Feedback on their antimicrobial prescribing was given, in writing and via group sessions. Pharmacists assessed the appropriateness of all new antimicrobial prescriptions 2 days per week for 6 months (46 days). The mean normalized prescribing rates of suboptimal to all prescribing were compared between groups using the t-test. Thematic analysis of qualitative interviews with 10 participants investigated whether and how the intervention had impact.

Results Data were collected on 204 prescriptions for 166 patients. For the intervention group, the mean normalized rate of suboptimal to all prescribing was 0.32 ± 0.36; for the control group, it was 0.68 ± 0.36. The normalized rates of suboptimal prescribing were significantly different between the groups (P = 0.0005). The qualitative data showed that individuals' prescribing behaviour was influenced by a complex series of dynamic interactions between individual and social variables, such as interplay between personal knowledge and the expectations of others.

Conclusions The feedback intervention increased appropriate prescribing by acting as a positive stimulus within a complex network of behavioural influences. Prescribing behaviour is adaptive and can be positively influenced by structured feedback. Changing doctors' perceptions of acceptable, typical and best practice could reduce suboptimal antimicrobial prescribing.

Web-based alcohol screening and brief intervention for Māori and non-Māori: the New Zealand e-SBINZ trials

BACKGROUND: Hazardous alcohol consumption is a leading modifiable cause of mortality and morbidity among young people. Screening and brief intervention (SBI) is a key strategy to reduce alcohol-related harm in the community, and web-based approaches (e-SBI) have advantages over practitioner-delivered approaches, being cheaper, more acceptable, administrable remotely and infinitely scalable. An efficacy trial in a university population showed a 10-minute intervention could reduce drinking by 11% for 6 months or more among 17-24 year-old undergraduate hazardous drinkers. The e-SBINZ study is designed to examine the effectiveness of e-SBI across a range of universities and among Māori and non-Māori students in New Zealand. METHODS/DESIGN: The e-SBINZ study comprises two parallel, double blind, multi-site, individually randomised controlled trials. This paper outlines the background and design of the trial, which is recruiting 17-24 year-old students from seven of New Zealand's eight universities. Māori and non-Māori students are being sampled separately and are invited by e-mail to complete a web questionnaire including the AUDIT-C. Those who score >4 will be randomly allocated to no further contact until follow-up (control) or to assessment and personalised feedback (intervention) via computer. Follow-up assessment will occur 5 months later in second semester. Recruitment, consent, randomisation, intervention and follow-up are all online. Primary outcomes are (i) total alcohol consumption, (ii) frequency of drinking, (iii) amount consumed per typical drinking occasion, (iv) the proportions exceeding medical guidelines for acute and chronic harm, and (v) scores on an academic problems scale. DISCUSSION: The trial will provide information on the effectiveness of e-SBI in reducing hazardous alcohol consumption across diverse university student populations with separate effect estimates for Māori and non-Māori students. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry (ANZCTR) ACTRN12610000279022.

Web-based alcohol intervention for Māori university students: double-blind, multi-site randomized controlled trial

AIMS: Like many indigenous peoples, New Zealand Māori bear a heavy burden of alcohol-related harm relative to their non-indigenous compatriots, and disparities are greatest among young adults. We tested the effectiveness of web-based alcohol screening and brief intervention (e-SBI) for reducing hazardous drinking among Māori university students. DESIGN: Parallel, double-blind, multi-site, randomized controlled trial. SETTING: Seven of New Zealand's eight universities. PARTICIPANTS: In April 2010, we sent e-mail invitations to all 6697 17-24-year-old Māori students to complete a brief web questionnaire including the Alcohol Use Disorders Identification Test (AUDIT)-C, a screening tool for hazardous and harmful drinking. Those screening positive were computer randomized to: <10 minutes of web-based alcohol assessment and personalized feedback (intervention) or screening alone (control). MEASUREMENTS: We conducted a fully automated 5-month follow-up assessment with observers and participants blinded to study hypotheses, design and intervention delivery. Pre-determined primary outcomes were: (i) frequency of drinking, (ii) amount consumed per typical drinking occasion, (iii) overall volume of alcohol consumed and (iv) academic problems. FINDINGS: Of the participants, 1789 were hazardous or harmful drinkers (AUDIT-C ≥ 4) and were randomized: 850 to control, 939 to intervention. Follow-up assessments were completed by 682 controls (80%) and 733 intervention group members (78%). Relative to controls, participants receiving intervention drank less often [RR = 0.89; 95% confidence interval (CI): 0.82-0.97], less per drinking occasion (RR = 0.92; 95% CI: 0.84-1.00), less overall (RR = 0.78; 95% CI: 0.69-0.89) and had fewer academic problems (RR = 0.81; 95% CI: 0.69-0.95). CONCLUSIONS: Web-based screening and brief intervention reduced hazardous and harmful drinking among non-help-seeking Māori students in a large-scale pragmatic trial. The study has wider implications for behavioural intervention in the important but neglected area of indigenous health.

The Effects of Systematic Self-Monitoring, Feedback, and Collaborative Assessment on Stress Reduction

Thesis (Ph.D.)--University of Washington, 2016-08

The effectiveness of using patient-reported outcome measures as quality improvement tools

Aim: To investigate the value of using PROMs as quality improvement tools. Methods: Two systematic reviews were undertaken. The first reviewed the quantitative literature on the impact of PROMs feedback and the second reviewed the qualitative literature on the use of PROMs in practice. These reviews informed the focus of the primary research. A cluster randomised controlled trial (PROFILE) examined the impact of providing peer benchmarked PROMs feedback to consultant orthopaedic surgeons on improving outcomes for hip replacement surgery. Qualitative interviews with surgeons in the intervention arm of the trial examined the view of and reactions to the feedback. Results: The quantitative review of 17 studies found weak evidence to suggest that providing PROMs feedback to professionals improves patient outcomes. The qualitative review of 16 studies identified the barriers and facilitators to the use of PROMs based on four themes: practical considerations, attitudes towards the data, methodological concerns and the impact of feedback on care. The PROFILE trial included 11 surgeons and 215 patients in the intervention arm, and 10 surgeons and 217 patients in the control arm. The trial found no significant difference in the Oxford Hip Score between the arms (-0.7, 95% CI -1.9-0.5, p=0.2). Interviews with surgeons revealed mixed opinions about the value of the PROMs feedback and the information did not promote explicit changes to their practice. Conclusion: It is important to use PROMs which have been validated for the specific purpose of performance measurement, consult with professionals when developing a PROMs feedback intervention, communicate with professionals about the objectives of the data collection, educate professionals on the properties and interpretation of the data, and support professionals in using the information to improve care. It is also imperative that the burden of data collection and dissemination of the information is minimised.

Protocol for the PINCER trial: a cluster randomised trial comparing the effectiveness of a pharmacist-led IT-based intervention with simple feedback in reducing rates of clinically important errors in medicines management in general practices

Background: Medication errors are an important cause of morbidity and mortality in primary care. The aims of this study are to determine the effectiveness, cost effectiveness and acceptability of a pharmacist-led information-technology-based complex intervention compared with simple feedback in reducing proportions of patients at risk from potentially hazardous prescribing and medicines management in general (family) practice. Methods: Research subject group: "At-risk" patients registered with computerised general practices in two geographical regions in England. Design: Parallel group pragmatic cluster randomised trial. Interventions: Practices will be randomised to either: (i) Computer-generated feedback; or (ii) Pharmacist-led intervention comprising of computer-generated feedback, educational outreach and dedicated support. Primary outcome measures: The proportion of patients in each practice at six and 12 months post intervention: - with a computer-recorded history of peptic ulcer being prescribed non-selective non-steroidal anti-inflammatory drugs - with a computer-recorded diagnosis of asthma being prescribed beta-blockers - aged 75 years and older receiving long-term prescriptions for angiotensin converting enzyme inhibitors or loop diuretics without a recorded assessment of renal function and electrolytes in the preceding 15 months. Secondary outcome measures; These relate to a number of other examples of potentially hazardous prescribing and medicines management. Economic analysis: An economic evaluation will be done of the cost per error avoided, from the perspective of the UK National Health Service (NHS), comparing the pharmacist-led intervention with simple feedback. Qualitative analysis: A qualitative study will be conducted to explore the views and experiences of health care professionals and NHS managers concerning the interventions, and investigate possible reasons why the interventions prove effective, or conversely prove ineffective. Sample size: 34 practices in each of the two treatment arms would provide at least 80% power (two-tailed alpha of 0.05) to demonstrate a 50% reduction in error rates for each of the three primary outcome measures in the pharmacist-led intervention arm compared with a 11% reduction in the simple feedback arm. Discussion: At the time of submission of this article, 72 general practices have been recruited (36 in each arm of the trial) and the interventions have been delivered. Analysis has not yet been undertaken.

PINCER trial: a cluster randomised trial comparing the effectiveness and cost-effectiveness of a pharmacist-led IT-based intervention with simple feedback in reducing rates of clinically important errors in medicines management in general practices

Background: Medication errors in general practice are an important source of potentially preventable morbidity and mortality. Building on previous descriptive, qualitative and pilot work, we sought to investigate the effectiveness, cost-effectiveness and likely generalisability of a complex pharm acist-led IT-based intervention aiming to improve prescribing safety in general practice. Objectives: We sought to: • Test the hypothesis that a pharmacist-led IT-based complex intervention using educational outreach and practical support is more effective than simple feedback in reducing the proportion of patients at risk from errors in prescribing and medicines management in general practice. • Conduct an economic evaluation of the cost per error avoided, from the perspective of the National Health Service (NHS). • Analyse data recorded by pharmacists, summarising the proportions of patients judged to be at clinical risk, the actions recommended by pharmacists, and actions completed in the practices. • Explore the views and experiences of healthcare professionals and NHS managers concerning the intervention; investigate potential explanations for the observed effects, and inform decisions on the future roll-out of the pharmacist-led intervention • Examine secular trends in the outcome measures of interest allowing for informal comparison between trial practices and practices that did not participate in the trial contributing to the QRESEARCH database. Methods Two-arm cluster randomised controlled trial of 72 English general practices with embedded economic analysis and longitudinal descriptive and qualitative analysis. Informal comparison of the trial findings with a national descriptive study investigating secular trends undertaken using data from practices contributing to the QRESEARCH database. The main outcomes of interest were prescribing errors and medication monitoring errors at six- and 12-months following the intervention. Results: Participants in the pharmacist intervention arm practices were significantly less likely to have been prescribed a non-selective NSAID without a proton pump inhibitor (PPI) if they had a history of peptic ulcer (OR 0.58, 95%CI 0.38, 0.89), to have been prescribed a beta-blocker if they had asthma (OR 0.73, 95% CI 0.58, 0.91) or (in those aged 75 years and older) to have been prescribed an ACE inhibitor or diuretic without a measurement of urea and electrolytes in the last 15 months (OR 0.51, 95% CI 0.34, 0.78). The economic analysis suggests that the PINCER pharmacist intervention has 95% probability of being cost effective if the decision-maker’s ceiling willingness to pay reaches £75 (6 months) or £85 (12 months) per error avoided. The intervention addressed an issue that was important to professionals and their teams and was delivered in a way that was acceptable to practices with minimum disruption of normal work processes. Comparison of the trial findings with changes seen in QRESEARCH practices indicated that any reductions achieved in the simple feedback arm were likely, in the main, to have been related to secular trends rather than the intervention. Conclusions Compared with simple feedback, the pharmacist-led intervention resulted in reductions in proportions of patients at risk of prescribing and monitoring errors for the primary outcome measures and the composite secondary outcome measures at six-months and (with the exception of the NSAID/peptic ulcer outcome measure) 12-months post-intervention. The intervention is acceptable to pharmacists and practices, and is likely to be seen as costeffective by decision makers.

Consumer feedback following participation in a family-based intervention for youth mental health

Background. This paper presents findings derived from consumer feedback, following a multicentre randomised controlled trial for adolescent mental health problems and substance misuse. The paper focuses on the implementation of a family-based intervention, including fidelity of delivery, family members’ experiences, and their suggestions for program improvements.
Methods. Qualitative and quantitative data (

Effectiveness of patient feedback as an educational intervention to improve medical student consultation (PTA Feedback Study): study protocol for a randomized controlled trial.

Oral feedback from clinical educators is the traditional teaching method for improving clinical consultation skills in medical students. New approaches are needed to enhance this teaching model. Multisource feedback is a commonly used assessment method for learning among practising clinicians, but this assessment has not been explored rigorously in medical student education. This study seeks to evaluate if additional feedback on patient satisfaction improves medical student performance.

Data feedback and behavioural change intervention to improve primary care prescribing safety (EFIPPS) : multicentre, three arm, cluster-randomised controlled trial

Funding and trial registration: Scottish Government Chief Scientist Office grant CZH/3/17. ClinicalTrials.gov registration NCT01602705.