MAAGs: the next generation. A study of the development of medical audit advisory groups and the arrangements for supporting clinical audit in primary care

Background: MAAGs have, historically, been disparate organisations with a lack of central direction, albeit with the same goal: to develop and support the performance of audit in primary care. This goal has been (and is being) achieved in a number of ways all over the country. In the last two years, MAAGs have witnessed many changes in primary care and are adapting themselves to suit these new arrangements at a local level.

Aim: To formalise our knowledge of where MAAGs are going, how they are getting there and the support they are receiving.

Method: A postal questionnaire to the 104 MAAGs in England and Wales, addressing 6 main issues of relevance to the development of MAAGs and the support they are receiving.

Results: At least two MAAGs have dissolved, leaving a possible total of 102 still in existence. Of these, 76 (74.5%) responded to the survey. The composition of the MAAG committee has changed dramatically since the inception of MAAGs in 1990, and staffing levels appear to have risen substantially. MAAGs appear to be more adequately funded by their health authorities than has previously been reported and many are actively seeking additional sources of funding. There is still large variation in levels of MAAG funding. Furthermore, funding is unrelated to the number of GPs or practices served. Security for MAAG staff appears to have been addressed in many areas, with 84% of MAAGs having at least one member of staff on a permanent employment contract. Many MAAGs are developing rolling programmes in an attempt to eliminate the short-sighted approach to the development of clinical audit that has existed since MAAGs were first set up.

Conclusion: Many MAAGs (with the obvious exception of those that have been dissolved) appear to be thriving without central direction or initiative. It is now evident that we were a little hasty in our concerns for the future of MAAGs beyond April 1996. It would seem that many organisations have taken the situation which arose two years ago as an opportunity to grow and develop in ways that may not have been possible within the confines of the Health Circular.

Doctors under the microscope: the birth of medical audit

In 1989 a UK government White Paper introduced medical audit as a comprehensive and statutory system of assessment and improvement in quality of care in hospitals. A considerable body of research has described the evolution of medical audit in terms of a struggle between doctors and National Health Service managers over control of quality assurance. In this paper we examine the emergence of medical audit from 1910 to the early 1950s, with a particular focus on the pioneering work of the American surgeons Codman, MacEachern and Ponton. It is contended that medical professionals initially created medical audit in order to articulate a suitable methodology for assessing individual and organisational performance. Rather than a means of protecting the medical profession from public scrutiny, medical auditing was conceived and operationalised as a managerial tool for fostering the active engagement of senior hospital managers and discharging public accountability. These early debates reveal how accounting was implicated in the development of a system for monitoring and improving the work of medical professionals, advancing the quality of hospital care, and was advocated in ways, which included rather than excluded managers.

Discharge communication from inpatient care: an audit of written medical discharge summary procedure against the new National Health Service Standard for clinical handover

OBJECTIVE: To audit written medical discharge summary procedure and practice against Standard Six (clinical handover) of the Australian National Safety and Quality Health Service Standards at a major regional Victorian health service. METHODS: Department heads were invited to complete a questionnaire about departmental discharge summary practices. RESULTS: Twenty-seven (82%) department heads completed the questionnaire. Seven (26%) departments had a documented discharge summary procedure. Fourteen (52%) departments monitored discharge summary completion and 13 (48%) departments monitored the timeliness of completion. Seven (26%) departments informed the patient of the content of the discharge summary and six (22%) departments provided the patient with a copy. Seven (26%) departments provided training for staff members on how to complete discharge summaries. Completing discharge summaries was usually delegated to the medical intern. CONCLUSIONS: The introduction of the National Service Standards prompted an organisation-wide audit of discharge summary practices against the external criterion. There was substantial variation in the organisation's practices. The Standards and the current audit results highlight an opportunity for the organisation to enhance and standardise discharge summary practices and improve communication with general practice.

Audit of the Douglas Hocking Research Institute bone bank : ten years of non-irradiated bone graft

Background:  An audit performed in the use of non-irradiated femoral head bone graft at the Geelong Hospital over a 10-year period. While it is thought the non-irradiated bone graft provides a better structural construct there is theoretical increased risk of infection transmission.

Methods:  We performed a retrospective review of prospectively collected data in the use of non-irradiated bone allograft used from the Geelong Hospital Douglas Hosking Research Institute bone bank over a 10-year period. The review was performed using data collected from the bone bank and correlating it with the patient’s medical record. All complications, including infections, related to the use of the allograft were recorded.

Results:  We found that over the 10 years to 2004 that 811 femoral heads were donated, with 555 being used over 362 procedures in 316 patients. We identified a total of nine deep infections, of which seven were in joint replacements. Overall this was a 2.5% deep infection rate, which was lowered to 1.4% if the previously infected joints that were operated on were excluded.

Conclusion:  The use of non-irradiated femoral head bone graft was safe in a regional setting.

Reduced emergency calls and improved weekend discharge after introduction of a new electronic handover system

Objectives: To measure the frequency and content of electronic handover before and after implementation of the Blue BARRWUE handover system, and to measure its effect on patient safety and hospital efficiency over weekends.

Design, setting and participants: Point-prevalence study comparing outcomes for general medical inpatients present over weekends before implementation (1 May 2008 to 30 April 2009) and after implementation (1 May 2009 to 30 April 2010) of the Blue BARRWUE handover system at Geelong Hospital.

Intervention: Implementation of the Blue BARRWUE handover system and its components (updated working diagnosis, background, alerts, resuscitation status, requests, who to do what and when, updates and executable discharge plan).
Main outcome measures: Presence of any written handover notes or updated working diagnoses in the BOSSnet clinical information system, content of handover notes, frequency of weekend discharges and medical emergency team (MET) calls before and after implementation.

Results: In the 12 months before implementation of the Blue BARRWUE handover system, 976 patients (47.98%) had a handover note in BOSSnet, versus 1646 patients (95.09%) in the 12 months after implementation (P< 0.001; rate ratio [RR], 20.75; 95% CI, 16.33–26.44). Before implementation, 289 patients (14.21%) were discharged over weekends, versus 353 patients (20.39%) after implementation, (P < 0.001; RR, 1.44; 95% CI, 1.25–1.65). MET calls were made for 152 general medical patients before implementation (7.47%), versus 95 general medical patients (5.49%) after implementation (P= 0.01; RR, 0.73; 95% CI, 0.57–0.94).

Conclusions: The Blue BARRWUE system has sustainably improved written handover in our organisation and was associated with improvement in both patient safety and hospital efficiency.

Effects of patient-, environment- and medication-related factors on high-alert medication incidents.

To measure the rate of medication incidents associated with the prescription and administration of high-alert medications and to identify patient-, environment- and medication-related factors associated with these incidents.

Oxygen delivery to patients after cardiac surgery : a medical record audit

OBJECTIVE: To describe how intensive care nurses manage the administration of supplemental oxygen to patients during the first 24 hours after cardiac surgery.
METHODS: A retrospective audit was conducted of the medical records of 245 adult patients who underwent cardiac surgery between 1 January 2005 and 31 May 2008 in an Australian metropolitan hospital. Physiological data (oxygen saturation measured by pulse oximetry and respiratory rate) and intensive care unit management data (oxygen delivery device, oxygen flow rate and duration of mechanical ventilation) were collected at hourly intervals over the first 24 hours of ICU care.
RESULTS: Of the 245 patients whose records were audited, 185 were male; mean age was 70 years (SD, 10), and mean APACHE II score was 17.5 (SD, 5.14). Almost half the patients (122, 49.8%) were extubated within 8 hours of ICU admission. The most common oxygen delivery device used immediately after extubation was the simple face mask (214 patients, 87%). Following extubation, patients received supplemental oxygen via, on average, two different delivery devices (range, 1-3), and had the delivery device changed an average of 1.38 times (range, 0-6) during the 24 hours studied. Twenty-two patients (9%) received non-invasive ventilation or high-flow oxygen therapy, and 16 (7%) experienced one or more episode of hypoxaemia during mechanical ventilation. A total of 148 patients (60%) experienced one or more episodes of low oxygenation or abnormal respiratory rate during the first 24 hours of ICU care despite receiving supplemental oxygen.
CONCLUSION: These findings suggest that the ICU environment does not protect cardiac surgical patients from suboptimal oxygen delivery, and highlights the need for strategies to prompt the early initiation of interventions aimed at optimising blood oxygen levels in cardiac surgical patients in the ICU.

Fall incidence and fall prevention practices at acute care hospitals in Singapore : a retrospective audit

Objective To investigate the incidence of falls and explore fall prevention practices at acute care hospitals in Singapore.

Design A retrospective audit to collect baseline data on (1) incidence of falls (patient fall rates and fall injury rates) and (2) fall prevention practices, was conducted in five acute care hospitals in Singapore from December 2004 to March 2005.

Study participants Medical record data (n = 6000) of patients admitted into the medical, surgical and geriatric units in the five hospitals.

Outcome measures Fall incidence was obtained from the hospital's fall databases and incident reports for the period of June 2003 to May 2004. In total, 6000 medical records from five hospitals were randomly selected, retrieved and reviewed to determine whether falls, fall assessments and interventions were being initiated and documented.

Results The number of fallers for all hospitals was 825. Analysis showed that patient fall rates ranged from 0.68 to 1.44 per 1000 patient days, and the proportion of falls associated with injury ranged from 27.4% to 71.7%. The use of a fall risk assessment tool by nurses was recorded in 77% of all the nursing records.

Conclusion This study has laid the foundation for further research for fall prevention in Singapore by describing current fall rates, fall-associated injury rates and the status of fall prevention practices in acute care settings. The results will be used to inform the development of a tailored multifaceted strategy to facilitate the implementation of Fall Prevention Clinical Practice Guidelines to reduce the burden of falls and fall injuries in hospitals in Singapore.

The role of the medical emergency team in end-of-life care : a multicenter, prospective, observational study

Objective: To investigate the role of medical emergency teams in end-of-life care planning.

Design: One month prospective audit of medical emergency team calls.

Setting: Seven university-affiliated hospitals in Australia, Canada, and Sweden.

Patients: Five hundred eighteen patients who received a medical emergency team call over 1 month.

Interventions: None.

Measurements and Main Results: There were 652 medical emergency team calls in 518 patients, with multiple calls in 99 (19.1%) patients. There were 161 (31.1%) patients with limitations of medical therapy during the study period. The limitation of medical therapy was instituted in 105 (20.3%) and 56 (10.8%) patients before and after the medical emergency team call, respectively. In 78 patients who died with a limitation of medical therapy in place, the last medical emergency team review was on the day of death in 29.5% of patients, and within 2 days in another 28.2%. Compared with patients who did not have a limitation of medical therapy, those with a limitation of medical therapy were older (80 vs. 66 yrs; p < .001), less likely to be male (44.1% vs. 55.7%; p .014), more likely to be medical admissions (70.8% vs. 51.3%; p < .001), and less likely to be admitted from home (74.5% vs. 92.2%, p < .001). In addition, those with a limitation of medical therapy were less likely to be discharged home (22.4% vs. 63.6%; p < .001) and more likely to die in hospital (48.4% vs. 12.3%; p < .001). There was a trend for increased likelihood of calls associated with limitations of medical therapy to occur out of hours (51.0% vs. 43.8%, p .089).

Conclusions: Issues around end-of-life care and limitations of medical therapy arose in approximately one-third of calls, suggesting a mismatch between patient needs for end-of-life care and resources at participating hospitals. These calls frequently occur in elderly medical patients and out of hours. Many such patients do not return home, and half die in hospital. There is a need for improved advanced care planning in our hospitals, and to confirm our findings in other organizations.

The evolution of clinical audit as a tool for quality improvement.

Clinical auditing practices are recognized universally as a useful tool in evaluating and improving the quality of care provided by a health service. External auditing is a regular activity for mental health services in Australia but internal auditing activities are conducted at the discretion of each service. This paper evaluates the effectiveness of 6 years of internal auditing activities in a mental health service. A review of the scope, audit tools, purpose, sampling and design of the internal audits and identification of the recommendations from six consecutive annual audit reports was completed. Audit recommendations were examined, as well as levels of implementation and reasons for success or failure. Fifty-seven recommendations were identified, with 35% without action, 28% implemented and 33.3% still pending or in progress. The recommendations were more likely to be implemented if they relied on activity, planning and action across a selection of service areas rather than being restricted to individual departments within a service, if they did not involve non-mental health service departments and if they were not reliant on attitudinal change. Tools used, scope and reporting formats have become more sophisticated as part of the evolutionary nature of the auditing process. Internal auditing in the Barwon Health Mental Health Service has been effective in producing change in the quality of care across the organization. A number of evolutionary changes in the audit process have improved the efficiency and effectiveness of the audit.

Implementation of an audit with feedback knowledge translation intervention to promote medication error reporting in health care: a protocol.

BACKGROUND: Health professionals strive to deliver high-quality care in an inherently complex and error-prone environment. Underreporting of medical errors challenges attempts to understand causative factors and impedes efforts to implement preventive strategies. Audit with feedback is a knowledge translation strategy that has potential to modify health professionals' medical error reporting behaviour. However, evidence regarding which aspects of this complex, multi-dimensional intervention work best is lacking. The aims of the Safe Medication Audit Reporting Translation (SMART) study are to: 1. Implement and refine a reporting mechanism to feed audit data on medication errors back to nurses 2. Test the feedback reporting mechanism to determine its utility and effect 3. Identify characteristics of organisational context associated with error reporting in response to feedback METHODS/DESIGN: A quasi-experimental design, incorporating two pairs of matched wards at an acute care hospital, is used. Randomisation occurs at the ward level; one ward from each pair is randomised to receive the intervention. A key stakeholder reference group informs the design and delivery of the feedback intervention. Nurses on the intervention wards receive the feedback intervention (feedback of analysed audit data) on a quarterly basis for 12 months. Data for the feedback intervention come from medication documentation point-prevalence audits and weekly reports on routinely collected medication error data. Weekly reports on these data are obtained for the control wards. A controlled interrupted time series analysis is used to evaluate the effect of the feedback intervention. Self-report data are also collected from nurses on all four wards at baseline and at completion of the intervention to elicit their perceptions of the work context. Additionally, following each feedback cycle, nurses on the intervention wards are invited to complete a survey to evaluate the feedback and to establish their intentions to change their reporting behaviour. To assess sustainability of the intervention, at 6 months following completion of the intervention a point-prevalence chart audit is undertaken and a report of routinely collected medication errors for the previous 6 months is obtained. This intervention will have wider application for delivery of feedback to promote behaviour change for other areas of preventable error and adverse events.

Clinical review criteria and medical emergency teams: evaluating a two-tier rapid response system

OBJECTIVES: To assess the prevalence of patients fulfilling clinical review criteria (CRC), to determine activation rates for CRC assessments, to compare baseline characteristics and outcomes of patients who fulfilled CRC with patients who did not, and to identify the documented nursing actions in response to CRC values. DESIGN, SETTING AND PARTICIPANTS: A cross-sectional study using a retrospective medical record audit, in a universityaffiliated, tertiary referral hospital with a two-tier rapid response system in Melbourne, Australia. We used a convenience sample of hospital inpatients on general medical, surgical and specialist service wards admitted during a 24-hour period in 2013. MAIN OUTCOME MEASURES: Medical emergency team (MET) or code blue activation, unplanned intensive care unit admissions, hospital length of stay and inhospital mortality. For patients who fulfilled CRC or MET criteria during the 24- hour period, the specific criteria fulfilled, escalation treatments and outcomes were collected. RESULTS: Of the sample (N = 422), 81 patients (19%) fulfilled CRC on 109 occasions. From 109 CRC events, 66 patients (81%) had at least one observation fulfilling CRC, and 15 patients (18%) met CRC on multiple occasions. The documented escalation rate was 58 of 109 events (53%). The number of patients who fulfilled CRC and subsequent MET call activation criteria within 24 hours was significantly greater than the number who did not meet CRC (P < 0.001). CONCLUSIONS: About one in five patients reached CRC during the study period; these patients were about four times more likely to also fulfil MET call criteria. Contrary to hospital policy, escalation was not documented for about half the patients meeting CRC values. Despite the clarity of escalation procedures on the graphic observation chart, escalation remains an ongoing problem. Further research is needed on the impact on patient outcomes over time and to understand factors influencing staff response.

Inter-hospital 'patient expect' calls of clinical handovers for expected patients transferred from rural to metropolitan hospitals: a retrospective clinical audit

Patients requiring inter-hospital air transport across large geographical spaces are at significant risk of adverse outcomes. The aims of this study were to examine the characteristics of clinical handover conducted by telephone and subsequently transcribed in medical records during the inter-hospital transfer of rural patients, and to identify any deficits of this telephone clinical handover. A retrospective audit was conducted of transcribed telephone handovers ('patient expect' calls) occurring with inter-hospital transfers from two rural hospitals to a metropolitan tertiary hospital of all rural patients (n = 127) between January and June 2012. Patient transport between various sites occurred through the Royal Flying Doctor Service. For these hospitals, patient expect calls constituted the only handover record for clinicians during the time of patient transport. Information on patient identification stickers relating to patients' age or gender did not always correspond with details collected during patient expect calls. The name of a clinician at the receiving hospital authorising the transfer was provided in 14 calls (11.1%). It was difficult to determine who made and received calls, and who accepted responsibility for patients at the receiving site. Deterioration in a patient's condition was made in three calls. Actions to be taken after patients' arrival were included in 24 (19%) calls. Planning was restricted to identifying who to contact to review instructions. Inconsistent and overuse of abbreviations was likely to have affected the ability to accurately read back patient information. Crucial information was missing from calls, which may have contributed to delayed and inappropriate delivery of care.