MAAGs: the next generation. A study of the development of medical audit advisory groups and the arrangements for supporting clinical audit in primary care

Background: MAAGs have, historically, been disparate organisations with a lack of central direction, albeit with the same goal: to develop and support the performance of audit in primary care. This goal has been (and is being) achieved in a number of ways all over the country. In the last two years, MAAGs have witnessed many changes in primary care and are adapting themselves to suit these new arrangements at a local level.

Aim: To formalise our knowledge of where MAAGs are going, how they are getting there and the support they are receiving.

Method: A postal questionnaire to the 104 MAAGs in England and Wales, addressing 6 main issues of relevance to the development of MAAGs and the support they are receiving.

Results: At least two MAAGs have dissolved, leaving a possible total of 102 still in existence. Of these, 76 (74.5%) responded to the survey. The composition of the MAAG committee has changed dramatically since the inception of MAAGs in 1990, and staffing levels appear to have risen substantially. MAAGs appear to be more adequately funded by their health authorities than has previously been reported and many are actively seeking additional sources of funding. There is still large variation in levels of MAAG funding. Furthermore, funding is unrelated to the number of GPs or practices served. Security for MAAG staff appears to have been addressed in many areas, with 84% of MAAGs having at least one member of staff on a permanent employment contract. Many MAAGs are developing rolling programmes in an attempt to eliminate the short-sighted approach to the development of clinical audit that has existed since MAAGs were first set up.

Conclusion: Many MAAGs (with the obvious exception of those that have been dissolved) appear to be thriving without central direction or initiative. It is now evident that we were a little hasty in our concerns for the future of MAAGs beyond April 1996. It would seem that many organisations have taken the situation which arose two years ago as an opportunity to grow and develop in ways that may not have been possible within the confines of the Health Circular.

Clinical audit, guidelines and standards : a productive relation for managing clinical practices

This paper contributes to the knowledge about the process of standardisation within the domain of medicine. Standardisation has become an important form of governance and co-ordination, and there is limited empirical knowledge about its nature and consequences (Brunsson et al., 2000). This paper aims to explore the development, circulation and standardisation process of a specific clinical audit programme: the Scottish Hip Fracture Audit. This audit started as a local initiative and now has developed into a sophisticated arena (Sahlin-Andersson, 2000) which provides Scottish hospitals with monthly ‘real-time reports’ outlining their performance against Scottish government targets. The paper argues that the interrelation between clinical audit and evidence-based medicine (EBM) can become a ‘productive relation’ (Mykhalovskiy, 2003), that opens up spaces of intervention, in which the clinical communities engage with processes of change of clinical procedures, and in these spaces, clinicians and managers are in a position to refine clinical practice and service organisation, to reflect upon their own actions and to allow insight into the rationalities of their work (Berg, 1997).

The evolution of clinical audit as a tool for quality improvement.

Clinical auditing practices are recognized universally as a useful tool in evaluating and improving the quality of care provided by a health service. External auditing is a regular activity for mental health services in Australia but internal auditing activities are conducted at the discretion of each service. This paper evaluates the effectiveness of 6 years of internal auditing activities in a mental health service. A review of the scope, audit tools, purpose, sampling and design of the internal audits and identification of the recommendations from six consecutive annual audit reports was completed. Audit recommendations were examined, as well as levels of implementation and reasons for success or failure. Fifty-seven recommendations were identified, with 35% without action, 28% implemented and 33.3% still pending or in progress. The recommendations were more likely to be implemented if they relied on activity, planning and action across a selection of service areas rather than being restricted to individual departments within a service, if they did not involve non-mental health service departments and if they were not reliant on attitudinal change. Tools used, scope and reporting formats have become more sophisticated as part of the evolutionary nature of the auditing process. Internal auditing in the Barwon Health Mental Health Service has been effective in producing change in the quality of care across the organization. A number of evolutionary changes in the audit process have improved the efficiency and effectiveness of the audit.

Restorative care for palliative patients: a retrospective clinical audit of outcomes for patients admitted to an inpatient palliative care unit

BACKGROUND: Restorative care in palliative care is a subset of rehabilitation that aims to improve quality of life through restoration or maintenance of physical functions. Outcomes for restorative care programmes delivered by palliative care units have not adequately been assessed. OBJECTIVES: The objectives are to examine the outcomes of a restorative care programme in an inpatient palliative care unit, including discharge destination, performance status changes and length of stay. METHODS: Retrospective clinical audit of consecutive patients admitted to Calvary Health Care Bethlehem in Melbourne, Australia, principally for restorative care from July 2010 to December 2011. RESULTS: 79 admissions met inclusion criteria. Mean age was 76.5 years (SD=11.14) and 43 (54%) were men. 75 (95%) patients had a malignant diagnosis; of these, the majority had lung cancer (24%). 16 patients (20%) were discharged home, 51 (65%) died and 12 (15%) were transferred. Of the patients discharged home, only 6 (38% of those discharged home) improved their performance status. Those discharged home had a significantly shorter length of stay (17 days compared to 39 days; p<0.05). Patients discharged home also had significantly better Australia-modified Karnofsky Performance Status (AKPS) and Resource Utilisation Groups-Activities of Daily Living (RUG-ADL) scores on admission than others (both p<0.05). CONCLUSIONS: The majority of patients referred for restorative care died during admission, with only a minority discharged home. Patients discharged most commonly experienced maintenance and not improvement in performance status. A successful discharge home following restorative care was associated with a shorter length of stay. Implications and recommendations for successful restorative care will be discussed.

Retrospective clinical audit of outcomes for patients admitted to an inpatient palliative care unit for restorative care

Background Restorative care in palliative care is a subset of rehabilitation that aims to improve quality of life through restoration or maintenance of physical functions. Outcomes for restorative care programmes delivered by palliative care units have not adequately been assessed.

Objectives The objectives are to examine the outcomes of a restorative care programme in an inpatient palliative care unit, including discharge destination, performance status changes and length of stay.

Methods Retrospective clinical audit of consecutive patients admitted to Calvary Health Care Bethlehem in Melbourne, Australia, principally for restorative care from July 2010 to December 2011.

Results 79 admissions met inclusion criteria. Mean age was 76.5 years (SD=11.14) and 43 (54%) were men. 75 (95%) patients had a malignant diagnosis; of these, the majority had lung cancer (24%). 16 patients (20%) were discharged home, 51 (65%) died and 12 (15%) were transferred. Of the patients discharged home, only 6 (38% of those discharged home) improved their performance status. Those discharged home had a significantly shorter length of stay (17 days compared to 39 days; p<0.05). Patients discharged home also had significantly better Australia-modified Karnofsky Performance Status (AKPS) and Resource Utilisation Groups-Activities of Daily Living (RUG-ADL) scores on admission than others (both p<0.05).

Conclusions The majority of patients referred for restorative care died during admission, with only a minority discharged home. Patients discharged most commonly experienced maintenance and not improvement in performance status. A successful discharge home following restorative care was associated with a shorter length of stay. Implications and recommendations for successful restorative care will be discussed.

Inter-hospital 'patient expect' calls of clinical handovers for expected patients transferred from rural to metropolitan hospitals: a retrospective clinical audit

Patients requiring inter-hospital air transport across large geographical spaces are at significant risk of adverse outcomes. The aims of this study were to examine the characteristics of clinical handover conducted by telephone and subsequently transcribed in medical records during the inter-hospital transfer of rural patients, and to identify any deficits of this telephone clinical handover. A retrospective audit was conducted of transcribed telephone handovers ('patient expect' calls) occurring with inter-hospital transfers from two rural hospitals to a metropolitan tertiary hospital of all rural patients (n = 127) between January and June 2012. Patient transport between various sites occurred through the Royal Flying Doctor Service. For these hospitals, patient expect calls constituted the only handover record for clinicians during the time of patient transport. Information on patient identification stickers relating to patients' age or gender did not always correspond with details collected during patient expect calls. The name of a clinician at the receiving hospital authorising the transfer was provided in 14 calls (11.1%). It was difficult to determine who made and received calls, and who accepted responsibility for patients at the receiving site. Deterioration in a patient's condition was made in three calls. Actions to be taken after patients' arrival were included in 24 (19%) calls. Planning was restricted to identifying who to contact to review instructions. Inconsistent and overuse of abbreviations was likely to have affected the ability to accurately read back patient information. Crucial information was missing from calls, which may have contributed to delayed and inappropriate delivery of care.

Trajectory of sedation assessment and sedative use in intubated and ventilated patients in intensive care: a clinical audit

Background: Sedation is crucial for the recovery of patients in intensive care units (ICUs). Maintaining comfort and safety promotes optimal care for critically ill patients. Purpose: To examine sedation assessment and management undertaken by health professionals for mechanically ventilated patients in one Australian ICU. Methods: A retrospective clinical audit was undertaken of medical records of all eligible, mechanically ventilated patients admitted to an ICU of an Australian metropolitan, teaching hospital over a 12-month period. A Sedation Audit Tool was used to collect data from the day of intubation to 5 days after intubation. Findings: Data were extracted from medical records of 150 patients. The Riker Sedation-Agitation Scale (SAS) was the scoring system used. Patients were unarousable or very sedated between 57% and 81% at some point during the study period, while between 5% and 11% were agitated, very agitated or extremely agitated across this time. Patients' sedation scores were not documented in between 3.3% and 23.3% of patients. Medications commonly used were propofol, midazolam, morphine, and fentanyl. There were 135 situations of adverse events, which related to patients pulling endotracheal tubes leading to malpositioning, patients biting endotracheal tubes causing desaturation, patient experiencing excessive agitation requiring restraint use, patients experiencing increased intracranial pressure above desired limits, patients self-extubating, and patients experiencing over-drowsiness leading to delays in extubation. Conclusions: Many patients were either very sedated or agitated at some point during the study period, and some patients experienced adverse outcomes associated with sedation practices. The findings inform future quality initiatives to improve sedation practices.

Rationale and design of the national benchmarking and evidence-based national clinical guidelines for chronic heart failure management programs study

OBJECTIVES: The National Benchmarks and Evidence-Based National Clinical Guidelines for Heart Failure Management Programs Study is a national, multicenter study designed to determine the nature, range, and effect of interventions applied by chronic heart failure management programs (CHF-MPs) throughout Australia on patient outcomes. Its primary objective is to use these data to develop national benchmarks and evidence-based clinical guidelines and optimize their cost-effective application by reducing quality and outcome variability. DATA SOURCES/STUDY SETTING: Primary data will be collected from CHF-MP coordinators and CHF patients enrolled in these programs on a national basis. Secondary outcome data will be collected from a national morbidity record and from patients' medical records. STUDY DESIGN: Stage I of the study involves a prospective clinical audit of all CHF-MPs throughout Australia (n = 45) to determine the extent of variability in programs currently. Stage II is a prospective cross-sectional survey design enrolling 1,500 patients (average of 40 patients per program) to firstly determine the typical profile of patients being managed via a CHF-MP in Australia and, secondly, the subsequent morbidity and mortality during the 6-month follow-up. Outcome data will be subject to multivariate analysis to determine the key components of care in this regard. All study data will be then examined in the final stage of the study (III) to develop national benchmarks for the application and auditing of CHF-MPs in Australia. CONCLUSION: Variability in patient outcomes is a product of heterogeneity among CHF-MPs. The development of national benchmarks will minimize such heterogeneity and will provide a greater level of evidence for their cost-effective application.

Clinical events reported by surgeons assessing their peers

BACKGROUND: All surgical deaths in Queensland, Australia are reviewed by external surgeon peers, and clinical events are recorded. The study objective was to classify clinical events in surgical patients who died.

METHODS: Deaths notified to the Queensland Audit of Surgical Mortality between 2007 and 2013 were assessed by surgeons' peers who decided whether a clinical event occurred. The most serious clinical event per patient was analyzed.

RESULTS: Peer surgeons reviewed 4,816 deaths. Most patients (70.7%) had no clinical event. Events were preventable in 58% of patients and less than 1 in 10 events was severe. The most frequent events were classified as patient assessment (34.5%), suboptimal therapy (15.3%), and delays (15.1%).

CONCLUSIONS: Peer review of all surgical deaths identifies preventable clinical events and provides opportunities to improve decision making, better therapy and reduce delay in implementing appropriate surgical care. Review feedback to surgeons and other stakeholders should improve patient safety and quality.

Ethical dilemmas of a large national multi-centre study in Australia

Aims and objectives: To examine the impact and obstacles that individual Institutional Research Ethics Committee (IRECs) had on a large-scale national multi-centre clinical audit called the National Benchmarks and Evidence-based National Clinical guidelines for Heart failure management programmes Study.

Background: Multi-centre research is commonplace in the health care system. However, IRECs continue to fail to differentiate between research and quality audit projects.

Methods: The National Benchmarks and Evidence-based National Clinical guidelines for Heart failure management programmes study used an investigator-developed questionnaire concerning a clinical audit for heart failure programmes throughout Australia. Ethical guidelines developed by the National governing body of health and medical research in Australia classified the National Benchmarks and Evidence-based National Clinical guidelines for Heart failure management programmes Study as a low risk clinical audit not requiring ethical approval by IREC.

Results: Fifteen of 27 IRECs stipulated that the research proposal undergo full ethical review. None of the IRECs acknowledged: national quality assurance guidelines and recommendations nor ethics approval from other IRECs. Twelve of the 15 IRECs used different ethics application forms. Variability in the type of amendments was prolific. Lack of uniformity in ethical review processes resulted in a six- to eight-month delay in commencing the national study.

Conclusions: Development of a national ethics application form with full ethical review by the first IREC and compulsory expedited review by subsequent IRECs would resolve issues raised in this paper. IRECs must change their ethics approval processes to one that enhances facilitation of multi-centre research which is now normative process for health services.

Relevance to clinical practice: The findings of this study highlight inconsistent ethical requirements between different IRECs. Also highlighted are the obstacles and delays that IRECs create when undertaking multi-centre clinical audits. However, in our clinical practice it is vital that clinical audits are undertaken for evaluation purposes. The findings of this study raise awareness of inconsistent ethical processes and highlight the need for expedient ethical review for clinical audits.

How do we compare? - Applying UK pay for performance indicators to an Australian general practice

BACKGROUND United Kingdom general practitioners receive payment based on their performance in multiple clinical indicators. We set out to apply the same indicators in an Australian general practice to benchmark our performance and to see how much work was required to obtain the data.

METHODS Clinical indicators for the 2008–2009 UK Quality and Outcomes Framework (QOF) cycle were examined and achievement levels measured in a large rural Australian general practice, mainly by computer searching of the clinical database.

RESULTS Outcome measures were obtainable for 79 out of 80 indicators. Manual perusal of computer records was required for 16 indicators. Data collection takes approximately 130 hours. The Australian general practice achieved 66% of available pay for performance points compared to the UK average of 97%.

DISCUSSION United Kingdom QOF clinical data is obtainable relatively easily in a well computerised Australian rural general practice. The exercise identified significant areas in which clinical performance could be improved.

He did what? Well that wasn't handed over! Communicating risk in mental health

Mental health inpatient units are dynamic, complex environments that provide care for patients with heterogeneous ages, diagnoses and levels of acuity. These environments commonly expose clinicians and patients to many potential risks. Despite extensive research into risk assessment, prediction and management, no study has investigated how risk information is communicated at handover in acute mental health settings. Given the pivotal role handover plays in informing risk management, this evidence gap is significant. This paper reports on a study that investigated the practices of communicating risk at handover in an Australian acute mental health inpatient unit. The aim of this research was to identify the frequency and type of risk information communicated between nursing shifts, and the methods by which this communication was performed. A secondary aim was to identify effective and ineffective risk communication practices. This study involved an observational design method using a 14-item Clinical Audit Tool derived from handover principles outlined by World Health Organization. Five hundred occasions of patient handover were observed. Few risk information items were observed to be communicated in any method. Risk communication practice was inconsistent, and a key recommendation from the study is the use of standardized handover tools that ensures risk information is adequately reported.

Factors influencing participation in a vascular disease prevention lifestyle program among participants in a cluster randomized trial

Background
Previous research suggests that lifestyle intervention for the prevention of diabetes and cardiovascular disease (CVD) are effective, however little is known about factors affecting participation in such programs. This study aims to explore factors influencing levels of participation in a lifestyle modification program conducted as part of a cluster randomized controlled trial of CVD prevention in primary care.

Methods
This concurrent mixed methods study used data from the intervention arm of a cluster RCT which recruited 30 practices through two rural and three urban primary care organizations. Practices were randomly allocated to intervention (n = 16) and control (n = 14) groups. In each practice up to 160 eligible patients aged between 40 and 64 years old, were invited to participate. Intervention practice staff were trained in lifestyle assessment and counseling and referred high risk patients to a lifestyle modification program (LMP) consisting of two individual and six group sessions over a nine month period. Data included a patient survey, clinical audit, practice survey on capacity for preventive care, referral and attendance records at the LMP and qualitative interviews with Intervention Officers facilitating the LMP. Multi-level logistic regression modelling was used to examine independent predictors of attendance at the LMP, supplemented with qualitative data from interviews with Intervention Officers facilitating the program.

Results
A total of 197 individuals were referred to the LMP (63% of those eligible). Over a third of patients (36.5%) referred to the LMP did not attend any sessions, with 59.4% attending at least half of the planned sessions. The only independent predictors of attendance at the program were employment status - not working (OR: 2.39 95% CI 1.15-4.94) and having high psychological distress (OR: 2.17 95% CI: 1.10-4.30). Qualitative data revealed that physical access to the program was a barrier, while GP/practice endorsement of the program and flexibility in program delivery facilitated attendance.

Conclusion
Barriers to attendance at a LMP for CVD prevention related mainly to external factors including work commitments and poor physical access to the programs rather than an individuals’ health risk profile or readiness to change. Improving physical access and offering flexibility in program delivery may enhance future attendance. Finally, associations between psychological distress and attendance rates warrant further investigation.

Effects of patient-, environment- and medication-related factors on high-alert medication incidents.

To measure the rate of medication incidents associated with the prescription and administration of high-alert medications and to identify patient-, environment- and medication-related factors associated with these incidents.

Medication errors in hospitalised children

This study aims to explore the characteristics of reported medication errors occurring among children in an Australian children's hospital, and to examine the types, causes and contributing factors of medication errors.