Are diagnosis specific outcome indicators based on administrative data useful in assessing quality of hospital care?

Background: Hospital performance reports based on administrative data should distinguish differences in quality of care between hospitals from case mix related variation and random error effects. A study was undertaken to determine which of 12 diagnosis-outcome indicators measured across all hospitals in one state had significant risk adjusted systematic ( or special cause) variation (SV) suggesting differences in quality of care. For those that did, we determined whether SV persists within hospital peer groups, whether indicator results correlate at the individual hospital level, and how many adverse outcomes would be avoided if all hospitals achieved indicator values equal to the best performing 20% of hospitals. Methods: All patients admitted during a 12 month period to 180 acute care hospitals in Queensland, Australia with heart failure (n = 5745), acute myocardial infarction ( AMI) ( n = 3427), or stroke ( n = 2955) were entered into the study. Outcomes comprised in-hospital deaths, long hospital stays, and 30 day readmissions. Regression models produced standardised, risk adjusted diagnosis specific outcome event ratios for each hospital. Systematic and random variation in ratio distributions for each indicator were then apportioned using hierarchical statistical models. Results: Only five of 12 (42%) diagnosis-outcome indicators showed significant SV across all hospitals ( long stays and same diagnosis readmissions for heart failure; in-hospital deaths and same diagnosis readmissions for AMI; and in-hospital deaths for stroke). Significant SV was only seen for two indicators within hospital peer groups ( same diagnosis readmissions for heart failure in tertiary hospitals and inhospital mortality for AMI in community hospitals). Only two pairs of indicators showed significant correlation. If all hospitals emulated the best performers, at least 20% of AMI and stroke deaths, heart failure long stays, and heart failure and AMI readmissions could be avoided. Conclusions: Diagnosis-outcome indicators based on administrative data require validation as markers of significant risk adjusted SV. Validated indicators allow quantification of realisable outcome benefits if all hospitals achieved best performer levels. The overall level of quality of care within single institutions cannot be inferred from the results of one or a few indicators.

Equity weights in the allocation of health care: the rank-dependent QALY model

This paper introduces the rank-dependent quality-adjusted life-years (QALY) model, a new method to aggregate QALYs in economic evaluations of health care. The rank-dependent QALY model permits the formalization of influential concepts of equity in the allocation of health care, such as the fair innings approach, and it includes as special cases many of the social welfare functions that have been proposed in the literature. An important advantage of the rank-dependent QALY model is that it offers a straightforward procedure to estimate equity weights for QALYs. We characterize the rank-dependent QALY model and argue that its central condition has normative appeal. (C) 2003 Elsevier B.V. All rights reserved.

Quality assurance of paediatric cardiac surgery: A prospective 6-year analysis

Objective: To audit effective quality assurance methods to monitor outcomes following paediatric cardiac surgery at a single institution. Methods: All patients undergoing cardiac surgery from January 1996 to December 2001 were enrolled prospectively. Patients were stratified by complexity of surgical procedure into four groups, with Category 4 being the most complex procedure. Outcome measures included death, length of admission and morbidity from complications. Results: A total of 1815 patients underwent 1973 surgical procedures. Of these, 1447 (73.3%) were cardiopulmonary bypass procedures, and 543 (27.5%) were more complex (Category 3 and 4) procedures. Median patient age was 3.5 years (range, 1 day-20 years) and patient weight 15.0 kg (range, 900 g to 90 kg). Sixty-six patients (3.6%) died during the study period. Of the procedures in 1996, 22.7% were classified as complex compared with 29.2% of procedures in 2001. The annual surgical mortality ranged from 1.9-4.7% (P=0.20), and when mortality was adjusted for complexity of surgery, there was no significant yearly variation in the mortality rate (P=0.57). Analysis of individual surgeon's results showed no significant difference in the mortality rate by complexity of surgery performed (P=0.90). Mean ventilation times did not change significantly over time (P=0.79). The yearly incidence of significant neurological complications ranged from 0.6% to 4.5% and the incidence of arrhythmias from 4.2% to 8.0%. No difference was detected between the years. Conclusions: Stratifying complexity of surgery proved valuable in monitoring surgical outcomes and detecting differences in performance over time as large subgroups were created for analysis.

Stakeholder concerns about Australia's mental health care system

There is growing community and professional concern that the Australian mental health care system requires substantial reform. In response to these concerns, a Senate Select Committee on Mental Health has been commissioned to conduct an inquiry into the provision of mental health services. The current study involved a content analysis of 725 submissions received by the Committee, and highlighted significant areas for reform. People with mental illness face difficulties in accessing mental health care, the care they do receive is of varying quality and poorly coordinated, and necessary services from other sectors, such as housing, are lacking. These problems may be exacerbated for particular groups with complex needs or heightened levels of vulnerability. The system requires reorienting towards the consumers and carers it is designed to serve, and needs stronger governance, higher levels of accountability and improved monitoring of quality. These findings are discussed in the context of the recent acknowledgement of mental health as an issue by the Council of Australian Governments (COAG), which has called for an action plan to be prepared for its consideration by June 2006.

Using a problem detection study (PDS) to identify and compare health care provider and consumer views of antihypertensive therapy

The objectives of this study were to ascertain consumer knowledge and behaviour about hypertension and treatment and to compare these with health care providers' perceptions (of 'most' consumers). The design for the study was a problem detection study (PDS): focus groups and then survey. Focus groups and survey participants were convenience samples of consumers, doctors, nurses and pharmacists. The main outcome measures were agreement on a 5-point Likert scale with statements about consumers' knowledge and behaviour about high blood pressure and medication. The survey identified areas of consensus and disagreement between consumers and health providers. While general knowledge and concordance with antihypertensive therapy among consumers was good, consequences such as eye and kidney disease, interactions with herbal medicines, and how to deal with missing a dose were less well known. Side effects were a problem for over one-quarter of participants, and cost was a problem in continuing therapy. Half the consumers had not received sufficient written information. Providers overall disagreed that most consumers have an adequate understanding of the condition. They agreed that most consumers adhere to therapy and can manage medicines; and about their own profession's role in information provision and condition management. Consumers confirmed positive provider behaviour, suggesting opportunities for greater communication between providers about actions taken with their consumers. In conclusion, the PDS methodology was useful in identifying consumer opinions. Differences between consumer and provider responses were marked, with consumers generally rating their knowledge and behaviour above providers' ratings of 'most' consumers. There are clear gaps to be targeted to improve the outcomes of hypertension therapy.

Quality assurance experience with the randomized neuropathic bone pain trial (Trans-Tasman Radiation Oncology Group, 96.05)

Background and purpose: Trans-Tasman Radiation Oncology Group 96.05 is a prospective randomized controlled trial comparing a single 8 Gy with 20 Gy in five fractions of radiotherapy (RT) for neuropathic pain due to bone metastases. This paper summarizes the quality assurance (QA) activities for the first 234 patients (accrual target 270). Materials and methods: Independent audits to assess compliance with eligibility/exclusion criteria and appropriateness of treatment of the index site were conducted after each cohort of approximately 45 consecutive patients. Reported serious adverse events (SAEs) in the form of cord/cauda equina compression or pathological fracture developing at the index site were investigated and presented in batches to the Independent Data Monitoring Committee. Finally, source data verification of the RT prescription page and treatment records was undertaken for each of the first 234 patients to assess compliance with the protocol. Results: Only one patient was found conclusively not to have genuine neuropathic pain, and there were no detected 'geographical misses' with RT fields. The overall rate of detected infringements for other eligibility criteria over five audits (225 patients) was 8% with a dramatic improvement after the first audit. There has at no stage been a statistically significant difference in SAEs by randomization arm. There was a 22% rate of RT protocol variations involving ten of the 14 contributing centres, although the rate of major dose violations (more than +/- 10% from protocol dose) was only 6% with no statistically significant difference by randomization arm (P = 0.44). Conclusions: QA auditing is an essential but time-consuming component of RT trials, including those assessing palliative endpoints. Our experience confirms that all aspects should commence soon after study activation. Crown Copyright (C) 2003 Published by Elsevier Science Ltd. All rights reserved.