UK consensus project on quality in palliative day services: developing a quality indicator set using the RAND/UCLA appropriateness method

Introduction
Evaluating quality of palliative day services is essential for assessing care across diverse settings, and for monitoring quality improvement approaches.

Aim
To develop a set of quality indicators for assessment of all aspects (structure, process and outcome) of care in palliative day services.

Methods
Using a modified version of the RAND/UCLA appropriateness method (Fitch et al., 2001), a multidisciplinary panel of 16 experts independently completed a survey rating the appropriateness of 182 potential quality indicators previously identified during a systematic evidence review. Panel members then attended a one day, face-to-face meeting where indicators were discussed and subsequently re-rated. Panel members were also asked to rate the feasibility and necessity of measuring each indicator.

Results
71 indicators classified as inappropriate during the survey were removed based on median appropriateness ratings and level of agreement. Following the panel discussions, a further 60 were removed based on appropriateness and feasibility ratings, level of agreement and assessment of necessity. Themes identified during the panel discussion and findings of the evidence review were used to translate the remaining 51 indicators into a final set of 27.

Conclusion
The final indicator set included information on rationale and supporting evidence, methods of assessment, risk adjustment, and recommended performance levels. Further implementation work will test the suitability of this ‘toolkit’ for measurement and benchmarking. The final indicator set provides the basis for standardised assessment of quality across services, including care delivered in community and primary care settings.

Reference

• Fitch K, Bernstein SJ, Aguilar MD, et al. The RAND/UCLA Appropriateness Method User’s Manual. Santa Monica, CA: RAND Corporation; 2001. http://www.rand.org/pubs/monograph_reports/MR1269

PIPc study: development of indicators of potentially inappropriate prescribing in children (PIPc) in primary care using a modified Delphi technique

Objective There is limited evidence regarding the quality of prescribing for children in primary care. Several prescribing criteria (indicators) have been developed to assess the appropriateness of prescribing in older and middle-aged adults but few are relevant to children. The objective of this study was to develop a set of prescribing indicators that can be applied to prescribing or dispensing data sets to determine the prevalence of potentially inappropriate prescribing in children (PIPc) in primary care settings.


Design Two-round modified Delphi consensus method.


Setting Irish and UK general practice.


Participants A project steering group consisting of academic and clinical general practitioners (GPs) and pharmacists was formed to develop a list of indicators from literature review and clinical expertise. 15 experts consisting of GPs, pharmacists and paediatricians from the Republic of Ireland and the UK formed the Delphi panel.


Results 47 indicators were reviewed by the project steering group and 16 were presented to the Delphi panel. In the first round of this exercise, consensus was achieved on nine of these indicators. Of the remaining seven indicators, two were removed following review of expert panel comments and discussion of the project steering group. The second round of the Delphi process focused on the remaining five indicators, which were amended based on first round feedback. Three indicators were accepted following the second round of the Delphi process and the remaining two indicators were removed. The final list consisted of 12 indicators categorised by respiratory system (n=6), gastrointestinal system (n=2), neurological system (n=2) and dermatological system (n=2).


Conclusions The PIPc indicators are a set of prescribing criteria developed for use in children in primary care in the absence of clinical information. The utility of these criteria will be tested in further studies using prescribing databases.