Intelligent outcome measures in liaison psychiatry:essential even if not desirable. Commentary on... a multidimensional Framework for Routine Outcome Measurement in Liaison Psychiatry (FROM-LP)

Service development is guided by outcome measures that inform service commissioners and providers. Those in liaison psychiatry should be encouraged to develop a positive approach that integrates the collection of outcome measures into everyday clinical practice. The Framework for Routine Outcome Measurement in Liaison Psychiatry (FROM-LP) is a very useful tool to measure service quality and clinical effectiveness, using a combination of clinician-rated and patient-rated outcome measures and patient-rated experience measures. However, it does not include measures of cost-effectiveness or training activities. The FROM-LP is a significant step towards developing nationally unified outcome measures.

Routine measurement of outcomes in Australia's public sector mental health services

OBJECTIVE: This paper describes the Australian experience to date with a national 'roll out' of routine outcome measurement in public sector mental health services. METHODS: Consultations were held with 123 stakeholders representing a range of roles. RESULTS: Australia has made an impressive start to nationally implementing routine outcome measurement in mental health services, although it still has a long way to go. All States/Territories have established data collection systems, although some are more streamlined than others. Significant numbers of clinicians and managers have been trained in the use of routine outcome measures, and thought is now being given to ongoing training strategies. Outcome measurement is now occurring 'on the ground'; all States/Territories will be reporting data for 2003-04, and a number have been doing so for several years. Having said this, there is considerable variability regarding data coverage, completeness and compliance. Some States/Territories have gone to considerable lengths to 'embed' outcome measurement in day-to-day practice. To date, reporting of outcome data has largely been limited to reports profiling individual consumers and/or aggregate reports that focus on compliance and data quality issues, although a few States/Territories have begun to turn their attention to producing aggregate reports of consumers by clinician, team or service. CONCLUSION: Routine outcome measurement is possible if it is supported by a co-ordinated, strategic approach and strong leadership, and there is commitment from clinicians and managers. The Australian experience can provide lessons for other countries.

Introduction of routine outcome measures: staff reactions and issues for consideration

The aim of this study was to explore clinician reactions to (i) the introduction of routine outcome measures and (ii) the utility of outcomes data in clinical practice. Focus group discussions (n = 34) were conducted with mental health staff (n = 324) at approximately 8 months post implementation of routine outcome measures. A semi-structured interview schedule was used to collect data on two key issues; reactions to the introduction of outcome measures and factors influencing the utility of outcomes data in clinical practice. Data from the discussion groups were analysed using content analysis to isolate emerging themes. While the majority of participants endorsed the collection and utilization of outcomes data, many raised questions about the merits of the initiative. Ambivalence, competing work demands, lack of support from senior medical staff, questionable evidence to support the use of outcome measures, and fear of how outcomes data might be used emerged as key issues. At 8 months post implementation a significant number of clinical staff remained ambivalent about the benefits of outcome measurement and had not engaged in the process. The shift to a service model driven by outcomes and case-mix data will take time and resources to achieve. Implications for nursing staff are discussed.

Validation of an Australian sign language instrument of outcome measurement for adults in mental health settings

Objective: There are currently no adult mental health outcome measures that have been translated into Australian sign language (Auslan). Without a valid and reliable Auslan outcome measure, empirical research into the efficacy of mental health interventions for sign language users is unattainable. To address this research problem the Outcome Rating Scale (ORS), a measure of general functioning, was translated into Auslan and recorded on to digital video disk for use in clinical settings. The purpose of the present study was therefore to examine the reliability, validity and acceptability of an Auslan version of the ORS (ORS-Auslan). Method: The ORS-Auslan was administered to 44 deaf people who use Auslan as their first language and who identify as members of a deaf community (termed ‘Deaf’ people) on their first presentation to a mental health or counselling facility and to 55 Deaf people in the general community. The community sample also completed an Auslan version of the Depression Anxiety Stress Scale-21 (DASS-21). Results: t-Tests indicated significant differences between the mean scores for the clinical and community sample. Internal consistency was acceptable given the low number of items in the ORS-Auslan. Construct validity was established by significant correlations between total scores on the DASS-21-Auslan and ORS-Auslan. Acceptability of ORS-Auslan was evident in the completion rate of 93% compared with 63% for DASS-21-Auslan. Conclusions: This is the only Auslan outcome measure available that can be used across a wide variety of mental health and clinical settings. The ORS-Auslan provides mental health clinicians with a reliable and valid, brief measure of general functioning that can significantly distinguish between clinical and non-clinical presentations for members of the Deaf community.

Outcome measurement and service evaluation - a note on research design.

The purpose of this research note is to demonstrate how an individualised quality of life instrument could be adapted to provide a more accurate estimate of the impact of a social service on a person’s quality of life. An increase in quality of life between the start and end of a service is often taken as an indication that the service impacted positively on quality of life. The modifications to the quality of life instrument suggested in this paper show that this assumption is not always accurate and should be questioned directly.

d-outcome measurement for a nonlocality test

For the purpose of a nonlocality test, we propose a general correlation observable of two parties by utilizing local d- outcome measurements with SU(d) transformations and classical communications. Generic symmetries of the SU(d) transformations and correlation observables are found for the test of nonlocality. It is shown that these symmetries dramatically reduce the number of numerical variables, which is important for numerical analysis of nonlocality. A linear combination of the correlation observables, which is reduced to the Clauser- Home-Shimony-Holt (CHSH) Bell's inequality for two outcome measurements, leads to the Collins-Gisin-Linden-Massar-Popescu (CGLMP) nonlocality test for d-outcome measurement. As a system to be tested for its nonlocality, we investigate a continuous- variable (CV) entangled state with d measurement outcomes. It allows the comparison of nonlocality based on different numbers of measurement outcomes on one physical system. In our example of the CV state, we find that a pure entangled state of any degree violates Bell's inequality for d(greater than or equal to2) measurement outcomes when the observables are of SU(d) transformations.

Adolescent Drug Abuse Diagnosis (ADAD) vs. Health of Nation Outcome Scale for Children and Adolescents (HoNOSCA) in clinical outcome measurement.

BACKGROUND: The Adolescent Drug Abuse Diagnosis (ADAD) and Health of Nation Outcome Scales for Children and Adolescents (HoNOSCA) are both measures of outcome for adolescent mental health services. AIMS: To compare the ADAD with HoNOSCA; to examine their clinical usefulness. METHODS: Comparison of the ADAD and HoNOSCA outcome measures of 20 adolescents attending a psychiatric day care unit. RESULTS: ADAD change was positively correlated with HoNOSCA change. HoNOSCA assesses the clinic's day-care programme more positively than the ADAD. The ADAD detects a group for which the mean score remains unchanged whereas HoNOSCA does not. CONCLUSIONS: A good convergent validity emerges between the two assessment tools. The ADAD allows an evidence-based assessment and generally enables a better subject discrimination than HoNOSCA. HoNOSCA gives a less refined evaluation but is more economic in time and possibly more sensitive to change. Both assessment tools give useful information and enabled the Day-care Unit for Adolescents to rethink the process of care and of outcome, which benefited both the institution and the patients.

Impact of complications in total ankle replacement and ankle arthrodesis analyzed with a validated outcome measurement

Major modifications in the design and techniques of total ankle replacement have challenged the perception that ankle arthrodesis is the treatment of choice for end-stage ankle arthritis. High complication and revision rates have been reported after both procedures.

Outcome measurement in Australian rehabilitation environments

Objective: To determine the frequency and pattern of methods of outcome assessment used in Australian physical rehabilitation environments. Design: Postal survey. Methods: A questionnaire on service type, staffing, numbers of adults treated and outcome measures used for 7 conditions related to injury and road trauma as well as stroke and neuromuscular disorders was sent to 973 services providing adult physical rehabilitation treatment. Results: Questionnaires were completed by 440 service providers for a response rate of 45%, similar to that reported in a recent European survey reported in this journal. A small number of measures were reported as in use by most respondents, while a large number of measures were used by a few respondents. Measures of physical changes were used more frequently than those of generic well-being or quality of life. Ease of use and reporting to other professionals were cited as the most important reasons in selection of outcome measures. Conclusion: This Australian-wide survey detected considerable heterogeneity in outcome measurement procedures used in rehabilitation environments. While the goal of measurement may vary between providers and differ between conditions, the results highlight opportunities for harmonization, benchmarking and measurement of health-related quality of life.

An Investigation into the Implementation of CYP-IAPT Routine Outcome Measures in their First Year of Integration into Child Psychotherapy Practice

This thesis examines the impact on child and adolescent psychotherapists within CAMHS of the introduction of routine outcome measures (ROMs) associated with the Children and Young People’s Improving access to Psychological Therapies programme (CYP-IAPT). All CAMHS therapists working within a particular NHS mental health Trust1 were required to trial CYP-IAPT ROMs as part of their everyday clinical practice from October 2013-September 2014. During this period considerable freedom was allowed as to which of the measures each therapist used and at what frequency. In order to assess the impact of CYP-IAPT ROMs on child psychotherapy, I conducted semi-structured interviews with eight psychotherapists within a particular CAMHS partnership within one NHS Trust. Each statement was coded and grouped according to whether it related to initial (generic) assessment, goal setting / monitoring, monitoring on-going progress, therapeutic alliance, or to issues concerning how data might be used or interpreted by managers and commissioners. Analysis of interviews revealed greatest concern about session-by session ROMs, as these are felt to impact most significantly on psychotherapy; therapists felt that session-by-session ROMs do not take account of negative transference relationships, they are overly repetitive and used to reward / punish the therapist. Measures used at assessment and review were viewed as most compatible with psychotherapy, although often experienced as excessively time consuming. The Goal Based Outcome Measure was generally experienced as compatible with psychotherapy so long as goals are formed collaboratively between therapist and young person. There was considerable anxiety about how data may be (mis)used and (mis)interpreted by managers and commissioners, for example to end treatment prematurely, trigger change of therapist in the face of negative ROMs data, or to damage psychotherapy. Use of ROMs for short term and generic work was experienced as less intrusive and contentious.

A tool to measure progress and outcome in recovery

Recovery and the use of routine outcome measurement tools are key topics for mental health nurses. This article reports on research carried out to assess the usability of an outcome measure designed to assess recovery in clinical practice. Results indicate that the Individual Recovery Outcomes Counter (I.ROC) is both easy to use and well liked by services users.