Introduction of routine outcome measures: staff reactions and issues for consideration

The aim of this study was to explore clinician reactions to (i) the introduction of routine outcome measures and (ii) the utility of outcomes data in clinical practice. Focus group discussions (n = 34) were conducted with mental health staff (n = 324) at approximately 8 months post implementation of routine outcome measures. A semi-structured interview schedule was used to collect data on two key issues; reactions to the introduction of outcome measures and factors influencing the utility of outcomes data in clinical practice. Data from the discussion groups were analysed using content analysis to isolate emerging themes. While the majority of participants endorsed the collection and utilization of outcomes data, many raised questions about the merits of the initiative. Ambivalence, competing work demands, lack of support from senior medical staff, questionable evidence to support the use of outcome measures, and fear of how outcomes data might be used emerged as key issues. At 8 months post implementation a significant number of clinical staff remained ambivalent about the benefits of outcome measurement and had not engaged in the process. The shift to a service model driven by outcomes and case-mix data will take time and resources to achieve. Implications for nursing staff are discussed.

Investigation of psychological and neuropsychological factors associated with clinical outcome following a group rehabilitation programme

The present study investigated neuropsychological and psychological factors associated with successful treatment outcome following a group intervention for individuals with acquired brain injury (ABI). Participants were classified into two groups (Clinically Improved and Not Improved) based upon the findings of a previous study (Ownsworth, McFarland, & Young, 2000a). A discriminant analysis was used to predict group membership on three outcome measures (Awareness and Strategy Behaviour indices of the Self-Regulation Skills Interview and the Psychosocial Dimension of the Sickness Impact Profile) between pre-assessment and post-assessment, and between pre-assessment and 6 months follow-up. Neuropsychological factors involved measures of executive functioning and psychological factors were assessed using measures of personality-related denial and coping-related denial. Overall, the results indicated that individuals with impaired executive functioning were most likely to be classified as Clinically Improved on measures of awareness, strategy behaviour and psychosocial functioning. Individuals who deny or minimise their ABI symptoms were less likely to improve their psychosocial functioning following the group intervention. Future research needs to evaluate interventions for enhancing self-regulation skills and improving psychosocial functioning for individuals who employ denial as a main strategy for coping following ABI.

Clinical progression and outcome of dysphagia following paediatric traumatic brain injury: a prospective study

Objectives : To provide a preliminary clinical profile of the resolution and outcomes of oral-motor impairment and swallowing function in a group of paediatric dysphagia patients post-traumatic brain injury (TBI). To document the level of cognitive impairment parallel to the return to oral intake, and to investigate the correlation between the resolution of impaired swallow function versus the resolution of oral-motor impairment and cognitive impairment. Participants : Thirteen children admitted to an acute care setting for TBI. Main outcome measures : A series of oral-motor (Verbal Motor Production Assessment for Children, Frenchay Dysarthria Assessment, Schedule for Oral Motor Assessment) and swallowing (Paramatta Hospital's Assessment for Dysphagia) assessments, an outcome measure for swallowing (Royal Brisbane Hospital's Outcome Measure for Swallowing), and a cognitive rating scale (Rancho Level of Cognitive Functioning Scale). Results : Across the patient group, oral-motor deficits resolved to normal status between 3 and 11 weeks post-referral (and at an average of 12 weeks post-injury) and swallowing function and resolution to normal diet status were achieved by 3-11 weeks post-referral (and at an average of 12 weeks post-injury). The resolution of dysphagia and the resolution of oral-motor impairment and cognitive impairment were all highly correlated. Conclusion : The provision of a preliminary profile of oral-motor functioning and dysphagia resolution, and data on the linear relationship between swallowing impairment and cognition, will provide baseline information on the course of rehabilitation of dysphagia in the paediatric population post-TBI. Such data will contribute to more informed service provision and rehabilitation planning for paediatric patients post-TBI.

Outcome measurement in Australian rehabilitation environments

Objective: To determine the frequency and pattern of methods of outcome assessment used in Australian physical rehabilitation environments. Design: Postal survey. Methods: A questionnaire on service type, staffing, numbers of adults treated and outcome measures used for 7 conditions related to injury and road trauma as well as stroke and neuromuscular disorders was sent to 973 services providing adult physical rehabilitation treatment. Results: Questionnaires were completed by 440 service providers for a response rate of 45%, similar to that reported in a recent European survey reported in this journal. A small number of measures were reported as in use by most respondents, while a large number of measures were used by a few respondents. Measures of physical changes were used more frequently than those of generic well-being or quality of life. Ease of use and reporting to other professionals were cited as the most important reasons in selection of outcome measures. Conclusion: This Australian-wide survey detected considerable heterogeneity in outcome measurement procedures used in rehabilitation environments. While the goal of measurement may vary between providers and differ between conditions, the results highlight opportunities for harmonization, benchmarking and measurement of health-related quality of life.

A review of the psychometric properties of the Health of the Nation Outcomes Scales (HoNOS) family of measures

BACKGROUND: The Health of the Nation Outcome Scales was developed to routinely measure outcomes for adults with mental illness. Comparable instruments were also developed for children and adolescents (the Health of the Nation Outcome Scales for Children and Adolescents) and older people (the Health of the Nation Outcome Scales 65+). All three are being widely used as outcome measures in the United Kingdom, Australia and New Zealand. There is, however, no comprehensive review of these instruments. This paper fills this gap by reviewing the psychometric properties of each. METHOD: Articles and reports relating to the instruments were retrieved, and their findings synthesised to assess the instruments' validity (content, construct, concurrent, predictive), reliability (test-retest, inter-rater), sensitivity to change, and feasibility/utility. RESULTS: Mostly, the instruments perform adequately or better on most dimensions, although some of their psychometric properties warrant closer examination. CONCLUSION: Collectively, the Health of the Nation Outcome Scales family of measures can assess outcomes for different groups on a range of mental health-related constructs, and can be regarded as appropriate for routinely monitoring outcomes.

A metacognitive contextual intervention to enhance error awareness and functional outcome following traumatic brain injury: A single-case experimental design

Very few empirically validated interventions for improving metacognitive skills (i.e., self-awareness and self-regulation) and functional outcomes have been reported. This single-case experimental study presents JM, a 36-year-old man with a very severe traumatic brain injury (TBI) who demonstrated long-term awareness deficits. Treatment at four years post-injury involved a metacognitive contextual intervention based on a conceptualization of neuro-cognitive, psychological, and socio-environmental factors contributing to his awareness deficits. The 16-week intervention targeted error awareness and self-correction in two real life settings: (a) cooking at home: and (b) volunteer work. Outcome measures included behavioral observation of error behavior and standardized awareness measures. Relative to baseline performance in the cooking setting, JM demonstrated a 44% reduction in error frequency and increased self-correction. Although no spontaneous generalization was evident in the volunteer work setting, specific training in this environment led to a 39% decrease in errors. JM later gained paid employment and received brief metacognitive training in his work environment. JM's global self-knowledge of deficits assessed by self-report was unchanged after the program. Overall, the study provides preliminary support for a metacognitive contextual approach to improve error awareness and functional Outcome in real life settings.