Routine measurement of outcomes in Australia's public sector mental health services

OBJECTIVE: This paper describes the Australian experience to date with a national 'roll out' of routine outcome measurement in public sector mental health services. METHODS: Consultations were held with 123 stakeholders representing a range of roles. RESULTS: Australia has made an impressive start to nationally implementing routine outcome measurement in mental health services, although it still has a long way to go. All States/Territories have established data collection systems, although some are more streamlined than others. Significant numbers of clinicians and managers have been trained in the use of routine outcome measures, and thought is now being given to ongoing training strategies. Outcome measurement is now occurring 'on the ground'; all States/Territories will be reporting data for 2003-04, and a number have been doing so for several years. Having said this, there is considerable variability regarding data coverage, completeness and compliance. Some States/Territories have gone to considerable lengths to 'embed' outcome measurement in day-to-day practice. To date, reporting of outcome data has largely been limited to reports profiling individual consumers and/or aggregate reports that focus on compliance and data quality issues, although a few States/Territories have begun to turn their attention to producing aggregate reports of consumers by clinician, team or service. CONCLUSION: Routine outcome measurement is possible if it is supported by a co-ordinated, strategic approach and strong leadership, and there is commitment from clinicians and managers. The Australian experience can provide lessons for other countries.

Do adults in contact with Australia's public sector mental health services get better

This paper describes the outcomes of episodes of care for adults in public sector mental health services across Australia, with a view to informing the debate on service quality. Health of the Nation Outcome Scales (HoNOS) change scores and effect sizes were calculated for 14,659 acute inpatient episodes and 23,692 community episodes. The results showed that people in contact with public sector mental health services generally do get better, although the magnitude of improvement depends on the setting and episode type. This confirmatory finding is particularly positive, given current community concerns about the quality and effectiveness of mental health services.

Constraints to organizational learning during major change at a mental health services facility

This paper explains what happened during a three years long qualitative study at a mental health services organization. The study focuses on differences between espoused theory and theory in use during the implementation of a new service delivery model. This major organizational change occurred in a National policy environment of major health budget cutbacks. Primarily as a result of poor resourcing provided to bring about policy change and poor implementation of a series of termination plans, a number of constraints to learning contributed to the difficulties in implementing the new service delivery model. The study explores what occurred during the change process. Rather than blame participants of change for the poor outcomes, the study is set in a broader context of a policy environment—that of major health cutbacks.

Telemedicine for rural and remote child and youth mental health services

The E-Child and Youth Mental Health Service was designed to provide children and adolescents in Queensland with access to specialist mental health consultations using telemedicine. A project officer provided a single point of contact for referral management and clinic coordination, thereby reducing barriers of access to the service. Over a six-month period from November 2004, 42 point-to-point videoconferences were conducted to nine sites in Queensland. Three multipoint conferences were also conducted. Eleven videoconferences (24%) were arranged for administrative purposes, and 34 (76%) were conducted for the delivery of clinical services (30 patients). The referral and consultation activity suggests an improvement in the capacity of rural and remote mental health service providers to deliver specialist services for children and adolescents.

Supervision practices in allied mental health: Relationships of supervision characteristics to perceived impact and job satisfaction

This study examined whether supervision characteristics impacted on mental health practice and morale, and developed a new Supervision Attitude Scale (SAS). Telephone surveys were conducted with a representative sample of 272 staff from public mental health services across Queensland. Although supervision was widely received and positively rated, it had low average intensity, and assessment and training of skills was rarely incorporated. Perceived impact on practice was associated with acquisition of skills and positive attitudes to supervisors, but extent of supervision was related to impact only if it was from within the profession. Intention to resign was unrelated to extent of supervision, but was associated with positive attitudes to supervisors, accessibility, high impact, and empathy or praise in supervision sessions. The SAS had high internal consistency, and its intercorrelations were consistent with it being a measure of relationship positivity. The study supported the role of supervision in retention and in improving practice. It also highlighted supervision characteristics that might be targeted in training, and provided preliminary data on a new measure.

Work activities of occupational therapists in Australian mental health services

The aim of this study was to obtain a profile of occupational therapists’ work activities in contemporary Australian mental health services so as to better understand the specific contribution of this profession. The study also aimed to determine whether or not actual work activity was congruent with the preferred roles of occupational therapists. A cross-sectional survey of 196 occupational therapists working in mental health was conducted. For the purposes of the study, a new instrument was developed that evaluated both actual and preferred work roles in four broad categories: administrative, general clinical skills, specialist clinical skills and community development. Respondents were engaged in a greater proportion of generic than discipline-specific work activities. They reported a preference for higher levels of activity in each of the work categories. These findings suggest that, contrary to some previous reports, not only are occupational therapists in Australia engaged in a broad spectrum of non-specialist mental health work activities, but these activities are mostly congruent with their expectations and wishes.

Complexity, conflict and uncertainty: Issues in collaboration between child protection and mental health services

This paper provides an analysis of data from a state-wide survey of statutory child protection workers, adult mental health workers, and child mental health workers. Respondents provided details of their experience of collaboration on cases where a parent had mental health problems and there were serious child protection concerns. The survey was conducted as part of a large mixed-method research project on developing best practice at the intersection of child protection and mental health services. Descriptions of 300 cases were provided by 122 respondents. Analyses revealed that a great deal of collaboration occur-red across a wide range of government and community-based agencies; that collaborative processes were often positive and rewarding for workers; and that collaboration was most difficult when the nature of the parental mental illness or the need for child protection intervention was contested. The difficulties experienced included communication, role clarity, competing primary focus, contested parental mental health needs, contested child protection needs, and resources. (C) 2004 Elsevier Ltd. All rights reserved.

Sources of stress experienced by occupational therapists and social workers in mental health settings

This study examined the sources of stress experienced by occupational therapists and social workers employed in Australian public mental health services and identified the demographic and work-related factors related to stress using a cross-sectional survey design. Participants provided demographic and work-related information and completed the Mental Health Professionals Stress Scale. The overall response rate to the survey was 76.6%, consisting of 196 occupational therapists and 108 social workers. Results indicated that lack of resources, relationships and conflicts with other professionals, workload, and professional self-doubt were correlated with increased stress. Working in case management was associated with stress caused by client-related difficulties, lack of resources, and professional self-doubt. The results of this study suggest that Australian occupational therapists and social workers experience stress, with social workers reporting slightly more overall stress than occupational therapists. Copyright © 2005 Whurr Publishers Ltd.

Interagency collaboration between child protection and mental health services: Practices, attitudes and barriers

Objective: The aim of this paper is to examine some of the factors that facilitate and hinder interagency collaboration between child protection services and mental health services in cases where there is a parent with a mental illness and there are protection concerns for the child(ren). The paper reports on agency practices, worker attitudes and experiences, and barriers to effective collaboration. Method: A self-administered, cross-sectional survey was developed and distributed via direct mail or via line supervisors to workers in statutory child protection services, adult mental health services, child and youth mental health services, and Suspected Child Abuse and Neglect (SCAN) Teams. There were 232 completed questionnaires returned, with an overall response rate of 21%. Thirty-eight percent of respondents were statutory child protection workers. 39% were adult mental health workers, 16% were child and youth mental health workers, and 4% were SCAN Team medical officers (with 3% missing data). Results: Analysis revealed that workers were engaging in a moderate amount of interagency contact, but that they were unhappy with the support provided by their agency. Principle components analysis and multivariate analysis of variance (MANOVA) on items assessing attitudes toward other workers identified four factors, which differed in rates of endorsement: inadequate training, positive regard for child protection workers, positive regard for mental health workers, and mutual mistrust (from highest to lowest level of endorsement). The same procedure identified the relative endorsement of five factors extracted from items about potential barriers: inadequate resources, confidentiality, gaps in interagency processes, unrealistic expectations, and professional knowledge domains and boundaries. Conclusions: Mental health and child protection professionals believe that collaborative practice is necessary; however, their efforts are hindered by a lack of supportive structures and practices at the organizational level. (c) 2005 Published by Elsevier Ltd.

Challenges in implementing evidence-based practice into mental health services

This paper highlights challenges in implementing mental health policy at a service delivery level. It describes an attempt to foster greater application of recovery-orientated principles and practices within mental health services. Notwithstanding a highly supportive policy environment, strong support from service administrators, and an enthusiastic staff response to training, application of the training and support tools was weaker than anticipated. This paper evaluates the dissemination trial against key elements to promote sustained adoption of innovations. Organisational and procedural changes are required before mental health policies are systematically implemented in practice.