It's all a bit wishy washy : the challenge of building partnerships for effective mental health evaluation

Mental wellbeing and social connectedness is a key health priority in Victoria. Actions and interventions that may contribute to the promotion of community level mental wellbeing and social connectedness often occurs in other, non-health sectors. Including evidence from these sectors in evaluations of community based interventions around mental wellbeing and social connectedness is important to ensure comprehensive evaluation, and the development of best practice in this health priority area. However, published evaluation material of community based interventions around this health topic is limited, and rarely captures information from non-health sectors. This pilot study investigated the capacity of health promotion practitioners and other key stakeholders working in this area in Victoria to undertake evaluation of community based mental wellbeing and social connectedness interventions, issues and barriers faced in evaluation, and practitioners’ needs to be able to conduct effective and comprehensive evaluations.

Qualitative methods including semi-structure interviews and document analysis were used. Data was coded and analysed inductively, and key themes developed.

Results indicate that evaluating such interventions is challenging for practitioners due to the broad nature of the topic, and the measurement tools available. Many practitioners would like to conduct more comprehensive evaluation and include evidence from other sectors. Managerial and organizational support to develop partnerships both within the health sector and inter-sectorally was identified as a need in order to develop evaluation skills and facilitate more comprehensive evidence gathering.

This study underscores the importance of inter-sectoral partnerships for developing best evidence-based practice in community health. Partnerships are necessary for conducting comprehensive and effective evaluation to contribute to the evidence base. However, developing effective partnerships is challenging, and acts as a barrier to effective evaluation in a key health area for some community health practitioners. The findings also highlight an agenda for more action by managers to facilitate the development of relevant inter-sectoral partnerships.

Identification of mental illness in police cells: a comparison of police processes, the brief jail mental health screen and the jail screening assessment tool

The study investigated current police practices employed to identify those with a mental illness in police custody, and to evaluate the predictive utility of the Brief Jail Mental Health Screen (BJMHS) and the Jail Screening Assessment Tool (JSAT). One hundred and fifty detainees were recruited from two police stations in Melbourne, Australia. Measures included the Structured Clinical Interview for DSM-IV-TR, BJMHS and JSAT. Axis-I disorders were compared with police decisions regarding identification of mental illness based on their usual practices. Participants were classified as requiring referral for further mental health evaluation according to the screening tools. Results indicated that current police practices produced high false negatives, with many of those experiencing mental illness not identified. There was no significant difference in performance between BJMHS (AUC =0.722) and JSAT (AUC =0.779) in identifying those with a serious mental illness (p=0.109). However, JSAT performed significantly better at identifying any Axis-I disorder, excluding substance use disorders, as compared with BJMHS (AUC =0.815, vs AUC =0.729; p=0.018). Given the high prevalence of mental illness among detainees, there is a pressing need to introduce standardised screening tools for mental illness in police custody. This can assist the police in managing detainees appropriately and securing mental health services as required.

An examination of the consistency of investigative interviewers' performance

Three original studies were conducted to examine the consistency of investigative-interviewer performance across similar and distinct interview tasks. Overall, the degree of consistency depended on numerous factors, including the nature of the event and interview paradigm, the precision of the assessment measure and whether group versus individual stability was measured. The portfolio highlights and discusses some of the complexities that can arise when conducting a parenting capacity assessment with a patient who has, or is suspected of having, an intellectual disability. Four case studies are presented.

Evaluation of outcome in child and adolescent mental health services: children with persistent conduct problems

This article focuses on the evaluation of outcome in child and adolescent mental health services. We examined the outcomes of 46 children with persistent conduct problems by gathering at baseline and six months information from multiple informants on multiple domains including the functioning of the child, risk factors, and parents’ and children’s perceptions of the treatment process. A statistically significant reduction in oppositional/conduct symptoms was reported six months after the initial clinical contact. However, the majority of the group still scored within the clinical range. The various outcome measures are correlated to only a mild to moderate degree. Teachers did not notice the same degree of change at school, despite the changes noticed by parents. Symptom improvement and satisfaction with a service are two separate issues. Parents’ satisfaction was related to their perception of the therapist and the therapy offered. Their satisfaction was high if they perceived that the therapist was able to communicate well, show care and concern, and if the therapy was perceived as organized. Much can be learned from a comprehensive outcome measurement system within a mental health service.

The mental health Risk Assessment and Management Process (RAMP) for schools: II. Process evaluation

The Risk Assessment and Management Process (RAMP) is a whole-school process for the assessment and management of student’s mental health and wellbeing in primary and secondary schools. A process evaluation revealed that RAMP was implemented as intended across six primary and three secondary schools in Melbourne, Australia. Using the RAMP risk and protective factors monitoring form and screening processes, each school identified ‘at-risk’ students who had not previously been identified or received assistance from welfare staff at the school. School staff and mental health workers from local agencies reported improvements in their knowledge of risk and protective factors, and their ability to identify at-risk students following RAMP. They also reported satisfaction in outcomes for at-risk students managed within the school using RAMP. All the primary schools and one of the
secondary schools continued to use some RAMP processes in their school up to 6 months after the initial implementation of the program.

Evaluation of a community-based mental health drug and alcohol nurse in the care of people living with HIV/AIDS

There is a growing need for advanced practice mental health and drug and alcohol nursing roles in the care of people living with HIV/AIDS; however, limited publications address these domains. This study evaluated a community-based mental health drug and alcohol nurse role caring for people living with HIV/AIDS (Mental Health D&A Nurse) in a large not-for-profit district nursing organization providing care to people living with HIV/AIDS in an Australian city. Outcomes from a client assessment and 6–8-week follow-up by the Mental Health D&A Nurse are presented as captured by the Depression Anxiety Stress Scales (DASS 21), Alcohol, Smoking and Substance Involvement Screening Test (ASSIST), Health of the Nation Outcome Scales (HONOS) and WHOQoL BREF. Mean scores and caseness were analysed, and significant differences were found on the 'impairment' and 'social problems' subscales of the HONOS. Results of semi-structured interviews with clients describe effective and supportive mental health care and health-promoting education following visits by the Mental Health D&A Nurse. These positive findings support continuing implementation of the role within this community setting and indicate that even greater benefits will ensue as the role develops further. Findings are of interest to clinicians and policy makers seeking to implement similar roles in community-based HIV/AIDS care.

Improving collaboration between private psychiatrists, the public mental health sector and general practitioners : evaluation of the Partnership Project

Objectives: We describe the evaluation of the Partnership Project, which was designed to improve linkages between public and private sector mental health services. We consider the Project's key elements: a Linkage Unit, designed to improve collaborative arrangements for consumers and promote systems-level and cultural change; and the expansion of private psychiatrists' roles to include supervision and training, case conferencing and secondary consultation. The evaluation aimed to describe the impacts and outcomes of these elements.

Method: The evaluation used de-identified data from the Linkage Unit database, the Project's billing system, and the Health Insurance Commission (HIC). It drew on consultations with key stakeholders (semistructured interviews with 36 key informants, and information from a forum attended by over 40 carers and a meeting of five public sector and three private sector psychiatrists) and a series of case studies.

Results: The Linkage Unit facilitated 224 episodes of collaborative care, many of which had positive outcomes for providers, consumers and carers. It had a significant impact at a systems level, raising consciousness about collaboration and influencing procedural changes. Thirty-two private psychiatrists consented to undertaking expanded roles, and the Project was billed $78 032 accordingly. Supervision and training were most common, involving 16 psychiatrists and accounting for approximately 80% of the total hours and cost. Commonwealth expenditure on private psychiatrists' participation in the expanded roles was not associated with a reduction in benefits paid by the HIC. Key informants were generally positive about the expanded roles.

Conclusions: The Project represented a considered, innovative approach to dealing with poor collaboration between the public mental health sector, private psychiatrists and GPs. The Linkage Unit achieved significant systems-level and cultural change, which has the potential to be sustained. Expanded roles for private psychiatrists, particularly supervision and training, may improve collaboration, and warrant further exploration in terms of costs and benefits.

Dialectical behavior therapy in community mental health settings : an evaluation

Borderline personality disorder causes extreme and enduring suffering. Dialectical Behavior Therapy is a psychological intervention that has been developed to treat the disorder. Two studies were conducted to test the effectiveness of the treatment. Results showed that borderline personality disorder can be treated effectively in the public mental health system. The portfolio presents four case studies to examine the notion that Cognitive Behavior Therapy (CBT) is efficacious in the treatment of anxiety as a comorbid condition.

Description and qualitative evaluation of Jigsaw, an integrated young persons' mental health program

Objective: The aim of this paper is to describe the establishment of an integrated young person’s mental health service and the findings of a qualitative evaluation conducted 2 years after its establishment.
Method: A qualitative evaluation of the service was undertaken using a semi-structured interview, a service satisfaction survey and partnership analysis tool.
Results: The major problems encountered in establishing the service were insufficient recognition of the cultural challenges in working together, difficulty in recruiting general practitioners, establishing a youth friendly environment and maintaining the quality of the relationship between partners.
Conclusion: Despite almost 3 years of preparation, many important aspects of change management were underestimated or inadequately attended to.

An evaluation of a mental health screening and referral pathway for community nursing care : nurses' and general practitioners' perspectives

Aims and objectives. To evaluate a feasible, best practice mental health screening and referral clinical pathway for generalist community nursing care of war veterans and war widow(er)s in Australia.
Background. War veterans commonly experience mental health difficulties and do not always receive required treatment, as can also occur for war widow(er)s. Whenever opportunity arises, such as during community nursing care, it is vital to identify mental health problems in a health promotion framework.
Design. A clinical pathway was developed by literature review and consultation and then trialled and evaluated using mixed methods – quantitative and qualitative.
Methods. Community nurses who trialled the pathway completed an evaluation survey and attended focus groups. General practitioners responded to an evaluation survey.
Results. Most nurses found the pathway clear and easy to understand but not always easy to use. They emphasised the need to establish trust and rapport with clients prior to implementing the pathway. It was sometimes difficult to ensure effective referral to general practitioners for clients who screened positive for a mental health problem. When referral was accomplished, general practitioners reported adequate and useful information was provided. Some general practitioners also commented on the difficulty of achieving effective communication between general practitioners and nurses.
Conclusions. Nurses and some general practitioners found the pathway useful for their practice. They offered several suggestions for improvement by simplifying the trialled pathway and accompanying guidelines and strategies to improve communication between nurses and general practitioners. This study adds understanding of how community nurses might productively screen for mental health difficulties.
Relevance to clinical practice. The trialled pathway, which was modified and refined following the study, is an evidence-based
resource for community nurses in Australia and similar contexts to guide practise and maximise holistic care for war veterans and war widow(er)s and possibly other client groups.

Mixed methods evaluation research for a mental health screening and referral clinical pathway

Rationale: This study is an exemplar of mixed method evaluation research for development of a clinical pathway.

Aim: To develop and evaluate an evidence-based, feasible mental health screening and referral clinical pathway for Department of Veterans’ Affairs-funded community nursing care of war veterans and war widows in the Australian context.

Methods: Mixed methods were applied to formulate and clinically evaluate an appropriate pathway. The pathway was applied at urban and rural sites for the nursing care of 97 war veteran and war widow clients. Evaluative data were collected from clients, their informal carers, community nurses, and general practitioners. Chart auditing and pre-post measures were undertaken. Collaboration occurred with an interdisciplinary design team.

Results: The final modified six-page pathway includes use of validated screening tools (Kessler Psychological Distress Scale [K10]) and Alcohol Use Disorder Identification Test, appropriate referral information, directions for support and health-promoting education, and evidence-based guidelines. Implications for Practice: The clinical pathway is a useful, tested, evidence-based guide for generalist community nurses to identify and suitably respond to common mental healthcare needs of war veterans and war widows. The pathway provides outcomes acceptable to clients and their carers, nurses and doctors.

Conclusions: This study provides an evaluated clinical pathway for generalist community nurses to screen for mental health difficulties, make appropriate referrals as required and to support war veteran and war widow clients. However, the study also shows how research can be used to develop and evaluate
practical, evidence-based clinical pathways.