It's all a bit wishy washy : the challenge of building partnerships for effective mental health evaluation

Mental wellbeing and social connectedness is a key health priority in Victoria. Actions and interventions that may contribute to the promotion of community level mental wellbeing and social connectedness often occurs in other, non-health sectors. Including evidence from these sectors in evaluations of community based interventions around mental wellbeing and social connectedness is important to ensure comprehensive evaluation, and the development of best practice in this health priority area. However, published evaluation material of community based interventions around this health topic is limited, and rarely captures information from non-health sectors. This pilot study investigated the capacity of health promotion practitioners and other key stakeholders working in this area in Victoria to undertake evaluation of community based mental wellbeing and social connectedness interventions, issues and barriers faced in evaluation, and practitioners’ needs to be able to conduct effective and comprehensive evaluations.

Qualitative methods including semi-structure interviews and document analysis were used. Data was coded and analysed inductively, and key themes developed.

Results indicate that evaluating such interventions is challenging for practitioners due to the broad nature of the topic, and the measurement tools available. Many practitioners would like to conduct more comprehensive evaluation and include evidence from other sectors. Managerial and organizational support to develop partnerships both within the health sector and inter-sectorally was identified as a need in order to develop evaluation skills and facilitate more comprehensive evidence gathering.

This study underscores the importance of inter-sectoral partnerships for developing best evidence-based practice in community health. Partnerships are necessary for conducting comprehensive and effective evaluation to contribute to the evidence base. However, developing effective partnerships is challenging, and acts as a barrier to effective evaluation in a key health area for some community health practitioners. The findings also highlight an agenda for more action by managers to facilitate the development of relevant inter-sectoral partnerships.

Training in Mental Health: Evaluation of the Telephone Conference Network

The Telephone Conference Network, sponsored by The Pennsylvania State University's Coordinating Council for Health Care, is designed as a cost-effective format for providing inservice training in geriatric mental health for individuals who serve the elderly. Institutions which subscribe to the Telephone Conference Network are equipped with a conference speaker and telephone hook-up providing a two-way line of communication, and may choose from a variety of inservice programs. Mailed evaluations were completed by participants (N=73) in the "Skills to Manage Moods" program, a series of four 1-hour sessions designed to teach participants the skills needed to help patients cope with depression and to deliver the program to others. The majority of respondents reported high levels of satisfaction with the Telephone Conference Network system and the specific program in which they participated. Although 85 percent reported that they would be able to use the skills learned in the program on the job, 50 percent reported that they would not be interested in teaching these skills to others. The convenience and efficiency of the Telephone Conference Network were the most frequently mentioned strengths of the system, while the physical facilities and the program delivery format adopted by the individual institutions were the most frequently mentioned weaknesses. These data suggested several recommendations for Network subscribers and for professionals offering telephone conference programs, including ensuring optimal class enrollment and adequate physical facilities, and participant involvement in program implementation.

The relationship between parents' and their adolescent children's mental health and mental illness

Depression and anxiety disorders are high-prevalence disorders with a significant impact globally and high social and economic costs. Promotion of mental health and the prevention of depression and anxiety disorders are key health priorities internationally. It is now understood that mental health and mental illness are not two ends of one spectrum but two separate, related spectrums. The relationship between mental illness in parents and the development of mental illness in their children has been well documented however this relationship has not yet been examined from a mental health perspective. A number of mental health protective factors (also known as flourishing factors) have been shown to have a preventative effect on the development of depression and anxiety disorders, however whether parents’ mental health protective factors may have any effect on children’s depression and anxiety disorder outcomes remains unknown.

Identification of mental illness in police cells: a comparison of police processes, the brief jail mental health screen and the jail screening assessment tool

The study investigated current police practices employed to identify those with a mental illness in police custody, and to evaluate the predictive utility of the Brief Jail Mental Health Screen (BJMHS) and the Jail Screening Assessment Tool (JSAT). One hundred and fifty detainees were recruited from two police stations in Melbourne, Australia. Measures included the Structured Clinical Interview for DSM-IV-TR, BJMHS and JSAT. Axis-I disorders were compared with police decisions regarding identification of mental illness based on their usual practices. Participants were classified as requiring referral for further mental health evaluation according to the screening tools. Results indicated that current police practices produced high false negatives, with many of those experiencing mental illness not identified. There was no significant difference in performance between BJMHS (AUC =0.722) and JSAT (AUC =0.779) in identifying those with a serious mental illness (p=0.109). However, JSAT performed significantly better at identifying any Axis-I disorder, excluding substance use disorders, as compared with BJMHS (AUC =0.815, vs AUC =0.729; p=0.018). Given the high prevalence of mental illness among detainees, there is a pressing need to introduce standardised screening tools for mental illness in police custody. This can assist the police in managing detainees appropriately and securing mental health services as required.

An examination of the consistency of investigative interviewers' performance

Three original studies were conducted to examine the consistency of investigative-interviewer performance across similar and distinct interview tasks. Overall, the degree of consistency depended on numerous factors, including the nature of the event and interview paradigm, the precision of the assessment measure and whether group versus individual stability was measured. The portfolio highlights and discusses some of the complexities that can arise when conducting a parenting capacity assessment with a patient who has, or is suspected of having, an intellectual disability. Four case studies are presented.

"It broke our hearts": Understanding parents' lived experiences of their child's admission to an acute mental health care facility

This article reports the evaluative findings of an Early Psychosis Education Program (EPEP) designed to support parents caring for their child who was recently admitted to the psychiatric intensive care unit of an inpatient mental health care facility in Australia. The EPEP offered education on mental illness, treatment options, and medication, as well as information on the recovery model of care. The EPEP was facilitated by two RNs and was evaluated for educational effectiveness using a simple pre- and postevaluation questionnaire. The evaluation revealed two themes expressed by parents: "We didn't see it coming," and "Hopelessness and helplessness." The themes highlighted the parents' lack of mental health care knowledge prior to the EPEP, which had a significant impact on the parents' experiences and well-being. The evaluative findings highlighted a need for a nurse-led EPEP within the community. A community EPEP has the potential to strengthen the partnership between parents, families, and mental health service providers and to help with the provision of a recovery framework of care.

Evaluation of outcome in child and adolescent mental health services: children with persistent conduct problems

This article focuses on the evaluation of outcome in child and adolescent mental health services. We examined the outcomes of 46 children with persistent conduct problems by gathering at baseline and six months information from multiple informants on multiple domains including the functioning of the child, risk factors, and parents’ and children’s perceptions of the treatment process. A statistically significant reduction in oppositional/conduct symptoms was reported six months after the initial clinical contact. However, the majority of the group still scored within the clinical range. The various outcome measures are correlated to only a mild to moderate degree. Teachers did not notice the same degree of change at school, despite the changes noticed by parents. Symptom improvement and satisfaction with a service are two separate issues. Parents’ satisfaction was related to their perception of the therapist and the therapy offered. Their satisfaction was high if they perceived that the therapist was able to communicate well, show care and concern, and if the therapy was perceived as organized. Much can be learned from a comprehensive outcome measurement system within a mental health service.

Championing the interface between mental health and child protection: evaluation of a service initiative to improve joint working in Northern Ireland

The importance of establishing effective interagency working between adult mental health services and child care services in order to safeguard children has been repeatedly identified by research, policy, inquiries and inspection reports. This article reports on the evaluation of an initiative in one Health and Social Care Trust in Northern Ireland that aimed to facilitate joint working and so improve service provision and protection for children and families. The Champions Initiative involved identifying a champion in each multi-disciplinary community mental health team and in each family and child care team who would have responsibility for providing information, promoting joint working and identifying any obstacles to better co-operation. The evaluation of this initiative assessed levels of experience, training, confidence, understanding and awareness in the Champions and their team members at baseline. The Champions and their Team Leaders were then followed-up after six months to obtain their qualitative views of the impact of the initiative. The results include comparisons between mental health and child care staff, and crucially, views about whether the initiative has had any impact on working together. This study also generated recommendations for further service development in this complex and important area of practice.

Regress? React? Resolve?: An evaluation of mental health service provision in Northern Ireland

Report prepared for Action Mental Health by Queen’s University Belfast