Practical application of the Delphi technique in a bicultural mental health nursing study in New Zealand

Background. Numerous studies have employed the Delphi technique to seek expert opinion about aspects of clinical practice. When researching literature on the Delphi technique, however, we discovered discrepancies in its application, and a lack of detail when reporting design, administration, and analysis methods. Such lack of specificity hinders the replicability and assessment of the clinical and cultural validity and reliability of Delphi studies.

Aim. The aim of this paper is to detail the practical application of the Delphi technique as a culturally and clinically valid means of accessing expert opinion on the importance of clinical criteria.

Methods. Reference is made to a bicultural New Zealand mental health nursing clinical indicator study that employed a three-round reactive Delphi survey. Equal proportions of Maori and non-Maori nurses (n = 20) and consumers (n = 10) rated the importance of 91 clinical indicator statements for the achievement of professional practice standards. Additional statements (n = 21) suggested by Delphi participants in round 1 were included in subsequent rounds. In round 2, participants explained the rating they applied to statements that had not reached consensus in round 1, and summarized responses were provided to participants in round 3. Consensus was considered to have been achieved if 85% of round 3 ratings lay within a 2-point bracket on the 5-point Likert-scale overall, or in one of the Maori nurse, non-Maori nurse, or consumer groups. A mean rating of 4·5 after round 3 was set as the importance threshold.

Findings. Consensus occurred overall on 75 statements, and within groups on another 24. Most statements (n = 86) reached the importance benchmark.

Conclusions. When rigorous methods of participant selection, group composition, participant feedback, and determination of consensus and importance are employed, the Delphi technique is a reliable, cost-effective means of obtaining and prioritizing experts judgements.

Development of a professional practice audit questionnaire for mental health nursing in Aotearoa/New Zealand

This paper reports the three-stage development of a professional practice audit questionnaire for mental health nursing in Aotearoa/New Zealand. In Study 1, clinical indicator statements (n = 99) generated from focus group data, which were considered to be unobservable in the nursing documentation in consumer case notes, were included in a three-round Delphi process. Consensus of ratings occurred for the mental health nurse and academic participants (n = 7) on 83 clinical indicator statements. In Study 2, the clinical indicator statements (n = 67) that met importance and consensus criteria were incorporated into a questionnaire, which was piloted at a New Zealand mental health service. The questionnaire was then modified for use in a national field study. In Study 3, the national field study, registered mental health nurses (n = 422) from 11 New Zealand District Health Board mental health services completed the questionnaire. Five categories of nursing practice were identified: professional and evidence-based practice; consumer focus and reflective practice; professional development and integration; ethically and legally safe practice; and culturally safe practice. Analyses revealed little difference in the perceptions of nurses from different backgrounds regarding the regularity of the nursing practices. Further research is needed to calibrate the scores on each clinical indicator statement with behaviour in clinical practice.

New Zealand development and trial of mental health nursing clinical indicators - a bicultural study

This paper describes the development and validation of bicultural clinical indicators that measure achievement of mental health nursing practice standards in New Zealand (ANZMCHN, 1995, Standards of practice for mental health nursing in New Zealand. ANZCMHN, Greenacres). A four-stage research design was utilised including focus groups, Delphi surveys, a pilot, and a national field study, with mental health nurses and consumers as participants. During the national field study, consumer files (n=327) from 11 District Health Boards, and registered nurses (n=422) completed an attitude questionnaire regarding the regularity of specific nursing and service activities. Results revealed a variation in the mean occurrence of the clinical indicators in consumer case notes of 18.5–89.9%. Five factors with good internal consistency, encompassing domains of mental health nursing required for best practice, were derived from analysis of the questionnaire. This study presents a research framework for developing culturally and clinically valid, reliable measures of clinical practice.

The impact of workload on wellbeing, mental health and depression : a longitudinal study of work perception

This paper explores the relationships between characteristics of the job (workload, control and support) and organizational justice (distributive, procedural, interpersonal and informational) at Time 1, onto three indicators of psychological health at Time 2 (psychological wellbeing, distress and depression). The sample consisted of sworn members of a state-based police force (n=143). Hierarchical regression analyses indicated that workload was associated with psychological wellbeing, distress and depression at the one-year follow-up. Specifically, high workload at Time 1 was associated with psychological distress and depression at Time 2, and low workload was associated with psychological wellbeing at Time 2. Further, there was a significant relationship between perceived informational justice at Time 1 and psychological wellbeing at Time 2. No significant interaction effects were demonstrated for the job characteristics or organizational justice onto psychological health status. That is, longitudinally, workload directly influences both positive and negative mental health, and informational justice is related to psychological wellbeing. The implications for the demand-control-support model are discussed. The injustice-as-stressor argument was generally not supported.

Evaluation of a community-based mental health drug and alcohol nurse in the care of people living with HIV/AIDS

There is a growing need for advanced practice mental health and drug and alcohol nursing roles in the care of people living with HIV/AIDS; however, limited publications address these domains. This study evaluated a community-based mental health drug and alcohol nurse role caring for people living with HIV/AIDS (Mental Health D&A Nurse) in a large not-for-profit district nursing organization providing care to people living with HIV/AIDS in an Australian city. Outcomes from a client assessment and 6–8-week follow-up by the Mental Health D&A Nurse are presented as captured by the Depression Anxiety Stress Scales (DASS 21), Alcohol, Smoking and Substance Involvement Screening Test (ASSIST), Health of the Nation Outcome Scales (HONOS) and WHOQoL BREF. Mean scores and caseness were analysed, and significant differences were found on the 'impairment' and 'social problems' subscales of the HONOS. Results of semi-structured interviews with clients describe effective and supportive mental health care and health-promoting education following visits by the Mental Health D&A Nurse. These positive findings support continuing implementation of the role within this community setting and indicate that even greater benefits will ensue as the role develops further. Findings are of interest to clinicians and policy makers seeking to implement similar roles in community-based HIV/AIDS care.

Factors associated with dropout and diagnosis in child and adolescent mental health services

Objective: Dropout from child and adolescent mental health services has ramifications for children, families and the services themselves. Understanding the factors that are associated with dropout for different diagnoses has the potential to assist with tailoring of services to reduce dropout. The aim of the current study was to identify such factors.

Method: A file audit was conducted for all referrals to a child and adolescent mental health service over a 12 month period, yielding 520 subjects for analysis (264 male, 256 female, mean age = 12.6 years). Parent, child and service variables of interest were recorded as were diagnoses, which were categorized into 25 superordinate categories.

Results: Almost 50% of subjects dropped out of treatment. Factors associated with dropout varied across diagnosis, and no factor was associated with dropout for all diagnoses.

Conclusion: There are differences in the factors that were associated with dropout for different disorders. This is a useful finding in terms of understanding and preventing dropout in child and adolescent mental health settings, but more research is needed.

The validation of an Australian sign language instrument for outcome measurement of adults in mental health settings

Objective: There are currently no adult mental health outcome measures that have been translated into Australian sign language (Auslan). Without a valid and reliable Auslan outcome measure, empirical research into the efficacy of mental health interventions for sign language users is unattainable. To address this research problem the Outcome Rating Scale (ORS), a measure of general functioning, was translated into Auslan and recorded on to digital video disk for use in clinical settings. The purpose of the present study was therefore to examine the reliability, validity and acceptability of an Auslan version of the ORS (ORS-Auslan).
Method: The ORS-Auslan was administered to 44 deaf people who use Auslan as their first language and who identify as members of a deaf community (termed ‘Deaf’ people) on their first presentation to a mental health or counselling facility and to 55 Deaf people in the general community. The community sample also completed an Auslan version of the Depression Anxiety Stress Scale-21 (DASS-21).
Results: t-Tests indicated significant differences between the mean scores for the clinical and community sample. Internal consistency was acceptable given the low number of items in the ORS-Auslan. Construct validity was established by significant correlations between total scores on the DASS-21-Auslan and ORS-Auslan. Acceptability of ORS-Auslan was evident in the completion rate of 93% compared with 63% for DASS-21-Auslan.
Conclusions: This is the only Auslan outcome measure available that can be used across a wide variety of mental health and clinical settings. The ORS-Auslan provides mental health clinicians with a reliable and valid, brief measure of general functioning that can significantly distinguish between clinical and non-clinical presentations for members of the Deaf community.