The role of economic evaluation in mental health care

Objective: A consequence of the integration of psychiatry into acute and public health medicine is that psychiatrists are being asked to evaluate their services. There is pressure on mental health-care systems because it is recognized that funds should be directed where they can provide the best health outcomes, and also because there are resource constraints which limit our capacity to meet all demands for health care. This pressure can be responded to by evaluation which demonstrates the effectiveness and efficiency of psychiatric treatment. This paper seeks to remind psychiatrists of the fundamental principles of economic evaluation in the hope that these will enable psychiatrists to understand the methods used in evaluation and to work comfortably with evaluators. Method: The paper reviews the basic principles behind economic evaluation, illustrating these with reference to case studies. It describes: (i) the cost of the burden of illness and treatment, and how these costs are measured; (ii) the measurement of treatment outcomes, both as changes in health status and as resources saved; and (iii) the various types of economic evaluation, including cost-minimization, cost-effectiveness, cost-utility and cost-benefit analysis. Results: The advice in the paper provides psychiatrists with the necessary background to work closely with evaluators. A checklist of the critical questions to be addressed is provided as a guide for those undertaking economic evaluations. Conclusions: If psychiatrists are willing to learn the basic principles of economic evaluation and to apply these, they can respond to the challenges of evaluation.

Prospective memory rehabilitation for adults with traumatic brain injury: A compensatory training programme

Primary objective: To describe a prospective memory rehabilitation programme based on a compensatory training approach and report the results of three case studies. Research design: Programme evaluation using pre-and post-intervention assessments and telephone follow-up. Methods and procedures: Three participants with traumatic brain injury completed 8 weeks of training with 1 - 2 hour individual sessions. Assessments were formal prospective memory assessment, self-report and measures of diary use. Experimental interventions: Intervention aimed to identify potential barriers, establish self-awareness of memory deficits, introduce a customized compensatory tool, a cueing system and organizational strategies. A significant other was involved in training to assist generalization. Main outcomes and results: All three participants improved on formal prospective memory assessment and demonstrated successful diary use after the programme. Self-report of prospective memory failure fluctuated and may reflect increased self-awareness. Conclusion: A compensatory approach may be useful in improving prospective memory performance following TBI.

Assessing the effectiveness of a mammography screening service

Background: Trials have shown that mammography screening reduces mortality and probably decreases morbidity related to breast cancer. Methods: We assessed whether the major mammography service in Western Australia (BreastScreen WA) is likely to reduce mortality by comparing prognostic variables between screen-detected and other cases of breast cancer diagnosed in 1999. We assessed likely reductions in morbidity by comparing treatments received by these two groups. To confirm mortality and morbidity reduction, we also compared prognostic variables and treatments with targets. Information on demographic variables, tumour characteristics at presentation and treatments were collected from medical records for all incident cases of breast cancer in Western Australia in 1999. We matched cases with the Western Australian Cancer Registry records to determine which cases had been detected by BreastScreen WA. Results: BreastScreen WA achieved the targets for mortality reduction. Tumours detected by BreastScreen WA were smaller in size, less likely to have vascular invasion, of lower histological grade and were more likely to be ductal carcinoma in situ alone without invasive carcinoma. Oestrogen receptor status was more likely to be positive, the difference in progesterone status was not significant, and lymph node involvement tended to be lower. BreastScreen WA patients were treated more often with local therapy and less often with systemic therapy, and the proportion of patients treated with breast-conserving surgery was close to the target for minimizing morbidity in breast cancer. Conclusion: Mammographic detection of breast cancer by BreastScreen WA is associated with reduced breast cancer morbidity and a more favourable prognosis.

Community-based programmes to prevent falls in children: A systematic review

Objective: We systematically reviewed the literature to examine the evidence for the effectiveness of community-based interventions to reduce fall-related injury in children aged 0-16 years. Methods: We performed a comprehensive search of the literature using the following study selection criteria: community-based intervention study; target population was children aged 0-16 years; outcome measure was fall-related injury rates; and either a community control or historical control was used in the study design. Quality assessment and data abstraction were guided by a standardized procedure and performed independently by two authors. Results: Only six studies fitting the inclusion criteria were identified in our search and only two of these used a trial design with a contemporary community control. Neither of the high quality evaluation studies showed an effect from the intervention and while authors of the remaining studies reported effective falls prevention programmes, the pre- and post-intervention design, uncontrolled for background secular trends, makes causal inferences from these studies difficult. Conclusion: There is a paucity of research studies from which evidence regarding the effectiveness of community-based intervention programmes for the prevention of fall-related injury in children could be based.

Physical activity measurement - a primer of health promotion

As the importance of physical activity is recognised in health promotion, the task of measuring it becomes a central research and practice challenge. Measurement of physical activity is important to policy makers interested in population surveillance, as well as to practitioners interested in programme evaluation and research. This review outlines 'best practice' in physical activity measurement, and provides an inventory of established physical activity and related measures for use in health promotion programme evaluation, research and surveillance at the national and local level. [PUBLICATION ABSTRACT]

Self-awareness and psychosocial functioning following acquired brain injury: An evaluation of a group support programme

This study investigated a group support programme designed to improve self-awareness deficits and psychosocial functioning in a group of chronic patients (N = 21) with acquired brain injury (ABI). The participants were on average 8.6 years (range: 1-36 years) post-injury and were seen at the Brain Injury Association of Queensland, Australia. The assessment of participants involved two standardised measures of intellectual self-awareness with collateral reports from relatives. The present study introduced a new measure called the Self-Regulation Skills Interview (SRSI) which assessed higher levels of self awareness and self-regulation skills. Psychosocial functioning was assessed using a standardised self-report measure. At baseline the group had a relatively high level of intellectual self-awareness regarding their deficits, a low to moderate level of self-regulation skills, and significant psychosocial impairment. The participants were involved in a 16-week group programme which involved components of cognitive rehabilitation, cognitive-behavioural therapy, and social skills training. A post-intervention assessment indicated that participants had significantly improved levels of self-regulation skills and psychosocial functioning. A 6-month follow-up assessment indicated that overall, participants had maintained the gains made during the programme. The important role of self-regulation skills is emphasised as the principle factor contributing to the maintenance of the gains observed.

Considerations in the design of a mixed-method cluster evaluation of a community programme for 'at-risk' young people

This article discusses the design of a comprehensive evaluation of a community development programme for young people 'at-risk' of self-harming behaviour. It outlines considerations in the design of the evaluation and focuses on the complexities and difficulties associated with the evaluation of a community development programme. The challenge was to fulfil the needs of the funding body for a broad, outcome-focused evaluation while remaining close enough to the programme to accurately represent its activities and potential effects at a community level. Specifically, the strengths and limitations of a mixed-method evaluation plan are discussed with recommendations for future evaluation practice.

An evaluation of a suburban railway pedestrian crossing safety programme

This study evaluated a programme of educational and environmental (access prevention) interventions designed to reduce the incidence of illegal and unsafe crossing of the rail corridor at a suburban station in Auckland, New Zealand. Immediately after the programme of interventions, the proportion of those crossing the rail corridor by walking across the tracks directly rather than using the nearby overbridge had decreased substantially. Three months later, the decrease was even greater. However, the educational and environmental interventions were introduced simultaneously so that the effects of each could not be separated, nor could other unmeasured factors be ruled out. Anonymous surveys administered immediately before and 3 months after the interventions indicated that while awareness of the illegality of walking across the tracks had increased slightly, perception of risk had not changed. This suggests that the educational interventions may have had less effect than the access prevention measures. (C) 2001 Elsevier Science Ltd. All rights reserved.

Kick'n'on: The design and evaluation of a group programme for young males with psychotic disorders

Young men with psychotic disorders have persistently poorer outcomes in social functioning when interventions aimed at arresting social isolation are not implemented. Recent literature has indicated that it is important to develop rehabilitation programmes that are based on areas of needs that are identified by the participants. To assist in the design of a group programme, a qualitative (focus group) investigation of the perceptions of young males concerning male roles and identity in today’s society was conducted. The participants were six young males with psychotic disorders who had been referred to an Australian regional rehabilitation service to address poor social functioning and social isolation. Three main themes emerged from the focus groups. These were role models, concept of what is a man, and societal expectations. The findings were used to develop a group programme called Kick’n’On.

Audit and comprehensive health assessment programme in the primary healthcare of adults with intellectual disability: a pilot study

International research has demonstrated significant shortcomings in the health of adults with intellectual disability (ID). Because general practitioners (GPs) are the main providers of primary healthcare for this population, strategies to improve general practice care are an important aspect of rectifying these shortcomings. The present pilot study aimed to determine the effect of various interventions on health maintenance activities and to assess their acceptability to GPs, with a view to informing larger scale studies. The GPs were recruited through an earlier questionnaire-based postal survey. The GPs identified all their adult patients with ID, then obtained consent for participation from three patients randomly selected by the investigators. The GPs completed two self-evaluation forms and case note audits 12 months apart, read a synopsis of the relevant literature provided by the researchers, and completed a comprehensive health assessment (CHA) of their three patients. Forty-five GPs agreed to participate in the CHA programme (CHAP), and 15 completed the project. Thirty-eight patients completed the project. The number of patient-GP dyads who completed the project was too small to demonstrate statistically significant changes in health issues over time. The GPs found that the synopsis of the literature was the best intervention for increasing knowledge and was also the most practical to use in general practice. The CHAP was the intervention that prompted the most action from the GP which would not have been undertaken otherwise. The CHAP appeared to provide a superior review process compared to the other interventions used in the present study. The numbers of health maintenance activities found to be overdue and the number of health issues detected as a result of the process were considerable. The CHAP served as a communication tool and an educative instrument, providing a basis for future studies and strategies to improve the general practice care of adults with ID.

Acceptability and feasibility of a community-based screening programme for melanoma in Australia

The evaluation of a community-based screening programme for melanoma (SkinWatch) in 18 regional communities (total adult population >30 years 63 035) in Queensland, Australia is described. The aim of the SkinWatch programme was to promote whole-body skin screening for melanoma by primary care physicians. The programme included community education, education and support for local medical practitioners and open-access skin screening clinics. Programme delivery was achieved through assistance of local volunteers. All programme activities and resources were recorded for process evaluation. A baseline telephone survey (n = 3110) and a telephone survey four months after programme launch (n = 680) assessed community awareness of the SkinWatch programme and, 37 face-to-face interviews with community members, doctors and community leaders were conducted to assess satisfaction with the programme. A sample of 1043 of 16 383 residents who attended the skin screening clinics provided as part of the programme were interviewed to assess reasons for attending, and positive and negative aspects of SkinWatch programme. Community awareness of the SkinWatch programme increased by over 30% (p < 0.001) within four months of the start of the programme. Interview participants described the SkinWatch programme as a useful service for the communities and 90% stated they would revisit the clinics. A total of 43% of all attendees were over 50 years old, and nearly 50% were men. These findings demonstrate the acceptability and feasibility of a community-based screening programme for melanoma in rural areas. Volunteers were instrumental in increasing community ownership of and involvement in the SkinWatch programme.