Assessing cost-effectiveness - Mental health: introduction to the study and methods

Objective: The Assessing Cost-Effectiveness - Mental Health (ACE-MH) study aims to assess from a health sector perspective, whether there are options for change that could improve the effectiveness and efficiency of Australia's current mental health services by directing available resources toward 'best practice' cost-effective services. Method: The use of standardized evaluation methods addresses the reservations expressed by many economists about the simplistic use of League Tables based on economic studies confounded by differences in methods, context and setting. The cost-effectiveness ratio for each intervention is calculated using economic and epidemiological data. This includes systematic reviews and randomised controlled trials for efficacy, the Australian Surveys of Mental Health and Wellbeing for current practice and a combination of trials and longitudinal studies for adherence. The cost-effectiveness ratios are presented as cost (A$) per disability-adjusted life year (DALY) saved with a 95% uncertainty interval based on Monte Carlo simulation modelling. An assessment of interventions on 'second filter' criteria ('equity', 'strength of evidence', 'feasibility' and 'acceptability to stakeholders') allows broader concepts of 'benefit' to be taken into account, as well as factors that might influence policy judgements in addition to cost-effectiveness ratios. Conclusions: The main limitation of the study is in the translation of the effect size from trials into a change in the DALY disability weight, which required the use of newly developed methods. While comparisons within disorders are valid, comparisons across disorders should be made with caution. A series of articles is planned to present the results.

The role of economic evaluation in mental health care

Objective: A consequence of the integration of psychiatry into acute and public health medicine is that psychiatrists are being asked to evaluate their services. There is pressure on mental health-care systems because it is recognized that funds should be directed where they can provide the best health outcomes, and also because there are resource constraints which limit our capacity to meet all demands for health care. This pressure can be responded to by evaluation which demonstrates the effectiveness and efficiency of psychiatric treatment. This paper seeks to remind psychiatrists of the fundamental principles of economic evaluation in the hope that these will enable psychiatrists to understand the methods used in evaluation and to work comfortably with evaluators. Method: The paper reviews the basic principles behind economic evaluation, illustrating these with reference to case studies. It describes: (i) the cost of the burden of illness and treatment, and how these costs are measured; (ii) the measurement of treatment outcomes, both as changes in health status and as resources saved; and (iii) the various types of economic evaluation, including cost-minimization, cost-effectiveness, cost-utility and cost-benefit analysis. Results: The advice in the paper provides psychiatrists with the necessary background to work closely with evaluators. A checklist of the critical questions to be addressed is provided as a guide for those undertaking economic evaluations. Conclusions: If psychiatrists are willing to learn the basic principles of economic evaluation and to apply these, they can respond to the challenges of evaluation.

The effects of normalisation on the ability of business end-users to detect data anomalies: An experimental evaluation

With the proliferation of relational database programs for PC's and other platforms, many business end-users are creating, maintaining, and querying their own databases. More importantly, business end-users use the output of these queries as the basis for operational, tactical, and strategic decisions. Inaccurate data reduce the expected quality of these decisions. Implementing various input validation controls, including higher levels of normalisation, can reduce the number of data anomalies entering the databases. Even in well-maintained databases, however, data anomalies will still accumulate. To improve the quality of data, databases can be queried periodically to locate and correct anomalies. This paper reports the results of two experiments that investigated the effects of different data structures on business end-users' abilities to detect data anomalies in a relational database. The results demonstrate that both unnormalised and higher levels of normalisation lower the effectiveness and efficiency of queries relative to the first normal form. First normal form databases appear to provide the most effective and efficient data structure for business end-users formulating queries to detect data anomalies.

Social-cognitive and perceived environment influences associated with physical activity in older Australians

Background, Regular physical activity in older adults can facilitate healthy aging, improve functional capacity, and prevent disease. However, factors associated with physical inactivity in older populations are poorly understood. This study attempts to identify social-cognitive and perceived environmental influences associated with physical activity participation in older populations. Methods. In a randomly selected sample of 449 Australian adults age 60 and older, we assessed self-reported physical activity and a range of social-cognitive and perceived environmental factors. Respondents were classified as sufficiently active and inactive based on energy expenditure estimates (kcal/week) derived from self-reported physical activity. Two logistic regression models, with and without self-efficacy included, were conducted to identify modifiable independent predictors of physical activity. Results. Significantly more males than females were physically active. Physical activity participation was related to age with a greater proportion of those age 65-69 being active than those age 60-64 or 70 or older. High self-efficacy, regular participation of friends and family, finding footpaths safe for walking, and access to local facilities were significantly associated with being active. Conclusion. Identifying predictors of physical activity in older populations, particularly social support, facility access, and neighbourhood safety, can inform the development of policy and intervention strategies to promote the health of older people. (C) 2000 American Health Foundation and Academic Press.

Performance measurement in child protection

The increasing use of performance measurement by government means that child protection services are under pressure to demonstrate effectiveness in protecting children from harm and efficiency in the use of public funds to help children and families. From a policy perspective, the way performance measurement is conceptualised and implemented can have major consequences for service delivery. This paper examines key issues raised in the literature about performance measurement, the context for its introduction in child protection, how the concepts of effectiveness and efficiency are dealt with, how client outcomes are defined, and assumptions about 'good performance'. An overview of performance measurement in child protection in Australia is provided. The paper argues that a critical approach to performance measurement in child protection can contribute to improved service delivery to clients.

Applications of motion study in developmental disabilities: A review

Motion study is an engineering technology that analyzes human body motions. During the past decade (1990-1999) a series of studies investigated the role of motion study in developmental disabilities. This article reviews the literature on the applications of motion study in the field. A historical and conceptual review of motion study leading to the current status of studies is presented followed by a review of the research literature. Two main eras of research focus were identified. The first era (1990-1995) of studies established the superior effectiveness and efficiency of tasks designed with motion study or motion study-related principles over traditional site-based task designs. The second era (1995-1999) of studies examined the interaction between motion study-based task designs and other variables such as choice, preference, and functionally equivalent and competing task designs and communicative alternatives. Our review found that applying motion study principles as an antecedent guide and practice to eliminating or reducing ineffective motions and simplifying effective motions resulted in positive task outcomes with most of the participants.

A core vocabulary approach for management of inconsistent speech disorder

Developmental speech disorder is accounted for by theories derived from psychology, psycholinguistics, linguistics and medicine, with researchers developing assessment protocols that reflect their theoretical perspective. How theory and data analyses lead to different therapy approaches, however, is sometimes unclear. Here, we present a case management plan for a 7 year old boy with unintelligible speech. Assessment data were analysed to address seven case management questions regarding need for intervention, service delivery, differential diagnosis, intervention goals, generalization of therapeutic gains, discharge criteria and evaluation of efficacy. Jarrod was diagnosed as having inconsistent speech disorder that required intervention. He pronounced 88% of words differently when asked to name each word in the 25 word inconsistency test of the Diagnostic Evaluation of Articulation and Phonology three times, each trial separated by another activity. Other standardized assessments supported the diagnosis of inconsistent speech disorder that, according to previous research, is associated with a deficit in phonological assembly. Core vocabulary intervention was chosen as the most appropriate therapy technique. Its nature and a possible protocol for implementation is described.

The role of gender in the construction and evaluation of feedback effectiveness

This study investigated factors that influence managers’ conceptions and subordinates’ perceptions of effective feedback. A social rules perspective was used to operationalize male and female managers’ conceptions of effective negative feedback. In the first study, 68 male and female managers identified their optimal strategies for providing feedback to subordinates. Male and female managers endorsed different goals and tactics for giving negative feedback, particularly in terms of levels of participation and directness. In the second study, 116 male and female subordinates evaluated the comparative effectiveness and difficulty of these and other standard approaches to feedback. The female manager strategy was evaluated by both men and women as generally more task and relationship effective but not more difficult to enact.

Efficacy of praziquantel against Schistosoma japonicum: field evaluation in an area with repeated chemotherapy compared with a newly identified endemic focus in Hunan, China

This study conducted in 1999/2000 was designed to evaluate the efficacy of praziquantel against Schistosoma japonicum in an area with repeated chemotherapy (Area A) compared with a newly identified endemic focus (Area B) in Hunan Province, China. The population size was 2015 and 2180 in Areas A and B, respectively, of which 1129 and 1298 subjects received stool examination. A total of 230 subjects were identified by the Kato-Katz technique (4 smears per person) as being infected with S. japonicum, 124 in Area A (prevalence 11 %) and 106 in Area B (prevalence 8.2%). They were treated with a single oral dose of praziquantel (40 mg/kg) in the non-transmission season. A follow-up stool examination was made 50 days after treatment. Among the 220 cases followed, 22 were found stool-egg-positive, with an overall cure rate of 90 %, and 99 % reduction of infection intensity (eggs per gram stool). No significant difference was found in cure rates between the 2 areas (89.7% vs 90.3%). The efficacy of the drug in the area with repeated chemotherapy was not significantly different from that in the newly identified endemic focus. This study, therefore, suggests that the efficacy of praziquantel against S. japonicum has not changed in the Dongting Lake region after more than 14 years of mass chemotherapy, and there is no evidence of tolerance or resistance of S. japonicum against praziquantel.

ReoPro rules: results from the 'DoTirofiban and ReoPro give similar efficacy trial' (TARGET) - A Key Paper Evaluation (Topol, Ej et al)

In the treatment of atherosclerotic disease, stenting in the presence of a glycoprotein (GP) IIb/IIIa antagonist is becoming an increasingly common procedure. The ‘Do Tirofiban and ReoPro Give Similar Efficacy Trial’ (TARGET) was designed to determine whether the cheaper tirofiban was as effective and safe as abciximab in the prevention of ischaemic events with stenting. Unexpectedly, abciximab was shown to be superior to tirofiban. Tirofiban is a selective GP IIb/IIIa antagonist whereas abciximab has additional anti-inflammatory actions, which may contribute to its superiority.

The effectiveness of parent management training to increase self-efficacy in parents of children with Asperger syndrome

This study was a trial of an intervention programme aimed to improve parental self-efficacy in the management of problem behaviours associated with Asperger syndrome. The intervention was compared across two formats, a I day workshop and six individual sessions, and also with a non-intervention control group. The results indicated that, compared with the control group, parents in both intervention groups reported fewer problem behaviours and increased self-efficacy following the interventions, at both 4 weeks and 3 months follow-up. The results also showed a difference in self-efficacy between mothers and fathers, with mothers reporting a significantly greater increase in self-efficacy following intervention than fathers. There was no significant difference between the workshop format and the individual sessions.

General practitioner attitudes to case conferences: how can we increase participation and effectiveness?

Objectives: To identify general practitioners' views on the barriers to using case conferencing (as outlined in the Medical Benefits Schedule (MBS) Enhanced Primary Care package) and to develop a set of principles to encourage greater GP participation in case conferences. Design: Qualitative study, involving semistructured questions administered to focus groups of GPs, conducted between April and July 2001 as part of a broader study of case coordination in palliative care. Participants: 29 GPs from urban, regional, and rural areas of Queensland. Principal findings: Many of the GPs' work practices militated against participation in traditionally structured case conferences. GPs thought the range of MBS item numbers should be expanded to cover alternative methods of liaison (eg, phone consultations with other service providers). The onerous bureaucratic processes required to claim reimbursement were an additional disincentive. Conclusions: GPs would probably be more likely to participate in case conferences if they were initiated by specialist services and arranged more flexibly to suit GP work schedules.

Short report: Molecular evaluation of the efficacy of chloroquine treatment of uncomplicated Plasmodium falciparum malaria in East Timor

The efficacy of chloroquine treatment of uncomplicated Plasmodium falciparum malaria in East Timor was investigated via molecular tools. Genotyping of the polymorphic markers msp1 and msp2 was performed to investigate the number and type of parasite alleles in pre- and posttreatment blood samples collected from 48 patients. Patients were infected with a minimum of 8 msp1 and 14 msp2 allelic types of parasite, and 43% of the patients had more than one allelic type before treatment. The genotyping also revealed that 66.7% of the patients were infected with at least one identical allelic type of parasite before and after treatment and therefore were likely to have experienced recrudescence. All parasites in pre- and posttreatment blood samples carried the K76T mutation in pfcrt, regardless of the clinical response to chloroquine. The sequence polymorphism patterns in pfcrt in the majority of parasites examined were identical to those observed in Bougainville, Papua New Guinea.

An evaluation of a family psychoeducation program in community mental health

The aim of the research project was to identify the efficacy of the family psychoeducation program as a strategy for reducing the hospital admissions of young people. It also aimed to determine if the family psychoeducation program had an impact on the experience of caregiving and knowledge and satisfaction of services provided by the mental health service. A retrospective chart audit compared readmission history of 27 clients whose families attended a psychoeducation program with readmission history of a matched group of young people whose families did not attend the program. A telephone survey was conducted for both groups of families to investigate knowledge and understanding of services and burden of care. The results indicated that family participation in a brief multiple family psychoeducation program did not reduce the number or duration of admissions of the young people. There was no impact on the level of care for families who attended the psychoeducation program, however, this group showed some evidence of increased knowledge and understanding of services as compared to the control group.

The effectiveness of personalized smoking cessation strategies for callers to a Quitline service

Aim To assess the effectiveness of a program of computer-generated tailored advice for callers to a telephone helpline, and to assess whether it enhanced a series of callback telephone counselling sessions in aiding smoking cessation. Design Randomized controlled trial comparing: (1) untailored self-help materials; (2) computer-generated tailored advice only, and (3) computer-generated tailored advice plus callback telephone counselling. Assessment surveys were conducted at baseline, 3, 6 and 12 months. Setting Victoria, Australia. Participants A total of 1578 smokers who called the Quitline service and agreed to participate. Measurements Smoking status at follow-up; duration of cessation, if quit; use of nicotine replacement therapy; and extent of participation in the callback service. Findings At the 3-month follow-up, significantly more (chi(2)(2) = 16.9; P < 0.001) participants in the computer-generated tailored advice plus telephone counselling condition were not smoking (21%) than in either the computer-generated advice only (12%) or the control condition (12%). Proportions reporting not smoking at the 12-month follow-up were 26%, 23% and 22%, respectively (NS) for point prevalence, and for 9 months sustained abstinence; 8.2, 6.0, and 5.0 (NS). In the telephone counselling group, those receiving callbacks were more likely than those who did not to have sustained abstinence at 12 months (10.2 compared with 4.0, P < 0.05). Logistic regression on 3-month data showed significant independent effects on cessation of telephone counselling and use of NRT, but not of computer-generated tailored advice. Conclusion Computer-generated tailored advice did not enhance telephone counselling, nor have any independent effect on cessation. This may be due to poor timing of the computer-generated tailored advice and poor integration of the two modes of advice.