Measuring the economic impact of falls prevention interventions

The objective of this paper is to assess the appropriateness of available health economic models and concepts in the development of a best practice model to assess community based multifactorial falls prevention programs. To this end, a critical review and synthesis of contemporary published and unpublished  methodological approaches to economic evaluation of health initiatives in general and falls prevention initiatives in particular, has been carried out. The review  indicates that costs, time and utility all need to be taken into consideration when economically evaluating a falls prevention program.

A recommended approach that takes into account a full consideration of relevant costs and benefits associated with falls prevention programs is outlined. This approach can help demonstrate the true relative efficacy of preventing falls over the treatment of their consequences.

An evaluation of a self-intiated practice exercise for investigative interviewers of children

The current study extends debate and research on the important role of practice in promoting and sustaining complex skills in investigative interviewing. Specifically, we explored the use of self-initiated practice as one avenue for facilitating ongoing development of professionals who interview children about abuse. A group of 40 investigative interviewers were required to organise and administer their own practice opportunities and to document these sessions in a diary. The professionals were aware of the important role of practice and what constitutes best-practice interview guidelines; however no instruction was given about the desired format, structure and timing of the practice sessions. A combination of quantitative and qualitative analyses revealed poor adherence to self-initiated practice, and the practice (among those who adhered to this model) had negligible impact on performance. Overall, these findings highlight the need for careful monitoring and evaluation of all interviewer practice tasks.

Evaluation of the effectiveness of marine protected areas in temperate waters of Australasia

An evaluation of the effectiveness of Marine Protected Areas (MPAs) in temperate waters of Australasia has been conducted for this thesis. The aim was to identify key elements needed in a strategy for establishment and management of MPA’s in temperate waters of Australasia. This aim was achieved by assessing how effective a sample of MPA’s has been in meeting the conservation objectives for their establishment and by identifying factors that have contributed to success or failure of the MPA’s in meeting these objectives. Particular attention was paid to the objectives of ecological sustainability and biodiversity preservation. A MPA for the purposes of this research was defined as an area of coastal or marine environment, with a substantial subtidal component, set aside by law primarily for conservation purposes. The study region encompassed the coastal zones of Victoria, Tasmania and South Australia (Australia) and New Zealand. The questions posed in order to address the aim of this thesis were; a) Have existing MPA’s been effective in achieving conservation objectives? b) What have been the important influences on effectiveness of existing MPA’s? c) What are the key elements required for implementation of effective MPA’s? The thesis is divided into three parts. Part I is a review of the literature on implementation and effectiveness of MPA’s. Part II presents a detailed evaluation of one MPA: Point Lonsdale Marine Reserve (PLMR), Victoria, Australia. Part in is an evaluation of a number of Australasian temperate MPA’s based on information provided in a survey of people involved in management of MPA’s, and from a variety of published and unpublished documents. The MPA’s are described, evidence about ecological effectiveness is presented and factors that have enhanced and limited the ability of these MPA’s to achieve conservation objectives are derived. A substantial amount of scientific evidence was found for increases in abundance, mean size and size range of fish and invertebrate populations within the boundaries of ‘no-take’ MPA’s, Some evidence was found for ‘spillover’ of adults and juveniles into adjacent fishing grounds. Ecological effects detected within ‘no-take’ MPA’s in Australasia matched those described in the literature. The abundance and mean size of a number of previously exploited species have increased, migration into adjacent fishing grounds has been documented, and species richness has increased in at least one MPA. The PLMR was established primarily to protect the scientifically significant intertidal rock platforms. The results of the case study suggest that this objective has been achieved. Opinions about effectiveness were obtained for 28 MPA’s. Of these 19 were considered to be achieving some objectives and 10 were considered to be performing well in terms of overall ecological effectiveness. Positive effects on biodiversity were generally assumed as a result of reduction of damaging anthropogenic effects on habitat. Many questionnaire respondents noted an increase in community awareness about and support for marine conservation as a result of proclamation of MPA’s, Overall, the results support the value of MPA’s for sustainability of fish stocks and preservation of biodiversity, but there is substantial doubt over whether some of the MPA’s are too small to maintain benefits in the long-term. ‘No-take’ MPA’s, particularly those more remote from the impacts of human activities, have been the most effective in achieving objectives. A number of interacting factors important to eventual success of MPA’s were identified. The most important enhancing factors identified for the PLMR were physical attributes that limit the extent of human use and a strong conservation ethic amongst many of the visitors to this marine reserve. Limiting factors were far more numerous. Of most concern is the inadequacy of at-site management. Almost half of visitors to the area were not aware of its marine reserve status, despite the fact many were frequent visitors. The need for better educational and interpretative material on-site is highlighted by the results of the PLMR visitor survey. A total of 56 factors that have enhanced effectiveness and 46 factors that have limited effectiveness of Australasian temperate MPA’s were identified. A number of factors were important in more than one MPA and this was used to derive a set of critical, or key, factors. For example, a conclusion of all three approaches used in this study is that failure to implement day-to-day management through lack of resources was a major constraint on effectiveness. The importance of MPA’s to marine conservation depends, in part, on how well they are managed. The key factors that influence MPA effectiveness were used as the basis for derivation of the main requirements for implementation of MPA’s that will be capable of meeting the objectives for their establishment. The most important needs are: • that ‘no-take’ areas surrounded by buffer zones form the basis for a system of MPA’s; • that a high level of protection is bestowed by legislation and regulations; • that a minimum size be set for the ‘no-take’ core areas; • that the selection of sites for MPA’s takes into account land-based impacts; • that institutional arrangements are developed specifically for MPA’s; • that funding for MPA’s is increased to enable effective management; • that day-to-day management is implemented in all MPA’s, with enforcement and education programs as priority areas; • that a monitoring program for one or more MPA in each 'State' is established to provide evidence of ecological effects of reservation; • that public and stakeholder involvement in development and implementation of MPA’s is encouraged as this will influence the degree of public support and compliance; • that community-based programs to educate the general public, stakeholders, the media and decision-makers about the value of MPA’s are essential; and • that measures to reduce financial impact on affected stakeholders be implemented.

Evaluation of the performance and development culture initiative 2005-2008

An evaluation of the P&D Culture initiative 2005-2008 was contracted to Deakin University in 2009. The findings from the evaluation indicated a belief that the P&D Culture initiative had a significant impact on:

* Establishing effective school policies, processes and structures
* Strengthening school culture related to continuous improvement
* Improved instructional practice
* Improved student learning
* Implementation of other DEECD initiatives.

Acceptability, impact and sustainability of the national pilot quality assurance system for self management programs

Chronic condition self-management education and training interventions such as the Stanford Self Management Programs (SMP) have the capacity to improve health and quality of life of people with chronic conditions whilst reducing the use of health services. This is in line with the outcomes from the recent Council of Australian Governments’ meeting where it was indicated that self-management will be a centrepiece in forthcoming chronic disease initiatives.
Aim: report on a large national pilot quality assurance program involving the implementation and of an evaluation and quality monitoring system for SMPs including the provision of structured feedback to courses course leaders and service providers. During 2005/06 the quality assurance program was implemented at 11 diverse organisations across Australia. The program involved assisting organisations apply the 42-item Health Education Impact Questionnaire (HEIQ), a chronic disease health education outcome measure, and then observe and evaluate the value and impact of the quality program. Interviews with course leaders (n=60) and course participants (n=35) have elicited views about course quality and feedback processes.
Results: The evaluation revealed enablers and barriers to effective implementation and sustainability. Important enablers were:
- Course Leaders and organisations valued an Australia-wide system that provided feedback on course
quality and the impact on participants.
- Course Leaders were strongly personally motivated to respond appropriately to HEI-Q course
report feedback.
- Completing the questionnaire provided participants with the opportunity to reflect on issues that
emerge in the course content and reflect on their progression at the end of the SSMP.
Sustainability issues included:
- Organisations and course leaders require support, training and flexibility on how to administer and
manage the use of the HEI-Q.
- Availability of administrative resources in organisations to support the quality assurance activities.
- The requirement that course leaders are trained in interpreting HEI-Q course report data.
A quality improvement framework was developed which identified the actions required of key stakeholders to
support effective implementation.
Discussion: With the increasing endorsement of SMP across sectors it is important that course quality is known, is acceptable, and is communicated to stakeholders to inform and engender confidence in the SSMP. To effectively implement and sustain a quality improvement program for SMP, the processes and tools for measuring outcomes need to be responsive, flexible and easily integrated into the organisation and delivery of programs.

Evaluating the impact of an environmental education programme; an empirical study in Mexico.

This study draws on information from 11 in-depth interviews, two focus groups and 72 written questionnaires to evaluate an extra-curricular environmental education programme on forestry designed for preparatory school students from a small rural community in Mexico. Specifically, the study assessed the impact of the programme on the ecological knowledge of 72 students. Qualitative feedback suggests that students learnt about forestry, acquired greater awareness of the importance of conservation for the local environment and enjoyed the participatory teaching methods used in the programme. Quantitative results show a positive and significant association between the number of times a student participated in the programme and the student’s ecological knowledge. Students who participated in the programme once had a 16.3% higher knowledge on ecological concepts and knew, on average, 1.5 more local forest plants than students who never attended it (p<.001). Findings suggest that the inclusion of participatory environmental education programmes in preparatory schools would improve the acquisition of ecological knowledge. Further research could consider the consistency of the findings by replicating participatory methods presented here and by using an experimental research design.

Improving collaboration between private psychiatrists, the public mental health sector and general practitioners : evaluation of the Partnership Project

Objectives: We describe the evaluation of the Partnership Project, which was designed to improve linkages between public and private sector mental health services. We consider the Project's key elements: a Linkage Unit, designed to improve collaborative arrangements for consumers and promote systems-level and cultural change; and the expansion of private psychiatrists' roles to include supervision and training, case conferencing and secondary consultation. The evaluation aimed to describe the impacts and outcomes of these elements.

Method: The evaluation used de-identified data from the Linkage Unit database, the Project's billing system, and the Health Insurance Commission (HIC). It drew on consultations with key stakeholders (semistructured interviews with 36 key informants, and information from a forum attended by over 40 carers and a meeting of five public sector and three private sector psychiatrists) and a series of case studies.

Results: The Linkage Unit facilitated 224 episodes of collaborative care, many of which had positive outcomes for providers, consumers and carers. It had a significant impact at a systems level, raising consciousness about collaboration and influencing procedural changes. Thirty-two private psychiatrists consented to undertaking expanded roles, and the Project was billed $78 032 accordingly. Supervision and training were most common, involving 16 psychiatrists and accounting for approximately 80% of the total hours and cost. Commonwealth expenditure on private psychiatrists' participation in the expanded roles was not associated with a reduction in benefits paid by the HIC. Key informants were generally positive about the expanded roles.

Conclusions: The Project represented a considered, innovative approach to dealing with poor collaboration between the public mental health sector, private psychiatrists and GPs. The Linkage Unit achieved significant systems-level and cultural change, which has the potential to be sustained. Expanded roles for private psychiatrists, particularly supervision and training, may improve collaboration, and warrant further exploration in terms of costs and benefits.

Evaluation of Bayesian belief networks for diagnosis of psychotic disorders

The thesis examined the inter-rater reliability and procedural validity of four computerised Bayesian belief networks (BBNs) which were developed to assist with the diagnosis of psychotic disorders. The results of this research indicated that BBNs can significantly improve diagnostic reliability and may represent an important advance over current diagnostic methods. The professional portfolio investigated, through the presentation of case studies and review of literature relevant to each case study, how comorbidity and context of depression may impact on cognitive behavioural therapy treatment.

Evaluation of three remote camera systems for detecting mammals and birds

Automated camera systems have widespread application in wildlife studies and their use is increasing (Kucera & Barrett 1993; Cutler & Swann 1999; Swann et al. 2004; Parker et al. 2008). Among other applications, they have been used to produce species inventories, estimate population sizes, study behaviour and examine the impact and activity of predators (Cutler & Swann 1999; Swann et al. 2004). Modern camera systems can operate for extended durations, are relatively non-invasive, easy to operate, portable, durable and can take good-quality images by day and night (Kucera & Barrett 1993; Peterson & Thomas 1998; Allison & Destefano 2006; Parker et al. 2008). Beyond their scientific applications, the generation of high-quality images can be useful for educational and conservation purposes (Cutler & Swann 1999). The two most common types of systems currently used in ecological research are passive and active infrared (IR) systems (Cutler & Swann 1999; Parker et al. 2008). An older form of remote photography is video which captures a continuous record of activity at a focal site (Stewart et al.1997; King et al. 2001). Camera systems have certain limitations and biases (Swann et al. 2004), yet these have not been well studied. Refinement of the use of camera systems is required to fully realize their value (Towerton et al. 2008). Here, we describe a comparison of detection rates of mammals and birds by passive and active IR camera systems, using a video system to benchmark detection rates.

Cognitive evaluation : prompts used to measure sponsorship awareness

Marketing managers have the same accountability for their spending on sponsorship as they do for their general advertising spend. Since the direct impact on customer loyalty and profit is so hard to measure, surrogate measures such as recall are often used. Key issues with recall measures are the nature and type of prompting given. This paper reports the results of an experiment on three different ways of measuring sponsorship recall based on brand, category and event prompts. Differences between the prompts are shown with some facilitating and another inhibiting recall. The results are discussed within the framework of spreading activation theory which has the potential to explain and predict recall.

Scaling up community-based obesity prevention in Australia : background and evaluation design of the health promoting communities : being active eating well initiative

Background : There is only limited evidence available on how best to prevent childhood obesity and community-based interventions hold promise, as several successful interventions have now been published. The Victorian Government has recently funded six disadvantaged communities across Victoria, Australia for three years to promote healthy eating and physical activity for children, families, and adults in a community-based participatory manner. Five of these intervention communities are situated in Primary Care Partnerships and are the subject of this paper. The interventions will comprise a mixture of capacity-building, environmental, and whole-of-community approaches with targeted and population-level interventions. The specific intervention activities will be determined locally within each community through stakeholder and community consultation. Implementation of the interventions will occur through funded positions in primary care and local government. This paper describes the design of the evaluation of the five primary care partnership-based initiatives in the 'Go for your life' Health Promoting Communities: Being Active Eating Well (HPC:BAEW) initiative.

Methods/Design : A mixed method and multi-level evaluation of the HPC:BAEW initiative will capture process, impact and outcome data and involve both local and state-wide evaluators. There will be a combined analysis across the five community intervention projects with outcomes compared to a comparison group using a cross-sectional, quasi-experimental design. The evaluation will capture process, weight status, socio-demographic, obesity-related behavioral and environmental data in intervention and comparison areas. This will be achieved using document analysis, paper-based questionnaires, interviews and direct measures of weight, height and waist circumference from participants (children, adolescents and adults).

Discussion : This study will add significant evidence on how to prevent obesity at a population level in disadvantaged and ethnically diverse communities. The outcomes will have direct influence on policy and practice and guide the development and implementation of future obesity prevention efforts in Australia and internationally.

Using a knowledge management evaluation framework for improving an ERP system - a Hong Kong construction industry case study

Organisations need to rely on leadership, information support and human capital in order to ensure a knowledge advantage over their competitors. Knowledge management (KM) provides organisations with sustainable competitive advantage, because it becomes extremely difficult for an organisation to cut expenditure and increase revenue by simply reengineering its business model. Project delivery and success has been traditionally viewed and measured as management of a three-legged stool, with the legs defined as cost, schedule and quality. However, KM can be linked to success by organisations becoming more effective as well as being more efficient.

This paper uses a KM framework, the Knowledge Advantage (K-Adv), developed initially for use by construction organisations. It assesses the impact of leadership and its supporting information communication technology infrastructure on the ability of people (by effectively creating, sharing, disseminating and using knowledge) to facilitate sustainable competitive advantage.

A case study that is presented is based upon the experience of a leading construction company using an Enterprise Resources Planning (ERP) system to demonstrate the effectiveness of KM from a cost management business unit perspective. Results are evaluated using a capability maturity model (CMM) - that forms the core of the K-Adv tool - to help improve processes that meet the needs of the organisation operating in a highly dynamic business environment. The case study is part of a broader doctoral research project that uses action learning to facilitate and measure ERP improvement.

Obesity prevention in the family day care setting : impact of the romp & chomp intervention on opportunities for children's physical activity and healthy eating

Background The Romp & Chomp intervention reduced the prevalence of overweight/obesity in pre-school children in Geelong, Victoria, Australia through an intervention promoting healthy eating and active play in early childhood settings. This study aims to determine if the intervention successfully created more health promoting family day care (FDC) environments.
Methods The evaluation had a cross-sectional, quasi-experimental design with the intervention FDC service in Geelong and a comparison sample from 17 FDC services across Victoria. A 45-item questionnaire capturing nutrition- and physical activity-related aspects of the policy, socio-cultural and physical environments of the FDC service was completed by FDC care providers (in 2008) in the intervention (n = 28) and comparison (n = 223) samples.
Results Select results showed intervention children spent less time in screen-based activities (P = 0.03), organized active play (P < 0.001) and free inside play (P = 0.03) than comparison children. There were more rules related to healthy eating (P < 0.001), more care provider practices that supported children’s positive meal experiences (P < 0.001), fewer unhealthy food items allowed (P = 0.05), higher odds of staff being trained in nutrition (P = 0.04) and physical activity (P < 0.001), lower odds of having set minimum times for outside (P < 0.001) and organized (P = 0.01) active play, and of rewarding children with food (P < 0.001).
Conclusions Romp & Chomp improved the FDC service to one that discourages sedentary behaviours and promotes opportunities for children to eat nutritious foods. Ongoing investment to increase children’s physical activity within the setting and improving the capacity and health literacy of care providers is required to extend and sustain the improvements.