Impact evaluation of a five-day short course in health promotion: workforce development in action

Issue addressed: This paper reports on impact evaluation of a series of five-day Short Courses in Health Promotion that have been delivered to more than 2,000 people since 2002 as part of a statewide workforce development strategy.

Methods: A triangulated mixed methods research design was selected for the evaluation. Data were collected through a mail survey, key informant interviews, focus groups and organisational case studies. Stakeholder and participant involvement were central to the evaluation.

Results: Organisational change emerged as a key theme. Impacts of the short course were felt in relation to health promotion practice and on organisational capacity to conduct health promotion, while the development of confidence and skills of participants to engage in collaborative opportunities was a not unexpected, but important, benefit of the course.

Conclusions: A short course is effective if attention is given to quality delivery, adult learning methods, participant involvement, appropriate targeting, good planning, and adequate funding. However, respondents commonly report the need for organisational change in order for health promotion practice to be embedded into organisations and for practitioners to be supported in their efforts to re-orient services towards health promotion.

Process and impact evaluation of the romp & chomp obesity prevention intervention in early childhood settings : lessons learned from implementation in preschools and long day care settings

Background: The Romp & Chomp controlled trial, which aimed to prevent obesity in preschool Australian children, was recently found to reduce the prevalence of childhood overweight and obesity and improve children’s dietary patterns. The intervention focused on capacity building and policy implementation within various early childhood settings. This paper reports on the process and impact evaluation of this trial and the lessons learned from this complex community intervention.
Methods: Process data was collected throughout and audits capturing nutrition and physical activity-related environments and practices were completed postintervention by directors of Long Day Care (LDC) centers (n = 10) and preschools (n = 41) in intervention and comparison (n = 161 LDC and n = 347 preschool) groups.
Results: The environmental audits demonstrated positive impacts in both settings on policy, nutrition, physical activity opportunities, and staff capacity and practices, although results varied across settings and were more substantial in the preschool settings. Important lessons were learned in relation to implementation of such community-based interventions, including the significant barriers to implementing health-promotion interventions in early childhood settings, lack of engagement of for-profit LDC centers in the evaluation, and an inability to attribute direct intervention impacts when the intervention components were delivered as part of a health-promotion package integrated with other programs.
Conclusions: These results provide confidence that obesity prevention interventions in children’s settings can be effective; however, significant efforts must be directed toward developing context-specific strategies that invest in policies, capacity building, staff support, and parent engagement. Recognition by funders and reviewers of the difficulties involved in implementing and evaluating such complex interventions is also critical to strengthening the evidence base on the effectiveness of such public health approaches to obesity prevention.

Impact of nursing information systems on residential care provision in an aged care provider

The challenge of an ageing population has placed a great pressure on the Australian aged care sector in the coming decades. Technology-enabled solutions such as health information systems (HIS) can be seen as a way to improve care quality, safety and process efficiency. Compared to the overall healthcare sector, the adoption of HIS in the aged care sector has been slower. One reason for this is that aged care providers are not well informed therefore not yet convinced of the positive impacts of technology solutions on their service provision. This paper reports findings from an evaluation of the impact of HIS adoption at an aged care provider in Victoria. The evaluation was conducted in two distinct areas, residential aged care and residential disability services. Overall, the findings show positive impacts of the system on individual work of the care staff and on service provision of the organisation as well as suggesting opportunities for improvement in later implementation stages. The evaluation will also inform other aged care and disability service providers of the benefits of HIS and useful lessons in adoption of technology solutions.

A virtuous circle: the positive evaluation phenomenon in arts audience research

Arts impact evaluation is the subject of widespread criticism, ranging from a detailed critique of methodology to a wholesale rejection of the very purpose of the endeavour. In particular, it is often identified that audience evaluations are almost always positive. Yet whatever the critique, arts impact evaluation is becoming more and not less prevalent as a condition of public and philanthropic funding. This article explores both the methodologicaland conceptual problems that contribute to the perceived positive characterof social impact research, in two parts: (1) an investigation of the critical literature on audience evaluation, particularly in relation to the argument that evaluation is inevitably positive and as such leads to a confusion between the goals of evaluation and arts advocacy; (2) a reflection on our practices as audience researchers in the performing arts and the practical factors that contribute to the dominance of the positive in audience evaluation.

Product evaluation and purchase intention : impact of country-of-origin and experience in living in a foreign country

This article presents the results of an experiment that compares the perceptions of product quality and purchase intentions of foreign versus home products by Chinese consumers who have had experience living in a western society compared to those living in China. The results indicate experience does affect purchase likelihood for home versus foreign products. Chinese, generally, find country of parts as the best cue in evaluating product quality and purchase intentions.

The Health Education Impact Questionnaire (heiQ): An outcomes and evaluation measure for patient education and self-management interventions for people with chronic conditions

Objective: This paper describes the development and validation of the Health Education Impact Questionnaire (heiQ). The aim was to develop a user-friendly, relevant, and psychometrically sound instrument for the comprehensive evaluation of patient education programs, which can be applied across a broad range of chronic conditions.

Methods: Item development for the heiQ was guided by a Program Logic Model, Concept Mapping, interviews with stakeholders and psychometric analyses. Construction (N = 591) and confirmatory (N = 598) samples were drawn from consumers of patient education programs and hospital outpatients. The properties of the heiQ were investigated using item response theory and structural equation modeling.

Results: Over 90 candidate items were generated, with 42 items selected for inclusion in the final scale. Eight independent dimensions were derived: Positive and Active Engagement in Life (five items, Cronbach's alpha (α) = 0.86); Health Directed Behavior (four items, α = 0.80); Skill and Technique Acquisition (five items, α = 0.81); Constructive Attitudes and Approaches (five items, α = 0.81); Self-Monitoring and Insight (seven items, α = 0.70); Health Service Navigation (five items, α = 0.82); Social Integration and Support (five items, α = 0.86); and Emotional Wellbeing (six items, α = 0.89).

Conclusion:The heiQ has high construct validity and is a reliable measure of a broad range of patient education program benefits.

Practice Implications: The heiQ will provide valuable information to clinicians, researchers, policymakers and other stakeholders about the value of patient education programs in chronic disease management.

Consolidation within the Australian real estate investment trust sector : an evaluation of the impact on unitholder returns

Mergers and acquisitions within the Australian-real estate investment trusts (A-REITs) sector have become a noticeable trend in the last decade. Utilising
event study methodology, 36 successful A-REIT mergers and acquisitions
between January 1995 and December 2008 were examined. Both target and
bidding shareholders experience positive excess returns of 4.27% and 0.54%
respectively over the 41 day event window [−20, +20]. Analysis indicates that the
cumulative abnormal returns (CARs) for bidding firms are considerably greater
than previous research suggests. This study finds higher bidder CARs when scrip
or a combination of scrip and cash is used to finance the acquisition. We also find
that the relative size or the size of the acquirer have a positive and significant
impact on the excess returns of bidding A-REITs. This suggests that the
synergistic benefits from the acquisition are a result of economies of scale and
increased market power. There is also some evidence that the relative size and
method of payment influence the CARs of target firms during the event window.