Quantitative evaluation in health promotion : What's the difference?

This is the third in a series of articles on quantitative evaluation in health promotion written by Damien Jolley for the Health Promotion Journal of Australia. The first of these articles, published in the December 2000 issue, discussed the ideas behind sample surveys and how they can be used to improve evaluation of health promotion initiatives.1 The second, in the April 2001 issue, discussed confidence intervals in more detail and presented some strategies for computing confidence intervals for population percentages, both manually and using appropriate computer software. 2

`This was a great project!`: reflections on a `successful` mental health promotion project in a remote Indigenous school

Issue addressed: The complexities encountered in an Indigenous community when a white project support team assisted a school (Bwgcolman on Palm Island, Queensland) to implement MindMatters, a centralised, national project aiming to promote the psychosocial health of young Australians through the development of a comprehensive, school- based mental health promotion program. Approach: The MindMatters consortium offered pilot schools curriculum materials, professional development for staff, funding and ongoing support at a local level in return for their participation in the project. The support team flew to the island on two occasions to provide support. Conclusion: Whether or not MindMatters constituted a community project at Bwgcolman is debatable. Nevertheless, the project at Bwgcolman was considered a 'success' by key players since initial aims identified by the school were tangible (eg, professional development, curriculum development) and met in a way that the school could take ownership of. Additionally, behavioural management policy was implemented in a manner that was cognisant of a history of coercive relations with Indigenous communities. So what?: It is important in the telling of the success story at Bwgcolman that even though MindMatters endeavoured to be culturally sensitive, it was nevertheless a centralist mental health promotion program. Future mental health promotion initiatives need to be aware that the approach of the support team in attempting to hand back some community control at the local level may have played a role in the school succeeding.

Healthy nature healthy people: 'contact with nature' as an upstream health promotion intervention for populations

Whilst urban-dwelling individuals who seek out parks and gardens appear to intuitively understand the personal health and well-being benefits arising from `contact with nature', public health strategies are yet to maximize the untapped resource nature provides, including the benefits of nature contact as an upstream health promotion intervention for populations. This paper presents a summary of empirical, theoretical and anecdotal evidence drawn from a literature review of the human health benefits of contact with nature. Initial findings indicate that nature plays a vital role in human health and well-being, and that parks and nature reserves play a significant role by providing access to nature for individuals. Implications suggest contact with nature may provide an effective population-wide strategy in prevention of mental ill health, with potential application for sub-populations, communities and individuals at higher risk of ill health. Recommendations include further investigation of `contact with nature' in population health, and examination of the benefits of nature-based interventions. To maximize use of `contact with nature' in the health promotion of populations, collaborative strategies between researchers and primary health, social services, urban planning and environmental management sectors are required. This approach offers not only an augmentation of existing health promotion and prevention activities, but provides the basis for a socio-ecological approach to public health that incorporates environmental sustainability.

Impact evaluation of a five-day short course in health promotion: workforce development in action

Issue addressed: This paper reports on impact evaluation of a series of five-day Short Courses in Health Promotion that have been delivered to more than 2,000 people since 2002 as part of a statewide workforce development strategy.

Methods: A triangulated mixed methods research design was selected for the evaluation. Data were collected through a mail survey, key informant interviews, focus groups and organisational case studies. Stakeholder and participant involvement were central to the evaluation.

Results: Organisational change emerged as a key theme. Impacts of the short course were felt in relation to health promotion practice and on organisational capacity to conduct health promotion, while the development of confidence and skills of participants to engage in collaborative opportunities was a not unexpected, but important, benefit of the course.

Conclusions: A short course is effective if attention is given to quality delivery, adult learning methods, participant involvement, appropriate targeting, good planning, and adequate funding. However, respondents commonly report the need for organisational change in order for health promotion practice to be embedded into organisations and for practitioners to be supported in their efforts to re-orient services towards health promotion.

Global priority setting for Cochrane systematic reviews of health promotion and public health research

Background: Systematic reviews of health promotion and public health interventions are increasingly being conducted to assist public policy decision making. Many intra-country initiatives have been established to conduct systematic reviews in their relevant public health areas. The Cochrane Collaboration, an international organisation established to conduct and publish systematic reviews of healthcare interventions, is committed to high quality reviews that are regularly updated, published electronically, and meeting the needs of the consumers.

Aims: To identify global priorities for Cochrane systematic reviews of public health topics.

Methods: Systematic reviews of public health interventions were identified and mapped against global health risks. Global health organisations were engaged and nominated policy-urgent titles, evidence based selection criteria were applied to set priorities.

Results: 26 priority systematic review titles were identified, addressing interventions such as community building activities, pre-natal and early infancy psychosocial outcomes, and improving the nutrition status of refugee and displaced populations.

Discussion: The 26 priority titles provide an opportunity for potential reviewers and indeed, the Cochrane Collaboration as a whole, to address the previously unmet needs of global health policy and research agencies.

Health and well-being naturally: 'contact with nature' in health promotion for targeted individuals, communities and populations

Issue addressed: The increase in mental health disorders worldwide makes it important to recognise health promotion interventions that are effective, accessible and affordable. Although natural spaces are coming to be recognised as health-promoting settings for general populations, little is understood about the use of nature contact in treatment and care for individuals experiencing ill-health.

Methods: This paper provides a summary of key research findings and presents a case study examining the self reported health and well-being benefits of nature contact for a small clinical sample. The 'Spectrum of Interventions for Mental Health Problems and Mental Disorders' provides a conceptual framework for ordering current and future information relating to nature-based interventions.

Results: Evidence demonstrates that separately, physical activity, social connection, and contact with nature enhance human health and well-being. The case example illustrates how 'active', 'social' and 'adventurous' contact with nature may be combined within a treatment intervention to protect and enhance the health of individuals experiencing chronic mental, emotional and physical health difficulties.

Conclusions: 'Contact with nature' constitutes a health promotion strategy with potential application in prevention, early intervention, treatment and care. Recommendations include further research to investigate the benefits of nature contact within existing interventions, and the impacts of 'active' and 'social' nature contact within tailored interventions for targeted individuals and communities.

The role of workplace health promotion in addressing job stress

The enormous human and economic costs associated with occupational stress suggest that initiatives designed to prevent and/or reduce employee stress should be high on the agenda of workplace health promotion (WHP) programmes. Although employee stress is often the target of WHP, reviews of job stress interventions suggest that the common approach to combating job stress is to focus on the individual without due consideration of the direct impacts of working conditions on health as well as the effects of working conditions on employees' ability to adopt and sustain ‘healthy’ behaviours. The purpose of the first part of this paper is to highlight the criticisms of the individual approach to job stress and to examine the evidence for developing strategies that combine both individual and organizational-directed interventions (referred to as the comprehensive approach). There is a risk that WHP practitioners may lose sight of the role that they can play in developing and implementing the comprehensive approach, particularly in countries where occupational health and safety authorities are placing much more emphasis on identifying and addressing organizational sources of job stress. The aim of the second part of this paper is therefore to provide a detailed description of what the comprehensive approach to stress prevention/reduction looks like in practice and to examine the means by which WHP can help develop initiatives that address both the sources and the symptoms of job stress.

Evaluating health promotion in schools: a case study of design, implementation and results from the Hong Kong Healthy Schools Award Scheme

Health promoting schools (HPS) and Healthy Schools Award Schemes from a number of countries have demonstrated positive changes in children’s health behaviours and the culture and organisation of the school. The Hong Kong Healthy Schools Award Scheme (HKHSA) aims to promote staff development, parental education, involvement of the whole school community, and linkage with different stakeholders to improve the health and well-being of the pupils, parents and staff, and the broader community, supported by a system to monitor the achievement. This concept is very much in line with the research literature on school effectiveness and improvement. The indicators examined to evaluate the success of the HKHSA reflect outcomes related to both health and education and are not limited to changes in population health status. The early results demonstrated significant improvements in various aspects of student health and also improvement in school culture and organisation. The evaluation framework described in this paper and data collected to assess how schools perform in the HKHSA scheme, provides insight into how HPSs could lead to better outcomes for both education and health.

From policy to practice: the development of an integrated health promotion plan for children's services at Plenty Valley Community Health Inc.

Current changes in the funding of health promotion in community health in Victoria require community health agencies to integrate health promotion with service delivery. This provides both opportunities and challenges for community health staff. Members of the Children’s Service Team at Plenty Valley Community Health Inc. addressed these changes by developing an integrated health promotion plan. The approach used involved identifying client pathways and then integrating opportunities for health promotion interventions into these pathways. Staff perceptions of the process involved in developing the plan were examined. The use of client pathways to integrate health promotion into everyday practice proved a successful approach for members of the Children’s Services Team, and provides a useful model for health promotion planning in community health that helps staff to see the relevance of health promotion to their practice, and engages staff in the planning process. Members of the Children’s Services Team reported that the process involved in developing their integrated health promotion plan was a very worthwhile experience that allowed them a strong sense of ownership of the plan.

Program, agency and effect sustainability in health promotion

ISSUE ADDRESSED: Achieving sustainability is often considered a key objective of health promotion efforts despite a lack of consensus as to what sustainability is.

MATERIAL: A review of the international health promotion literature was conducted to identify understandings of sustainability in health promotion.

RESULTS:Three distinct understandings of sustainability in respect of programs, health promotion agencies and program effects were identified.

CONCLUSIONS: Despite a strong emphasis on program sustainability in the health promotion field, clear criteria for why programs should be continued is required rather than assuming that it is the best option. Arguably more important than the maintenance of either programs or the agencies which support them is the ability to produce sustainable program effects.