Planning and evaluation

Introduction: The core business of public health is to protect and promote health in the population. Public health planning is the means to maximise these aspirations. Health professionals develop plans to address contemporary health priorities as the evidence about changing patterns of mortality and morbidity is presented. Officials are also alert to international trends in patterns of disease that have the potential to affect the health of Australians. Integrated planning and preparation is currently underway involving all emergency health services, hospitals and population health units to ensure Australia's quick and efficient response to any major infectious disease outbreak, such as avian influenza (bird flu). Public health planning for the preparations for the Sydney Olympics and Paralympic Games in 2000 took almost three years. ‘Its major components included increased surveillance of communicable disease; presentations to sentinel emergency departments; medical encounters at Olympic venues; cruise ship surveillance; environmental and food safety inspections; bioterrorism surveillance and global epidemic intelligence’ (Jorm et al 2003, 102). In other words, the public health plan was developed to ensure food safety, hospital capacity, safe crowd control, protection against infectious diseases, and an integrated emergency and disaster plan. We have national and state plans for vaccinating children against infectious diseases in childhood; plans to promote dental health for children in schools; and screening programs for cervical, breast and prostate cancer. An effective public health response to a change in the distribution of morbidity and mortality requires planning. All levels of government plan for the public’s health. Local governments (councils) ensure healthy local environments to protect the public’s health. They plan parks for recreation, construct traffic-calming devices near schools to prevent childhood accidents, build shade structures and walking paths, and even embed drafts/chess squares in tables for people to sit and play. Environmental Health officers ensure food safety in restaurants and measure water quality. These public health measures attempt to promote the quality of life of residents. Australian and state governments produce plans that protect and promote health through various policy and program initiatives and innovations. To be effective, program plans need to be evaluated. However, building an integrated evaluation plan into a program plan is often forgotten, as planning and evaluation are seen as two distinct entities. Consequently, it is virtually impossible to measure, with any confidence, the extent to which a program has achieved its goals and objectives. This chapter introduces you to the concepts of public health program planning and evaluation. Case studies and reflection questions are presented to illustrate key points. As various authors use different terminology to describe the same concepts/actions of planning and evaluation, the glossary at the back of this book will help you to clarify the terms used in this chapter.

Australian nursing informatics competency project

A study of Australian nurses on their use of information technology in the workplace was undertaken by the Australian Nursing Federation (ANF) in 2007. This study of over 4000 nurses highlighted that nurses recognise benefits to adopting more information technology in the workplace although there are significant barriers to their use. It also identified gross deficits in the capacity of the nursing workforce to engage in the digital processing of information. Following the release of the study last year, the ANF commenced work on a number of key recommendations from the report in order to overcome identified barriers and provide opportunities for nurses to better utilise information technology and information management systems. One of these recommendations was to seek research funding to develop national information technology and information management competency standards for nurses. This project has now received Federal Government funding to undertake this development. This project is being developed in collaboration with the ANF and the Queensland University of Technology. This paper will discuss the methodology, development and publication of the Australian Nursing Informatics Competency Standards Project which is currently underway and due for completion in May 2009. The Australian Nursing Informatics Competencies will be presented at the conference.

Development and use of clinical guidelines

The purpose of this chapter is to provide an overview of the development and use of clinical guidelines as a tool for decision making in clinical practice. Nurses have always developed and used tools to guide clinical decision making related to interventions in practice. Since Florence Nightingale (Nightingale 1860) gave us ‘notes’ on nursing in the late 1800s, nurses have continued to use tools, such as standards, policies and procedures, protocols, algorithms, clinical pathways and clinical guidelines, to assist them in making appropriate decisions about patient care that eventuate in the best desired patient outcomes. Clinical guidelines have enjoyed growing popularity as a comprehensive tool for synthesising clinical evidence and information into user-friendly recommendations for practice. Historically, clinical guidelines were developed by individual experts or groups of experts by consensus, with no transparent process for the user to determine the validity and reliability of the recommendations. The acceptance of the evidence-based practice (EBP) movement as a paradigm for clinical decision making underscores the imperative for clinical guidelines to be systematically developed and based on the best available research evidence. Clinicians are faced with the dilemma of choosing from an abundance of guidelines of variable quality, or developing new guidelines. Where do you start? How do you find an existing guideline to fit your practice? How do you know if a guideline is evidence-based, valid and reliable? Should you apply an existing guideline in your practice or develop a new guideline? How do you get clinicians to use the guidelines? How do you know if using the guideline will make any difference in care delivery or patient outcomes? Whatever the choice, the challenge lies in choosing or developing a clinical guideline that is credible as a decision-making tool for the delivery of quality, efficient and effective care. This chapter will address the posed questions through an exploration of the ins and outs of clinical guidelines, from development to application to evaluation.

Enhancing transition : an enhanced model of clinical placement for final year nursing students

Specialised support for student nurses making the transition to graduate nurse can be crucial to successful and smooth adjustment, and can create a path to positive and stable career experiences. This paper describes an enhanced model of final year nursing student placements which was trialled in 2006 at the Queensland University of Technology. The model involved collaboration with two major urban health services and resources were developed to support effective transition experiences. Ninety-two students, including 29 trial participants and 63 non-trial participants were assessed on preparedness for professional practice, before and after the trial semester. Results indicated an increase in preparedness across the entire sample, but students participating in the trial did not differ significantly in overall preparedness change from those who did not participate. Higher baseline preparedness in the trial group highlighted the possibility that proactive students who choose enrichment experiences tend to be likelier to gain benefit from such options than those who do not. Qualitative findings from focus groups conducted with 12 transition group students highlighted that one of the main beneficial aspects of the experience for students was the sense of belonging to a team that understood their learning needs and could work constructively with them.

Taiwanese nursing students' attitudes toward older people

The aim of this research was to establish Taiwanese undergraduate nursing students’ attitudes toward older people. This study involved a cross-sectional survey of 362 nursing students in a university in southern Taiwan. Overall, the results showed that nursing students had positive attitudes toward older people. Moreover, the findings suggested that nursing students’ intention to work with older people and gender were important factors influencing their attitudes toward older people. The findings of this study indicate that efforts are required to maintain these positive attitudes. In addition, provision of nursing courses related to older people that place greater emphasis on attitudes about aging and that take into account students’ working experience and career intention will lead to higher quality of care for older people.

Bahrain skills gaps study : tourism, construction, and education skills plans

The tourism, construction, and education plans and skills strategies (embedded in project reports) were developed as part of a nation-wide comprehensive research project covering current, emerging and future skills deficiencies and requirements in Bahrain’s labour market. The research covered the majority of economic sectors and activities in the Kingdom and will serve as a basis for formulating industry and occupational outlooks as well as career guidance and awareness activities by academic and training institutions across Bahrain. It will provides foundation work for industry skills councils in order to conduct and achieve a uniform system of occupational standards across industries, occupations and job levels.

Evaluation of community participation for the development of culture-based fisheries in village reservoirs of Sri Lanka

In this paper an attempt is made to identify the socioeconomic characteristics of a community that influences the development and management of culture-based fisheries in village reservoirs of Sri Lanka. Socioeconomic data were collected from 46 agricultural farming communities associated with 47 village reservoirs in Sri Lanka. Principal component analysis indicated that scores of the first principal component were positively influenced by socioeconomic characteristics that are favorable for making collective decisions. These included leadership of the officers, age of the group, percentage of active members of the group, percentage of kinship of the group, percentage of common interest of the group, and percentage of participation of the group. The size of the group had negative effect on the first principal component. The principal component scores of communication were positively related to willingness to pay (P< 0.001). The communities with socioeconomic characteristics favouring collective decision making were in favor of culture-based fisheries. Homogeneity of group characteristics facilitated successful development of culture-based fisheries.

“Filling out the forms was a nightmare” : project evaluation and the reflective practitioner in community theatre in contemporary Northern Ireland

Since the Good Friday Agreement of 1998, large sums have been invested in community theatre projects in Northern Ireland, in the interests of conflict transformation and peace building. While this injection of funds has resulted in an unprecedented level of applied theatre activity, opportunities to maximise learning from this activity are being missed. It is generally assumed that project evaluation is undertaken at least partly to assess the degree of success of projects against important social objectives, with a view to learning what works, what does not, and what might work in the future. However, three ethnographic case studies of organisations delivering applied theatre projects in Northern Ireland indicate that current processes used to evaluate such projects are both flawed and inadequate for this purpose. Practitioners report that the administrative work involved in applying for and justifying funding is onerous, burdensome, and occurs at the expense of artistic activity. This is a very real concern when the time and effort devoted to ‘filling out the forms’ does not ultimately result in useful evaluative information. There are strong disincentives for organisations to report honestly on their experiences of difficulties, or undesirable impacts of projects, and this problem is not transcended by the use of external evaluators. Current evaluation processes provide little opportunity to capture unexpected benefits of projects, and small but significant successes which occur in the context of over-ambitious objectives. Little or no attempt is made to assess long-term impacts of projects on communities. Finally, official evaluation mechanisms fail to capture the reflective practice and dialogic analysis of practitioners, which would richly inform future projects. The authors argue that there is a need for clearer lines of communication, and more opportunities for mutual learning, among stakeholders involved in community development. In particular, greater involvement of the higher education sector in partnership with government and non-government agencies could yield significant benefits in terms of optimizing learning from applied theatre project evaluations.

A national evaluation of the Australian Occupational Therapy Competency Standards (1994): a multistakeholder perspective

This paper summarises results from an evaluation of the adequacy and utility of the Australian Competency Standards for Entry-Level Occupational Therapists © (OT AUSTRALIA, 1994a). It comprised a two-part study, incorporating an online survey of key national stakeholders (n = 26), and 13 focus groups (n = 152) conducted throughout Australia with occupational therapy clinicians, academics, OT AUSTRALIA association and Occupational Therapy Registration Board representatives, as well as university program accreditors. The key recommendations were that: (i) urgent revision to reflect contemporary practice, paradigms, approaches and frameworks is required; (ii) the standards should exemplify basic competence at graduation (not within two years following); (iii) a revision cycle of five years is required; (iv) the Australian Qualifications Framework should be retained, preceded by an introduction describing the scope and nature of occupational therapy practice in the national context; (v) access to the standards should be free and unrestricted to occupational therapists, students and the public via the OT AUSTRALIA (national) website; (vi) the standards should incorporate a succinct executive summary and additional tools or templates formatted to enable occupational therapists to develop professional portfolios and create working documents specific to their workplace; and (vii) language must accommodate contextual variation while striking an appropriate balance between providing instruction and encouraging innovation in practice.

An evaluation of current and future botnet defenses

Botnets are large networks of compromised machines under the control of a bot master. These botnets constantly evolve their defences to allow the continuation of their malicious activities. The constant development of new botnet mitigation strategies and their subsequent defensive countermeasures has lead to a technological arms race, one which the bot masters have significant incentives to win. This dissertation analyzes the current and future states of the botnet arms race by introducing a taxonomy of botnet defences and a simulation framework for evaluating botnet techniques. The taxonomy covers current botnet techniques and highlights possible future techniques for further analysis under the simulation framework. This framework allows the evaluation of the effect techniques such as reputation systems and proof of work schemes have on the resources required to disable a peer-to-peer botnet. Given the increase in the resources required, our results suggest that the prospects of eliminating the botnet threat are limited.

Dragline automation: experimental evaluation through productivity trial

Since 1993 we have been working on the automation of dragline excavators, the largest earthmoving machines that exist. Recently we completed a large-scale experimental program where the automation system was used for production purposes over a two week period and moved over 200,000 tonnes of overburden. This is a landmark achievement in the history of automated excavation. In this paper we briefly describe the robotic system and how it works cooperatively with the machine operator. We then describe our methodology for gauging machine performance, analyze results from the production trial and comment on the effectiveness of the system that we have created. © Springer-Verlag Berlin Heidelberg 2006.

Design and evaluation of an MRI compatible axial compression device for 3D assessment of spinal deformity and flexibility

Magnetic Resonance Imaging (MRI) offers a valuable research tool for the assessment of 3D spinal deformity in AIS, however the horizontal patient position imposed by conventional scanners removes the axial compressive loading on the spine which is an important determinant of deformity shape and magnitude in standing scoliosis patients. The objective of this study was to design, construct and test an MRI compatible compression device for research into the effect of axial loading on spinal deformity using supine MRI scans. The compression device was designed and constructed, consisting of a vest worn by the patient, which was attached via straps to a pneumatically actuated footplate. An applied load of 0.5 x bodyweight was remotely controlled by a unit in the scanner operator’s console. The entire device was constructed using non-metallic components for MRI compatibility. The device was evaluated by performing unloaded and loaded supine MRI scans on a series of 10 AIS patients. The study concluded that an MRI compatible compression device had been successfully designed and constructed, providing a research tool for studies into the effect of axial loading on 3D spinal deformity in scoliosis. The 3D axially loaded MR imaging capability developed in this study will allow future research investigations of the effect of axial loading on spinal rotation, and for imaging the response of scoliotic spinal tissues to axial loading.

The meaning of cancer for Australian Aboriginal women : changing the focus of cancer nursing

Aim: The purpose of the study was to explore why Aboriginal women participate in cancer screening programs but appear reluctant to following-up results, or accept medical advice about treatment. Methods: Interpretive ethnography, a qualitative methodology, was used to explore Aboriginal women’s perception of cancer, and the cultural context in which meaning was constructed and influenced treatment decision. Data collection, which occurred over two years, involved fieldwork, participant-observation, face-to-face interviews and focus groups, in two rural Aboriginal communities. Forty eight interviews were recorded from a cross section of the communities, including cancer survivors and patients, family members, health care providers and other women from the community. Results: Key findings were that Aboriginal women’s had a fearful and fatalistic attitude toward cancer, doubted the efficacy of treatment and carried an enduring ambivalence toward the authority of whiteman’s medicine. The women faced a dilemma of wanting access to cancer treatment options but feared entering hospital or clinics not attuned to their cultural needs. Conclusion: The findings highlight the need for a culture-centred approach that decentres the authority of conventional services and instead gives prominence to Aboriginal cultural values as a focal point in cancer control. It should be the responsibility of cancer nurses and others to engage with their local Aboriginal communities to build relationships that foster an exchange of learning about cultural differences that make a difference to how cancer control is practiced.