The development of the extended adolescent injury checklist (E-AIC) : a measure for injury prevention program evaluation

The Extended Adolescent Injury Checklist (E-AIC), a self-report measure of injury based on the model of the Adolescent Injury Checklist (AIC), was developed for use in the evaluation of school-based interventions. The three stages of this development involved focus groups with adolescents and consultations with medical staff, pilot testing of the revised AIC in a high school context, and use of the finalised checklist in pre- and post-questionnaires to examine its utility. Results revealed that responses to the final version of the E-AIC were meaningful and remained consistent over time. The E-AIC appears to be a promising measure of adolescent injury that is simple, time-efficient and appropriate for use in the evaluation of school-based injury prevention programs.

Assessment by interview and portfolio in a Graduate School Program

Assessment plays an integral role in teaching and learning in Higher Education and teachers have a strong interest in debates and commentaries on assessment as and for learning. In a one-year graduate entry teacher preparation program, the temptation is to emphasize assessment in an attempt to ensure students “cover” everything as part of a robust preparation for the profession. The risk is that, for students, assessment drives curriculum, and time spent in the completion of assignments is no guarantee of either effective learning or authentic preparation for teaching. Interviews as assessment provide an opportunity for a learning experience as well as an authentic task, since students will shortly be interviewing for employment in a “real world” situation. This paper reports on a project experimenting with interview panels as authentic assessment with pre-service early childhood teachers. At the end of their first semester of study, students enrolled in the Graduate Diploma of Education program at the Queensland University of Technology in Australia were required to participate in a panel interview where they were graded by a panel made up of three faculty staff and one undergraduate student enrolled in the four-year Bachelor of Education program. Students and panel members completed a questionnaire on their experience after the interview. Results indicated that both students and staff valued the experience and felt it was authentic. Results are discussed in terms of how the assessment interview and portfolio presentation supports graduating students in their preparation for employment interviews, and how this authentic assessment task has benefits for both students and teaching staff.

A Process and Outcome Evaluation of the Under the Limit (UTL) Therapeutic Drink Driving Program for Recidivist and High Range Offenders

Drink driving is a major public health issue and this report examines the experiences of convicted offenders who participated in an established drink driving rehabilitation program Under the Limit (UTL). Course completers were surveyed at least three months after they had finished the 11-week UTL course. The aim of this study was to examine whether the UTL program reduced the level of alcohol consumption either directly as a result of participation in the UTL drink driving program or through increased use of community alcohol program by participants. The research involved a self-report outcome evaluation to determine whether the self-reported levels of alcohol use after the course had changed from the initial alcohol use reported by offenders. The findings are based on the responses of 30 drink-driving offenders who had completed the UTL program (response rate: 20%). While a process evaluation was proposed in the initial application, the low response rate meant that this follow up research was not feasible. The response rate was low for two reasons, it was difficult to: recruit participants who consented to follow up, and subsequently locate and survey those who had consented to involvement.

Development of school connectedness as a component of an injury prevention program for early adolescents

The current program of research addresses the need for multi-level programs to target the major increase in injury rates that occurs throughout adolescence. Specifically, it involves the investigation of school connectedness as a protective factor for adolescent injury, and the development of school connectedness as a component of an injury prevention program. To date, school-based risk taking and injury prevention has frequently been limited to addressing adolescents' knowledge and attitudes to risk behaviours, and has largely overlooked the importance of the wider school social context as a protective factor in adolescent development. Additionally, school connectedness has been primarily studied in terms of its impact on student achievement, wellbeing and risk taking behaviour, and research has not yet addressed possible links with injury. Further, school connectedness intervention programs have targeted risk taking behaviours without evaluating their potential impact on injury outcomes. This is the first reported research to develop strategies to increase school connectedness as part of a school-based injury prevention program. The research program was conceptualised as three distinct stages. The development of these research stages was informed by a comprehensive review of the literature on adolescent risk taking, injury and school-based prevention, as well as on school connectedness and its importance in adolescence. A review of the school connectedness literature indicated that students' connectedness is largely influenced by relationships within the school context including with teachers and other school staff, and is therefore a potentially modifiable factor that may be targeted in school-based programs. Overall, the literature shows school connectedness to be a key protective factor in adolescent development. This review established a foundation from which the current program of research was designed. The first stage of the research involved an empirical investigation of the relationship between adolescent risk taking-related injuries and school connectedness. Stage one incorporated two studies. The first involved the development of a measure of adolescent injury, the Extended Adolescent Injury Checklist (E-AIC), for use in the current research as well as in future school-based studies and program evaluation. The results of this study also highlighted the extent of the problem of risk-related injury in adolescence. The second study in Stage one examined the relationship between students' reports of school connectedness, risk taking behaviour and risk taking-related injuries on the E-AIC. The results of this study showed significant relationships between increased school connectedness and reduced reported engagement in transport and violence risk taking, and fewer associated injuries. This study therefore suggested the potential for school-based injury prevention programs to incorporate strategies targeting increased adolescent connectedness to school. The second stage of this research involved the compilation of an evidence base to inform the design of a school connectedness intervention. Stage two also incorporated two studies. The first study in Stage two involved a systematic review of programs that have targeted school connectedness for reduced risk taking and injury. The results of this study revealed that interventions targeting school connectedness can be effective in reducing adolescent risk taking behaviour, and also provided an evidence base for the design of the current school connectedness intervention. The second study in Stage two examined teachers' understanding and perceptions of school connectedness. This qualitative study indicated that teachers consider students' connectedness to be an important factor that relates to their risk taking behaviour; and also provided directions and content for the intervention design stage. The third stage of this research built upon the findings of each of the previous studies, and involved the design, implementation and evaluation of a school connectedness intervention as a component of an adolescent injury prevention program, Skills for Preventing Injury in Youth (SPIY). This connectedness intervention was designed as a professional development workshop for teachers of 13 to 14 year old adolescents, and was developed as a complementary component to the curriculum-based SPIY program. The SPIY connectedness component was implemented and evaluated using process and six-month impact evaluation methodologies. The results of this study revealed that teachers saw value in the program and made use of the strategies presented, and that program school students' self-reported violence risk behaviour was reduced at six-month follow-up. Despite these promising findings, the results of this study did not demonstrate a significant impact of the program on change in students' connectedness to school, relative to comparison schools. The positive impact on self-reported violence risk behaviour was however replicated in additional analyses comparing students participating in the connectedness version of SPIY with students participating in an earlier curriculumonly version of the program. This finding indicated that the connectedness component has additional benefits relating to reduction in violence risks, over and above a curriculum-only version of the program. This research was the first reported to address the relationship between school connectedness and adolescent injury outcomes, and to develop school connectedness as a component of an adolescent injury prevention program. Overall, the results of this program of research have demonstrated the importance of incorporating strategies targeting the wider school social context, including school connectedness, in adolescent injury prevention programs. This research has important implications for future research and practice in adolescent injury prevention.

Best practice in peer-led curriculum content : informing an interactive program to improve passenger safety among high school seniors

Despite ongoing improvements in behaviour change strategies, licensing models and road law enforcement measures young drivers remain significantly over-represented in fatal and non-fatal road related crashes. This paper focuses on the safety of those approaching driving age and identifies both high priority road safety messages and relevant peer-led strategies to guide the development school programs. It summarises the review in a program logic model built around the messages and identified curriculum elements, as they may be best operationalised within the licensing and school contexts in Victoria. This paper summarises a review of common deliberate risk-taking and non-deliberate unsafe driving behaviours among novice drivers, highlighting risks associated with speeding, driving while fatigued, driving while impaired and carrying passengers. Common beliefs of young people that predict risky driving were reviewed, particularly with consideration of those beliefs that can be operationalised in a behaviour change school program. Key components of adolescent risk behaviour change programs were also reviewed, which identified a number of strategies for incorporation in a school based behaviour change program, including: a well-structured theoretical design and delivery, thoughtfully considered peer-selected processes, adequate training and supervision of peer facilitators, a process for monitoring and sustainability, and interactive delivery and participant discussions. The research base is then summarised in a program logic model with further discussion about the quality of the current state of knowledge of evaluation of behaviour change programs and the need for considerable development in program evaluation.

Barriers and facilitators of a designated driver program

The general aim of designated driver programs is to reduce the level of drink driving by encouraging potential drivers to travel with a driver who has abstained from (or at least limited) consuming alcohol. Designated driver programs are quite widespread around the world, however a limited number have been rigorously evaluated. This paper reports the qualitative results from an evaluation of a designated driver program known as ‘Skipper’, in a provincial city in Queensland. Focus groups were conducted with 108 individuals from the intervention area. These focus groups aimed to assess the barriers and facilitators to the programs’ effectiveness by obtaining information about the patrons’ views on various aspects of the program, as well as designated driver and travelling after drinking more generally. A brief questionnaire was also given to participants in order to present responses in terms of the participants’ characteristics. Results suggest general support for the designated driver concept and the ‘Skipper’ program specifically. Facilitating factors reported by participants included the media coverage highlighting the risks associated with drink driving and the social acceptability of choosing not to drink. However, there was also some suggestion that the impact of the program was mainly to encourage those who already engage in designated driver behaviour to continue doing so, rather than encouraging the uptake of the behaviour among potential new users. Some of the suggested barriers to this kind of behaviour change include: social pressure to drink; alcohol dependency; and a failure to plan ahead.

Building research capacity in the nursing workforce : the design and evaluation of the nurse researcher role

Objectives: The Nurse Researcher Project (NRP) was initiated to support development of a nursing research and evidence based practice culture in Cancer Care Services (CCS) in a large tertiary hospital in Australia. The position was established and evaluated to inform future directions in the organisation.---------- Background: The demand for quality cancer care has been expanding over the past decades. Nurses are well placed to make an impact on improving health outcomes of people affected by cancer. At the same time, there is a robust body of literature documenting the barriers to undertaking and utilising research by and for nurses and nursing. A number of strategies have been implemented to address these barriers including a range of staff researcher positions but there is scant attention to evaluating the outcomes of these strategies. The role of nurse researcher has been documented in the literature with the aim to provide support to nurses in the clinical setting. There is, to date, little information in relation to the design, implementation and evaluation of this role.---------- Design: The Donabedian’s model of program evaluation was used to implement and evaluate this initiative.---------- Methods: The ‘NRP’ outlined the steps needed to implement the nurse researcher role in a clinical setting. The steps involved the design of the role, planning for the support system for the role, and evaluation of outcomes of the role over two years.---------- Discussion: This paper proposes an innovative and feasible model to support clinical nursing research which would be relevant to a range of service areas.---------- Conclusion: Nurse researchers are able to play a crucial role in advancing nursing knowledge and facilitating evidence based practice, especially when placed to support a specialised team of nurses at a service level. This role can be implemented through appropriate planning of the position, building a support system and incorporating an evaluation plan.

Early Intervention Program Final Evaluation Report

The Early Intervention Program aims to facilitate contact between children and their non-residential parent as soon as practicable after breakdown and separation of the immediate family unit. The Program is auspiced by the Sunshine Coast Family Contact Centre Association. The Program has been offered since late 2007 following receipt of a grant from the National Community Crime Prevention Program [NCCP] for Domestic Violence Prevention. This external evaluator report summarised main achievements with respect to meeting program objectives and also makes recommentations in view the of the continuation of this innovative program.

Developing safer passengers through a school-based injury prevention program

Motor vehicle crashes are a leading cause of death among young people. Fourteen percent of adolescents aged 13-14 report passenger-related injuries within three months. Intervention programs typically focus on young drivers and overlook passengers as potential protective influences. Graduated Driver Licensing restricts passenger numbers, and this study focuses on a complementary school-based intervention to increase passengers’ personal- and peer-protective behavior. The aim of this research was to assess the impact of the curriculum-based injury prevention program, Skills for Preventing Injury in Youth (SPIY), on passenger-related risk-taking and injuries, and intentions to intervene in friends’ risky road behavior. SPIY was implemented in Grade 8 Health classes and evaluated using survey and focus group data from 843 students across 10 Australian secondary schools. Intervention students reported less passenger-related risk-taking six months following the program. Their intention to protect friends from underage driving also increased. The results of this study show that a comprehensive, school-based program targeting individual and social changes can increase adolescent passenger safety.

Primary classroom teachers' use of social and emotional wellbeing programs and the factors influencing program use

There has been a rapid escalation in the development and evaluation of social and emotional well-being (SEW) programs in primary schools over the last few decades. Despite the plethora of programs available, primary teachers’ use of SEW programs is not well documented in Australian schools, with even less consideration of the factors influencing program use. A cross-sectional survey was undertaken with primary classroom teachers across twelve schools in the Brisbane and Sunshine Coast Education Districts in Queensland, Australia, during 2005. A checklist of SEW programs and an audit of SEW practices in schools were employed to investigate the number, range and types of SEW programs used by primary classroom teachers and the contextual factors influencing program use. Whilst the majority of implementation studies have been conducted under intervention conditions, this study was designed to capture primary classroom teachers’ day-to-day use of SEW programs and the factors influencing program use under real-world conditions. The findings of this research indicate that almost three quarters of the primary classroom teachers involved in the study reported using at least one SEW program during 2005. Wide variation in the number and range of programs used was evident, suggesting that teachers are autonomous in their use of SEW programs. Evidence-based SEW programs were used by a similar proportion of teachers to non-evidence-based programs. However, irrespective of the type of program used, primary teachers overwhelmingly reported using part of a SEW program rather than the whole program. This raises some issues about the quality of teachers’ program implementation in real-world practice, especially with respect to programs that are evidence-based. A content analysis revealed that a wide range of factors have been examined as potential influences on teachers’ implementation of health promotion programs in schools, including SEW programs, despite the limited number of studies undertaken to date. However, variation in the factors examined and study designs employed both within and across health promotion fields limited the extent to which studies could be compared. A methodological and statistical review also revealed substantial variation in the quality of reporting of studies. A variety of factors were examined as potential influences on primary classroom teachers’ use of SEW programs across multiple social-ecological levels of influence (ranging from community to school and individual levels). In this study, parent or caregiver involvement in class activities and the availability of wellbeing-related policies in primary schools were found to be influential in primary classroom teachers’ use of SEW programs. Teachers who often or always involve parents or caregivers in class activities were at a higher odds of program use relative to teachers who never or rarely involved parents or caregivers in class activities. However, teachers employed in schools with the highest number of wellbeing-related policies available were at a lower odds of program use relative to teachers employed in schools with fewer wellbeing-related policies available. Future research should investigate primary classroom teachers’ autonomy and motivations for using SEW programs and the reasons behind the selection and use of particular types of programs. A larger emphasis should also be placed upon teachers not using SEW programs to identify valid reasons for non-use. This would provide another step towards bridging the gap between the expectations of program developers and the needs of teachers who implement programs in practice. Additionally, the availability of wellbeing-related school policies and the types of activities that parents and caregivers are involved with in the classroom warrant more in-depth investigation. This will help to ascertain how and why these factors influence primary classroom teachers’ use of SEW programs on a day-to-day basis in schools.

A stakeholder process evaluation of a social marketing walking intervention targeting children

One quarter of Australian children are overweight or obese (ABS, 2010), putting them at increased risk of physical and psychological health problems (Reilly et al., 2003). Overweight and obesity in childhood tends to persist into adulthood and is associated with premature death and morbidity (Reilly & Kelly, 2011). Increases in Australian children’s weight have coincided with declines in active transportation, such as walking, to school (Salmon et al., 2005). To address this problem, the Victorian Health Promotion Foundation (VicHealth), which is an independent statutory authority which advises government and contributes to promoting good health in Victoria (VicHealth, 2014), developed the Walk to School program. Walk to School aims to encourage primary school children in Victoria to walk to and from school more often. Walking to school is a low cost and effective means of reducing excess weight (Rosenberg et al., 2006) that can be easily integrated into daily routine (Brophy et al., 2011). The purpose of this paper is to present the results of the stakeholder process evaluation of Walk to School 2013, which forms part of a broader outcome evaluation that is currently in field. Although there is an emphasis on outcome evaluation of programs, process evaluation can be equally important in determining program success (Saunders et al., 2005). Further, process evaluation to assess program delivery and utilization is explicitly recommended by two social marketing frameworks (see Lefebvre et al., 1988; Walsh et al., 1993).

[await full-text]Evaluation of QAS Workplace Health and Safety Action Plan

This report identifies the outcomes of a program evaluation of the five year Workplace Health and Safety Strategy (2012-2017), specifically, the engagement component within the Queensland Ambulance Service. As part of the former Department of Community Safety, their objective was to work towards harmonising the occupational health and safety policies and process to improve the workplace culture. The report examines and assess the process paths and resource inputs into the strategy, provides feedback on progress to achieving identified goals as well as identify opportunities for improvements and barriers to progress. Consultations were held with key stakeholders within QAS and focus groups were facilitated with managers and health and safety representatives of each Local Area Service Network.

Report on Red Light Camera Program: Operation from July 1988 to December 1989

EXECUTIVE SUMMARY (excerpts) The red light camera (RLC) program commenced in July 1988, with five cameras operating at 15 sites in metropolitan Adelaide. This report deals with the first eighteen months of operation, to December 1989. A number of recommendations have been made… PROGRAM EVALUATION … In 1989 dollars, the program was estimated to have achieved an accident reduction benefit of $1.4m in the first 12 months of operation, which is almost twice the benefit expected using the assumptions made when selecting the sites. (There are 8 recommendations, mostly specific to the particular program characteristics)