Changing motorcycle rider safety attitudes and motives for risk taking : process evaluation of a rider training intervention

Risk-taking behaviour by motorcyclists has been shown to contribute to a substantial proportion of road crashes in Australia and abroad. Concern has been expressed that traditional motorcycle licence training programs do not sufficiently address such behaviour. Accordingly, the Three Steps to Safer Riding program was developed to address risk taking behaviour by riders as an adjunct to existing skills-based rider training. The program was designed to be delivered in a one hour classroom session at the start of training, with a 20 minute debrief to revise the key concepts at the end of training. This paper reports on the key training concepts, methodology and implementation of the pilot program with a major rider training organisation in Queensland and presents findings from a process evaluation. The Three Steps to Safer Riding intervention pilot was delivered to 518 learner riders over a three month period. Follow-up focus groups and one interview with intervention participants (N=18) five to eight months after completion of the program suggest that new riders (absolute novices) embraced and internalised many of the intervention concepts. However, some riders who had previous riding experience prior to training stated these issues were common sense, yet still expressed riding styles that were contrary to some of the key intervention messages. This is discussed in terms of raising awareness of risk issues for motorcyclists versus behaviour change. Additionally, interviews conducted with riding instructors are discussed regarding logistical challenges of implementation, training consistency, skills required to deliver the program, support for the program, and student engagement.

A process evaluation of a comprehensive school based injury prevention program

A process evaluation enables understanding of critical issues that can inform the improved, ongoing implementation of an intervention program. This study describes the process evaluation of a comprehensive, multi-level injury prevention program for adolescents. The program targets change in injury associated with violence, transport and alcohol risks and incorporates two primary elements: an 8-week, teacher delivered attitude and behaviour change curriculum for Grade 8 students; and a professional development program for teachers on school level methods of protection, focusing on strategies to increase students’ connectedness to school.

Reaching high-risk adolescents : a process evaluation of a school based injury prevention program

High-risk adolescents are a population most vulnerable to harm from injury due to increased engagement in risk taking behaviour. There is a gap in the literature regarding how universal school based injury prevention programs apply to high-risk adolescents. This study involves a component of the process evaluation of a school based injury prevention program, as it relates to high-risk adolescents (13-14 years)...

A stakeholder process evaluation of a social marketing walking intervention targeting children

One quarter of Australian children are overweight or obese (ABS, 2010), putting them at increased risk of physical and psychological health problems (Reilly et al., 2003). Overweight and obesity in childhood tends to persist into adulthood and is associated with premature death and morbidity (Reilly & Kelly, 2011). Increases in Australian children’s weight have coincided with declines in active transportation, such as walking, to school (Salmon et al., 2005). To address this problem, the Victorian Health Promotion Foundation (VicHealth), which is an independent statutory authority which advises government and contributes to promoting good health in Victoria (VicHealth, 2014), developed the Walk to School program. Walk to School aims to encourage primary school children in Victoria to walk to and from school more often. Walking to school is a low cost and effective means of reducing excess weight (Rosenberg et al., 2006) that can be easily integrated into daily routine (Brophy et al., 2011). The purpose of this paper is to present the results of the stakeholder process evaluation of Walk to School 2013, which forms part of a broader outcome evaluation that is currently in field. Although there is an emphasis on outcome evaluation of programs, process evaluation can be equally important in determining program success (Saunders et al., 2005). Further, process evaluation to assess program delivery and utilization is explicitly recommended by two social marketing frameworks (see Lefebvre et al., 1988; Walsh et al., 1993).

Educators’ perspectives about how older hospital patients can engage in a falls prevention education programme: A qualitative process evaluation

- Objectives Falls are the most frequent adverse event reported in hospitals. Patient and staff education delivered by trained educators significantly reduced falls and injurious falls in an older rehabilitation population. The purpose of the study was to explore the educators’ perspectives of delivering the education and to conceptualise how the programme worked to prevent falls among older patients who received the education. - Design A qualitative exploratory study. - Methods Data were gathered from three sources: conducting a focus group and an interview (n=10 educators), written educator notes and reflective researcher field notes based on interactions with the educators during the primary study. The educators delivered the programme on eight rehabilitation wards for periods of between 10 and 40 weeks. They provided older patients with individualised education to engage in falls prevention and provided staff with education to support patient actions. Data were thematically analysed and presented using a conceptual framework. - Results Falls prevention education led to mutual understanding between staff and patients which assisted patients to engage in falls prevention behaviours. Mutual understanding was derived from the following observations: the educators perceived that they could facilitate an effective three-way interaction between staff actions, patient actions and the ward environment which led to behaviour change on the wards. This included engaging with staff and patients, and assisting them to reconcile differing perspectives about falls prevention behaviours. - Conclusions Individualised falls prevention education effectively provides patients who receive it with the capability and motivation to develop and undertake behavioural strategies that reduce their falls, if supported by staff and the ward environment.

A cluster randomised controlled trial and process evaluation of the early years DELTA parenting programme

This paper reports the results from a cluster randomised controlled trial (RCT) and process evaluation of the Early Years DELTA Parenting Programme; a six-week, group based intervention. The evaluation was part funded by DELTA and involved 23 primary schools and 334 parents. Results showed that intervention parents reported increased parental self-efficacy in relation to: knowledge of their child’s development and needs; self-acceptance as a good parent, and; disciplining and setting boundaries. No change was observed in the remaining outcome areas. Parent interviews indicated a high level of programme satisfaction and the main benefits reflected the outcomes measured by the RCT. This small, robust evaluation is commensurate with other similar research demonstrating the effectiveness and reach of short-term, group-based parenting programmes.

Process Evaluation of the Roots of Empathy Program

This paper presents the findings of a qualitative process evaluation of the Roots of Empathy (ROE) programme. ROE is a universal, classroom-based intervention, which aims to enhance social and emotional learning of primary (elementary) school children. Effective delivery of such complex social interventions in real-world settings requires in-depth knowledge and understanding of factors that interact to influence implementation and fidelity. A case study methodology was employed with six schools, to explore the views of key actors and stakeholders involved in the delivery and receipt of the programme. Overall, ROE was delivered with high fidelity and the programme was viewed positively across the schools. However, one issue was the varied level of interest and awareness of the programme from parents.

Description and process evaluation of pharmacists’ interventions in a pharmacist-led information technology-enabled multicentre cluster randomised controlled trial for reducing medication errors in general practice (PINCER trial)

Objective To undertake a process evaluation of pharmacists' recommendations arising in the context of a complex IT-enabled pharmacist-delivered randomised controlled trial (PINCER trial) to reduce the risk of hazardous medicines management in general practices. Methods PINCER pharmacists manually recorded patients’ demographics, details of interventions recommended, actions undertaken by practice staff and time taken to manage individual cases of hazardous medicines management. Data were coded and double entered into SPSS v15, and then summarised using percentages for categorical data (with 95% CI) and, as appropriate, means (SD) or medians (IQR) for continuous data. Key findings Pharmacists spent a median of 20 minutes (IQR 10, 30) reviewing medical records, recommending interventions and completing actions in each case of hazardous medicines management. Pharmacists judged 72% (95%CI 70, 74) (1463/2026) of cases of hazardous medicines management to be clinically relevant. Pharmacists recommended 2105 interventions in 74% (95%CI 73, 76) (1516/2038) of cases and 1685 actions were taken in 61% (95%CI 59, 63) (1246/2038) of cases; 66% (95%CI 64, 68) (1383/2105) of interventions recommended by pharmacists were completed and 5% (95%CI 4, 6) (104/2105) of recommendations were accepted by general practitioners (GPs), but not completed at the end of the pharmacists’ placement; the remaining recommendations were rejected or considered not relevant by GPs. Conclusions The outcome measures were used to target pharmacist activity in general practice towards patients at risk from hazardous medicines management. Recommendations from trained PINCER pharmacists were found to be broadly acceptable to GPs and led to ameliorative action in the majority of cases. It seems likely that the approach used by the PINCER pharmacists could be employed by other practice pharmacists following appropriate training.

Process evaluation of a knowledge translation intervention using facilitation of local stakeholder groups to improve neonatal survival in the Quang Ninh province, Vietnam

BACKGROUND: Annually, 2.8 million neonatal deaths occur worldwide, despite the fact that three-quarters of them could be prevented if available evidence-based interventions were used. Facilitation of community groups has been recognized as a promising method to translate knowledge into practice. In northern Vietnam, the Neonatal Health - Knowledge Into Practice trial evaluated facilitation of community groups (2008-2011) and succeeded in reducing the neonatal mortality rate (adjusted odds ratio, 0.51; 95 % confidence interval 0.30-0.89). The aim of this paper is to report on the process (implementation and mechanism of impact) of this intervention. METHODS: Process data were excerpted from diary information from meetings with facilitators and intervention groups, and from supervisor records of monthly meetings with facilitators. Data were analyzed using descriptive statistics. An evaluation including attributes and skills of facilitators (e.g., group management, communication, and commitment) was performed at the end of the intervention using a six-item instrument. Odds ratios were analyzed, adjusted for cluster randomization using general linear mixed models. RESULTS: To ensure eight active facilitators over 3 years, 11 Women's Union representatives were recruited and trained. Of the 44 intervention groups, composed of health staff and commune stakeholders, 43 completed their activities until the end of the study. In total, 95 % (n = 1508) of the intended monthly meetings with an intervention group and a facilitator were conducted. The overall attendance of intervention group members was 86 %. The groups identified 32 unique problems and implemented 39 unique actions. The identified problems targeted health issues concerning both women and neonates. Actions implemented were mainly communication activities. Communes supported by a group with a facilitator who was rated high on attributes and skills (n = 27) had lower odds of neonatal mortality (odds ratio, 0.37; 95 % confidence interval, 0.19-0.73) than control communes (n = 46). CONCLUSIONS: This evaluation identified several factors that might have influenced the outcomes of the trial: continuity of intervention groups' work, adequate attributes and skills of facilitators, and targeting problems along a continuum of care. Such factors are important to consider in scaling-up efforts.

Business To Business (B2B) Service Processes: An Approach To Customer Complaint Process Evaluation Towards Service Excellence

Trabalho de Dissertação que identifica as decisões estratégicas relacionadas com a estrutura de gestão de serviços, no contexto de tratamento de reclamações. Os temas de recuperação de serviços e gestão de reclamações são discutidos e são listadas as melhores práticas com o objetivo de prover qualidade de serviço excelente. Este trabalho apresenta uma revisão da literatura sobre gestão de serviços e sua estratégia, e sobre valor aos clientes e sua satisfação. Qualidade de Serviço, Recuperação de Serviço e Gestão de Reclamações são revistos, também para contextualizar o processo de tratamento de reclamações de uma empresa do ramo industrial em ambiente de negócios entre empresas (business to business), cujos dados foram utilizados para construção do modelo de simulação de um processo de tratamento de reclamações. Os resultados desta simulação, junto com o suporte de um questionário sobre tratamento de reclamações, proveram pontos de reflexão e recomendações sobre desenho da estrutura de serviços e de seu desempenho, voltados para a satisfação dos clientes.

An Educational international partnership responding to local needs: Process evaluation of the Brazil FAIMER Regional Institute

The Brazilian public health system requires competent professionals sensitive to the needs of the population. The Foundation for Advancement of International Medical Education and Research (FAIMER) provides a two-year faculty development programme for health professions educators, aiming to build leadership in education to improve health. A partnership with governmental initiatives and FAIMER was established for meeting these needs. This paper describes the initial process evaluation results of the Brazilian FAIMER Institute Fellowship (FAIMER BR). Methods: Data were analysed for the classes 2007-2010 regarding: application processes; innovation project themes; retrospective post-pre self-ratings of knowledge acquisition; and professional development portfolios. Results: Seventeen of 26 Brazilian states were represented among 98 Fellows, predominantly from public medical schools (75.5%) and schools awarded Ministry of Health grants to align education with public health services (89.8%). One-third (n = 32) of Fellows' innovation projects were related to these grants. Significant increases occurred in all topic subscales on self-report of knowledge acquisition (eff ect sizes, 1.21-2.77). In the follow up questionnaire, 63% of Fellows reported that their projects were incorporated into the curriculum or institutional policies. The majority reported that the programme deepened their knowledge (98%), provided new ideas about medical education (90%) and provided skills for conflict management (63%). One-half of the Fellows reported sustained benefits from the programme listserv and other communications, including breadth of expertise, establishment of research collaboration and receiving emotional support. Conclusion: Contributors to initial programme success included alignment of curriculum with governmental initiatives, curriculum design merging educational technology, leadership and management skills and central role of an innovation educational project responding to local needs.

A process evaluation of the childhood lead poisoning prevention program in Houston, Texas, 1992--1995

A process evaluation of the Houston Childhood Lead Poisoning Prevention Program, 1992-1995, was conducted. The Program's goal is to reduce lead poisoning prevalence. The study proposed to determine to what extent the Program was implemented as planned by measuring how well Program services were actually: (1) received by the intended target population; (2) delivered to children with elevated blood lead levels; (3) delivered in compliance with the Centers for Disease Control and Prevention and Program guidelines and timetables; and (4) able to reduce lead poisoning prevalence among those rescreened. Utilizing a program monitoring design, the Program's pre-collected computer records were reviewed. The study sample consisted of 820 children whose blood lead levels were above 15 micrograms per deciLiter, representing approximately 2.9% of the 28,406 screened over this period. Three blood lead levels from each participant were examined: the initial elevated result; the confirmatory result; and the next rescreen result, after the elevated confirmatory level. Results showed that the Program screened approximately 18% (28,406 of 161,569) of Houston's children under age 6 years for lead poisoning. Based on Chi-square tests of significance, results also showed that lead-poisoned participants were more likely to be younger than 3 years, male and Hispanic, compared to those not lead poisoned. The age, gender and ethnic differences observed were statistically significant (p =.01, p =.00, p =.00). Four of the six Program services: medical evaluations, rescreening, environmental inspections and confirmation, had satisfactory delivery completion rates of 71%-98%. Delivery timetable compliance rates for three of the six services examined: outreach contacts, home visits and environmental inspections were below 32%. However, dangerously elevated blood lead levels fell and lead poisoning prevalence dropped from 3.3% at initial screening to 1.2% among those rescreened, after intervention. From a public health perspective, reductions in lead poisoning prevalence are very meaningful. Based on these findings, the following are recommendations for future research: (1) integrate Program database files by utilizing a computer database management program; (2) target services at Hispanic male children under age 3 years living in the highest risk neighborhoods; (3) increase resources to: improve tracking and documentation of service delivery and provide more non-medical case management and environmental services; and (4) share the evaluation methodology/findings with the Centers for Disease Control and Prevention administrators; the implications may be relevant to other program managers conducting such assessments. ^

A process evaluation of a health literacy intervention targeting pediatric providers' communication skills at the Texas Children's Health Plan

Background. Health literacy is an important determinant for quality health care, and affects communication between patients and physicians. Poor communication may result in negative effects in health. Improved communication between patients and physicians could positively affect health outcomes. Communication skills are teachable.^ Objectives. (1) to evaluate the process involved in the design and implementation of a health literacy intervention targeting pediatric providers’ communication skills at the Texas Children’s Health Plan in Houston, Texas; and (2) to describe lessons learned from this process that may be used in future attempts to address the issue of health literacy and health communication. ^ Design/methods. The process evaluation of the implementation of a health literacy strategy at the Texas Children’s Health Plan (TCHP) consisted of a critical analysis of all documents and minutes from meetings of the team of investigators. It also involved a secondary analysis of data collected between December 2006 and June 2007. Descriptive statistics, paired t-test and Wilcoxon-signed-rank test were employed in analyzing the data. This information was complemented with a limited review of existing literature on communication skills training programs. ^ Results. The design of the educational intervention followed recommendations from experts in the field of health literacy. The delivery of the intervention was possible and benefited from existing resources and logistics within the TCHP. Very few targeted providers participated in two offerings of the workshop (6.6% and 1.7% respectively). After the educational intervention, providers showed increased knowledge of health literacy facts and its effects in health (p=0.001); increased awareness of the low health literacy problem (p=0.003); increased expectations for change in practice (p=0.002), and intent to use health literacy strategies for communication immediately following the intervention (p=0.001). Low participation indicated the need for further investigation of barriers to, and means for successful implementation of programs aimed to improving health communication. ^ Conclusions. A short, focused intervention utilizing health literacy strategies for communication appeared effective in increasing knowledge and intentions for change in a small group of pediatric providers. ^

Process evaluation of the Texas occupational safety & health surveillance system

Introduction: The Texas Occupational Safety & Health Surveillance System (TOSHSS) was created to collect, analyze and interpret occupational injury and illness data in order to decrease the impact of occupational injuries within the state of Texas. This process evaluation was performed midway through the 4-year grant to assess the efficiency and effectiveness of the surveillance system’s planning and implementation activities1. ^ Methods: Two evaluation guidelines published by the Centers for Disease Control and Prevention (CDC) were used as the theoretical models for this process evaluation. The Framework for Program Evaluation in Public Health was used to examine the planning and design of TOSHSS using logic models. The Framework for Evaluating Public Health Surveillance Systems was used to examine the implementation of approximately 60 surveillance activities, including uses of the data obtained from the surveillance system. ^ Results/Discussion: TOSHSS planning activities omitted the creation of a scientific advisory committee and specific activities designed to maintain contacts with stakeholders; and proposed activities should be reassessed and aligned with ongoing performance measurement criteria, including the role of collaborators in helping the surveillance system achieve each proposed activity. TOSHSS implementation activities are substantially meeting expectations and received an overall score of 61% for all activities being performed. TOSHSS is considered a surveillance system that is simple, flexible, acceptable, fairly stable, timely, moderately useful, with good data quality and a PVP of 86%. ^ Conclusions: Through the third year of TOSHSS implementation, the surveillance system is has made a considerable contribution to the collection of occupational injury and illness information within the state of Texas. Implementation of the nine recommendations provided under this process evaluation is expected to increase the overall usefulness of the surveillance system and assist TDSHS in reducing occupational fatalities, injuries, and diseases within the state of Texas. ^ 1 Disclaimer: The Texas Occupational Safety and Health Surveillance System is supported by Grant/Cooperative Agreement Number (U60 OH008473-01A1). The content of the current evaluation are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health.^