Evaluation of innovative state and community alcohol projects: breath alcohol testing program, effectiveness, impact and transferability. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Department of Transportation: enhancing policy and program effectiveness through improved management.

Mode of access: Internet.

FAMILY CHARACTERISTICS, STATE PROGRAM EFFECTIVENESS, AND REPORT OF INADEQUATE CARE AMONG FAMILIES OF YOUNG CHILDREN WITH HEARING LOSS

Approximately 1.6 per 1,000 newborns in the U.S. are born with hearing loss. Congenital hearing loss poses a risk to their speech, language, cognitive, and social-emotional development. Early detection and intervention can improve outcomes. Every state has an Early Hearing Detection and Intervention program (EHDI) to promote and track screening, audiological assessments and linkage to early intervention. However, a large percentage of children are “lost to system (LTS),” meaning that they did not receive recommended care or that it was not reported. This study used data from the 2009-2010 National Survey of Children with Special Health Care Needs and data from the 2011 EHDI Hearing Screening and Follow-Up Survey to examine how 1) family characteristics; 2) EHDI program effectiveness, as determined by LTS percentages; and 3) the family conditions of education and poverty are related to parental report of inadequate care. The sample comprised 684 children between the ages of 0 and 5 years with hearing loss. The results indicated that living in states with less effective EHDI programs was associated with an increased likelihood of not receiving early intervention services (EIS) and of reporting poor family-centered communication. Sibling classification was associated with both receipt of EIS and report of unmet need. Single mothers were less likely to report increased difficulties accessing care. Poor and less educated families, assessed separately, who lived in states with less effective EHDI programs, were more likely to report non-receipt of EIS and less likely to report unmet need as compared to similar families living in states with more effective programs. Poor families living in states with less effective programs were more likely to report less coordinated care than were poor families living in states with more effective programs. This study supports the conclusion that both family characteristics and the effectiveness of state programs affect quality of care outcomes. It appears that less effective state programs affect disadvantaged families’ service receipt report more than that of advantaged families. These findings are important because they may provide insights into the development of targeted efforts to improve the system of care for children with hearing loss.

Tobacco use prevention education (TUPE) programs in the state of Florida: Teachers' perceptions of program structure and effectiveness

This study described teacher perceptions of TUPE program effectiveness in Florida in an attempt to improve programs by identifying factors that might influence teacher motivation and performance. Very little work has been done to examine how teachers' perceptions are related to the effectiveness of TUPE programs. A statewide survey provided information about how teachers' perceptions of program effectiveness are affected by variables such as: program structure, barriers, tobacco use norms, and training variables. Data were obtained from a telephone survey conducted in Florida as part of the Tobacco Pilot Project (TPP). The sample included 296 middle school teachers and 282 high school teachers as well as 193 middle school principals and 190 high school principals. Correlational and hierarchical regression analyses identified correlates and predictors of teachers' ratings of effectiveness. Results suggest that use of peer leaders, more frequent evaluations, a higher degree of parent involvement, fewer barriers, greater student interest, and lower tolerance for tobacco use were correlated with higher ratings of program effectiveness. Furthermore, student interest, peer, staff, and community tolerance norms, peer leaders, program evaluation, and parent involvement predicted middle school teachers' perceptions. Parent tolerance, student interest, number of barriers, and more frequent program evaluation predicted high school teachers' perceptions. In addition, middle school teachers who reported a lower number of factors negatively associated with teacher receptivity were more likely to view TUPE programs more favorably than teachers who reported a greater number of these risk factors. This relationship was not as robust among the high school teacher sample. Differences between the middle and high school sample were found in the magnitude and number of significant correlations, the proportion of variance accounted for by predictor variables, and the strength of the relationship between the number of factors negatively associated with teacher receptivity and teachers' perceptions of TUPE effectiveness. These findings highlighted the importance of the timing, program features, and the external environment for enhancing or minimizing teachers' ratings of TUPE program effectiveness. In conclusion, significant increases in TUPE teachers' self-efficacy will occur through the participation of peers, parents, staff, and community leaders in different aspects of TUPE programs. ^

The development and implementation of the Promoting Resilient Officers (PRO) Program

This article describes the rationale, developmental process, and content of a resilience-building program that has been implemented with new recruits to a police academy. The process of extensive consultation with the police service (consistent with community-based participatory research principles) has helped to provide a sustainable and pragmatic program framework. The Promoting Resilient Officers (PRO) program is a seven-session strength-based program that integrates CBT and interpersonal perspectives within a salutogenic paradigm. PRO also includes two “refresher” sessions delivered online up to 18 months post the initial face-to-face sessions. PRO was delivered with high fidelity as an integral part of police recruit training and made sustainable by using psychologists within the police service to deliver the intervention. Implementation incorporated a Randomized Controlled design by which a rigorous evaluation of program effectiveness is being conducted. Initial data presented indicates a high level of engagement and acceptability of the PRO program.

Development of a school connectedness component of an adolescent injury prevention program : lessons for implementation

The school environment plays an important role in shaping adolescent outcomes, and research increasingly demonstrates the need to target the school social context in health promotion programs. This paper describes the research process undertaken to design a school connectedness component of an injury prevention program for early adolescents, Skills for Preventing Injury in Youth (SPIY). The connectedness component takes the form of a professional development workshop for teachers on increasing students’ connectedness to school, and this paper describes the research process used to construct program material. It also describes the methods used to encourage teachers’ implementation of connectedness strategies following program delivery. A multi-stage process of data collection included, (i) surveys with 540 Grade 9 students to examine links between school connectedness and risk-related injury, (ii) a systematic literature review of previously-evaluated school connectedness programs to determine key strategies that encourage implementation fidelity and program effectiveness, and (iii) interviews with 14 high school teachers to understand current use of connectedness strategies and ideas for program design. Findings from each stage are discussed in terms of how results informed the program design. The survey data provided information from which to frame program content, and the results of the systematic review demonstrated effective program strategies. The teacher interview data also provided program content incorporating target participants’ views and aligning with their priorities, which is important to ensure effective implementation of program strategies. A comprehensive design process provides an understanding of methods for, and may encourage, teachers’ future implementation of program strategies.

How small business advisory program delivery methods (collective learning, tailored, and practice-based approaches) affect learning and innovation

Past studies relate small business advisory program effectiveness to advisory characteristics such as advisory intensity and scope. We contribute to existing literature by seeking to identify the impact of different advisory program methods of delivery on learning and subsequent firm innovation behavior. Our research is based on a survey of 257 Australian firms completing small business advisory programs in the three years preceding the research. We explore the range of small business advisory program delivery methods in which our surveyed firms participated and, with reference to the literature on organizational learning and innovation, we analyze predictors of firms' learning ability and innovativeness based on the identified delivery methods. First, we found that business advisory programs that involved high levels of collective learning and tailored approaches enhanced firms' perceptions of their learning of critical skills or capabilities. We also found that small business advisory programs that were delivered by using practice-based approaches enhanced firms' subsequent organizational innovation. We verified this finding by testing whether firms that have participated in small business advisory services subsequently demonstrate improved behavior in terms of organizational innovativeness, when compared with matched firms that have not participated in an advisory program.

Impact of definitions of loss to follow-up (LTFU) in antiretroviral therapy program evaluation: variation in the definition can have an appreciable impact on estimated proportions of LTFU

OBJECTIVE To examine the impact of different definitions of loss to follow-up (LTFU) on estimates of program outcomes in cohort studies of patients on antiretroviral therapy (ART). STUDY DESIGN AND SETTING We examined the impact of different definitions of LTFU using data from the International Epidemiological Databases to Evaluate AIDS-Southern Africa. The reference approach, Definition A, was compared with five alternative scenarios that differed in eligibility for analysis and the date assigned to the LTFU outcome. Kaplan-Meier estimates of LTFU were calculated up to 2 years after starting ART. RESULTS Estimated cumulative LTFU were 14% and 22% at 12 and 24 months, respectively, using the reference approach. Differences in the proportion LTFU were reported in the alternative scenarios with 12-month estimates of LTFU varying by up to 39% compared with Definition A. Differences were largest when the date assigned to the LTFU outcome was 6 months after the date of last contact and when the site-specific definition of LTFU was used. CONCLUSION Variation in the definitions of LTFU within cohort analyses can have an appreciable impact on estimated proportions of LTFU over 2 years of follow-up. Use of a standardized definition of LTFU is needed to accurately measure program effectiveness and comparability between programs.

Evaluation of a wellness program at a large private sector petrochemical company in Texas

The study purpose was to analyze the effects Integrated Health Solutions (IHS), an employee wellness program that has been implemented for one year on the corporate campus of a major private sector petrochemical company in Houston, TX, has on employee health. ^ Chronic diseases are the leading causes of morbidity and mortality in the United States and are the most preventable of all health problems. The costs of chronic diseases in the working-age adult population include not only health problems and a decrease in quality of life, but also an increase the cost of health care and costs to businesses and employers, both directly and indirectly. These emerging costs to employers as well as the fact that adults now spend the majority of waking hours at the office have increased the interest in worksite health promotion programs that address many of the behavioral factors that lead to chronic conditions. Therefore, implementing and evaluating programs that are aimed at promoting health and decreasing the prevalence of chronic diseases at worksites is very important. ^ Data came from existing data that were collected by IHS staff during employee biometric screenings at the company in 2010 and 2011. Data from employees who participated in screenings in both 2010 and 2011 were grouped into a cohort by IHS staff. ^ One-tailed t-tests were conducted to determine if there were significant improvements in the biometric measures of body fat percentage, BMI, waist circumference, systolic and diastolic blood pressures, total, HDL, and LDL cholesterol levels, triglycerides, blood glucose levels, and cardiac risk ratios. Sensitivity analysis was conducted to determine if there were differences in program outcomes when stratified by age, gender, job type, and time between screenings. ^ Mean differences for the variables from 2010 to 2011 were small and not always in the desired direction for health improvement indicators. Through conducting t-tests, it was found that there were significant improvements in HDL, cardiac risk ratio, and glucose levels. There were significant increases in cholesterol, LDL, and diastolic blood pressures. For the IHS program, it appears that gender, job type, and time between screenings were possible modifiers of program effectiveness. When program outcome measures were stratified by these factors, results suggest that corporate employees had better outcomes than field employees, males had better outcomes overall than females, and more positive program effects were seen for employees with less time between their two screenings. ^ Recommendations for the program based on the results include ensuring validity of instruments and initial and periodic training of measurement procedures and equipment handling, using normative data or benchmarks to decrease chances for biased estimates of program effectiveness, measuring behaviors as well as biometric and physiologic statuses and changes, and collecting level of engagement data.^

Greek or not : the use of symbols and abbreviations in mathematics

The use of symbols and abbreviations adds uniqueness and complexity to the mathematical language register. In this article, the reader’s attention is drawn to the multitude of symbols and abbreviations which are used in mathematics. The conventions which underpin the use of the symbols and abbreviations and the linguistic difficulties which learners of mathematics may encounter due to the inclusion of the symbolic language are discussed. 2010 NAPLAN numeracy tests are used to illustrate examples of the complexities of the symbolic language of mathematics.

An integrated educational model for continuing nurse education

Aim This paper reports on the development and evaluation of an integrated clinical learning model to inform ongoing education for surgical nurses. The research aim was to evaluate the effectiveness of implementing a Respiratory Skills Update (ReSKU) education program, in the context of organisational utility, on improving surgical nurses' practice in the area of respiratory assessment. Background Continuous development and integration of technological innovations and research in the healthcare environment mandate the need for continuing education for nurses. Despite an increased worldwide emphasis on this, there is scant empirical evidence of program effectiveness. Methods A quasi experimental pre test, post test non–equivalent control group design evaluated the impact of the ReSKU program on surgical nurses' clinical practice. The 2008 study was conducted in a 400 bed regional referral public hospital and was consistent with contemporary educational approaches using multi-modal, interactive teaching strategies. Findings The study demonstrated statistically significant differences between groups regarding reported use of respiratory skills, three months after ReSKU program attendance. Between group data analysis indicated that the intervention group's reported beliefs and attitudes pertaining to subscale descriptors showed statistically significant differences in three of the six subscales. Conclusion The construct of critical thinking in the clinical context, combined with clinical reasoning and purposeful reflection, was a powerful educational strategy to enhance competency and capability in clinicians.

Characteristics of Chinese drivers attending a mandatory training course following license suspension

Penalties and sanctions to deter risky/illegal behaviours are important components of traffic law enforcement. Sanctions can be applied to the vehicle (e.g., impoundment), the person (e.g., remedial programs or jail), or the licence (e.g., disqualification). For licence sanctions, some offences attract automatic suspension while others attract demerit points which can indirectly lead to licence loss. In China, a licence is suspended when a driver accrues twelve demerit points within one year. When this occurs, the person must undertake a one-week retraining course at their own expense and successfully pass an examination to become relicensed. Little is known about the effectiveness of this program. A pilot study was conducted in Zhejiang Province to examine basic information about participants of a retraining course. The aim was to gather baseline data for future comparison. Participants were recruited at a driver retraining centre in a large city in Zhejiang Province. In total, 239 suspended drivers completed an anonymous questionnaire which included demographic information, driving history, and crash involvement. Overall, 87% were male with an overall mean age of 35.02 years (SD=8.77; range 21-60 years). A large proportion (83.3%) of participants owned a vehicle. Commuting to work was reported by 64% as their main reason for driving, while 16.3% reported driving for work. Only 6.4% reported holding a licence for 1 year or less (M=8.14 years, SD=6.5, range 1-31 years) and people reported driving an average of 18.06 hours/week (SD=14.4, range 1-86 hours). This represents a relatively experienced group, especially given the increase in new drivers in China. The number of infringements reportedly received in the previous year ranged from 2 to 18 (M=4.6, SD=3.18); one third of participants reported having received 5 or more infringements. Approximately one third also reported having received infringements in the previous year but not paid them. Various strategies for avoiding penalties were reported. The most commonly reported traffic violations were: drink driving (DUI; 0.02-0.08 mg/100ml) with 61.5% reporting 1 such violation; and speeding (47.7% reported 1-10 violations). Only 2.2% of participants reported the more serious drunk driving violation (DWI; above 0.08mg/100ml). Other violations included disobeying traffic rules, using inappropriate licence, and licence plate destroyed/not displayed. Two-thirds of participants reported no crash involvement in the previous year while 14.2% reported involvement in 2-5 crashes. The relationship between infringements and crashes was limited, however there was a small, positive significant correlation between crashes and speeding infringements (r=.2, p=.004). Overall, these results indicate the need for improved compliance with the law among this sample of traffic offenders. For example, lower level drink driving (DUI) and speeding were the most commonly reported violations with some drivers having committed a large number in the previous year. It is encouraging that the more serious offence of drunk driving (DWI) was rarely reported. The effectiveness of this driver retraining program and the demerit point penalty system in China is currently unclear. Future research including driver follow up via longitudinal study is recommended to determine program effectiveness to enhance road safety in China.

Evaluation in health outcomes research : linking theories, methodologies and practice in health promotion.

Health outcomes research has developed as a means of evaluating the effectiveness of health care interventions and as an approach to informing resource allocation. The use of a health outcomes approach in health promotion has made increasing demands on evaluation methodologies to demonstrate program effectiveness. However, criticism of the contribution of health promotion to outcomes research has made several assumptions about the use of qualitative methodologies and the content of program objectives largely derived from a biomedical approach. In contrast to the measurement of biomedical interventions in clinical health care, health promotion practice involves social phenomena, wide-reaching cultural, psychological, political and ideological problems and issues. The integration of methodologies of health promotion evaluation will inform further conceptualisation of the health outcomes approach with the differentiation of three types of outcomes: health development outcomes; social health outcomes; and biomedical health outcomes. It is concluded that this differentiation moves away from dualist concepts that advocate the replacement of goals and targets with regional and locally based approaches. Rather, the future direction for health promotion evaluation needs to employ a framework that elaborates multiple methodologies and approaches necessary for establishing what relationships exist between morbidity, mortality, health advancement and equity.

Segmenting Australian high school students : two-step cluster analysis preliminary results

A one size fits all approach dominates alcohol programs in school settings (Botvin et al., 2007), which may limit program effectiveness (Snyder et al., 2004). Programs tailored to the meet the needs and wants of adolescent groups may be more effective. Limited attention has been directed towards employing a full segmentation process. Where segmentation has been examined, the focus has remained on socio-demographic characteristics and more recently psychographic variables (Mathijssen et al., 2012). The current study aimed to identify whether the addition of behaviour could be used to identify segments. Variables included attitudes towards binge drinking (α = 0.86), behavioral intentions’ (α = 0.97), perceived behavioral control (PBC), injunctive norms (α = 0.94); descriptive norms (α = 0.87), knowledge and reported behaviour. Data was collected from five schools, n = 625 (32.96% girls). Two-Step cluster analysis produced a sample (n = 625) with a silhouette measure of cohesion and separation of 0.4. The intention measure and whether students reported previously consuming alcohol were the most distinguishing characteristics - predictor importance scores of (1.0). A four segment solution emerged. The first segment (“Male abstainers” – 37.2%) featured the highest knowledge score (M: 5.9) along with the lowest-risk drinking attitudes and intentions to drink excessively. Segment 2 (“At risk drinkers” - 11.2%) were characterised by their high-risk attitudes and high-risk drinking intentions. Injunctive (M: 4.1) and descriptive norms (M: 4.9) may indicate a social environment where drinking is the norm. Segment 3 (”Female abstainers” – 25.9%) represents young girls, who have the lowest-risk attitudes and low intentions to drink excessively. The fourth and final segment (boys = 67.4%) (“Moderate drinkers” – 25.7%) all report previously drinking alcohol yet their attitudes and intentions towards excessive alcohol consumption are lower than other segments. Segmentation focuses on identifying groups of individuals who feature similar characteristics. The current study illustrates the importance of including reported behaviour in addition to psychographic and demographic characteristics to identify unique groups to inform intervention planning and design. Key messages The principle of segmentation has received limited attention in the context of school-based alcohol education programs. This research identified four segments amongst 14-16 year high school students, each of which can be targeted with a unique, tailored program to meet the needs and wants of the target audience.