Process evaluation of the Texas occupational safety & health surveillance system

Introduction: The Texas Occupational Safety & Health Surveillance System (TOSHSS) was created to collect, analyze and interpret occupational injury and illness data in order to decrease the impact of occupational injuries within the state of Texas. This process evaluation was performed midway through the 4-year grant to assess the efficiency and effectiveness of the surveillance system’s planning and implementation activities1. ^ Methods: Two evaluation guidelines published by the Centers for Disease Control and Prevention (CDC) were used as the theoretical models for this process evaluation. The Framework for Program Evaluation in Public Health was used to examine the planning and design of TOSHSS using logic models. The Framework for Evaluating Public Health Surveillance Systems was used to examine the implementation of approximately 60 surveillance activities, including uses of the data obtained from the surveillance system. ^ Results/Discussion: TOSHSS planning activities omitted the creation of a scientific advisory committee and specific activities designed to maintain contacts with stakeholders; and proposed activities should be reassessed and aligned with ongoing performance measurement criteria, including the role of collaborators in helping the surveillance system achieve each proposed activity. TOSHSS implementation activities are substantially meeting expectations and received an overall score of 61% for all activities being performed. TOSHSS is considered a surveillance system that is simple, flexible, acceptable, fairly stable, timely, moderately useful, with good data quality and a PVP of 86%. ^ Conclusions: Through the third year of TOSHSS implementation, the surveillance system is has made a considerable contribution to the collection of occupational injury and illness information within the state of Texas. Implementation of the nine recommendations provided under this process evaluation is expected to increase the overall usefulness of the surveillance system and assist TDSHS in reducing occupational fatalities, injuries, and diseases within the state of Texas. ^ 1 Disclaimer: The Texas Occupational Safety and Health Surveillance System is supported by Grant/Cooperative Agreement Number (U60 OH008473-01A1). The content of the current evaluation are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health.^

An evaluation of a behavioral change intervention for smokeless tobacco use

During the last three decades considerable attention has been placed on the reduction of tobacco use due to cigarette smoking. During this time, studies have been funded and programs have been developed that focus on both prevention and cessation of cigarette smoking. This intense focus has led to a significant decline in cigarette smoking. But now, use of another form of tobacco--smokeless tobacco--is gaining in popularity.^ In 1989, the National Cancer Institute funded a research study at The University of Texas M. D. Anderson Cancer Center, called Working Well, to develop, implement, and evaluate worksite health promotion programs aimed at reducing cancer risks. As part of this program, a behavioral intervention for smokeless tobacco use was developed. This dissertation evaluates the impact of that behavioral change intervention for smokeless tobacco use.^ Data collected during the Working Well program were analyzed to determine the effect of the intervention. The primary outcomes analyzed were smokeless tobacco cessation, stages of change movement, and prevalence. The secondary outcomes analyzed included the prediction of smokeless tobacco use, stage movement, and cessation. Primary outcome analyses were conducted using the worksite as the unit of analysis, while the secondary analyses were conducted using the individual as the unit of analysis.^ Approximately 20% of the male population used smokeless tobacco. Results of intervention analyses indicate that the Working Well program produced no intervention effect on any of the primary outcomes. At the final observation, the experimental worksites achieved a quit rate of 27%, while the control worksites achieved a quit rate of 26% (P = 0.78). Stage movement for the experimental worksites was 49%, while the control worksites experienced stage movement of 43% (P = 0.20). The results of the analyses on smokeless tobacco prevalence followed the same pattern. Predictors of smokeless tobacco use, cessation, and stage movement were also identified.^ Based on the results found in this study, smokeless tobacco should remain a research priority. Future research should focus on smokeless tobacco use, including the identification of the determinants of smokeless tobacco use and the development of measures and effective intervention strategies. ^

Development and evaluation of a nutrition education program designed to increase fruit and vegetable consumption in girls, ages 9--12

The purpose of this study is to evaluate the theory-based Eat 5 nutrition badge. It is designed to increase fruit and vegetable (F&V) intake in 4th-6th grade junior Girl Scouts. Twenty-two troops were recruited and randomized by grade level (4th, 5th, 6th, or mixed) into either the intervention or control conditions. The leaders in the intervention condition received a brief training and the materials and conducted the program with their troops during four meetings. The Girl Scouts in the intervention condition completed 1-day Food Frequency Questionnaires and Nutrition Questionnaires both before and after completing the Eat 5 badge, and a third measurement of F&V intake three months after the posttest. Girl Scouts in the control condition were only evaluated at the three time periods.^ The primary hypotheses were that the Girl Scouts in the intervention condition would increase their daily intake of fruits and vegetables at both the posttest and three months later, compared to the Girl Scouts in the control condition. Other study questions investigated the impact of the Eat 5 program on intervening variables such as knowledge, self-efficacy, barriers, norms, F&V preference, and F&V selection and preparation skills.^ A nested ANOVA, with troop as the unit of analysis nested within condition, was used to assess the effects of the program. Pretest F&V intake and grade level were used as covariates. Pretest mean F&V intake for the total sample of 210 girls was 2.50 servings per day; 3.0 for the intervention group (n = 101). Significant increases in F&V intake (to 3.4 servings per day), knowledge, and fruit and vegetable preference were found for the intervention condition troops compared to the troops in the control condition. Three months later, the mean F&V intake had returned to pretest levels.^ This study indicates that social groups such as Girl Scouts can provide a channel for nutrition education. Long term effects were not sustained by the intervention; a possible cause was the lack of change in self-efficacy. Therefore, additional interventions are recommended such as booster lessons to maintain increased F&V intake by Girl Scouts. ^

AN INVESTIGATION OF THE IMPACT OF CHILDREN WITH BIRTH DEFECTS ON STRESS IN THEIR FAMILIES

A child with a birth defect places physical, financial and emotional stress upon the family. The purpose of this study was to assess the impact of a mildly handicapped child on the family's coping abilities.^ Two groups, 101 mothers of children with birth defects and 107 mothers of intact children, completed the Holroyd Questionnaire on Resources and Stress and the Luborsky Social Assets Scale. From these groups, 86 pairs were matched on four factors: the age (two to eight years) and sex of the study child and the mother's education and marital status.^ The children with birth defects had completed the diagnostic evaluation at the Meyer Center for Developmental Pediatrics, Texas Children's Hospital. Children with severe defects were excluded. The mean I.Q of the group was 88, s.d. 17; 17 children were mildly retarded and 35 had an I.Q. of 100 or above; areas of dysfunction included motor abnormalities, behavior disturbance, speech problems, and sensory impairments.^ The expected direction and statistically significant differences were obtained from the data for the matched pairs on the Q.R.S. scales. The mothers of children with a birth defect reported poor health, a negative attitude toward the child, being over-protective, financial problems and feeling a lack of social support and family integration. They perceived the child as socially obtrusive, limited as to occupational opportunities, and as having a difficult personality.^ The functioning levels of the handicapped children contributed to the respondent's problems. The child with behavior and speech problems but adequate intelligence was a situation which resulted in a poor health/mood of the mother. The mother's pessimism was related to the child's low intelligence.^ The social assets of the respondents with intact children were significantly higher than those of respondents of handicapped children. There was no relationship between the total social assets score and the scores on the Q.R.S. for mothers of handicapped children. These mothers did report poorer physical conditions, more smoking, and quarreling of their parents as they grew up. ^

Program evaluation for a summer science internship: Short and long term benefits as reported by interns

Undergraduate research programs have been used as a tool to attract and retain student interest in science careers. This study evaluates the short and long-term benefits of a Summer Science Internship (SSI) at the University of Texas Health Science Center at Houston– School of Public Health – in Brownsville, Texas, by analyzing survey data from alumni. Questions assessing short-term program impact were aimed at three main topics, student: satisfaction with program, self-efficacy for science after completing the program, and perceived benefits. Long-term program impact was assessed by looking at student school attendance and college majors along with perceived links between SSI and future college plans. Students reported high program satisfaction, a significant increase in science self-efficacy and high perceived benefits. At the time data were collected for the study, one-hundred percent of alumni were enrolled in school (high school or college). The majority of students indicated they were interested in completing a science major/career, heavily influenced by their participation in the program.^

Cataract surgery in cancer patients and its impact on quality of life as measured by the National Eye Institute Visual Functioning Questionnaire - 25 (NEI-VFQ-25)

Purpose. The measurement of quality of life has become an important topic in healthcare and in the allocation of limited healthcare resources. Improving the quality of life (QOL) in cancer patients is paramount. Cataract removal and lens implantation appears to improve patient well-being of cancer patients, though a formal measurement has never been published in the US literature. In this current study, National Eye Institute Visual Functioning Questionnaire (NEI-VFQ-25), a validated vision quality of life metric, was used to study the change in vision-related quality of life in cancer patients who underwent cataract extraction with intraocular lens implantation. ^ Methods. Under an IRB approved protocol, cancer patients who underwent cataract surgery with intraocular lens implantation (by a single surgeon) from December 2008 to March 2011, and who had completed a pre- and postoperative NEI-VFQ-25 were retrospectively reviewed. Post-operative data was collected at their routine 4-6 week post-op visit. Patients' demographics, cancer history, their pre and postoperative ocular examinations, visual acuities, and NEI-VFQ-25 with twelve components were included in the evaluation. The responses were evaluated using the Student t test, Spearman correlation and Wilcoxon signed rank test. ^ Results. 63 cases of cataract surgery (from 54 patients) from the MD Anderson Cancer Center were included in the study. Cancer patients had a significant improvement in the visual acuity (P<0.0001) postoperatively, along with a significant increase in vision-related quality of life (P<0.0001). Patients also had a statistically significant improvement in ten of the twelve subcategories which are addressed in the NEI-VFQ-25. ^ Conclusions. In our study, cataract extraction and intraocular implantation showed a significant impact on the vision-related quality of life in cancer patients. Although this study includes a small sample size, it serves as a positive pilot study to evaluate and quantify the impact of a surgical intervention on QOL in cancer patients and may help to design a larger study to measure vision related QOL per dollar spent for health care cost in cancer patients.^

Engaging stakeholders in community-level obesity prevention programming: Evaluation of the Fit Family Challenge

Introduction: Both a systems approach to change and a focus on multi-sector interventions ensures obesity prevention programming within the community is equitable, sustainable, and cost-effective. An authentic community engagement approach is required to implement interventions guided by best-evidence research and practice. Although there are examples illustrating the benefits of community engagement, there is no standardized method to implement it. The San Antonio Sports Foundation (SA Sports), a non-profit community-based organization, implements a variety of free events and programs promoting active life styles. One such program is the Fit Family Challenge which is a summer-long program implemented at the school level targeted at families. ^ Aims: This thesis was a culmination of the experience from the student collaborating with SA Sports as part of a practicum opportunity. Using secondary data collected by the Fit Family Challenge during the 2011 year, the goals of this thesis were: to assess individual changes; evaluate short-term impact; and describe the community engagement process. ^ Methods: SA Sports collected quantitative and qualitative data during the implementation and evaluation of the FFC program. SA Sports allowed the used of de-identified data to be analyzed to study the aims of this thesis. ^ Results: The program was able to provide families with the knowledge, information, and opportunity to exercise as a family and cook healthier meals. School district coordinators were generally satisfied and illustrated the benefits of a community partnership. An authentic community engagement was present highlighting the importance of communication, collaboration and the sustainability of such partnerships in the community. ^ Conclusion: The success of an obesity program should focus on triggers that initiate behavioral change rather than physiological changes. The evaluation was guided by a community engagement approach, which illustrated the development of new partnerships and the strengthening of other collaborations. Ultimately, the engagement approach empowered the community to identify their own problems and build collaboration, rather than tackling obesity prevention alone. ^

An evaluation of the centers for Medicare & Medicaid Services' Hospital Acquired Conditions and Present on Admission Indicator Reporting program

Objective: This dissertation evaluated three aspects of the Centers for Medicare and Medicaid Services' Hospital Acquired Conditions and Present on Admission Indicator Reporting program (HACPOA program) to produce three journal articles for publication. ^ Methods: All payer admission records from state inpatient databases from Arizona, New Jersey and Washington states were analyzed for the year 2008. However some analyses required a sample of adult only Medicare patients in the first two studies. California's inpatient data (2004 – 2010) was also analyzed in the third study to examine the reporting and non-payment program elements' impact on the incidence of hospital acquired conditions. ^ Results: Majority diagnoses reported in inpatient prospective payment systems hospitals were present on admission. However, some diagnoses are still coded as "not present on admission" and "insufficient documentation to determine whether or not conditions are present on admission or not". This is important because it reveals that hospital complications still occur in hospitals. Hospital fall and trauma injuries were the most common hospital acquired conditions observed in this study. Predictors of hospital fall injuries include age, gender, number of diagnoses, number of procedures, number of chronic conditions while predictors of hospital trauma injuries include number of e-codes, number of diagnoses and the presence of chronic conditions on a patient's admission records. Finally, the implementation of the present on admission reporting requirement increased reports of certain hospital acquired conditions while the non-payment policy element in the Hospital Acquired Conditions program reduced the incidence of hospital fall and trauma injuries in particular. ^ Conclusion: The implementation of the Hospital Acquired Conditions and Present on Admission Indicator Reporting program has made the state inpatient database a more useful source of data capable of now identifying hospital complications. The reporting and nonpayment program elements in the HACPOA program have also impacted the incidence of hospital acquired conditions. ^

Use of empowerment evaluation to determine a sustainability plan for a community-based preconception care program

Women With IMPACT (WWI) is a community-based preconception care educational intervention. WWI is being implemented by the Impacting Maternal and Prenatal Care Together (IMPACT) Collaborative and targets zip codes in Harris County, Texas at high risk for infant mortality, low birthweight, and preterm birth. WWI started March 2012 and continues through August 2013. Three workshop series are planned. This study was conducted with participants and facilitators from the first workshop series. This study aimed to 1) evaluate the WWI program using empowerment evaluation, 2) engage all WWI stakeholders in an empowerment evaluation so the method could be adopted as a participatory evaluation process for future IMPACT activities, and 3) develop recommendations for sustainability of the WWI intervention, based on empowerment evaluation findings and results from the pre/post program evaluation completed by WWI participants. Study participants included WWI participants and facilitators and IMPACT Collaborative Steering Committee members. WWI participants were female, 18-35 year-old, non-pregnant residents of zip codes at high risk of adverse birth outcomes. All other study participants were 18 years or older. A two-phased empowerment evaluation (EE) was utilized in this study. Sessions 1-4 were conducted independently of one another – 3 with participants at different sites and one with the facilitators. The fifth session included WWI participant and facilitator representatives, and IMPACT Steering Committee members. Session 5 built upon the work of the other sessions. Observation notes were recorded during each session. Thematic content analysis was conducted on all EE tables and observation notes. Mission statements drafted by each group focused on improvement of physical and mental health through behavior change and empowerment of all participants. The top 5 overall program components were: physical activity, nutrition, self-worth, in-class communication, and stress. Goals for program improvement were set by EE participants for each of these components. Through thematic content analysis of the tables and observation notes, social support emerged as an important theme of the program among all participant groups. Change to a healthy lifestyle emerged as an important theme in terms of program improvement. Two-phased EE provided an opportunity for all program stakeholders to provide feedback regarding important program components and provide suggestions for program improvement. EE, thematic content analysis, pre/post evaluation results, and inherent program knowledge were triangulated to make recommendations to sustain the program once the initial funding ends. ^