Program evaluation for a summer science internship: Short and long term benefits as reported by interns

Undergraduate research programs have been used as a tool to attract and retain student interest in science careers. This study evaluates the short and long-term benefits of a Summer Science Internship (SSI) at the University of Texas Health Science Center at Houston– School of Public Health – in Brownsville, Texas, by analyzing survey data from alumni. Questions assessing short-term program impact were aimed at three main topics, student: satisfaction with program, self-efficacy for science after completing the program, and perceived benefits. Long-term program impact was assessed by looking at student school attendance and college majors along with perceived links between SSI and future college plans. Students reported high program satisfaction, a significant increase in science self-efficacy and high perceived benefits. At the time data were collected for the study, one-hundred percent of alumni were enrolled in school (high school or college). The majority of students indicated they were interested in completing a science major/career, heavily influenced by their participation in the program.^

Evaluating the relative status of health and safety programs for minority academic and research institutions

A variety of occupational hazards are indigenous to academic and research institutions, ranging from traditional life safety concerns, such as fire safety and fall protection, to specialized occupational hygiene issues such as exposure to carcinogenic chemicals, radiation sources, and infectious microorganisms. Institutional health and safety programs are constantly challenged to establish and maintain adequate protective measures for this wide array of hazards. A unique subset of academic and research institutions are classified as historically Black universities which provide educational opportunities primarily to minority populations. State funded minority schools receive less resources than their non-minority counterparts, resulting in a reduced ability to provide certain programs and services. Comprehensive health and safety services for these institutions may be one of the services compromised, resulting in uncontrolled exposures to various workplace hazards. Such a result would also be contrary to the national health status objectives to improve preventive health care measures for minority populations.^ To determine if differences exist, a cross-sectional survey was performed to evaluate the relative status of health and safety programs present within minority and non-minority state-funded academic and research institutions. Data were obtained from direct mail questionnaires, supplemented by data from publicly available sources. Parameters for comparison included reported numbers of full and part-time health and safety staff, reported OSHA 200 log (or equivalent) values, and reported workers compensation experience modifiers. The relative impact of institutional minority status, institution size, and OSHA regulatory environment, was also assessed. Additional health and safety program descriptors were solicited in an attempt to develop a preliminary profile of the hazards present in this unique work setting.^ Survey forms were distributed to 24 minority and 51 non-minority institutions. A total of 72% of the questionnaires were returned, with 58% of the minority and 78% of the non-minority institutions participating. The mean number of reported full-time health and safety staff for the responding minority institutions was determined to be 1.14, compared to 3.12 for the responding non-minority institutions. Data distribution variances were stabilized using log-normal transformations, and although subsequent analysis indicated statistically significant differences, the differences were found to be predicted by institution size only, and not by minority status or OSHA regulatory environment. Similar results were noted for estimated full-time equivalent health and safety staffing levels. Significant differences were not noted between reported OSHA 200 log (or equivalent) data, and a lack of information provided on workers compensation experience modifiers prevented comparisons on insurance premium expenditures. Other health and safety program descriptive information obtained served to validate the study's presupposition that the inclusion criteria would encompass those organizations with occupational risks from all four major hazard categories. Worker medical surveillance programs appeared to exist at most institutions, but the specific tests completed were not readily identifiable.^ The results of this study serve as a preliminary description of the health and safety programs for a unique set of workplaces have not been previously investigated. Numerous opportunities for further research are noted, including efforts to quantify the relative amount of each hazard present, the further definition of the programs reported to be in place, determination of other means to measure health outcomes on campuses, and comparisons among other culturally diverse workplaces. ^

Choosing and Maintaining Programs for Sex Education in Schools: The CHAMPSS Model

Background: Despite effective solutions to reduce teen birth rates, Texas teen birth rates are among the highest in the nation. School districts can impact youth sexual behavior through implementation of evidence-based programs (EBPs); however, teen pregnancy prevention is a complex and controversial issue for school districts. Subsequently, very few districts in Texas implement EBPs for pregnancy prevention. Additionally, school districts receive little guidance on the process for finding, adopting, and implementing EBPs. Purpose: The purpose of this report is to present the CHoosing And Maintaining Programs for Sex education in Schools (CHAMPSS) Model, a practical and realistic framework to help districts find, adopt, and implement EBPs. Methods: Model development occurred in four phases using the core processes of Intervention Mapping: 1) knowledge acquisition, 2) knowledge engineering, 3) model representation, and 4) knowledge development. Results: The CHAMPSS Model provides seven steps, tailored for school-based settings, which encompass phases of assessment, preparation, implementation, and maintenance: Prioritize, Asses, Select, Approve, Prepare, Implement, and Maintain. Advocacy and eliciting support for adolescent sexual health are also core elements of the model. Conclusion: This systematic framework may help schools increase adoption, implementation, and maintenance for EBPs.

Sexual Health Education from the Perspective of School Staff: Implications for Adoption and Implementation of Effective Programs in Middle School

Introduction: US teens are having sex early; however, the vast majority of schools do not implement evidence-based sexual health education (SHE) programs that could delay sexual behavior and/or reduce risky behavior. This study examines middle school staff’s knowledge, attitudes, barriers, self-efficacy, and perceived support (psychosocial factors known to influence SHE program adoption and implementation). Methods: Professional school staff from 33 southeast Texas middle schools completed an internet or paper-based survey. Prevalence estimates for psychosocial variables were computed for the total sample. Chi-square and t-test analyses examined variation by demographic factors. Results: Almost 70% of participants were female, 37% white, 42% black, 16% Hispanic; 20% administrators, 15% nurses/counselors, 31% non-physical education/non-health teachers, 28% physical education/health teachers; mean age = 42.78 years (SD = 10.9). Over 90% favored middle school SHE, and over 75% reported awareness of available SHE curricula or policies. More than 60% expressed confidence for discussing SHE. Staff perceived varying levels of administrator (28%-56%) support for SHE and varying levels of support for comprehensive sex education from outside stakeholders (e.g., parents, community leaders) (42%-85%). Overall, results were more favorable for physical education/health teachers, nurses/counselors, and administrators (when compared to non-physical education/non-health teachers) and individuals with experience teaching SHE. Few significant differences were observed by other demographic factors. Conclusions: Overall, study results were extremely positive, which may reflect a high level of readiness among school staff for adopting and implementing effective middle school SHE programs. Study results highlight the importance of several key action items for schools.

A Coordinated and Systematic Model for Adopting, Implementing and Maintaining Effective Sexual Health Education Programs in Schools

Getting evidence-based sexual health education activities into schools can be a complicated process. Working models that assist our educational system in the selection, implementation, and maintenance of effective school-based adolescent health programs are needed. Replicating sexual health programs in school-based settings: A model for schools provides a comprehensive and applied approach that engages all of the important stakeholders within a school district. The results from this study hold much potential to inform Texas and the nation about how a coordinated and practical model can assist school districts to increase the use of evidence-based programs addressing teen pregnancy prevention and sexual health issues.

Implications for Adoption and Implementation of Effective Sexual Health Education Programs

Research on school-based sexual health education programs is at a critical juncture. With the growing number of evidenced-based programs, more focus is needed on how to help schools adopt and implement these programs. The article in this issue titled “Sexual Health Education from the Perspectives of School Staff: Implications for Adoption and Implementation of Effective Programs in Middle School” provides data on individual cognitive factors that may influence adoption and implementation. This commentary explores another framework, Concerns Based Adoption Model, as a tool for examining and supporting change associated with adoption and implementation of sexual health education programs.

Review: Reducing Adolescent Sexual Risk: A Theoretical Guide for Developing and Adapting Curriculum-Based Programs

A review of Reducing Adolescent Sexual Risk: A Theoretical Guide for Developing and Adapting Curriculum-Based Programs by Douglas Kirby.

Family Preservation Research: Where We've Been, Where We Should Be Going

Although the literature has provided many critiques of research done on family preservation programs, these critiques have usually been limited to the studies ' assumptions, approach, or methodology. Because of the nature of these critiques, suggestions for future research in this field of practice have been scattered throughout the literature and have not benefitted from a wider historical perspective. This paper examines the historical evolution of family preservation studies in child welfare and suggests future directions for research in the field. Among the suggestions the authors posit are (1) research questions should be framed by what we know about improvements in the lives of families and children served by family preservation programs; (2) future explorations should include areas that have received relatively little attention in current research, including the impact of organizational conditions on service fidelity and worker performance; (3) newer treatment models, particularly those that provide both intensive services during a crisis period and less intensive services for maintenance, should be tested; (4) data collection points in longitudinal studies should be guided by theory, and measures should change over time to reflect the theoretically expected changes in families; (5) complex measures of placement prevention and other measures that capture changes in family functioning, child well-being, and child safety, should be utilized to obtain a full picture of program effects; and (6) multiple informants should be used to provide data about program effectiveness. In addition, the authors will argue that the field should carefully consider the amount of change that should be expected from the service models delivered.

Household Hardships, Public Programs, and Their Associations with the Health and Development of Very Young Children: Insights from Children’s HealthWatch

America’s low-income families struggle to protect their children from multiple threats to their health and growth. Many research and advocacy groups explore the health and educational effects of food insecurity, but less is known about these effects on very young children. Children’s HealthWatch, a group of pediatric clinicians and public health researchers, has continuously collected data on the effects of food insecurity alone and in conjunction with other household hardships since 1998. The group’s peer reviewed research has shown that a number of economic risks at the household level, including food, housing and energy insecurity, tend to be correlated. These insecurities alone or in conjunction increase the risk that a young child will suffer various negative health consequences, including increases in lifetime hospitalizations, parental report of fair or poor health,1 or risk for developmental delays.2 Child food insecurity is an incremental risk indicator above and beyond the risk imposed by household-level food insecurity. The Children’sHealthwatch research also suggests public benefits programs modify some of these effects for families experiencing hardships. This empirical evidence is presented in a variety of public venues outside the usual scientific settings, such as congressional hearings, to support the needs of America’s most vulnerable population through policy change. Children’s HealthWatch research supports legislative solutions to food insecurity, including sustained funding for public programs and re-evaluation of the use of the Thrifty Food Plan as the basis of SNAP benefits calculations. Children’s HealthWatch is one of many models to support the American Academy of Pediatrics’ call to “stand up, speak up, and step up for children.”3 No isolated group or single intervention will solve child poverty or multiple hardships. However, working collaboratively each group has a role to play in supporting the health and well-being of young children and their families. 1. Cook JT, Frank DA, Berkowitz C, et al. Food insecurity is associated with adverse health outcomes among human infants and toddlers. J Nutr. 2004;134:1432-1438. 2. Rose-Jacobs R, Black MM, Casey PH, et al. Household food insecurity: associations with at-risk infant and toddler development. Pediatrics. 2008;121:65-72. 3. AAP leader says to stand up, speak up, and step up for child health [news release]. Boston, MA: American Academy of Pediatrics; October 11, 2008. http://www2.aap.org/pressroom/nce/nce08childhealth.htm. Accessed January 1, 2012.

Commentary on "Household Hardships, Public Programs, and Their Associations with the Health and Development of Very Young Children: Insights from Children's HealthWatch"

This commentary, written in response to the article "Household Hardships, Public Programs, and Their Associations with the Health and Development of Very Young Children: Insights from Children's HealthWatch", highlights the importance of the research done by Children's HealthWatch in relation to childhood food insecurity. Childhood food insecurity has been linked with various adverse health effects, including undernutrition, poor or delayed child development, and social and psychological consequences. Children's HealthWatch provides important data that can be used to monitor threats to our children's well-being and address problems with effective interventions.

A MANAGEMENT INFORMATION SYSTEM AND EVALUATION SCHEME FOR THE UNIVERSITY OF TEXAS EMPLOYEE ASSISTANCE PROGRAMS

Early Employee Assistance Programs (EAPs) had their origin in humanitarian motives, and there was little concern for their cost/benefit ratios; however, as some programs began accumulating data and analyzing it over time, even with single variables such as absenteeism, it became apparent that the humanitarian reasons for a program could be reinforced by cost savings particularly when the existence of the program was subject to justification.^ Today there is general agreement that cost/benefit analyses of EAPs are desirable, but the specific models for such analyses, particularly those making use of sophisticated but simple computer based data management systems, are few.^ The purpose of this research and development project was to develop a method, a design, and a prototype for gathering managing and presenting information about EAPS. This scheme provides information retrieval and analyses relevant to such aspects of EAP operations as: (1) EAP personnel activities, (2) Supervisory training effectiveness, (3) Client population demographics, (4) Assessment and Referral Effectiveness, (5) Treatment network efficacy, (6) Economic worth of the EAP.^ This scheme has been implemented and made operational at The University of Texas Employee Assistance Programs for more than three years.^ Application of the scheme in the various programs has defined certain variables which remained necessary in all programs. Depending on the degree of aggressiveness for data acquisition maintained by program personnel, other program specific variables are also defined. ^

Prenatal care content and utilization among pregnant women enrolled in managed care programs in Harris County, Texas

This research study was conducted as a descriptive study of prenatal care experiences of women enrolled in public and private managed care programs. The study's aim was to describe the demographic characteristics of the women in the study and to analyze and compare their prenatal care experiences. ^ The objective of this study was to examine the research question: Do pregnant women enrolled in Medicaid Managed Care receive the same level of care as women enrolled in other Managed Care Programs in Harris County, Texas? ^ The study population was a convenience sample of pregnant women enrolled in managed care programs who presented to one of the two hospital study sites for delivery of their infant. The study utilized a self administered survey to measure adequacy and content of prenatal care received by the women during this pregnancy. Adequacy of prenatal care utilization was determined based on the Kessner Index criteria of timing of initiation of care and number of visits. Content of care was measured by the number of different medical services the women reported they had received and the number of health information topics the women reported on which they had received information. Demographic characteristics were described with univariate and bivariate statistics of frequencies and cross tabulations. Associations were evaluated using measures of linear correlations. ^ Results from the study showed there is an association between enrollment in Medicaid Managed Care (public) and prenatal care received compared to women enrolled in other Managed Care Programs (private). The results were derived from statistical tests on data the postpartum women gave when they completed the self-administered survey. Provider type was a moderate predictor of quality and quantity of prenatal care. The results also indicate that in the study population, minority ethnicity, income and lower educational status were associated with intermediate and inadequate prenatal care. ^

A project to improve the information seeking skills and increase the use of evidence-based research in public health practice

The ability of public health practitioners (PHPs) to work efficiently and effectively is negatively impacted by their lack of knowledge of the broad range of evidence-based practice information resources and tools that can be utilized to guide them in their development of health policies and programs. This project, a three-hour continuing education hands-on workshop with supporting resources, was designed to increase knowledge and skills of these resources. The workshop was presented as a pre-conference continuing education program for the Texas Public Health Association (TPHA) 2008 Annual Conference. Topics included: identification of evidence-based practice resources to aid in the development of policies and programs; identification of sources of publicly available data; utilization of data for community assessments; and accessing and searching the literature through a collection of databases available to all citizens of Texas. Supplemental resources included a blog that served as a gateway to the resources explored during the presentation, a community assessment workbook that incorporates both Healthy People 2010 objectives and links to reliable sources of data, and handouts providing additional instruction on the use of the resources covered during the workshop.^ Before- and after-workshop surveys based on Kirkpatrick's 4-level model of evaluation and the Theory of Planned Behavior were administered. Of the questions related to the trainer, the workshop, and the usefulness of the workshop, participants gave "Good" to "Excellent" responses to all one question. Confidence levels overall increased a statistically significant amount; measurements of attitude, social norms, and control showed no significant differences before and after the workshop. Lastly, participants indicated they were likely to use resources shown during the workshop within a one to three month time period on average. ^ The workshop and creation of supplemental resources served as a pilot for a funded project that will be continued with the development and delivery of four 4-week long webinar-based training sessions to be completed by December 2008. ^

Systematic review of worksite-based behavior change programs that target metabolic syndrome risk factors

Approximately one-third of US adults have metabolic syndrome, the clustering of cardiovascular risk factors that include hypertension, abdominal adiposity, elevated fasting glucose, low high-density lipoprotein (HDL)-cholesterol and elevated triglyceride levels. While the definition of metabolic syndrome continues to be much debated among leading health research organizations, the fact is that individuals with metabolic syndrome have an increased risk of developing cardiovascular disease and/or type 2 diabetes. A recent report by the Henry J. Kaiser Family Foundation found that the US spent $2.2 trillion (16.2% of the Gross Domestic Product) on healthcare in 2007 and cited that among other factors, chronic diseases, including type 2 diabetes and cardiovascular disease, are large contributors to this growing national expenditure. Bearing a substantial portion of this cost are employers, the leading providers of health insurance. In lieu of this, many employers have begun implementing health promotion efforts to counteract these rising costs. However, evidence-based practices, uniform guidelines and policy do not exist for this setting in regard to the prevention of metabolic syndrome risk factors as defined by the National Cholesterol Education Program (NCEP) Adult Treatment Panel III (ATP III). Therefore, the aim of this review was to determine the effects of worksite-based behavior change programs on reducing the risk factors for metabolic syndrome in adults. Using relevant search terms, OVID MEDLINE was used to search the peer-reviewed literature published since 1998, resulting in 23 articles meeting the inclusion criteria for the review. The American Dietetic Association's Evidence Analysis Process was used to abstract data from selected articles, assess the quality of each study, compile the evidence, develop a summarized conclusion, and assign a grade based upon the strength of supporting evidence. The results revealed that participating in a worksite-based behavior change program may be associated in one or more improved metabolic syndrome risk factors. Programs that delivered a higher dose (>22 hours), in a shorter duration (<2 years) using two or more behavior-change strategies were associated with more metabolic risk factors being positively impacted. A Conclusion Grade of III was obtained for the evidence, indicating that studies were of weak design or results were inconclusive due to inadequate sample sizes, bias and lack of generalizability. These results provide some support for the continued use of worksite-based health promotion and further research is needed to determine if multi-strategy, intense behavior change programs targeting multiple risk factors are able to sustain health improvements in the long-term.^

Has implementation of integrated mental health services in primary care programs positively impacted health outcomes among the mentally ill in developing countries?

Objective. The World Health Organization (WHO) estimates that nearly 450 million people suffer from a mental disorder in the world. Developing countries do not have the health system structure in place to support the demand of mental health services. This study will conduct a review of mental health integration in primary care research that is carried out in low-income countries identified as such from the World Bank economic analysis. The research follows the standard of care that WHO has labeled appropriate in treatment of mental health populations. Methods. This study will use the WHO 10 principles of mental health integration into primary care as the global health standard of care for mental health. Low-income countries that used these principles in their national programs will be analyzed for effectiveness of mental health integration in primary care. Results. This study showed that mental health service integration in primary care did have an effect on health outcomes of low-income countries. However, information did not lead to significant quantitative results that determined how positive the effect was. Conclusion. More ethnographic research is needed in low-income countries to truly assess how effective the program is in integrating with the health system currently in place.^ ^