Program evaluation for a summer science internship: Short and long term benefits as reported by interns

Undergraduate research programs have been used as a tool to attract and retain student interest in science careers. This study evaluates the short and long-term benefits of a Summer Science Internship (SSI) at the University of Texas Health Science Center at Houston– School of Public Health – in Brownsville, Texas, by analyzing survey data from alumni. Questions assessing short-term program impact were aimed at three main topics, student: satisfaction with program, self-efficacy for science after completing the program, and perceived benefits. Long-term program impact was assessed by looking at student school attendance and college majors along with perceived links between SSI and future college plans. Students reported high program satisfaction, a significant increase in science self-efficacy and high perceived benefits. At the time data were collected for the study, one-hundred percent of alumni were enrolled in school (high school or college). The majority of students indicated they were interested in completing a science major/career, heavily influenced by their participation in the program.^

Design and evaluation of the parent education component of a comprehensive violence prevention project in middle schools

Low parental monitoring is related to youth risk behaviors such as delinquency and aggression. The purpose of this dissertation was to describe the development and evaluation of a parent education intervention to increase parental monitoring in Hispanic parents of middle school children.^ The first study described the process of intervention mapping as used to develop Padres Trabajando por la Paz, a newsletter intervention for parents. Using theory, empirical literature, and information from the target population, performance objectives and determinants for monitoring were defined. Learning objectives were specified and a staged social-cognitive approach was used to develop methods and strategies delivered through newsletters.^ The second study examined the outcomes of a randomized trial of the newsletter intervention. Outcome measures consisted of a general measure of monitoring, parent and child reports of monitoring behaviors targeted by the intervention, and psychosocial determinants of monitoring (self-efficacy, norms, outcome expectancies, knowledge, and beliefs). Seventy-seven parents completed the randomized trial, half of which received four newsletters over an eight-week period. Results revealed a significant interaction effect for baseline and treatment for parent's reports of norms for monitoring (p =.009). Parents in the experimental condition who scored low at baseline reported increased norms for monitoring at follow-up. A significant interaction effect for child reports of parental monitoring behaviors (p =.04) reflected an small increase across baseline levels in the experimental condition and decreases for the control condition at higher baseline scores. Both groups of parents reported increased levels of monitoring at follow-up. No other outcome measures varied significantly by condition.^ The third study examined the relationship between the psychosocial determinants of parental monitoring and parental monitoring behaviors in the study population. Weak evidence for a relationship between outcome expectancies and parental monitoring behaviors suggests further research in the area utilizing stronger empirical models such as longitudinal design and structural equation modeling.^ The low-cost, minimal newsletter intervention showed promise for changing norms among Hispanic parents for parental monitoring. In light of the importance of parental monitoring as a protective factor for youth health risk behaviors, more research needs to be done to develop and evaluate interventions to increase parental monitoring. ^

Using technology to teach technology: design and evaluation of bilingual online physician education about electronic medical records.

The "EMR Tutorial" is designed to be a bilingual online physician education environment about electronic medical records. After iterative assessment and redesign, the tutorial was tested in two groups: U.S. physicians and Mexican medical students. Split-plot ANOVA revealed significantly different pre-test scores in the two groups, significant cognitive gains for the two groups overall, and no significant difference in the gains made by the two groups. Users rated the module positively on a satisfaction questionnaire.

An evaluation of the impact of Inner City Development's Cooperative Home School: An educational alternative program to increase the quality and level of education in San Antonio's West Side community

The research study was intended to evaluate the effectiveness of Inner City Development's (I.C.D.) Cooperative Home School, an educational alternative program to the Title I public schools of San Antonio's West Side community. The study investigated students', parents' and tutors' perception of parental involvement and educational resources. The study also investigated each student's academic achievement. ^ The study found that students progressed toward expected math proficiency at a faster rate than they did in reading proficiency. However, because the target population size was small and a comparison group was not used, the results of this study are only suggestive. This research also indicated that study subjects believed students' quality and level of education increased substantially since program exposure. Study subjects mainly attributed the students' strides in academic performance to the increased amount of individualized attention students received in the small twelve-student class size. Study subjects were more satisfied with the home school's educational resources than those of the Title I public schools. Study subjects also perceived that parental involvement both at home and at school increased since enrollment in the home school program because: (1) there were more opportunities for involvement in the home school; and (2) parents felt closer to the tutors than the teachers in public school. ^ This evaluation also suggested improvements to program operations. With the help of additional volunteers, I.C.D. program operators could improve collection and organization of academic records. Furthermore, as suggested by program participants, science could be added to the curriculum. Lastly, a formal tutor orientation could be implemented to familiarize and train tutors on classroom management procedures. ^

The School Sealant Program: An evaluation of the oral health education component

Dental caries is a common preventable childhood disease leading to severe physical, mental and economic repercussions for children and their families if left untreated. A needs assessment in Harris County reported that 45.9% of second graders had untreated dental caries. In order to address this growing problem, the School Sealant Program (SSP), a primary preventive initiative, was launched by the Houston Department of Health and Human Services (HDHHS) to provide oral health education, and underutilized dental preventive services to second grade children from participating Local School Districts (LSDs). ^ To determine the effectiveness and efficiency of the SSP, a program evaluation was conducted by the HDHHS between September 2007 and June 2008 for the Oral Health Education (OHE) component of the SSP. The objective of the evaluation was to assess short term changes in oral health knowledge of the participants and determine if these changes, if any, were due to the OHE sessions. An 8-item multiple choice pre/post test was developed for this purpose and administered to the participants before and immediately after the OHE sessions. ^ The present project analyzed pre and post test data of 1,088 second graders from 22 participating schools. Changes in overall and topic-specific knowledge of the program participants before and after the OHE sessions were analyzed using the Wilcoxon's signed rank test. ^ Results. The overall knowledge assessment showed a statistically significant (p <0.001) increase in the dental health knowledge of the participants after the oral health education sessions. Participants in the higher scoring category (7-8 correct responses) increased from 9.5% at baseline to 60.8% after the education sessions. Overall knowledge increased in all school regions with the highest knowledge gains seen in the Central and South regions. Males and females had similar knowledge gains. Significant knowledge differences were also found for each of the topic specific categories (functions of teeth, healthy diet, healthy habits, dental sealants; p<0.001) indicating an increase in topic specific knowledge of the participants post-health education sessions. ^ Conclusions. The OHE sessions were successful in increasing the short term oral health knowledge of the participants. ^

An evaluation of the Texas "A Woman's Right to Know" booklet: A state mandated patient education document for induced abortion

Many patient educational documents are written at a grade level higher than the level at which most individuals can read. This discrepancy can lead to treatment noncompliance and negative health outcomes. Therefore, it is important that patients receive readable health information. The Texas "A Woman's Right to Know" booklet is a state mandated informational document provided to women seeking abortion services. Given the significance of the abortion procedure, it is imperative that women considering having an abortion receive accurate and readable health materials. However, no published studies were found that evaluated the readability of the "A Woman's Right to Know" booklet. Therefore, the purpose of this study was to assess the readability of the "A Woman's Right to Know" booklet. To assess the readability, the Flesch-Kincaid readability test was used to evaluate the reading grade level of the entire "A Woman's Right to Know" booklet and each of the 7 sections of the booklet. The results showed that the readability of the entire booklet as well as each section of the booklet was written below the 8th grade reading level. Although the booklet was written below the estimated United States reading level (8th grade), the reading level of this booklet may still be too high for people in Texas who read below the 8th grade level. Based on these results, it is recommended that health care professionals involved in the distribution and explanation of the "A Woman's Right to Know" booklet provide their patients with both written and verbal medical information. The patients should be allowed to ask questions about the abortion procedure so that they can make the most informed choice.^

A summative evaluation of a HIV/AIDS Early Childhood Care, Education and Development Teacher Training Workshop in Mongu, Zambia

Objective. To conduct a summative evaluation of an Early Childhood Care, Education and Development (ECCED) Teacher Training Workshop in Mongu, Zambia by assessing changes in knowledge, attitudes and intent to use the information. ^ Study design. A matched cohort survey design was used with additional qualitative data collected by structured observation of workshop sessions, daily facilitator and participant debriefs and participant interviews. ^ Results. Matching pre and post tests were completed by 27 individuals in addition to daily debriefs, structured workshop observation and participant interviews with 22% of the group. The participant population was predominantly female individuals aged 15-44 years old that had completed high school and additional post-secondary training, been teaching children aged 0 – 8 years for 2-5 years in the Western Province and received other HIV/AIDS and ECCED education. Pre-tests indicated a strong understanding of ECCED principles and misconceptions regarding HIV transmission, prevention and the disease's impact on early childhood development. The workshop was found to significantly increase the participants' knowledge of topics covered by the curriculum (paired t-test, N=27, p = 0.004, 95% CI 1.8, 8.6). Participants began with a more limited understanding of HIV/AIDS than ECCED, but the mean gain was much greater at 7.4 +/- 12.3 points. Significantly more participants believed at post-test that HIV/AIDS education should increase for future educators. The 77.8% of participants that increased their knowledge scores at post-test expressed significantly less fear of having a child with HIV/AIDS in the classroom (Independent Samples t-test, N= 27, p = 0.011). Overall participant fear decreased 15.5%. 92.6% and 88.9% of participants planned at post-test to respectively use and share the taught information in their daily professional lives and reported on innovative strategies to communicate with the community. ^ Conclusions. Teacher training workshops can significantly increase HIV/AIDS awareness and promote positive attitudes in educators working with children affected by HIV/AIDS. Using participant suggested teaching techniques such as poems and songs and translating the materials to the local language could assist future facilitators to both culturally and professionally relate to the workshop audience as well as increase participant capacity to share the information with the local community. ^

Evaluation of risk factors for long term changes in refractive error among adult patients at a Dallas Texas private setting A retrospective chart-review study

Background. Over 39.9% of the adult population forty or older in the United States has refractive error, little is known about the etiology of this condition and associated risk factors and their entailed mechanism due to the paucity of data regarding the changes of refractive error for the adult population over time.^ Aim. To evaluate risk factors over a long term, 5-year period, in refractive error changes among persons 43 or older by testing the hypothesis that age, gender, systemic diseases, nuclear sclerosis and baseline refractive errors are all significantly associated with refractive errors changes in patients at a Dallas, Texas private optometric office.^ Methods. A retrospective chart review of subjective refraction, eye health, and self-report health history was done on patients at a private optometric office who were 43 or older in 2000 who had eye examinations both in 2000 and 2005. Aphakic and pseudophakic eyes were excluded as well as eyes with best corrected Snellen visual acuity of 20/40 and worse. After exclusions, refraction was obtained on 114 right eyes and 114 left eyes. Spherical equivalent (sum of sphere + ½ cylinder) was used as the measure of refractive error.^ Results. Similar changes in refractive error were observed for the two eyes. The 5-year change in spherical power was in a hyperopic direction for younger age groups and in a myopic direction for older subjects, P<0.0001. The gender-adjusted mean change in refractive error in right eyes of persons aged 43 to 54, 55 to 64, 65 to 74, and 75 or older at baseline was +0.43D, +0.46 D, -0.09 D, and -0.23D, respectively. Refractive change was strongly related to baseline nuclear cataract severity; grades 4 to 5 were associated with a myopic shift (-0.38 D, P< 0.0001). The mean age-adjusted change in refraction was +0.27 D for hyperopic eyes, +0.56 D for emmetropic eyes, and +0.26 D for myopic eyes.^ Conclusions. This report has documented refractive error changes in an older population and confirmed reported trends of a hyperopic shift before age 65 and a myopic shift thereafter associated with the development of nuclear cataract.^

Process evaluation of intervention program for prevention of early sexual activity and alcohol use among Hispanic teenagers

Hispanic teens are a high-risk population for initiation of early sexual activity and alcohol use which in turn has numerous social and health consequences. One strategy to address prevention of these behaviors is to implement a capacity building intervention that promotes parent child communication, encompasses their cultural values and community participation. This study describes the process evaluation of a pilot intervention program amongst Hispanic teens and their families living along the Texas-Mexico border. “Girls Lets Talk” is a small group intervention with 10-14 year old teens and their female adult family members that involves education regarding effects of alcohol use and sexual activity as well as activities for monitoring and refusal skills to prevent risky behaviors. Two waves of the program each consisting of at least seven mother daughter dyads were conducted. During the designing process, community advisory board meetings and focus groups were held to review course materials and ensure they were appropriate to the Mexican American culture. Parent and adolescent surveys were administered at the beginning and end of the intervention to assess for psychosocial outcome variables. All sessions received high mean satisfactory scores (mean of 4.00 or better on a five point scale) for both adult and adolescent participants. Qualitative feedback was obtained via debriefing sessions to evaluate experience as well as alter recruitment strategies. A Wilcoxon Sign Rank analysis of the pre and post intervention surveys was done that showed significant changes in some outcome variables such as intentions and confidence for monitoring behaviors for adults and beliefs regarding sexual activity. “Girls Lets Talk” is a promising example of how a process evaluation plan can help develop a theory based health promotion program using the community based participatory research approach. The intervention may also be effective in altering intentions and enhancing self-efficacy among parents and teens in order to decrease risky behaviors such as early sexual activity and alcohol use.^

Development and evaluation of a nutrition education program designed to increase fruit and vegetable consumption in girls, ages 9--12

The purpose of this study is to evaluate the theory-based Eat 5 nutrition badge. It is designed to increase fruit and vegetable (F&V) intake in 4th-6th grade junior Girl Scouts. Twenty-two troops were recruited and randomized by grade level (4th, 5th, 6th, or mixed) into either the intervention or control conditions. The leaders in the intervention condition received a brief training and the materials and conducted the program with their troops during four meetings. The Girl Scouts in the intervention condition completed 1-day Food Frequency Questionnaires and Nutrition Questionnaires both before and after completing the Eat 5 badge, and a third measurement of F&V intake three months after the posttest. Girl Scouts in the control condition were only evaluated at the three time periods.^ The primary hypotheses were that the Girl Scouts in the intervention condition would increase their daily intake of fruits and vegetables at both the posttest and three months later, compared to the Girl Scouts in the control condition. Other study questions investigated the impact of the Eat 5 program on intervening variables such as knowledge, self-efficacy, barriers, norms, F&V preference, and F&V selection and preparation skills.^ A nested ANOVA, with troop as the unit of analysis nested within condition, was used to assess the effects of the program. Pretest F&V intake and grade level were used as covariates. Pretest mean F&V intake for the total sample of 210 girls was 2.50 servings per day; 3.0 for the intervention group (n = 101). Significant increases in F&V intake (to 3.4 servings per day), knowledge, and fruit and vegetable preference were found for the intervention condition troops compared to the troops in the control condition. Three months later, the mean F&V intake had returned to pretest levels.^ This study indicates that social groups such as Girl Scouts can provide a channel for nutrition education. Long term effects were not sustained by the intervention; a possible cause was the lack of change in self-efficacy. Therefore, additional interventions are recommended such as booster lessons to maintain increased F&V intake by Girl Scouts. ^