Use of empowerment evaluation to determine a sustainability plan for a community-based preconception care program

Women With IMPACT (WWI) is a community-based preconception care educational intervention. WWI is being implemented by the Impacting Maternal and Prenatal Care Together (IMPACT) Collaborative and targets zip codes in Harris County, Texas at high risk for infant mortality, low birthweight, and preterm birth. WWI started March 2012 and continues through August 2013. Three workshop series are planned. This study was conducted with participants and facilitators from the first workshop series. This study aimed to 1) evaluate the WWI program using empowerment evaluation, 2) engage all WWI stakeholders in an empowerment evaluation so the method could be adopted as a participatory evaluation process for future IMPACT activities, and 3) develop recommendations for sustainability of the WWI intervention, based on empowerment evaluation findings and results from the pre/post program evaluation completed by WWI participants. Study participants included WWI participants and facilitators and IMPACT Collaborative Steering Committee members. WWI participants were female, 18-35 year-old, non-pregnant residents of zip codes at high risk of adverse birth outcomes. All other study participants were 18 years or older. A two-phased empowerment evaluation (EE) was utilized in this study. Sessions 1-4 were conducted independently of one another – 3 with participants at different sites and one with the facilitators. The fifth session included WWI participant and facilitator representatives, and IMPACT Steering Committee members. Session 5 built upon the work of the other sessions. Observation notes were recorded during each session. Thematic content analysis was conducted on all EE tables and observation notes. Mission statements drafted by each group focused on improvement of physical and mental health through behavior change and empowerment of all participants. The top 5 overall program components were: physical activity, nutrition, self-worth, in-class communication, and stress. Goals for program improvement were set by EE participants for each of these components. Through thematic content analysis of the tables and observation notes, social support emerged as an important theme of the program among all participant groups. Change to a healthy lifestyle emerged as an important theme in terms of program improvement. Two-phased EE provided an opportunity for all program stakeholders to provide feedback regarding important program components and provide suggestions for program improvement. EE, thematic content analysis, pre/post evaluation results, and inherent program knowledge were triangulated to make recommendations to sustain the program once the initial funding ends. ^

Bayesian doubly optimal group sequential designs for randomized clinical trials

When conducting a randomized comparative clinical trial, ethical, scientific or economic considerations often motivate the use of interim decision rules after successive groups of patients have been treated. These decisions may pertain to the comparative efficacy or safety of the treatments under study, cost considerations, the desire to accelerate the drug evaluation process, or the likelihood of therapeutic benefit for future patients. At the time of each interim decision, an important question is whether patient enrollment should continue or be terminated; either due to a high probability that one treatment is superior to the other, or a low probability that the experimental treatment will ultimately prove to be superior. The use of frequentist group sequential decision rules has become routine in the conduct of phase III clinical trials. In this dissertation, we will present a new Bayesian decision-theoretic approach to the problem of designing a randomized group sequential clinical trial, focusing on two-arm trials with time-to-failure outcomes. Forward simulation is used to obtain optimal decision boundaries for each of a set of possible models. At each interim analysis, we use Bayesian model selection to adaptively choose the model having the largest posterior probability of being correct, and we then make the interim decision based on the boundaries that are optimal under the chosen model. We provide a simulation study to compare this method, which we call Bayesian Doubly Optimal Group Sequential (BDOGS), to corresponding frequentist designs using either O'Brien-Fleming (OF) or Pocock boundaries, as obtained from EaSt 2000. Our simulation results show that, over a wide variety of different cases, BDOGS either performs at least as well as both OF and Pocock, or on average provides a much smaller trial. ^

A process evaluation of the childhood lead poisoning prevention program in Houston, Texas, 1992--1995

A process evaluation of the Houston Childhood Lead Poisoning Prevention Program, 1992-1995, was conducted. The Program's goal is to reduce lead poisoning prevalence. The study proposed to determine to what extent the Program was implemented as planned by measuring how well Program services were actually: (1) received by the intended target population; (2) delivered to children with elevated blood lead levels; (3) delivered in compliance with the Centers for Disease Control and Prevention and Program guidelines and timetables; and (4) able to reduce lead poisoning prevalence among those rescreened. Utilizing a program monitoring design, the Program's pre-collected computer records were reviewed. The study sample consisted of 820 children whose blood lead levels were above 15 micrograms per deciLiter, representing approximately 2.9% of the 28,406 screened over this period. Three blood lead levels from each participant were examined: the initial elevated result; the confirmatory result; and the next rescreen result, after the elevated confirmatory level. Results showed that the Program screened approximately 18% (28,406 of 161,569) of Houston's children under age 6 years for lead poisoning. Based on Chi-square tests of significance, results also showed that lead-poisoned participants were more likely to be younger than 3 years, male and Hispanic, compared to those not lead poisoned. The age, gender and ethnic differences observed were statistically significant (p =.01, p =.00, p =.00). Four of the six Program services: medical evaluations, rescreening, environmental inspections and confirmation, had satisfactory delivery completion rates of 71%-98%. Delivery timetable compliance rates for three of the six services examined: outreach contacts, home visits and environmental inspections were below 32%. However, dangerously elevated blood lead levels fell and lead poisoning prevalence dropped from 3.3% at initial screening to 1.2% among those rescreened, after intervention. From a public health perspective, reductions in lead poisoning prevalence are very meaningful. Based on these findings, the following are recommendations for future research: (1) integrate Program database files by utilizing a computer database management program; (2) target services at Hispanic male children under age 3 years living in the highest risk neighborhoods; (3) increase resources to: improve tracking and documentation of service delivery and provide more non-medical case management and environmental services; and (4) share the evaluation methodology/findings with the Centers for Disease Control and Prevention administrators; the implications may be relevant to other program managers conducting such assessments. ^

A process evaluation of a health literacy intervention targeting pediatric providers' communication skills at the Texas Children's Health Plan

Background. Health literacy is an important determinant for quality health care, and affects communication between patients and physicians. Poor communication may result in negative effects in health. Improved communication between patients and physicians could positively affect health outcomes. Communication skills are teachable.^ Objectives. (1) to evaluate the process involved in the design and implementation of a health literacy intervention targeting pediatric providers’ communication skills at the Texas Children’s Health Plan in Houston, Texas; and (2) to describe lessons learned from this process that may be used in future attempts to address the issue of health literacy and health communication. ^ Design/methods. The process evaluation of the implementation of a health literacy strategy at the Texas Children’s Health Plan (TCHP) consisted of a critical analysis of all documents and minutes from meetings of the team of investigators. It also involved a secondary analysis of data collected between December 2006 and June 2007. Descriptive statistics, paired t-test and Wilcoxon-signed-rank test were employed in analyzing the data. This information was complemented with a limited review of existing literature on communication skills training programs. ^ Results. The design of the educational intervention followed recommendations from experts in the field of health literacy. The delivery of the intervention was possible and benefited from existing resources and logistics within the TCHP. Very few targeted providers participated in two offerings of the workshop (6.6% and 1.7% respectively). After the educational intervention, providers showed increased knowledge of health literacy facts and its effects in health (p=0.001); increased awareness of the low health literacy problem (p=0.003); increased expectations for change in practice (p=0.002), and intent to use health literacy strategies for communication immediately following the intervention (p=0.001). Low participation indicated the need for further investigation of barriers to, and means for successful implementation of programs aimed to improving health communication. ^ Conclusions. A short, focused intervention utilizing health literacy strategies for communication appeared effective in increasing knowledge and intentions for change in a small group of pediatric providers. ^

Process evaluation of the Texas occupational safety & health surveillance system

Introduction: The Texas Occupational Safety & Health Surveillance System (TOSHSS) was created to collect, analyze and interpret occupational injury and illness data in order to decrease the impact of occupational injuries within the state of Texas. This process evaluation was performed midway through the 4-year grant to assess the efficiency and effectiveness of the surveillance system’s planning and implementation activities1. ^ Methods: Two evaluation guidelines published by the Centers for Disease Control and Prevention (CDC) were used as the theoretical models for this process evaluation. The Framework for Program Evaluation in Public Health was used to examine the planning and design of TOSHSS using logic models. The Framework for Evaluating Public Health Surveillance Systems was used to examine the implementation of approximately 60 surveillance activities, including uses of the data obtained from the surveillance system. ^ Results/Discussion: TOSHSS planning activities omitted the creation of a scientific advisory committee and specific activities designed to maintain contacts with stakeholders; and proposed activities should be reassessed and aligned with ongoing performance measurement criteria, including the role of collaborators in helping the surveillance system achieve each proposed activity. TOSHSS implementation activities are substantially meeting expectations and received an overall score of 61% for all activities being performed. TOSHSS is considered a surveillance system that is simple, flexible, acceptable, fairly stable, timely, moderately useful, with good data quality and a PVP of 86%. ^ Conclusions: Through the third year of TOSHSS implementation, the surveillance system is has made a considerable contribution to the collection of occupational injury and illness information within the state of Texas. Implementation of the nine recommendations provided under this process evaluation is expected to increase the overall usefulness of the surveillance system and assist TDSHS in reducing occupational fatalities, injuries, and diseases within the state of Texas. ^ 1 Disclaimer: The Texas Occupational Safety and Health Surveillance System is supported by Grant/Cooperative Agreement Number (U60 OH008473-01A1). The content of the current evaluation are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health.^

Process evaluation of intervention program for prevention of early sexual activity and alcohol use among Hispanic teenagers

Hispanic teens are a high-risk population for initiation of early sexual activity and alcohol use which in turn has numerous social and health consequences. One strategy to address prevention of these behaviors is to implement a capacity building intervention that promotes parent child communication, encompasses their cultural values and community participation. This study describes the process evaluation of a pilot intervention program amongst Hispanic teens and their families living along the Texas-Mexico border. “Girls Lets Talk” is a small group intervention with 10-14 year old teens and their female adult family members that involves education regarding effects of alcohol use and sexual activity as well as activities for monitoring and refusal skills to prevent risky behaviors. Two waves of the program each consisting of at least seven mother daughter dyads were conducted. During the designing process, community advisory board meetings and focus groups were held to review course materials and ensure they were appropriate to the Mexican American culture. Parent and adolescent surveys were administered at the beginning and end of the intervention to assess for psychosocial outcome variables. All sessions received high mean satisfactory scores (mean of 4.00 or better on a five point scale) for both adult and adolescent participants. Qualitative feedback was obtained via debriefing sessions to evaluate experience as well as alter recruitment strategies. A Wilcoxon Sign Rank analysis of the pre and post intervention surveys was done that showed significant changes in some outcome variables such as intentions and confidence for monitoring behaviors for adults and beliefs regarding sexual activity. “Girls Lets Talk” is a promising example of how a process evaluation plan can help develop a theory based health promotion program using the community based participatory research approach. The intervention may also be effective in altering intentions and enhancing self-efficacy among parents and teens in order to decrease risky behaviors such as early sexual activity and alcohol use.^

Process and outcome evaluation of the hepatitis B perinatal vaccination program in Houston, Texas, 1991--1993

A retrospective cohort study was designed to evaluate the compliance of vaccination dose schedules and vaccination effectiveness at 12 months of age among a total of 226 high-risk infants born to HBsAg-positive pregnant women who participated in the HBV Perinatal Vaccination Program in Houston, Texas, 1991-1993.^ The seroprevalence of HBsAg-positivity was 0.5% among pregnant women who attended prenatal clinics in Houston, Texas, 1991-1993. The Asian women had the highest seroprevalence rate (5.9%), followed by black (1.9%), white (0.7%), and Hispanic women (0.3%). The seroprevalence of HBsAg increased with age (p =.02); the highest seroprevalence rate found among the $>$40 group (5.4%), followed by the 20-40 age group, and the $<$20 age. A steady increase was observed in the number of infants, from 45 in 1991, to 103 in 1993. The majority of these infants were black (58.0%), followed by Hispanic (28.8%), Asian (8.4%), and white infants (4.0%). Significant increases were observed from 1991 to 1993 in the number of infants who initiated vaccination (86.7% to 98.1%, p =.02) and in those infants who were post-tested at 12 months of age (24.4% to 44.7%, p =.04). During the same period an increase was also observed in the number of infants who completed the vaccination dose schedules (62.2% to 72.8%, p =.37). The compliance rates were not statistically significant regarding gender, race or ethnicity, health service area, medical referral source, and residential geographic areas. About 56.0% of the reasons cited for non-compliance among the 144 infants who neither completed the vaccination dose schedules nor received the 12-month post-test were "moved," and "no response/not at home." A total of 82 infants completed the vaccination dose schedules and were post-tested at 12 months of age for anti-HBs-positivity, and 96.3% of these infants seroconverted. A race-specific statistically significant seroconversion difference was found among infants who received all vaccination doses and were post-tested at 12 months of age (100% for the black and the white, 96.3% for the Hispanic, and 80.0% for the Asians infants, p =.05).^ From a public health perspective, the HBV Perinatal Vaccination Program improved during its first three years (1991-1993). It was effective in preventing perinatal HBV infection in almost 97.0% of infants who were vaccinated and post-tested. To increase the efficiency and efficacy of the program, the following recommendations are proposed: (1) Increase the vaccination compliance rate by educating and improving the tracking, communication and coordination channels with those individuals involved in the process and by increasing staff resources. (2) Reduce the post-test vaccination non-compliance by post-testing infants simultaneously with third vaccination dose at 6 months of age, and only post-test those infants who are anti-HBs-negative at 9-12 months of age. (Abstract shortened by UMI.) ^

Bench-scale evaluation of the activated sludge process for treatment of a high -strength chemical plant wastewater

A bench-scale treatability study was conducted on a high-strength wastewater from a chemical plant to develop an alternative for the existing waste stabilization pond treatment system. The objective of this study was to determine the treatability of the wastewater by the activated sludge process and, if treatable, to determine appropriate operating conditions, and to evaluate the degradability of bis(2-chloroethyl)ether (Chlorex) and benzene in the activated sludge system. Four 4-L Plexi-glass, complete mixing, continuous flow activated sludge reactors were operated in parallel under different operating conditions over a 6-month period. The operating conditions examined were hydraulic retention time (HRT), sludge retention time (SRT), nutrient supplement, and Chlorex/benzene spikes. Generally the activated sludge system treating high-strength wastewater was stable under large variations of organic loading and operating conditions. At an HRT of 2 days, more than 90% removal efficiency with good sludge settleability was achieved when the organic loading was less than 0.4 g BOD$\sb5$/g MLVSS/d or 0.8 g COD/g MLVSS/d. At least 20 days of SRT was required to maintain steady operation. Phosphorus addition enhanced the performance of the system especially during stressed operation. On the average, removals of benzene and Chlorex were 73-86% and 37-65%, respectively. In addition, the low-strength wastewater was treatable by activated sludge process, showing more than 90% BOD removal at a HRT of 0.5 days. In general, the sludge had poor settling characteristics. The aerated lagoon process treating high-strength wastewater also provided significant organic reduction, but did not produce an acceptable effluent concentration. ^