Addressing Multilevel Program Complexity by Evaluation Design

In this paper, we present the evaluation design for a complex multilevel program recently introduced in Switzerland. The evaluation embraces the federal level, the cantonal program level, and the project level where target groups are directly addressed. We employ Pawson and Tilley’s realist evaluation approach, in order to do justice to the varying context factors that impact the cantonal programs leading to varying effectiveness of the implemented activities. The application of the model to the canton of Uri shows that the numerous vertical and horizontal relations play a crucial role for the program’s effectiveness. As a general learning for the evaluation of complex programs, we state that there is a need to consider all affected levels of a program and that no monocausal effects can be singled out in programs where multiple interventions address the same problem. Moreover, considering all affected levels of a program can mean going beyond the borders of the actual program organization and including factors that do not directly interfere with the policy delivery as such. In particular, we found that the relationship between the cantonal and the federal level was a crucial organizational factor influencing the effectiveness of the cantonal program.

Benefits and Risks of Extended Duration Dual Antiplatelet Therapy After PCI in Patients With and Without Acute Myocardial Infarction

BACKGROUND The benefits and risks of prolonged dual antiplatelet therapy may be different for patients with acute myocardial infarction (MI) compared with more stable presentations. OBJECTIVES This study sought to assess the benefits and risks of 30 versus 12 months of dual antiplatelet therapy among patients undergoing coronary stent implantation with and without MI. METHODS The Dual Antiplatelet Therapy Study, a randomized double-blind, placebo-controlled trial, compared 30 versus 12 months of dual antiplatelet therapy after coronary stenting. The effect of continued thienopyridine on ischemic and bleeding events among patients initially presenting with versus without MI was assessed. The coprimary endpoints were definite or probable stent thrombosis and major adverse cardiovascular and cerebrovascular events (MACCE). The primary safety endpoint was GUSTO (Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Arteries) moderate or severe bleeding. RESULTS Of 11,648 randomized patients (9,961 treated with drug-eluting stents, 1,687 with bare-metal stents), 30.7% presented with MI. Between 12 and 30 months, continued thienopyridine reduced stent thrombosis compared with placebo in patients with and without MI at presentation (MI group, 0.5% vs. 1.9%, p < 0.001; no MI group, 0.4% vs. 1.1%, p < 0.001; interaction p = 0.69). The reduction in MACCE for continued thienopyridine was greater for patients with MI (3.9% vs. 6.8%; p < 0.001) compared with those with no MI (4.4% vs. 5.3%; p = 0.08; interaction p = 0.03). In both groups, continued thienopyridine reduced MI (2.2% vs. 5.2%, p < 0.001 for MI; 2.1% vs. 3.5%, p < 0.001 for no MI; interaction p = 0.15) but increased bleeding (1.9% vs. 0.8%, p = 0.005 for MI; 2.6% vs. 1.7%, p = 0.007 for no MI; interaction p = 0.21). CONCLUSIONS Compared with 12 months of therapy, 30 months of dual antiplatelet therapy reduced the risk of stent thrombosis and MI in patients with and without MI, and increased bleeding. (The Dual Antiplatelet Therapy Study [The DAPT Study]; NCT00977938).

Salivary cortisol, psychological stress and depressive symptoms among patients undergoing colon cancer screenings

As the second leading cause of cancer-related deaths in the United States, colon cancer has a high cure rate if detected early by a colonoscopy (U.S. Cancer Statistics Working Group, 2007). However, more than 41 million at-risk Americans are not properly receiving colonoscopy screenings according to the recommendations of the Center for Disease Control. This study provides insight into the physiological and psychological benefits of the colonoscopy procedure over and above cancer detection and prevention. Thirty-six patients receiving colonoscopic screening at the University of Connecticut Health Center participated in this study. A questionnaire battery that assessed perceived stress, depressive symptoms, colon cancer related worry, and social support, and optional saliva sampling was completed 2 weeks prior to and post colonoscopy. It was hypothesized that salivary cortisol concentrations, perceived stress, and self-reported depressive symptoms would show significant decreases from pre to post colonoscopy, and that these variables would all be positively correlated with one another. Results showed significant, positive correlations between depressive symptoms and both salivary cortisol (r (34)= .348, p< .05) and perceived stress (r (34)= .635, p< .01). Morning salivary cortisol levels decreased significantly from pre to post colonoscopy to levels below the population mean (t (16)=-3.711, p<. 01). No such differences were observed in either perceived stress or depressive symptoms. These results indicate that by decreasing cortisol concentrations to levels below that of the population mean, the colonoscopy provided physiological health benefits to patients beyond cancer screening. From a health psychology standpoint, this may encourage some of the 41 million Americans not receiving proper colon cancer screenings to adopt this potentially life-saving health behavior.

Household risk factors and the health and nutritional status of children in rural Honduras

During this cross-sectional study, both quantitative and qualitative research methods were used to elucidate the role that household environment and sanitation play in the nutritional status of children in a rural Honduran community. Anthropometric measurements were taken as measures of nutritional status among children under five years of age, while interviews regarding the household environment were conducted with their primary caregivers. Community participatory activities were conducted with primary caregivers, and results from water quality testing were analyzed for E. coli contamination. Anthropometric results were compared using the 1977 NCHS Growth Charts and the 2006 WHO Child Growth Standard to examine the implications of using the new WHO standard. The references showed generally good or excellent agreement between z-score categories, except among height-for-age classifications for males 24-35.9 months and weight-for-age classifications for males older than 24 months. Comparing the proportion of stunted, underweight, and wasted children, using the WHO standard generally resulted in higher proportions of stunting, lower underweight proportions, and higher overweight proportions. Logistic regression was used to determine which household and sanitation factors most influenced the growth of children. Results suggest only having water from a spring, stream, or other type of surface water as the primary source of drinking water is a significant risk factor for stunting. A protective association was seen between the household wealth index and stunting. Through participatory activities, the community provided insight on health issues important for improving child health. These activities yielded findings to be harnessed as a powerful resource to unify efforts for change. The qualitative findings were triangulated with the quantitative interview and water testing results to provide intervention recommendations for the community and its primary health care clinic. Recommendations include educating the community on best water consumption practices and encouraging the completion of at least some primary education for primary caregivers to improve child health. It is recommended that a community health worker program be developed to support and implement community interventions to improve water use and household sanitation behaviors and to encourage the involvement of the community in targeting and guiding successful interventions. ^

Marketing physical activity and healthy eating: A literature review of recent social marketing campaigns and development of a social marketing plan for the CATCH program

Background. This culminating experience project was inspired by an independent study conducted at The University of Texas School of Public Health with Dr. Andrew Springer, DrPH, who works on the evaluation of the Coordinated Approach to Child Health (CATCH) program in Travis County, Texas. It was indicated that a social marketing plan could enhance current efforts for the CATCH program. The aims of the project were to (1) review and synthesize literature on social marketing, with a specific focus on diet, physical activity, and obesity prevention; and (2) apply the gained knowledge toward a practical solution – a social marketing plan for the CATCH program.^ Methods. The literature review aimed to answer the following questions: (1) What audiences (ethnic and age groups), settings, health behaviors, and behavioral science theories have been used in social marketing campaigns? (2) What features of social marketing were used (e.g. formative research, segmentation, and the marketing mix - including promotional strategies and communication channels)? (3) What were the outcomes of the social marketing campaigns? The search aimed to identify studies that met the following inclusion criteria: (a) The study explicitly stated that social marketing was used; (b) The intervention promoted physical activity and/or healthy eating; (c) The population was children, adolescents, young adults, and/or parents; (d) Results of the intervention were available in the published literature The literature review includes studies from the past five years (2004 to 2009). After reviewing the social marketing literature, the insight and knowledge gained was applied to develop a social marketing plan for the CATCH program. The plan was guided by Hands-on Social Marketing, A Step-by-Step Guide and the Center for Disease Control and Prevention's Social Marketing web course.^

The movement toward patient safety: State action related to reporting and disclosure of healthcare-associated infections

Increasing attention has been given to the problem of medical errors over the past decade. Included within that focused attention has been a strong interest in reducing the occurrence of healthcare-associated infections (HAIs). Acting concurrently with federal initiatives, the majority of U.S. states have statutorily required reporting and public disclosure of HAI data. Although the occurrence of these state statutory enactments and other state initiatives represent a recognition of the strong concern pertaining to HAIs, vast differences in each state’s HAI reporting and public disclosure requirements creates a varied and unequal response to what has become a national problem.^ The purpose of this research was to explore the variations in state HAI legal requirements and other state mandates. State actions, including statutory enactments, regulations, and other initiatives related to state reporting and public disclosure mechanisms were compared, discussed, and analyzed in an effort to illustrate the impact of the lack of uniformity as a public health concern.^ The HAI statutes, administrative requirements, and other mandates of each state and two U.S. territories were reviewed to answer the following seven research questions: How far has the state progressed in its HAI initiative? If the state has a HAI reporting requirement, is it mandatory or voluntary? What healthcare entities are subject to the reporting requirements? What data collection system is utilized? What measures are required to be reported? What is the public disclosure mechanism? How is the underlying reported information protected from public disclosure or other legal release?^ Secondary publicly available data, including state statutes, administrative rules, and other initiatives, were utilized to examine the current HAI-related legislative and administrative activity of the study subjects. The information was reviewed and analyzed to determine variations in HAI reporting and public disclosure laws. Particular attention was given to the seven key research questions.^ The research revealed that considerable progress has been achieved in state HAI initiatives since 2004. Despite this progress, however, when reviewing the state laws and HAI programs comparatively, considerable variations were found to exist with regards to the type of reporting requirements, healthcare facilities subject to the reporting laws, data collection systems utilized, reportable measures, public disclosure requirements, and confidentiality and privilege provisions. The wide variations in state statutes, administrative rules, and other agency directives create a fragmented and inconsistent approach to addressing the nationwide occurrence of HAIs in the U.S. healthcare system. ^

Process evaluation of intervention program for prevention of early sexual activity and alcohol use among Hispanic teenagers

Hispanic teens are a high-risk population for initiation of early sexual activity and alcohol use which in turn has numerous social and health consequences. One strategy to address prevention of these behaviors is to implement a capacity building intervention that promotes parent child communication, encompasses their cultural values and community participation. This study describes the process evaluation of a pilot intervention program amongst Hispanic teens and their families living along the Texas-Mexico border. “Girls Lets Talk” is a small group intervention with 10-14 year old teens and their female adult family members that involves education regarding effects of alcohol use and sexual activity as well as activities for monitoring and refusal skills to prevent risky behaviors. Two waves of the program each consisting of at least seven mother daughter dyads were conducted. During the designing process, community advisory board meetings and focus groups were held to review course materials and ensure they were appropriate to the Mexican American culture. Parent and adolescent surveys were administered at the beginning and end of the intervention to assess for psychosocial outcome variables. All sessions received high mean satisfactory scores (mean of 4.00 or better on a five point scale) for both adult and adolescent participants. Qualitative feedback was obtained via debriefing sessions to evaluate experience as well as alter recruitment strategies. A Wilcoxon Sign Rank analysis of the pre and post intervention surveys was done that showed significant changes in some outcome variables such as intentions and confidence for monitoring behaviors for adults and beliefs regarding sexual activity. “Girls Lets Talk” is a promising example of how a process evaluation plan can help develop a theory based health promotion program using the community based participatory research approach. The intervention may also be effective in altering intentions and enhancing self-efficacy among parents and teens in order to decrease risky behaviors such as early sexual activity and alcohol use.^

Assessment of cancer incidence in Titus County, Texas, 1977--1984

The purpose of this study was to determine the incidence of cancer in Titus County, Texas, through the identification of all cases of cancer that occurred in residents of the county during the period from 1977 to 1984. Data gathered from Texas Cancer Registry, hospital records, and death certificates were analyzed with regard to anatomic site, race, sex, age, city of residence, and place of birth. Adjustment of incidence rates by sex and race allowed comparisons with U.S. rates provided by the Surveillance, Epidemiology, and End Results Program (SEER).^ Seven hundred sixty-six (766) cancer cases were identified for the eight year period during 171,536 person-years of observation. In whites, statistically significant standardized incidence ratios (SIR) were found for leukemia (males SIR = 2.70 and females SIR = 2.26), melanoma (males SIR = 1.90 and females SIR = 2.25), lung (males SIR = 1.45) and for multiple myeloma (both sexes combined SIR = 1.86). In blacks, significant excess numbers of cases were found for Hodgkin's disease (males SIR = 8.33 and females SIR = 13.3) and for esophagus and bone considering both sexes together (SIR = 2.68 and 12.54, respectively). Rates for blacks were based on a small population and therefore unstable. A statistically significant excess number of cases for all sites combined was found in Mount Pleasant residents (age-adjusted incidence rate = 563.6 per 100,000 per year).^ A review of possible environmental risk factors in the area: hazardous waste disposal site, lignite deposits, and petrochemical and poultry industries are presented. A need for further epidemiological and environmental studies to identify etiological factors that could be responsible for the excess number of leukemia cases are recommended. For melanoma, a public health educational program to teach the population methods of protection from sun exposure is also suggested. ^

Community health workers: The critical link to sustainable, healthy societies in low-resource settings---A model for the Baylor Shoulder to Shoulder Foundation

Community health workers (CHWs) can serve as a bridge between healthcare providers and communities to positively impact social determinants of health and, thus, the overall health of the population. The potential to effect lasting change is particularly significant within resource-poor settings with limited access to formally trained health care providers such as the small, rural village of Santa Ana Intibucá, Honduras and surrounding areas—located on the geographically and politically isolated border of Honduras and El Salvador. The Baylor Shoulder to Shoulder Foundation (BSTS) works in conjunction with Santa Ana's volunteer health committee to bring a health brigade that has provided health care and public health projects to the area at least twice a year since 2001. They have also hired a full-time Honduran physician, a Honduran in-country administrative director, and built a clinic; yet, no community health worker program exists. This CHW program model is the response to a clear need for a CHW program within the area served by BSTS and presents a CHW program model specific to Santa Ana Intibucá and surrounding areas to be implemented by BSTS. Methods used to develop this model include reviewing the literature for recommendations from leading authorities as well as successfully implemented CHW programs in comparable regions. This information was incorporated into existing knowledge and materials currently being used in the area. Using the CHW model proposed here, each brigade, in conjunction with the communities served, can help develop new modules to respond to the specific health priorities of the region at that time, incorporating consistent modes of contact with the local physician and the CHWs to provide refresher courses, training in new topics of interest, and to be reminded of the importance of community health workers' role as the critical link to healthy societies. With cooperation, effort, and support, the brigade can continue to help integrate a sustainable CHW system in which communities may be able to maximize the care they receive while also learning to care for their own health and the future of their communities.^

Evaluation of CHIP perinatal program outcomes in Harris County, Texas

This study compared initial year trends in prenatal care and birth outcomes of women enrolled in the Texas Children's Health Insurance Program (CHIP) Perinatal program to trends in Medicaid program women. The study utilized claims data from Community Health Choice (CHC), a health plan in Harris County, Texas that provides coverage to both populations. Quarterly data was analyzed and compared for the first two years of the CHIP Perinatal program (2007-2008) to determine if outcome trends for the CHIP program improved over the outcome trends seen with those enrolled in Medicaid. Study findings indicate an increase in the quarterly prenatal care utilization for the CHIP Perinatal population from 2007 to 2008 and the associated birth weights of babies delivered also had marginal improvements during the same timeframe. Enrollees in Medicaid continued to have overall better outcomes than those enrolled within the CHIP Perinatal program. However, the study showed that the rate of improvement in both prenatal care utilization and birth outcomes were greater for the CHIP Perinatal enrollees than those enrolled in Medicaid. ^ The majority of these improvements were significant when comparing each coverage program and from year to year. Lastly, the study showed that there was a correlation between prenatal care utilization and birth outcomes. However, further analysis of the data could not conclusively indicate that access to prenatal care services provided by the CHIP Perinatal program contributed to the increases observed in utilization and birth outcomes for the study's sample population.^

Effectiveness of a nutrition education program for women in a residential program after incarceration

Background: The number of incarcerated women has increased dramatically over the past two decades. During their stay in prison, the medical and nutritional needs of these women are frequently ignored. Overweight or obesity related to poor dietary habits and low-income status are important risk factors for health inequities. Women in this population are at risk for dietary-related chronic diseases such as hypertension, diabetes, and cardiovascular diseases. This is an indication that there is a need for nutrition education in this population. ^ Purpose: The purpose of this study was to provide an evidence-based nutrition education program at a facility for previously incarcerated women in Downtown Houston, Texas (Brigid's Hope). This nutrition education program focused on promoting better health and prevention of chronic diseases by increasing fruit and vegetable (FV) intake and healthy eating on a limited budget. Constructs such as knowledge, skills, self-efficacy, and perceived barriers were evaluated as well as acceptability, feasibility, and sustainability of the program. ^ Methods: The Hope for Health Nutrition Education Program occurred in four weekly sessions at Brigid's Hope. The evaluation design was a one-group quasi-experimental design with pre- and post-test measures. Identical pre- and post-tests were administered before and after the intervention. A total of 11 residents and 2 staff members participated in the study. Results: After four nutrition education sessions, post-tests revealed an overall increase in knowledge, skills, and self-efficacy scores, and decrease in perceived barrier scores towards FV consumption. Changes in skills, self-efficacy, and perceived barriers scores were found to be statistically significant. Participant satisfaction surveys revealed overall high satisfaction of the program and that continuing the program in the future would be possible with support from staff member and mentors. ^ Conclusions: Results from this study show that a nutrition education program can have positive effects towards knowledge, skills, self-efficacy, and perceived barriers towards FV consumption for previously incarcerated women. The high satisfaction for this program shows that a health promotion program with focus on diet and nutrition can play an important role in helping this unique population of women re-enter society.^

CLIMA ORGANIZACIONAL E BURNOUT: UM ESTUDO COM SERVIDORES PÚBLICOS FEDERAIS

As condições inadequadas vivenciadas nas organizações afligem não só os trabalhadores da iniciativa privada, pois são igualmente encontradas no segmento estatal, contrariando a expectativa de que o aparato governamental eliminaria as condições insalubres e criaria outras melhores nas quais prevalecesse à promoção de saúde. Diante desse panorama questionou-se porque, uma vez que, pelo menos do ponto de vista da sociedade leiga, esses servidores estão submetidos a condições privilegiadas de trabalho. O presente estudo objetivou identificar e descrever possíveis relações entre o clima organizacional e o burnout em servidores públicos de uma instituição federal de ensino. Objetivou-se ainda descrever o clima organizacional predominante. A pesquisa realizada teve cunho quantitativo, tipo estudo de caso e exploratória. A coleta de dados deu-se por meio das escalas ECO (escala de clima organizacional), ECB (escala de caracterização do burnout) e um questionário sociodemográfico, todos os instrumentos autoaplicáveis eletronicamente disponíveis à instituição. Participaram do estudo 201 servidores públicos federais, com idade média de 37 anos, majoritariamente de nível superior e casados. Os resultados revelaram que cerca de um quarto dos participantes raramente experimentaram burnout, no entanto outra quarta parte deles frequentemente experimentaram altos níveis de burnout, resultado bastante expressivo. Os servidores perceberam clima organizacional mediano, destacando-se a boa coesão entre os colegas de trabalho e a percepção de baixa recompensa. Merece destaque a grande dispersão entre as percepções de clima, o que permite inferir haver subclimas não identificados nesta investigação, possivelmente ocasionados por uma força de clima fraca e pela participação dos servidores de unidades de ensino geograficamente distintas, geridas por gestores locais com relativa autonomia. Os resultados dos cálculos de correlação revelaram que, quanto menos os participantes percebem apoio da chefia e da organização, coesão entre colegas, e mais controle/pressão, mais exaustos se sentem, mais desumanizam as pessoas com quem tratam e mais se decepcionam no trabalho e vice-versa. Conforto físico menor está associado a maior desumanização e a mais decepção no trabalho e vice-versa; e que controle/pressão, relaciona-se positiva e fracamente com desumanização e vice-versa. Desta forma, a hipótese de que existe associação entre burnout e clima organizacional foi confirmada. Os resultados também revelaram que os servidores com burnout, perceberam pior clima organizacional que os seus pares sem burnout, confirmando a segunda hipótese. Esses servidores também se mostraram neutros quanto à percepção de apoio da chefia e conforto físico; não percebem controle pressão, nem recompensa; todavia percebem coesão entre os colegas. Esses resultados sugerem que os participantes têm se apoiado nessas relações para suportar a indiferença e ausência de estímulos experimentados no trabalho. Os resultados obtidos nesse estudo permitiram concluir que o clima organizacional é fraco, provavelmente influenciado por uma cultura organizacional fraca, explicando a heterogeneidade da percepção do clima organizacional pelos servidores. Além disso, embora haja burnout entre poucos participantes, há que se atentar que cerca de um quarto deles, encontra-se acometido desta síndrome e isto poderá contagiar os demais.