Youth-focused empowerment evaluation using Photovoice

The Carrera-Children's Aid Society of New York model is a proven model of teen pregnancy prevention. There is a need to evaluate the effect that the model has had on the participants as individuals. Brighter Futures is a replication of the Carrera-Children's Aid Society of New York youth development model operated by Planned Parenthood of Houston and Southeast Texas. A qualitative youth-focused Empowerment Evaluation was initiated to determine the individual impact of the achieved program outcomes. The Empowerment Evaluation assessed what impact the Brighter Futures program has had on the students. The youth used Community-based Participatory Research (CBPR) approaches, such as Photovoice, in conjunction with guided writing and participatory groups to conduct this evaluation with in the framework of Empowerment Evaluation. Additionally, a semi-structured CBPR exercise was used to evaluate the effectiveness of the feasibility of Photovoice methodology with urban youth. ^

Development and formative evaluation of an obesity prevention intervention for the pediatric primary care setting: Helping HAND (Healthy Activity and Nutrition Directions)

As the obesity epidemic continues to increase, the pediatric primary care office setting remains a relatively unexplored arena to offer obesity prevention interventions for children. The increased risk for adult obesity among 10 to 14 year-old children who are overweight, suggests obesity prevention programs should be introduced just before this age or early in this age period. Research is also accumulating on the importance of targeting parents along with children, since parents are in charge of the home environment for children. Therefore, the aim of this project was to develop an obesity prevention program called Helping HAND (Healthy Activity and Nutrition Directions) based on Social Cognitive Theory and authoritative parenting techniques for the pediatric primary care setting and conduct one-on-one interviews with parents as the initial formative evaluation of the intervention material for the obesity prevention intervention. A secondary aim of the project was to determine the feasibility of identifying appropriate subjects for the intervention, and conducting qualitative evaluations of the materials through recruitment through pediatric primary care settings. ^

Team: Bee Me. A formulative evaluation of a negative eating attitudes and behaviors primary prevention curriculum targeted at 5 th grade elementary school girls

Objective. To evaluate a school-based intervention aimed at the primary prevention of negative eating attitudes and behaviors among preadolescent girls, and to revise curriculum lessons based on quantitative and qualitative findings. ^ Intervention Design. A formative evaluation was conducted on four Team: Bee Me curriculum lessons at a Houston elementary school. Evaluation focused on program satisfaction and short-term effect on knowledge and eating attitudes and behaviors. ^ Results. Sixteen girls participated in the five-day project. Statistically significant improvements in overall knowledge were observed (p<0.05), however only modest changes were observed in eating attitudes and behaviors. Program satisfaction was high among student participants and the teacher who implemented it. Insight for future modifications to this program and for similar interventions was provided by the students and teacher. ^ Conclusions. This program led to positive trends in outcome variables; however longer and more intensive testing of this program is needed to better evaluate its effectiveness.^

The Skip To Breakfast project: Development, implementation, and feasibility evaluation of an intervention to increase healthful breakfast consumption among fifth grade students and their families

Children and adults frequently skip breakfast and rates are currently increasing. In addition, the food choices made for breakfast are not always healthy ones. Breakfast skipping, in conjunction with unhealthy breakfast choices, leads to impaired cognitive functioning, poor nutrient intake, and overweight. In response to these public health issues, Skip To Breakfast, a behaviorally based school and family program, was created to increase consistent and healthful breakfast consumption among ethnically diverse fifth grade students and their families, using Intervention Mapping™. Four classroom lessons and four parent newsletters were used to deliver the intervention. For this project, a healthy, "3 Star Breakfast" was promoted, and included a serving each of dairy product, whole grain, and fruit, each with an emphasis on being low in fat and sugar. The goal of this project was to evaluate the feasibility and acceptability of the intervention. A pilot-test of the intervention was conducted in one classroom, in a school in Houston, during the Fall 2007 semester. A qualitative evaluation of the intervention was conducted, which included focus groups with students, phone interviews of parents, process evaluation data from the classroom teacher, and direct observation. Sixteen students and six parents participated in the study. Data were recorded and themes were identified. Initial results showed there is a need for such programs. Based on the initial feedback, edits were made to the intervention and program. Results showed high acceptability among the teacher, students, and parents. It became apparent that students were not reliably getting the parent newsletters to their parents to read, so a change to the protocol was made, in which students will receive incentives for having parents read newsletters and return signed forms, to increase parent participation. Other changes included small modifications to the curriculum, such as, clarifying instructions, changing in-class assignments to homework assignments, and including background reading materials for the teacher. The main trial is planned to be carried out in Spring 2008, in two elementary schools, utilizing four, fifth grade classes from each, with one school acting as the control and one as the intervention school. Results from this study can be used as an adjunct to the Coordinated Approach To Child Health (CATCH) program. ^

A program manual to assist with implementation of a volunteer health and wellness program

Based on the success of a community health and wellness program, Wellness in the City, delivered in Dallas County by trained volunteers, Texas Cooperative Extension (TCE) decided to pilot the program in 16 counties in North and East Texas. Before implementing the program, TCE wanted the Dallas County program to be reviewed and revised as needed to meet the diverse community needs in the pilot counties. TCE also asked for an implementation manual to be developed for the county agents to utilize. ^ To achieve these objectives, I first reviewed literature on other volunteer-implemented health interventions in the U.S. to see how they were planned, disseminated, implemented, and evaluated. Next, I reviewed the Wellness in the City program and materials. I applied all the information I gathered up to that point to the program development committee meetings (committee included seven TCE county agents, a TCE regional program director, and me). The program structure and training materials were revised based on our research and program implementation experience. These changes were made to ensure adequate training for the volunteers and to create a program that is applicable in the communities it will be piloted in. ^ With the program structure and training presentations developed, next I focused on compiling the implementation manual, which includes program details and volunteer recruitment, training, and management materials. The goal was to create a manual with everything the county agents will need to implement the program, so they can focus their efforts on putting the manual to use and recruiting and managing the volunteers. The final step was developing a program evaluation form for the agents to complete. It includes questions to assess the agents' thoughts about the training content, the feasibility of implementing the program using the manual, and the challenges of the program. ^

Analyzing the effectiveness of Kinderworld's food program on lowering & controlling childhood obesity

This is an analysis of previously collected data at Kinderworld Child Care and Early Learning Center, as part of an evaluation done to determine the program's effectiveness in reducing/controlling childhood obesity. Kinderworld is a private, for-profit organization that provides healthy, nutritious meals and snacks to children under the guidelines of the Child and Adult Care Food Program, and is reimbursed by the Texas Department of Agriculture on a fixed price-per-meal basis. The primary goal of the program is to reduce childhood obesity. Previous studies have shown a link between obesity and diet. Other, similar programs have shown success in reducing obesity among children with a healthy diet and exercise. The results from the outcome evaluation indicated that time spent in the center was positively related to higher proportions of healthy-weight children, and inversely related to BMI levels. ^

Incident hypertension among pre-hypertensive adolescents: Evaluation of pre-hypertension as an independent risk factor among secondary school students in the Houston area

Cardiovascular disease has been the leading cause of death in the United States for over fifty years. While multiple risk factors for cardiovascular disease have been identified, hypertension is one of the most commonly recognized and treatable. Recent studies indicate that the prevalence of hypertension among children and adolescents is between 3-5%, much higher than originally estimated and likely rising due to the epidemic of obesity in the U.S. In 2004, the National High Blood Pressure Education Program Working Group on High Blood Pressure in Children and Adolescents published new guidelines for the diagnosis and treatment of hypertension in this population. Included in these recommendations was the creation of a new diagnosis, pre-hypertension, aimed at identifying children at-risk for hypertension to provide early lifestyle interventions in an effort to prevent its ultimate development. In order to determine the risk associated with pre-hypertension for the development of incident HTN, a secondary analysis of a repeated cross-sectional study measuring blood pressure in Houston area adolescents from 2000 to 2007 was performed. Of 1006 students participating in the blood pressure screening on more than one occasion not diagnosed with hypertension at initial encounter, eleven were later found to have hypertension providing an overall incident rate of 0.5% per year. Incidence rates were higher among overweight adolescents–1.9% per year [IRR 8.6 (1.97, 51.63)]; students “at-risk for hypertension” (pre-hypertensive or initial blood pressure in the hypertensive range but falling on subsequent measures)–1.4% per year [IRR 4.77 (1.21, 19.78)]; and those with blood pressure ≥90th percentile on three occasions–6.6% per year [IRR 21.87 (3.40, 112.40)]. Students with pre-hypertension as currently defined by the Task Force did have an increased rate of hypertension (1.1% per year) but it did not reach statistical significance [IRR 2.44 (0.42, 10.18)]. Further research is needed to determine the morbidity and mortality associated with pre-hypertension in this age group as well as the effectiveness of various interventions for preventing the development of hypertensive disease among these at-risk individuals. ^

A formative evaluation of the American Diabetes Association's Choosing Health and Sensible Exercise childhood obesity intervention

Background. The increasing prevalence of overweight among youth in the United States, and the parallel rise in related medical comorbidities has led to a growing need for efficient weight-management interventions. Purpose. The aim of this study was to evaluate the effects of the Choosing Health and Sensible Exercise (C.H.A.S.E.) childhood obesity prevention program on Body Mass Index (BMI), physical activity and dietary behaviors. Methods. This study utilized de-identified data collected during the fall 2006 session of the C.H.A.S.E. program. A total of 65 students at Woodview Elementary School and Deepwater Elementary School participated in this intervention. The C.H.A.S.E. program is a 10-week obesity prevention program that focuses on nutrition and physical activity education. Collection of height and weight data, and a health behavior survey was conducted during the first and last week of the intervention. Paired t-tests were used to determine statistically significant differences between pre- and post-intervention measurements. One-way analysis of variance was used to adjust for potential confounders, such as gender, age, BMI category ("normal weight", "at risk overweight", or "overweight"), and self-reported weight loss goals. Data were analyzed using STATA, v. 9.2. Results. A significant decrease in mean BMI (p< 0.05) was found after the 10-week intervention. While the results were statistically significant for the group as a whole, changes in BMI were not significant when stratified by age, sex, or ethnicity. The mean overall scores for the behavior survey did not change significantly pre- and post-intervention; however, significant differences were found in the dietary intention scale, indicating that students were more likely to intend to make healthier food choices (p<0.05). No statistically significant decreases in BMI were found when stratified for baseline BMI-for-age percentiles or baseline weight loss efforts (p>0.05). Conclusion. The results of this evaluation provide information that will be useful in planning and implementing an effective childhood obesity intervention in the future. Changes in the self-reported dietary intentions and BMI show that the C.H.A.S.E. program is capable of modifying food choice selection and decreasing BMI. Results from the behavior questionnaire indicate that students in the intervention program were making changes in a positive direction. Future implementation of the C.H.A.S.E. program, as well as other childhood obesity interventions, may want to consider incorporating additional strategies to increase knowledge and other behavioral constructs associated with decreased BMI. In addition, obesity prevention programs may want to increase parental involvement and increase the dose or intensity of the intervention. ^

Evaluation of a pilot diabetes educational intervention using the American Diabetes Association's Risk Assessment form with the patrons of The Health Museum, Houston Texas

Diabetes Mellitus is not a disease, but a group of diseases. Common to all types of diabetes is high levels of blood glucose produced from a variety of causes. In 2006, the American Diabetes Association ranked diabetes as the fifth leading cause of death in the United States. The complications and consequences are serious and include nephropathy, retinopathy, neuropathy, heart disease, amputations, pregnancy complications, sexual dysfunction, biochemical imbalances, susceptibility and sensitivity to many other diseases and in some cases death. ^ The serious nature of diabetes mellitus and its complications has compelled researchers to devise new strategies to reach population segments at high risk. Various avenues of outreach have been attempted. This pilot program is not unique in using a health museum as a point of outreach. However health museums have not been a major source of interventions, either. Little information was available regarding health museum visitor demographics, visitation patterns, companion status and museum trust levels prior to this pilot intervention. This visitor information will improve planning for further interventions and studies. ^ This thesis also examined prevalence data in a temporal context, the populations at risk for diabetes, the collecting agencies, and other relevant collected data. The prevalence of diabetes has been rapidly increasing. The increase is partially explained by refinement of the definition of diabetes as the etiology has become better understood. Increasing obesity and sedentary lifestyles have contributed to the increase, as well as the burdensome increase on minority populations. ^ Treatment options are complex and have had limited effectiveness. This would lead one to conclude that prevention and early diagnosis are preferable. However, the general public has insufficient awareness and education regarding diabetes symptoms and the serious risks and complications the disease can cause. Reaching high risk, high prevalence, populations is challenging for any intervention. During its “free family Thursdays” The Health Museum (Houston, Texas) has attracted a variety of ethnic patrons; similar to the Houston and Harris County demographics. This research project explored the effectiveness of a pilot diabetes educational intervention in a health museum setting where people chose to visit. ^

Youth empowerment evaluation to improve afterschool programming

Community-based participatory research necessitates that community members act as partners in decision making and mutual learning and discovery. In the same light, for programs/issues involving youth, youth should be partners in knowledge sharing and evaluation (Checkoway & Richards-Schuster, 2004). This study is a youth-focused empowerment evaluation for the Successful Youth program. Successful Youth is a multi-component youth development after-school program for Latino middle school youth, created with the goal of reducing teen pregnancy. An empowerment evaluation is collaborative and participatory (Balcazar and Harper 2003). The three steps of an empowerment evaluation are: (1) defining mission, (2) taking stock, and (3) planning for the future (Fetterman 2001).^ In a program where youth are developing leadership skills, making choices, and learning how to self reflect and evaluate, the empowerment evaluation could not be more aligned with promoting and enhancing these skills. In addition, an empowerment evaluation is designed to "foster improvement and self-determination" and "build capacity" (Fetterman 2001). Four empowerment groups were conducted with approximately 6-9 Latino 7th grade students per group. All participants were enrolled in the Successful Youth program. Results indicate points where students' perceptions of the program were aligned with the program's mission and where gaps were identified. Students offered recommendations for program improvements. Additionally, students enjoyed expressing their feelings about the program and appreciated that their opinions were valued. Youth recommendations will be brought to program staff; and, where possible, gaps will be addressed. Empowerment evaluations with youth will continue during the duration of the program so that youth involvement and input remains integral in the evaluation and to ascertain whether the program's goals are being met. ^

Effectiveness of Texas Children's Hospital's Saturday Wellness Program for Children with special health care needs

Children with Special Health Care Needs comprise approximately 13% of children within the state of Texas. In addition to their primary diagnosis, it is estimated that approximately 18% of these children with special health care needs are overweight. Many times parents of children with special health care needs are extremely busy dealing with the daily responsibilities required to care for a child with a chronic illness, and thus, lose connections with their local communities and available resources for health needs such as obesity. Texas Children’s Hospital’s Wellness Program for Children with Special Health Care Needs is a family-centered wellness program to prevent obesity in this population; however, no formal evaluation of the program has been conducted. The purpose of this study was to assess the effectiveness of the Texas Children’s Saturday Wellness Program on weight status, nutrition knowledge, and the frequency of physical activity of children who participated in the program. A secondary data analysis was conducted with 50 children with special health care needs and their families who participated in the program during 2007 and 2008. A pre post-test study design was used with data collected immediately before and after participation in the 4 week program. Data measures included demographics (age, race, etc.), anthropometrics (height and weight), a quality of life survey focusing on nutrition and physical activity behaviors, and a knowledge survey on physical activity and nutrition. Of 50 participants, 33 (66%) completed the program. Children participating in the program showed a significant decrease in BMI (mean=29.83 to mean=29.22, BMI z score p<0.01), as well as frequency of physical activity (p<0.05) and knowledge (p<0.01). Texas Children’s Hospital’s wellness program for children with special health care needs provided a promising structure for a wellness program within a multi-ethnic special needs population; however, long term effect research is needed with a larger sample size and more comprehensive outcomes and process measures. Nonetheless, this program indicates the effectiveness and feasibility of a family-based approach to weight loss in children with special needs.^

Marketing physical activity and healthy eating: A literature review of recent social marketing campaigns and development of a social marketing plan for the CATCH program

Background. This culminating experience project was inspired by an independent study conducted at The University of Texas School of Public Health with Dr. Andrew Springer, DrPH, who works on the evaluation of the Coordinated Approach to Child Health (CATCH) program in Travis County, Texas. It was indicated that a social marketing plan could enhance current efforts for the CATCH program. The aims of the project were to (1) review and synthesize literature on social marketing, with a specific focus on diet, physical activity, and obesity prevention; and (2) apply the gained knowledge toward a practical solution – a social marketing plan for the CATCH program.^ Methods. The literature review aimed to answer the following questions: (1) What audiences (ethnic and age groups), settings, health behaviors, and behavioral science theories have been used in social marketing campaigns? (2) What features of social marketing were used (e.g. formative research, segmentation, and the marketing mix - including promotional strategies and communication channels)? (3) What were the outcomes of the social marketing campaigns? The search aimed to identify studies that met the following inclusion criteria: (a) The study explicitly stated that social marketing was used; (b) The intervention promoted physical activity and/or healthy eating; (c) The population was children, adolescents, young adults, and/or parents; (d) Results of the intervention were available in the published literature The literature review includes studies from the past five years (2004 to 2009). After reviewing the social marketing literature, the insight and knowledge gained was applied to develop a social marketing plan for the CATCH program. The plan was guided by Hands-on Social Marketing, A Step-by-Step Guide and the Center for Disease Control and Prevention's Social Marketing web course.^

An epidemiologic evaluation of a worksite based intervention

The healthcare industry spends billions on worker injury and employee turnover. Hospitals and healthcare settings have one of the highest rates of lost days due to injuries. The occupational hazards for healthcare workers can be classified into biological, chemical, ergonomic, physical, organizational, and psychosocial. Therefore, interventions addressing a range of occupational health risks are needed to prevent injuries and reduce turnover and reduce costs. ^ The Sacred Vocation Program (SVP) seeks to change the content of work, i.e., the meaningfulness of work, to improve work environments. The SVP intervenes at both the individual and organizational level. First the SVP attempts to connect healthcare workers with meaning from their work through a series of 5 self-discovery group sessions. In a sixth session the graduates take an oath recommitting them to do their work as a vocation. Once motivated to connect with meaning in their work, a representative employee group meets in a second set of five meetings. This representative group suggests organizational changes to create a culture that supports employees in their calling. The employees present their plan in the twelfth session to management beginning a new phase in the existing dialogue between employees and management. ^ The SVP was implemented in a large Dallas hospital (almost 1000 licensed beds). The Baylor University Medical Center (BUMC) Pastoral Care department invited front-line caregivers (primarily Patient Care Assistants, PCAs, or Patient Care Technicians, PCTs) to participate in the SVP. Participants completed SVP questionnaires at the beginning and following SVP implementation. Following implementation, employer records were collected on injury, absence and turnover to further evaluate the program's effectiveness on metrics that are meaningful to managers in assessing organizational performance. This provided an opportunity to perform an epidemiological evaluation of the intervention using the two sources of information: employee self-reports and employer administrative data. ^ The ability to evaluate the effectiveness of the SVP on program outcomes could be limited by the strength of the measures used. An ordinal CFA performed on baseline SVP questionnaire measurements examined the construct validity and reliability of the SVP scales. Scales whose item-factor structure was confirmed in ordinal CFA were evaluated for their psychometric properties (i.e., reliability, mean, ceiling and floor effects). CFA supported the construct validity of six of the proposed scales: blocks to spirituality, meaning at work, work satisfaction, affective commitment, collaborative communication, and MHI-5. Five of the six scales confirmed had acceptable measures of reliability (all but MHI-5 had α>0.7). All six scales had a high percentage (>30%) of the scores at the ceiling. These findings supported the use of these items in the evaluation of change although strong ceiling effects may hinder discerning change. ^ Next, the confirmed SVP scales were used to evaluate whether the intervention improved program constructs. To evaluate the SVP a one group pretest-posttest design compared participants’ self-reports before and after the intervention. It was hypothesized that measurements of reduced blocks to spirituality (α = 0.76), meaning at work (α = 0.86), collaborative communication (α = 0.67) and SVP job tasks (α = 0.97) would improve following SVP implementation. The SVP job tasks scale was included even though it was not included in the ordinal CFA analysis due to a limited sample and high inter-item correlation. Changes in scaled measurements were assessed using multilevel linear regression methods. All post-intervention measurements increased (increases <0.28 points) but only reduced blocks to spirituality was statistically significant (0.22 points on a scale from 1 to 7, p < 0.05) after adjustment for covariates. Intensity of the intervention (stratifying on high participation units) strengthened effects; but were not statistically significant. The findings provide preliminary support for the hypothesis that meaning in work can be improved and, importantly, lend greater credence to any observed improvements in the outcomes. (Abstract shortened by UMI.)^

Process evaluation of the Texas occupational safety & health surveillance system

Introduction: The Texas Occupational Safety & Health Surveillance System (TOSHSS) was created to collect, analyze and interpret occupational injury and illness data in order to decrease the impact of occupational injuries within the state of Texas. This process evaluation was performed midway through the 4-year grant to assess the efficiency and effectiveness of the surveillance system’s planning and implementation activities1. ^ Methods: Two evaluation guidelines published by the Centers for Disease Control and Prevention (CDC) were used as the theoretical models for this process evaluation. The Framework for Program Evaluation in Public Health was used to examine the planning and design of TOSHSS using logic models. The Framework for Evaluating Public Health Surveillance Systems was used to examine the implementation of approximately 60 surveillance activities, including uses of the data obtained from the surveillance system. ^ Results/Discussion: TOSHSS planning activities omitted the creation of a scientific advisory committee and specific activities designed to maintain contacts with stakeholders; and proposed activities should be reassessed and aligned with ongoing performance measurement criteria, including the role of collaborators in helping the surveillance system achieve each proposed activity. TOSHSS implementation activities are substantially meeting expectations and received an overall score of 61% for all activities being performed. TOSHSS is considered a surveillance system that is simple, flexible, acceptable, fairly stable, timely, moderately useful, with good data quality and a PVP of 86%. ^ Conclusions: Through the third year of TOSHSS implementation, the surveillance system is has made a considerable contribution to the collection of occupational injury and illness information within the state of Texas. Implementation of the nine recommendations provided under this process evaluation is expected to increase the overall usefulness of the surveillance system and assist TDSHS in reducing occupational fatalities, injuries, and diseases within the state of Texas. ^ 1 Disclaimer: The Texas Occupational Safety and Health Surveillance System is supported by Grant/Cooperative Agreement Number (U60 OH008473-01A1). The content of the current evaluation are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health.^

A review of economic analysis in the vaccination program; decision making and governance: Adivisory Committee on Immunization Practices (ACIP)

The Advisory Committee on Immunization Practices (ACIP) develops written recommendations for the routine administration of vaccines to children and adults in the U.S. civilian population. The ACIP is the only entity in the federal government that makes such recommendations. ACIP elaborates on selection of its members and rules out concerns regarding its integrity, but fails to provide information about the importance of economic analysis in vaccine selection. ACIP recommendations can have large health and economic consequences. Emphasis on economic evaluation in health is a likely response to severe pressures of the federal and state health budget. This study describes the economic aspects considered by the ACIP while sanctioning a vaccine, and reviews the economic evaluations (our economic data) provided for vaccine deliberations. A five year study period from 2004 to 2009 is adopted. Publicly available data from ACIP web database is used. Drummond et al. (2005) checklist serves as a guide to assess the quality of economic evaluations presented. Drummond et al.'s checklist is a comprehensive hence it is unrealistic to expect every ACIP deliberation to meet all of their criteria. For practical purposes we have selected seven criteria that we judge to be significant criteria provided by Drummond et al. Twenty-four data points were obtained in a five year period. Our results show that out of the total twenty-four data point‘s (economic evaluations) only five data points received a score of six; that is six items on the list of seven were met. None of the data points received a perfect score of seven. Seven of the twenty-four data points received a score of five. A minimum of a two score was received by only one of the economic analyses. The type of economic evaluation along with the model criteria and ICER/QALY criteria met at 0.875 (87.5%). These three criteria were met at the highest rate among the seven criteria studied. Our study findings demonstrate that the perspective criteria met at 0.583 (58.3%) followed by source and sensitivity analysis criteria both tied at 0.541 (54.1%). The discount factor was met at 0.250 (25.0%).^ Economic analysis is not a novel concept to the ACIP. It has been practiced and presented at these meetings on a regular basis for more than five years. ACIP‘s stated goal is to utilize good quality epidemiologic, clinical and economic analyses to help policy makers choose among alternatives presented and thus achieve a better informed decision. As seen in our study the economic analyses over the years are inconsistent. The large variability coupled with lack of a standardized format may compromise the utility of the economic information for decision-making. While making recommendations, the ACIP takes into account all available information about a vaccine. Thus it is vital that standardized high quality economic information is provided at the ACIP meetings. Our study may provide a call for the ACIP to further investigate deficiencies within the system and thereby to improve economic evaluation data presented. ^