Alternative Strategies for Identifying High-Performing Charter Schools in Texas

The Obama administration's recurring policy emphasis on high-performing charter schools begs the obvious question: how do you identify a high-performing charter school? That is a crucially important policy question because any evaluation strategy that incorrectly identifies charter school performance could have negative effects on the economically and/or academically disadvantaged students who frequently attend charter schools. If low-performing schools are mislabeled and allowed to persist or encouraged to expand, then students may be harmed directly. If high-performing schools are driven from the market by misinformation, then students will lose access to programs and services that can make a difference in their lives. Most of the scholarly analysis to date has focused on comparing the performance of students in charter schools to that of similar students in traditional public schools (TPS). By design, that research measures charter school performance only in relative terms. Charter schools that outperform similarly situated, but low performing, TPSs have positive effects, even if the charter schools are mediocre in an absolute sense. This analysis describes strategies for identifying high-performing charter schools by comparing charter schools with one another. We begin by describing salient characteristics of Texas charter schools. We follow that discussion with a look at how other researchers across the country have compared charter school effectiveness with TPS effectiveness. We then present several metrics that can be used to identify high-performing charter schools. Those metrics are not mutually exclusive—one could easily justify using multiple measures to evaluate school effectiveness—but they are also not equally informative. If the goal is to measure the contributions that schools are making to student knowledge and skills, then a value-added approach like the ones highlighted in this report is clearly superior to a levels-based approach like that taken under the current accountability system.

Rigorously assessing whether the data backs the back school.

A rigorous between-subjects methodology employing independent random samples and having broad clinical applicability was designed and implemented to evaluate the effectiveness of back safety and patient transfer training interventions for both hospital nurses and nursing assistants. Effects upon self-efficacy, cognitive, and affective measures are assessed for each of three back safety procedures. The design solves the problem of obtaining randomly assigned independent controls where all experimental subjects must participate in the training interventions.

Cost-effectiveness of universal prophylaxis in pregnancy with prior group B streptococci colonization.

OBJECTIVE: To estimate the costs and outcomes of rescreening for group B streptococci (GBS) compared to universal treatment of term women with history of GBS colonization in a previous pregnancy. STUDY DESIGN: A decision analysis model was used to compare costs and outcomes. Total cost included the costs of screening, intrapartum antibiotic prophylaxis (IAP), treatment for maternal anaphylaxis and death, evaluation of well infants whose mothers received IAP, and total costs for treatment of term neonatal early onset GBS sepsis. RESULTS: When compared to screening and treating, universal treatment results in more women treated per GBS case prevented (155 versus 67) and prevents more cases of early onset GBS (1732 versus 1700) and neonatal deaths (52 versus 51) at a lower cost per case prevented ($8,805 versus $12,710). CONCLUSION: Universal treatment of term pregnancies with a history of previous GBS colonization is more cost-effective than the strategy of screening and treating based on positive culture results.

Outcomes of safety and effectiveness in a multicenter randomized, controlled trial of whole-body hypothermia for neonatal hypoxic-ischemic encephalopathy.

BACKGROUND: Whole-body hypothermia reduced the frequency of death or moderate/severe disabilities in neonates with hypoxic-ischemic encephalopathy in a randomized, controlled multicenter trial. OBJECTIVE: Our goal was to evaluate outcomes of safety and effectiveness of hypothermia in infants up to 18 to 22 months of age. DESIGN/METHODS: A priori outcomes were evaluated between hypothermia (n = 102) and control (n = 106) groups. RESULTS: Encephalopathy attributable to causes other than hypoxia-ischemia at birth was not noted. Inotropic support (hypothermia, 59% of infants; control, 56% of infants) was similar during the 72-hour study intervention period in both groups. Need for blood transfusions (hypothermia, 24%; control, 24%), platelet transfusions (hypothermia, 20%; control, 12%), and volume expanders (hypothermia, 54%; control, 49%) was similar in the 2 groups. Among infants with persistent pulmonary hypertension (hypothermia, 25%; control, 22%), nitric-oxide use (hypothermia, 68%; control, 57%) and placement on extracorporeal membrane oxygenation (hypothermia, 4%; control, 9%) was similar between the 2 groups. Non-central nervous system organ dysfunctions occurred with similar frequency in the hypothermia (74%) and control (73%) groups. Rehospitalization occurred among 27% of the infants in the hypothermia group and 42% of infants in the control group. At 18 months, the hypothermia group had 24 deaths, 19 severe disabilities, and 2 moderate disabilities, whereas the control group had 38 deaths, 25 severe disabilities, and 1 moderate disability. Growth parameters were similar between survivors. No adverse outcomes were noted among infants receiving hypothermia with transient reduction of temperature below a target of 33.5 degrees C at initiation of cooling. There was a trend in reduction of frequency of all outcomes in the hypothermia group compared with the control group in both moderate and severe encephalopathy categories. CONCLUSIONS: Although not powered to test these secondary outcomes, whole-body hypothermia in infants with encephalopathy was safe and was associated with a consistent trend for decreasing frequency of each of the components of disability.

CATCH across Texas: Building a model for the diffusion of effective school-based health promotion programs

The impact of health promotion programs is related to both program effectiveness and the extent to which the program is implemented among the target population. The purpose of this dissertation was to describe the development and evaluation of a school-based program diffusion intervention designed to increase the rate of dissemination and adoption of the Child and Adolescent Trial for Cardiovascular Health, or CATCH program (recently renamed the Coordinated Approach to Child Health). ^ The first study described the process by which schools across the state of Texas spontaneously began to adopt the CATCH program after it was tested and proven effective in a multi-site randomized efficacy trial. A survey of teachers and administrator representatives of all schools on record that purchased the CATCH program, but were not involved in the efficacy trial, was used to find out who brought CATCH into the schools, how they garnered support for its adoption, why they decided to adopt the program, and what was involved in deciding to adopt. ^ The second study described how the Intervention Mapping framework guided the planning, development and implementation of a program for the diffusion of CATCH. An iterative process was used to integrate theory, literature, the experience of project staff and data from the target population into a meaningful set of program determinants and performance objectives. Proximal program objectives were specified and translated into both media and interpersonal communication strategies for program diffusion. ^ The third study assessed the effectiveness of the diffusion program in a case-comparison design. Three of the twenty Education Service Center regions in Texas were chosen, selected based on similar demographic criteria, and were followed for adoption of the CATCH curriculum. One of these regions received the full media and interpersonal channel intervention; a second received a reduced media-only intervention, and a third received no intervention. Results suggested the use of the interpersonal channels with media follow-up is an effective means to facilitate program dissemination and adoption. The media-alone condition was not effective in facilitating program adoption. ^

An evaluation of the impact of Inner City Development's Cooperative Home School: An educational alternative program to increase the quality and level of education in San Antonio's West Side community

The research study was intended to evaluate the effectiveness of Inner City Development's (I.C.D.) Cooperative Home School, an educational alternative program to the Title I public schools of San Antonio's West Side community. The study investigated students', parents' and tutors' perception of parental involvement and educational resources. The study also investigated each student's academic achievement. ^ The study found that students progressed toward expected math proficiency at a faster rate than they did in reading proficiency. However, because the target population size was small and a comparison group was not used, the results of this study are only suggestive. This research also indicated that study subjects believed students' quality and level of education increased substantially since program exposure. Study subjects mainly attributed the students' strides in academic performance to the increased amount of individualized attention students received in the small twelve-student class size. Study subjects were more satisfied with the home school's educational resources than those of the Title I public schools. Study subjects also perceived that parental involvement both at home and at school increased since enrollment in the home school program because: (1) there were more opportunities for involvement in the home school; and (2) parents felt closer to the tutors than the teachers in public school. ^ This evaluation also suggested improvements to program operations. With the help of additional volunteers, I.C.D. program operators could improve collection and organization of academic records. Furthermore, as suggested by program participants, science could be added to the curriculum. Lastly, a formal tutor orientation could be implemented to familiarize and train tutors on classroom management procedures. ^

Evaluation of the city of Houston HIV/STD prevention program in Houston Independent School District (HISD) high schools

This cross-sectional study was undertaken to evaluate the impact in terms of HIV/STD knowledge and sexual behavior that the City of Houston HIV/STD prevention program in HISD high schools has had on students who have participated in it by comparing them with their peers who have not, based on self reports. The study further evaluated the program cost-effectiveness for averting future HIV infections by computing Cost-Utility Ratios based on reported sexual behavior. ^ Mixed results were obtained, indicating a statistically significant difference in knowledge with the intervention group having scored higher (p-value 0.001) but not for any of the behaviors assessed. The knowledge score outcome's overall p-value after adjusting for each stratifying variable (age, grade, gender and ethnicity) was statistically significant. The Odds Ratio of intervention group participants aged 15 years or more scoring 70% or higher was 1.86 times; that of intervention group female participants was 2.29 times; and that of intervention group Black/African American participants was 2.47 times relative to their comparison group counterparts. The knowledge score results remained statistically significant in the logistic regression model, which controlled for age, grade level, gender and ethnicity. The Odds Ratio in this case was 1.74. ^ Three scenarios based on the difference in the risk of HIV infection between the intervention and comparison group were used for computation of Cost-Utility Ratios: Base, worst and best-case scenario. The best-case scenario yielded cost-effective results for male participants and cost-saving results for female participants when using ethnicity-adjusted HIV prevalence. The scenario remained cost-effective for female participants when using the unadjusted HIV prevalence. ^ The challenge to the program is to devise approaches that can enhance benefits for male participants. If it is a threshold problem implying that male participants require more intensive programs for behavioral change, then programs should first be piloted among boys before being implemented across the board. If it is a reflection of gender differences, then we might have to go back to the drawing board and engage boys in focus group discussions that will help formulate more effective programs. Gender-blind approaches currently in vogue do not seem to be working. ^

Team: Bee Me. A formulative evaluation of a negative eating attitudes and behaviors primary prevention curriculum targeted at 5 th grade elementary school girls

Objective. To evaluate a school-based intervention aimed at the primary prevention of negative eating attitudes and behaviors among preadolescent girls, and to revise curriculum lessons based on quantitative and qualitative findings. ^ Intervention Design. A formative evaluation was conducted on four Team: Bee Me curriculum lessons at a Houston elementary school. Evaluation focused on program satisfaction and short-term effect on knowledge and eating attitudes and behaviors. ^ Results. Sixteen girls participated in the five-day project. Statistically significant improvements in overall knowledge were observed (p<0.05), however only modest changes were observed in eating attitudes and behaviors. Program satisfaction was high among student participants and the teacher who implemented it. Insight for future modifications to this program and for similar interventions was provided by the students and teacher. ^ Conclusions. This program led to positive trends in outcome variables; however longer and more intensive testing of this program is needed to better evaluate its effectiveness.^

The School Sealant Program: An evaluation of the oral health education component

Dental caries is a common preventable childhood disease leading to severe physical, mental and economic repercussions for children and their families if left untreated. A needs assessment in Harris County reported that 45.9% of second graders had untreated dental caries. In order to address this growing problem, the School Sealant Program (SSP), a primary preventive initiative, was launched by the Houston Department of Health and Human Services (HDHHS) to provide oral health education, and underutilized dental preventive services to second grade children from participating Local School Districts (LSDs). ^ To determine the effectiveness and efficiency of the SSP, a program evaluation was conducted by the HDHHS between September 2007 and June 2008 for the Oral Health Education (OHE) component of the SSP. The objective of the evaluation was to assess short term changes in oral health knowledge of the participants and determine if these changes, if any, were due to the OHE sessions. An 8-item multiple choice pre/post test was developed for this purpose and administered to the participants before and immediately after the OHE sessions. ^ The present project analyzed pre and post test data of 1,088 second graders from 22 participating schools. Changes in overall and topic-specific knowledge of the program participants before and after the OHE sessions were analyzed using the Wilcoxon's signed rank test. ^ Results. The overall knowledge assessment showed a statistically significant (p <0.001) increase in the dental health knowledge of the participants after the oral health education sessions. Participants in the higher scoring category (7-8 correct responses) increased from 9.5% at baseline to 60.8% after the education sessions. Overall knowledge increased in all school regions with the highest knowledge gains seen in the Central and South regions. Males and females had similar knowledge gains. Significant knowledge differences were also found for each of the topic specific categories (functions of teeth, healthy diet, healthy habits, dental sealants; p<0.001) indicating an increase in topic specific knowledge of the participants post-health education sessions. ^ Conclusions. The OHE sessions were successful in increasing the short term oral health knowledge of the participants. ^

Incident hypertension among pre-hypertensive adolescents: Evaluation of pre-hypertension as an independent risk factor among secondary school students in the Houston area

Cardiovascular disease has been the leading cause of death in the United States for over fifty years. While multiple risk factors for cardiovascular disease have been identified, hypertension is one of the most commonly recognized and treatable. Recent studies indicate that the prevalence of hypertension among children and adolescents is between 3-5%, much higher than originally estimated and likely rising due to the epidemic of obesity in the U.S. In 2004, the National High Blood Pressure Education Program Working Group on High Blood Pressure in Children and Adolescents published new guidelines for the diagnosis and treatment of hypertension in this population. Included in these recommendations was the creation of a new diagnosis, pre-hypertension, aimed at identifying children at-risk for hypertension to provide early lifestyle interventions in an effort to prevent its ultimate development. In order to determine the risk associated with pre-hypertension for the development of incident HTN, a secondary analysis of a repeated cross-sectional study measuring blood pressure in Houston area adolescents from 2000 to 2007 was performed. Of 1006 students participating in the blood pressure screening on more than one occasion not diagnosed with hypertension at initial encounter, eleven were later found to have hypertension providing an overall incident rate of 0.5% per year. Incidence rates were higher among overweight adolescents–1.9% per year [IRR 8.6 (1.97, 51.63)]; students “at-risk for hypertension” (pre-hypertensive or initial blood pressure in the hypertensive range but falling on subsequent measures)–1.4% per year [IRR 4.77 (1.21, 19.78)]; and those with blood pressure ≥90th percentile on three occasions–6.6% per year [IRR 21.87 (3.40, 112.40)]. Students with pre-hypertension as currently defined by the Task Force did have an increased rate of hypertension (1.1% per year) but it did not reach statistical significance [IRR 2.44 (0.42, 10.18)]. Further research is needed to determine the morbidity and mortality associated with pre-hypertension in this age group as well as the effectiveness of various interventions for preventing the development of hypertensive disease among these at-risk individuals. ^

Get ur 60: A social marketing campaign to promote and facilitate physical activity among Central Texas middle school students

If allowed to continue unabated, the obesity epidemic may lead to the first decline in life expectancy in the developed world (Olshansky et al., 2005). Similar to the relationship between smoking habits in youth and adulthood, obesogenic dietary and physical activity habits in childhood may persist into adulthood (Kelder et al., 2002). Teaching children how to establish healthy eating habits and activity levels, as well as providing them the necessary resources to internalize and maintain these behaviors, may be the key to curbing this epidemic.^ A school-based obesity prevention approach is advantageous for many reasons including exposure to large captive audiences, reduced costs of sustainability and long-term maintenance, and generalizability of models and results across multiple populations. The effectiveness of school-based programs has been researched over the past 20 years, with promising results.^ Social marketing is a program-planning process that “facilitates the acceptance, rejection, modification, abandonment, or maintenance of particular behaviors” (Grier & Bryant, 2005). Social marketing has been shown to be effective in a variety of public health applications including improving diet, increasing physical activity, and preventing substance abuse. It is hypothesized that social marketing could further enhance the effectiveness of the Coordinated Approach To Child Health (CATCH) Central Texas Middle School Project, a school-based obesity prevention program.^ The development, implementation, and initial evaluation of the get ur 60 campaign, to promote the Center for Disease Control and Prevention (CDC) recommended sixty minutes of daily activity, is described in this paper. Various components of the get ur 60 campaign were assessed to evaluate the effectiveness of the campaign during the first semester of implementation. At the end of the spring semester focus groups were held to collect student reactions to the first semester of the get ur 60 campaign.^ The initial results from the first semester of get ur 60 have demonstrated that the campaign as designed was feasible to implement, accepted at all intervention schools, and resulted in a measure of success. ^

MEETING THE NEEDS OF HANDICAPPED CHILDREN: A STUDY OF EDUCATIONAL AND HEALTH CARE SERVICES PROVIDED TO PRE-KINDERGARTEN CHILDREN IN THE HOUSTON INDEPENDENT SCHOOL DISTRICT EARLY CHILDHOOD PROGRAM FOR THE HANDICAPPED (PARENT SATISFACTION, FUNCTIONAL STATUS, PSYCHOSOCIAL DEVELOPMENT)

The Education for All Handicapped Children Act of 1975, P.L. 94-142, created a new challenge for the nation's public school systems. During 1982-1983, a national study, called the "Collaborative Study of Children with Special Needs", was conducted in 5 metropolitan school districts to evaluate the effectiveness of education and health care services of children in kindergarten to 6th grade being provided under P.L. 94-142 programs. This dissertation (the Substudy) was undertaken to augment the findings of the Collaborative Study. The purpose of this study was to develop a database to provide descriptive information on the demographic, service and health characteristics of a small group of 3 and 4 year old handicapped children served by the Houston Independent School District (HISD) during 1982-1983.^ The study involved a stratified sample of 105 three and four year old children divided into 3 groups according to type of handicapping condition.^ The results of the study gave a clearer picture of the demographic characteristics of these Pre-K children. Specifically, sex ratio was approximately one, lower than the national norm. Family and socioeconomic characteristics were assessed.^ The study used an independence/dependence index composed of 11 items on the parent questionnaire to assess the level of functional independence of each child. An association was found between index scores and parent-reported effects of the child on family activity. Parents who said that their child's condition had affected the family's job situation, housing accomodations, vacation plans, marriage, choice of friends and social activities were also more likely to report less independence in the child. In addition, many of the Substudy children had extensive care-taking needs reflected in specific components of the index such as dressing, feeding, toileting or moving about the house.^ In general the results of the Pre-K Substudy indicate that at the early childhood level, the HISD special education program is functioning well in most areas and that parents are very satisfied with the program. (Abstract shortened with permission of author.)^

Are school nurses effective in the fight against childhood obesity?

Background. With childhood obesity on the rise in the United States, school nurses are faced with the task of preventing, identifying and treating obese children in their schools. This study reviews current literature and examines the effectiveness of the school nurse regarding obesity prevention and treatment services and the barriers they face.^ Methods. Ovid, Ebsco, Google Scholar and other professional websites were searched for school-based obesity interventions that included school nurses and that took place in the United States between 1996 and present day. This resulted in 8 studies.^ Results. Of the 8 studies identified, the majority were conducted in the Midwest, all of the studies were cross-sectional in design or qualitative in nature and only half of these studies were based off theoretical design. The most common barriers school nurses face include: lack of time, lack of support from both the school and parents, lack of confidence in counseling students and their parents and lack of specific guidelines for their role. ^ Conclusions. This study further reflects the need for more research using experimental research designs to evaluate nurse-driven interventions and nurse-related policies for childhood obesity prevention and treatment, the need to create specific guidelines for school nurses, the need for further education for nurses relating to counseling, and the need for more support from the school and community for school-based obesity prevention. ^

U.S. school based sealant programs: Review of their most common characteristics

In the United States, dental caries is the most common chronic illness in children, occurring five to eight times as frequently as asthma. 11 Dental caries is an unmet health need, disproportionately affecting minority groups and individuals with low socio-economic status.15,34,36 School-Based Sealant Programs were developed to target children at risk, to provide dental services in a closer geographic area, to offer low cost preventive dental services, and to educate families about oral health and prevention.1 There is scientific, evidence based literature that shows the effectiveness of dental sealants preventing dental decay. 13^ Currently, there is no central source for cataloging School-Based Sealant Programs (SBSPs). Information is scattered around publications and documents. For instance, the National Health and Nutrition Examination Survey (NHANES) does not have information about all the existing SBSPs. ^ This literature review determined which are the most common characteristics of SBSPs in the U.S. and determined the extent to which these programs provide sealants to children of low socio-economic status. The method utilized was an electronic database search. Pubmed and EBESCO host databases were searched with Mesh terms like “dental school sealant programs”, “community dentistry”, “school based sealant programs” and “oral preventive programs”. Results were organized in terms of location, population served, providers, funding source and data shared. ^ The searches produced 77 studies, from which 40 were included in this work. Only 18 U.S. states were represented in the results; however these findings are very consistent with the Best Practice Approach – School Based Sealant Programs3. Most of the SBSPs provide their services to children from low income families, and utilized the lower labor cost providers permitted by their state regulations. The author intends that this thesis work will become an aide in the development of future programs, and as evidence for the sustainability of these programs.^

The impact of a cooking and gardening summer camp experience on the fruit and vegetable consumption of elementary school-aged children

Childhood obesity is a significant public health problem. Over 15 percent of children in the United States are obese, and about 25 percent of children in Texas are overweight (CDC NHANES). Furthermore, about 30 percent of elementary school aged children in Harris County, Texas are overweight or obese (Children at Risk Institute 2010). In addition to actions such as increasing physical activity, decreasing television watching and video game time, decreasing snacking on low nutrient calorie dense foods and sugar sweetened beverages, children need to consume more fruits and vegetables. According to the National Health and Nutrition Examination Survey (NHANES) from 2002, about 26 percent of U.S. children are meeting the recommendations for daily fruit intake and about 16 percent are meeting the recommendations for daily vegetable intake (CDC NHANES). In 2004, the average total intake of vegetables was 0.9 cups per day and 1.1 cups of fruit per day by children ages four to nine years old in the U.S. (CDC NHANES). Not only do children need effective nutrition education to learn about fruits and vegetables, they also need access and repeated exposure to fruits and vegetables (Anderson 2009, Briefel 2009). Nutrition education interventions that provide a structured, hands-on curriculum such as school gardens have produced significant changes in child fruit and vegetable intake (Blair 2009, McAleese 2007). To prevent childhood obesity from continuing into adolescence and adulthood, effective nutrition education interventions need to be implemented immediately and for the long-term. However, research has shown short-term nutrition education interventions such as summer camps to be effective for significant changes in child fruit and vegetable intake, preferences, and knowledge (Heim 2009). ^ A four week summer camp based on cooking and gardening was implemented at 6 Multi-Service centers in a large, urban city. The participants included children ranging in age from 7 to 14 years old (n=64). The purpose of the camp was to introduce children to their food from the seed to the plate through the utilization of gardening and culinary exercises. The summer camp activities were aimed at increasing the children's exposure, willingness to try, preferences, knowledge, and intake of fruits and vegetables. A survey was given on the first day of camp and again on the last day of camp that measured the pre- and post differences in knowledge, intake, willingness to try, and preferences of fruits and vegetables. The present study examined the short-term effectiveness of a cooking and garden-based nutrition education program on the knowledge, willingness, preferences, and intake among children aged 8 to 13 years old (n=40). The final sample of participants (n=40) was controlled for those who completed pre- and post-test surveys and who were in or above the third grade level. Results showed a statistically significant increase in the reported intake of vegetables and preferences for vegetables, specifically green beans, and fruits. There was also a significant increase in preferences for fruits among boys and participants ages 11 to 13 years. The results showed a change in the expected direction of willingness to try, preferences for vegetables, and intake of fruit, however these were not statistically significant. Interestingly, the results also showed a decrease in the intake of low nutrient calorie dense foods such as sweets and candy.^