The Comprehensive Assessment of Leadership for Learning: A Next Generation Formative Evaluation and Feedback System

Recent developments in federal policy have prompted the creation of state evaluation frameworks for principals and teachers that hold educators accountable for effective practices and student outcomes. These changes have created a demand for formative evaluation instruments that reflect current accountability pressures and can be used by schools to focus school improvement and leadership development efforts. The Comprehensive Assessment of Leadership for Learning (CALL) is a next generation, 360-degree on-line assessment and feedback system that reflect best practices in feedback design. Some unique characteristics of CALL include a focus on: leadership distributed throughout the school rather than as carried out by an individual leader; assessment of leadership tasks rather than perceptions of leadership practice; a focus on larger complex systems of middle and high school; and transparency of assessment design. This paper describes research contributing to the design and validation of the CALL survey instrument.

Formative Evaluation of the "Time Twisters": A Comic Book Based Obesity Prevention Curriculum for Elementary School Students

Introduction: Obesity is a public health problem, particularly in Hispanic children. Alternative media channels may offer the potential to motivate children to engage in health promoting behaviors. A comic book, “Time Twisters”, was developed to impact screen time use, physical activity, and dietary behavior for elementary school children and evaluated for acceptability and feasibility prior to implementation in a multi-component physical activity intervention. [See PDF for complete abstract]

Design and evaluation of the parent education component of a comprehensive violence prevention project in middle schools

Low parental monitoring is related to youth risk behaviors such as delinquency and aggression. The purpose of this dissertation was to describe the development and evaluation of a parent education intervention to increase parental monitoring in Hispanic parents of middle school children.^ The first study described the process of intervention mapping as used to develop Padres Trabajando por la Paz, a newsletter intervention for parents. Using theory, empirical literature, and information from the target population, performance objectives and determinants for monitoring were defined. Learning objectives were specified and a staged social-cognitive approach was used to develop methods and strategies delivered through newsletters.^ The second study examined the outcomes of a randomized trial of the newsletter intervention. Outcome measures consisted of a general measure of monitoring, parent and child reports of monitoring behaviors targeted by the intervention, and psychosocial determinants of monitoring (self-efficacy, norms, outcome expectancies, knowledge, and beliefs). Seventy-seven parents completed the randomized trial, half of which received four newsletters over an eight-week period. Results revealed a significant interaction effect for baseline and treatment for parent's reports of norms for monitoring (p =.009). Parents in the experimental condition who scored low at baseline reported increased norms for monitoring at follow-up. A significant interaction effect for child reports of parental monitoring behaviors (p =.04) reflected an small increase across baseline levels in the experimental condition and decreases for the control condition at higher baseline scores. Both groups of parents reported increased levels of monitoring at follow-up. No other outcome measures varied significantly by condition.^ The third study examined the relationship between the psychosocial determinants of parental monitoring and parental monitoring behaviors in the study population. Weak evidence for a relationship between outcome expectancies and parental monitoring behaviors suggests further research in the area utilizing stronger empirical models such as longitudinal design and structural equation modeling.^ The low-cost, minimal newsletter intervention showed promise for changing norms among Hispanic parents for parental monitoring. In light of the importance of parental monitoring as a protective factor for youth health risk behaviors, more research needs to be done to develop and evaluate interventions to increase parental monitoring. ^

Youth empowerment evaluation to improve afterschool programming

Community-based participatory research necessitates that community members act as partners in decision making and mutual learning and discovery. In the same light, for programs/issues involving youth, youth should be partners in knowledge sharing and evaluation (Checkoway & Richards-Schuster, 2004). This study is a youth-focused empowerment evaluation for the Successful Youth program. Successful Youth is a multi-component youth development after-school program for Latino middle school youth, created with the goal of reducing teen pregnancy. An empowerment evaluation is collaborative and participatory (Balcazar and Harper 2003). The three steps of an empowerment evaluation are: (1) defining mission, (2) taking stock, and (3) planning for the future (Fetterman 2001).^ In a program where youth are developing leadership skills, making choices, and learning how to self reflect and evaluate, the empowerment evaluation could not be more aligned with promoting and enhancing these skills. In addition, an empowerment evaluation is designed to "foster improvement and self-determination" and "build capacity" (Fetterman 2001). Four empowerment groups were conducted with approximately 6-9 Latino 7th grade students per group. All participants were enrolled in the Successful Youth program. Results indicate points where students' perceptions of the program were aligned with the program's mission and where gaps were identified. Students offered recommendations for program improvements. Additionally, students enjoyed expressing their feelings about the program and appreciated that their opinions were valued. Youth recommendations will be brought to program staff; and, where possible, gaps will be addressed. Empowerment evaluations with youth will continue during the duration of the program so that youth involvement and input remains integral in the evaluation and to ascertain whether the program's goals are being met. ^

Development and evaluation of a video-based modeling strategy for the dissemination phase of a school health tobacco -use prevention program

Even the best school health education programs will be unsuccessful if they are not disseminated effectively in a manner that encourages classroom adoption and implementation. This study involved two components: (1) the development of a videotape intervention to be used in the dissemination phase of a 4-year, NCI-funded diffusion study and (2) the evaluation of that videotape intervention strategy in comparison with a print (information transfer) strategy. Conceptualization has been guided by Social Learning Theory, Diffusion Theory, and communication theory. Additionally, the PRECEDE Framework has been used. Seventh and 8th grade classroom teachers from Spring Branch Independent School District in west Houston participated in the evaluation of the videotape and print interventions using a 57-item preadoption survey instrument developed by the UT Center for Health Promotion Research and Development. Two-way ANOVA was used to study individual score differences for five outcome variables: Total Scale Score (comprised of 57 predisposing, enabling, and reinforcing items), Adoption Characteristics Subscale, Attitude Toward Innovation Subscale, Receptivity Toward Innovation, and Reinforcement Subscale. The aim of the study is to compare the effect upon score differences of video and print interventions alone and in combination. Seventy-three 7th and 8th grade classroom teachers completed the study providing baseline and post-intervention measures on factors related to the adoption and implementation of tobacco-use prevention programs. Two-way ANOVA, in relation to the study questions, found significant scoring differences for those exposed to the videotape intervention alone for both the Attitude Toward Innovation Subscale and the Receptivity to Adopt Subscale. No significant results were found to suggest that print alone influences favorable scoring differences between baseline and post-intervention testing. One interaction effect was found suggesting video and print combined are more effective for influencing favorable scoring differences for the Reinforcement for the Adoption Subscale.^ This research is unique in that it represents a newly emerging field in health promotion communications research with implications for Social Learning Theory, Diffusion Theory, and communication science that are applicable to the development of improved school health interventions. ^