The development of the extended adolescent injury checklist (E-AIC) : a measure for injury prevention program evaluation

The Extended Adolescent Injury Checklist (E-AIC), a self-report measure of injury based on the model of the Adolescent Injury Checklist (AIC), was developed for use in the evaluation of school-based interventions. The three stages of this development involved focus groups with adolescents and consultations with medical staff, pilot testing of the revised AIC in a high school context, and use of the finalised checklist in pre- and post-questionnaires to examine its utility. Results revealed that responses to the final version of the E-AIC were meaningful and remained consistent over time. The E-AIC appears to be a promising measure of adolescent injury that is simple, time-efficient and appropriate for use in the evaluation of school-based injury prevention programs.

The Mirror Room Project: A Critical Ethnographic Program Evaluation of a Teaching Personal and Social Responsibility Based Youth Development Program

Amongst a host of other benefits, proper physical education has the possibility to create a safe place where responsibility can be transferred from the teacher/facilitator, to the student. This is especially true with an underserved population. This critical program evaluation of the program CHARM was done for the purpose of program improvement. This research was a place for participants to share their experiences of the program. The participants were 5 underserved youth, 5 undergraduate students, 3 teachers and 1 graduate student. Observations, interviews, and document analysis were used to gather data. Data was analyzed using a first level read-through, and two second-level analyses. Summaries were written, and cross-case analyses were completed. The main finding of the research was the development of a Handbook, which is a guide to running the program. Secondary findings include issues of program structure, goal setting, meaningful relationships, roles, SNAP, and an outlier in the data.

Methodological convergence of program evaluation designs

Resumen tomado de la publicación

Impact of definitions of loss to follow-up (LTFU) in antiretroviral therapy program evaluation: variation in the definition can have an appreciable impact on estimated proportions of LTFU

OBJECTIVE To examine the impact of different definitions of loss to follow-up (LTFU) on estimates of program outcomes in cohort studies of patients on antiretroviral therapy (ART). STUDY DESIGN AND SETTING We examined the impact of different definitions of LTFU using data from the International Epidemiological Databases to Evaluate AIDS-Southern Africa. The reference approach, Definition A, was compared with five alternative scenarios that differed in eligibility for analysis and the date assigned to the LTFU outcome. Kaplan-Meier estimates of LTFU were calculated up to 2 years after starting ART. RESULTS Estimated cumulative LTFU were 14% and 22% at 12 and 24 months, respectively, using the reference approach. Differences in the proportion LTFU were reported in the alternative scenarios with 12-month estimates of LTFU varying by up to 39% compared with Definition A. Differences were largest when the date assigned to the LTFU outcome was 6 months after the date of last contact and when the site-specific definition of LTFU was used. CONCLUSION Variation in the definitions of LTFU within cohort analyses can have an appreciable impact on estimated proportions of LTFU over 2 years of follow-up. Use of a standardized definition of LTFU is needed to accurately measure program effectiveness and comparability between programs.

A Multi- Faceted, Intensive Family Preservation Program Evaluation

This evaluation of a county intensive family preservation services (ifps) program makes several important methodological contributions to assessing post-treatment placement patterns of ifps clients. It is the first published ifps evaluation that utilizes an interval-level, overall measure of restrictiveness of placement, and one of the few that has followed placement patterns for a full two-years after treatment. The study is also a good example of complementing placement data with measures of family health and stability, and with qualitative feedback from former ifps clients. Finally, this study demonstrates the potential for doing methodologically sound evaluations of local ifps programs.

Program evaluation for a summer science internship: Short and long term benefits as reported by interns

Undergraduate research programs have been used as a tool to attract and retain student interest in science careers. This study evaluates the short and long-term benefits of a Summer Science Internship (SSI) at the University of Texas Health Science Center at Houston– School of Public Health – in Brownsville, Texas, by analyzing survey data from alumni. Questions assessing short-term program impact were aimed at three main topics, student: satisfaction with program, self-efficacy for science after completing the program, and perceived benefits. Long-term program impact was assessed by looking at student school attendance and college majors along with perceived links between SSI and future college plans. Students reported high program satisfaction, a significant increase in science self-efficacy and high perceived benefits. At the time data were collected for the study, one-hundred percent of alumni were enrolled in school (high school or college). The majority of students indicated they were interested in completing a science major/career, heavily influenced by their participation in the program.^

The Colic Clinic---a comprehensive program evaluation

Child abuse correlated with excessive infant crying affects millions of families each year, with consequences of the abuse lasting a lifetime. The University Of Texas School Of Medicine's Colic Clinic is currently in the early stages of testing Dr. Harvey Karp's combinatorial soothing technique for infants called "The Happiest Baby on the Block". In order to gauge the program's potential effectiveness, the Colic Clinic Protocol was examined in order to assess the applicability of the intervention to known causal factors of child abuse associated with excessive infant crying. ^ This evaluation also carried out an anticipated cost-benefit breakout analysis for the implementation of the intervention for 100 children and compared the cost of the program implementation to the cost associated with a single instance of child abuse. The analysis revealed that while accounting for materials, advertising, salaried personnel and other overhead expenses, the cost to implement the intervention was less than half the cost of the medical treatment associated with a single victim of whiplash-shaken infant syndrome. ^ Although the program is still in its early evaluative phase, the future implications of this work are extensive. If this intervention is revealed to be relevant and cost effective, it will precipitate sweeping changes in medical education and training, public health detection and prevention programs, and law enforcement.^

Sources of selection bias in evaluating social programs: An interpretation of conventional measures and evidence on the effectiveness of matching as a program evaluation method

This paper decomposes the conventional measure of selection bias in observational studies into three components. The first two components are due to differences in the distributions of characteristics between participant and nonparticipant (comparison) group members: the first arises from differences in the supports, and the second from differences in densities over the region of common support. The third component arises from selection bias precisely defined. Using data from a recent social experiment, we find that the component due to selection bias, precisely defined, is smaller than the first two components. However, selection bias still represents a substantial fraction of the experimental impact estimate. The empirical performance of matching methods of program evaluation is also examined. We find that matching based on the propensity score eliminates some but not all of the measured selection bias, with the remaining bias still a substantial fraction of the estimated impact. We find that the support of the distribution of propensity scores for the comparison group is typically only a small portion of the support for the participant group. For values outside the common support, it is impossible to reliably estimate the effect of program participation using matching methods. If the impact of participation depends on the propensity score, as we find in our data, the failure of the common support condition severely limits matching compared with random assignment as an evaluation estimator.

Program Evaluation of an After-School Socialization Group Program

Use of evidence-based practice is becoming more expected and necessary for mental health practitioners. This allows for proof, accountability, and rigorous standards to be upheld, facilitates healthcare reimbursement, and provides a wider range of services to more clients. Appropriate monitoring and outcome measurement is essential to determine the effectiveness of a given intervention. An organization providing group social skills interventions for children 7-18 years was analyzed to facilitate the best plan for evaluating treatment effectiveness. Measurable goals and objectives consistent with the organizations mission and values were developed. Appropriate social skills measurement tools were identified. Strengths and weaknesses of each measure were compared, and existing literature was reviewed to ensure cohesion between this evaluation and current standards in literature. Parent report, self report, and teacher report on Piers-Harris II, BASC-2, and Skills Improvement System Rating Scales were determined to be the most relevant measures of social skills development. A timeline for administration and plan for how to implement measurement and use data was suggested as well as considerations for future research.

The Fair Housing Assistance Program evaluation./

"October 1985"--p. [4] of cover.