The Mirror Room Project: A Critical Ethnographic Program Evaluation of a Teaching Personal and Social Responsibility Based Youth Development Program

Amongst a host of other benefits, proper physical education has the possibility to create a safe place where responsibility can be transferred from the teacher/facilitator, to the student. This is especially true with an underserved population. This critical program evaluation of the program CHARM was done for the purpose of program improvement. This research was a place for participants to share their experiences of the program. The participants were 5 underserved youth, 5 undergraduate students, 3 teachers and 1 graduate student. Observations, interviews, and document analysis were used to gather data. Data was analyzed using a first level read-through, and two second-level analyses. Summaries were written, and cross-case analyses were completed. The main finding of the research was the development of a Handbook, which is a guide to running the program. Secondary findings include issues of program structure, goal setting, meaningful relationships, roles, SNAP, and an outlier in the data.

Sources of selection bias in evaluating social programs: An interpretation of conventional measures and evidence on the effectiveness of matching as a program evaluation method

This paper decomposes the conventional measure of selection bias in observational studies into three components. The first two components are due to differences in the distributions of characteristics between participant and nonparticipant (comparison) group members: the first arises from differences in the supports, and the second from differences in densities over the region of common support. The third component arises from selection bias precisely defined. Using data from a recent social experiment, we find that the component due to selection bias, precisely defined, is smaller than the first two components. However, selection bias still represents a substantial fraction of the experimental impact estimate. The empirical performance of matching methods of program evaluation is also examined. We find that matching based on the propensity score eliminates some but not all of the measured selection bias, with the remaining bias still a substantial fraction of the estimated impact. We find that the support of the distribution of propensity scores for the comparison group is typically only a small portion of the support for the participant group. For values outside the common support, it is impossible to reliably estimate the effect of program participation using matching methods. If the impact of participation depends on the propensity score, as we find in our data, the failure of the common support condition severely limits matching compared with random assignment as an evaluation estimator.

Impact of definitions of loss to follow-up (LTFU) in antiretroviral therapy program evaluation: variation in the definition can have an appreciable impact on estimated proportions of LTFU

OBJECTIVE To examine the impact of different definitions of loss to follow-up (LTFU) on estimates of program outcomes in cohort studies of patients on antiretroviral therapy (ART). STUDY DESIGN AND SETTING We examined the impact of different definitions of LTFU using data from the International Epidemiological Databases to Evaluate AIDS-Southern Africa. The reference approach, Definition A, was compared with five alternative scenarios that differed in eligibility for analysis and the date assigned to the LTFU outcome. Kaplan-Meier estimates of LTFU were calculated up to 2 years after starting ART. RESULTS Estimated cumulative LTFU were 14% and 22% at 12 and 24 months, respectively, using the reference approach. Differences in the proportion LTFU were reported in the alternative scenarios with 12-month estimates of LTFU varying by up to 39% compared with Definition A. Differences were largest when the date assigned to the LTFU outcome was 6 months after the date of last contact and when the site-specific definition of LTFU was used. CONCLUSION Variation in the definitions of LTFU within cohort analyses can have an appreciable impact on estimated proportions of LTFU over 2 years of follow-up. Use of a standardized definition of LTFU is needed to accurately measure program effectiveness and comparability between programs.

Program Evaluation of an After-School Socialization Group Program

Use of evidence-based practice is becoming more expected and necessary for mental health practitioners. This allows for proof, accountability, and rigorous standards to be upheld, facilitates healthcare reimbursement, and provides a wider range of services to more clients. Appropriate monitoring and outcome measurement is essential to determine the effectiveness of a given intervention. An organization providing group social skills interventions for children 7-18 years was analyzed to facilitate the best plan for evaluating treatment effectiveness. Measurable goals and objectives consistent with the organizations mission and values were developed. Appropriate social skills measurement tools were identified. Strengths and weaknesses of each measure were compared, and existing literature was reviewed to ensure cohesion between this evaluation and current standards in literature. Parent report, self report, and teacher report on Piers-Harris II, BASC-2, and Skills Improvement System Rating Scales were determined to be the most relevant measures of social skills development. A timeline for administration and plan for how to implement measurement and use data was suggested as well as considerations for future research.

Contract-program evaluation: Impact of the DRG classification system on hospitals' outputs

A Work Project, presented as part of the requirements for the Award of a Masters Degree in Management from the NOVA – School of Business and Economics

Access, equity and social cohesion: evaluation of intersectoral strategies for people experiencing homelessness

Objective To understand and evaluate the work of intersectoral assistance on the insertion and the flow of people in situation of street with severe mental illness in public services of Mental Health. Method A case study developed from ten visits to a night shelter between March and April 2012. For data collection, the participant observation and semi-structured interviews were carried out with four sheltered individuals, as well as non-directive group interviews with five technicians of the social-assistance services. Results Were analyzed using Content Analysis and developing a Logic Model validated with the professionals involved. Conclusion The social assistance services are the main entry of this clientele in the public network of assistance services, and the Mental Health services have difficulty in responding to the specificities of the same clientele and in establishing intersectoral work.


Reporting a program evaluation: Needs, program plan, intervention, and decisions

The approach to intervention programs varies depending on the methodological perspective adopted. This means that health professionals lack clear guidelines regarding how best to proceed, and it hinders the accumulation of knowledge. The aim of this paper is to set out the essential and common aspects that should be included in any program evaluation report, thereby providing a useful guide for the professional regardless of the procedural approach used. Furthermore, the paper seeks to integrate the different methodologies and illustrate their complementarity, this being a key aspect in terms of real intervention contexts, which are constantly changing. The aspects to be included are presented in relation to the main stages of the evaluation process: needs, objectives and design (prior to the intervention), implementation (during the intervention), and outcomes (after the intervention). For each of these stages the paper describes the elements on which decisions should be based, highlighting the role of empirical evidence gathered through the application of instruments to defined samples and according to a given procedure.

The Brazilian Zero Hunger social program implications in achieving sustainable development

This article aims to analyse the progress taken by Brazil towards the accomplishment of a sustainable development, mainly highlighting the success of the Zero Hunger social programme in achieving the elimination of starvation. As one of the essential pillars to the sustainable development, the State’s social performance demands actions directed to the elimination of extreme poverty and hunger, establishing a basis for equitable growth. It is necessary to clarify the juridical and constitutional framework of Brazil, aiming to emphasise the Zero Hunger importance in achieving the Brazilian Republic’s goals and reaching an international pattern on sustainable development. Also, it will be stressed that the international order influences Brazilian domestic law and is one of the main aspects for the Zero Hunger program development.