Reporting a program evaluation: Needs, program plan, intervention, and decisions

The approach to intervention programs varies depending on the methodological perspective adopted. This means that health professionals lack clear guidelines regarding how best to proceed, and it hinders the accumulation of knowledge. The aim of this paper is to set out the essential and common aspects that should be included in any program evaluation report, thereby providing a useful guide for the professional regardless of the procedural approach used. Furthermore, the paper seeks to integrate the different methodologies and illustrate their complementarity, this being a key aspect in terms of real intervention contexts, which are constantly changing. The aspects to be included are presented in relation to the main stages of the evaluation process: needs, objectives and design (prior to the intervention), implementation (during the intervention), and outcomes (after the intervention). For each of these stages the paper describes the elements on which decisions should be based, highlighting the role of empirical evidence gathered through the application of instruments to defined samples and according to a given procedure.

Cooking and Active Leisure TAS Program, Spain: A Program Impact Pathways (PIP) analysis

Background. The “Cooking and Active Leisure” Tu y Alícia por la Salud (CAL-TAS) Program is a schoolbased pilot that addresses healthy lifestyle needs of Spanish secondary school students with initiatives that research has proven to improve dietary and physical activity behaviors. Objective. The objectives were to perform a Program Impact Pathways (PIP) analysis to describe key activities and processes of the CAL-TAS Program, identify Critical Quality Control Points (CCPs), and identify a suite of common indicators of healthy lifestyles to be applied across participant schools. Methods. The CAL-TAS Program designers and implementation team developed this PIP analysis through an iterative process and presented the results for feedback at the seven-country Healthy Lifestyles Program Evaluation Workshop held in Granada, Spain, 13–14 September 2013, under the auspices of the Mondelēz International Foundation. Results. The team identified three PIP CCPs: teachers’ motivation and training, changes in students’ knowledge of healthy lifestyles, and changes in students’ healthy lifestyle behavior. The selected indicators of the program’s impact on healthy lifestyles are adequacy of food intake, level of knowledge of healthy lifestyles gained, and adequacy of physical activity level according to World Health Organization recommendations. A clear definition of impact indicators, as well as collection of accurate data on healthy lifestyle behaviors and knowledge, is essential to understanding the effectiveness of this program before it can be scaled up. Conclusions. CAL-TAS is an effective secondary school-based program encouraging healthy lifestyles. The PIP analysis was instrumental in identifying CCPs to sustain and improve the quality of the program. The team hopes to sustain and improve the program through these program evaluation recommendations.

Política Mundial en Línia

Aquest projecte MQD va servir per crear nou material docent amb un suport digital per a dues assignatures – Política Comparada i Avaluació de la Gestió Pública – en dues llicenciatures diferents – Ciència Política i Periodisme – Un element clau va ser la participació dels estudiants. En ambdós casos, la forma d’ensenyar va canviar de forma substantiva ja que es va dedicar força temps a fer que els estudiants treballessin en el producte final. La principal idea al darrera d’aquesta experiència era que aprenguéssin “fent.” Una altra idea fonamental és que el seu treball es pugui ensenyar per internet a tothom que tingui interès. La utilització d’una pàgina web va donar visibilitat externa al seu treball. Els resultats es poden consultar a http://cpdp.uab.cat/politica/ i http://cpdp.uab.cat/evaluacio/. Aquesta experiència va ser inclosa en el llibre "Cap a l’EEES. Experiències docents innovadores a ciències socials i a ciències humanes" publicat per la UAB.

The ethnography of study abroad: what is study abroad as a cultural event?

Recent research in the field of study abroad shows that study abroad participation among all U.S. students increased 20% since 2001 and nearly 200,000 U.S. students currently go abroad each year. Additionally, about 8% of all undergraduate degree recipients receive part of their education abroad. Although quantitative studies have dominated research on study abroad, my research project calls for a qualitative approach since the goal is to understand what study abroad is as a cultural event, what authentic cultural immersion is, how program stakeholders understand and perceive cultural immersion, and how cultural immersion in programs can be improved. Following the tradition of ethnographic and case study approaches in study abroad research, my study also pivots on ethnography. As an ethnographer I collected data mainly through participant observation, semi-structured interviews, and document analysis. The study abroad participants were a group of undergraduate native speakers of English studying Spanish for seven weeks in Cádiz, a small costal city in southern Spain, as well as program coordinators, host community members, and professors. I also examined the specific program design features, particularly the in-class and out-of-class activities that students participated in. The goal was to understand if these features were conducive to authentic immersion in the language and culture. Eventually, I elaborated an ethnographic evaluation of the study abroad program and its design features suggesting improvements in order to enhance the significance and value of study abroad as a cultural event. Among other things, I discussed the difficulties that students had at the beginning of their sojourn to understand local people, get used to their host families’ small apartments, get adjusted to new schedules and eating habits, and venture out from the main group to individually explore the new social and cultural fabric and interact with the host community. The program evaluation revealed the need for carefully-designed pre-departure preparation sessions, pre-departure credit-bearing courses in intercultural communication, and additional language practice abroad and opportunities to come in contact with the local community through internships, volunteer or field work. My study gives an important contribution in study abroad research and education. It benefits students, teachers, and study abroad directors and coordinators in suggesting ideas on how to improve the program and optimize the students’ cultural experiences abroad. This study is also important because it investigated how US undergraduate learners studying the Spanish language and culture approach and perceive the study abroad experience in Spain.

Improving Social Understanding of Preschool Children: Evaluation of a Training Program

This study tested the effects of a training program intending to foster social understanding or the capacity which enables them to understand themselves and others in terms of intentions, beliefs, desires, and emotions in children at preschool age. A number of studies have shown that in the context of shared narratives, children are particularly likely to engage in talk about inner states

Evaluation of subsidies programs to sell green cars: Impact on prices, quantities and efficiency

During the recent period of economic crisis, many countries have introduced scrappage schemes to boost the sale and production of vehicles, particularly of vehicles designed to pollute less. In this paper, we analyze the impact of a particular scheme in Spain (Plan2000E) on vehicle prices and sales figures as well as on the reduction of polluting emissions from vehicles on the road. We considered the introduction of this scheme an exogenous policy change and because we could distinguish a control group (non-subsidized vehicles) and a treatment group (subsidized vehicles), before and after the introduction of the Plan, we were able to carry out our analysis as a quasi-natural experiment. Our study reveals that manufacturers increased vehicle prices by the same amount they were granted through the Plan (1,000 €). In terms of sales, econometric estimations revealed an increase of almost 5% as a result of the implementation of the Plan. With regard to environmental efficiency, we compared the costs (inverted quantity of money) and the benefits of the program (reductions in polluting emissions and additional fiscal revenues) and found that the Plan would only be beneficial if it boosted demand by at least 30%.

Audit risk and rent extraction: Evidence from a randomized evaluation in Brazil

We report results from a randomized policy experiment designed to test whether increasedaudit risk deters rent extraction in local public procurement and service delivery in Brazil. Ourestimates suggest that temporarily increasing annual audit risk by about 20 percentage pointsreduced the proportion of irregular local procurement processes by about 17 percentage points.This reduction was driven entirely by irregularities involving mismanagement or corruption. Incontrast, we find no evidence that increased audit risk affected the quality of publicly providedpreventive and primary health care services -measured based on user satisfaction surveys- orcompliance with national regulations of the conditional cash transfer program "Bolsa Família".

An evaluation of the life-cycle effects of minimum pensions on retirement behavior

In this paper we explore the effects of the minimum pension program on welfare andretirement in Spain. This is done with a stylized life-cycle model which provides a convenient analytical characterization of optimal behavior. We use data from the Spanish Social Security to estimate the behavioral parameters of the model and then simulate the changes induced by the minimum pension in aggregate retirement patterns. The impact is substantial: there is threefold increase in retirement at 60 (the age of first entitlement) with respect to the economy without minimum pensions, and total early retirement (before or at 60) is almost 50% larger.

Extension and evaluation of JXTA protocols for supporting reliable P2P distributed computing

Peer-reviewed