Reporting a program evaluation: Needs, program plan, intervention, and decisions

The approach to intervention programs varies depending on the methodological perspective adopted. This means that health professionals lack clear guidelines regarding how best to proceed, and it hinders the accumulation of knowledge. The aim of this paper is to set out the essential and common aspects that should be included in any program evaluation report, thereby providing a useful guide for the professional regardless of the procedural approach used. Furthermore, the paper seeks to integrate the different methodologies and illustrate their complementarity, this being a key aspect in terms of real intervention contexts, which are constantly changing. The aspects to be included are presented in relation to the main stages of the evaluation process: needs, objectives and design (prior to the intervention), implementation (during the intervention), and outcomes (after the intervention). For each of these stages the paper describes the elements on which decisions should be based, highlighting the role of empirical evidence gathered through the application of instruments to defined samples and according to a given procedure.

The ethnography of study abroad: what is study abroad as a cultural event?

Recent research in the field of study abroad shows that study abroad participation among all U.S. students increased 20% since 2001 and nearly 200,000 U.S. students currently go abroad each year. Additionally, about 8% of all undergraduate degree recipients receive part of their education abroad. Although quantitative studies have dominated research on study abroad, my research project calls for a qualitative approach since the goal is to understand what study abroad is as a cultural event, what authentic cultural immersion is, how program stakeholders understand and perceive cultural immersion, and how cultural immersion in programs can be improved. Following the tradition of ethnographic and case study approaches in study abroad research, my study also pivots on ethnography. As an ethnographer I collected data mainly through participant observation, semi-structured interviews, and document analysis. The study abroad participants were a group of undergraduate native speakers of English studying Spanish for seven weeks in Cádiz, a small costal city in southern Spain, as well as program coordinators, host community members, and professors. I also examined the specific program design features, particularly the in-class and out-of-class activities that students participated in. The goal was to understand if these features were conducive to authentic immersion in the language and culture. Eventually, I elaborated an ethnographic evaluation of the study abroad program and its design features suggesting improvements in order to enhance the significance and value of study abroad as a cultural event. Among other things, I discussed the difficulties that students had at the beginning of their sojourn to understand local people, get used to their host families’ small apartments, get adjusted to new schedules and eating habits, and venture out from the main group to individually explore the new social and cultural fabric and interact with the host community. The program evaluation revealed the need for carefully-designed pre-departure preparation sessions, pre-departure credit-bearing courses in intercultural communication, and additional language practice abroad and opportunities to come in contact with the local community through internships, volunteer or field work. My study gives an important contribution in study abroad research and education. It benefits students, teachers, and study abroad directors and coordinators in suggesting ideas on how to improve the program and optimize the students’ cultural experiences abroad. This study is also important because it investigated how US undergraduate learners studying the Spanish language and culture approach and perceive the study abroad experience in Spain.

Cap a on van els programes de garantia social

En el present estudi es descriu l'experiència de la implantació dels PGS en la comunitat de Castella-La Manxa, partint d'un marc conceptual en el que es descriuen les modalitats i característiques de programes. Es detallen les dades obtingudes mitjançant d'un estudi empíric que ofereix informació sobre els diferents agents (professorat, alumnes, famílies) que concurreixen en tals Programes de Garantía Social.

Cooking and Active Leisure TAS Program, Spain: A Program Impact Pathways (PIP) analysis

Background. The “Cooking and Active Leisure” Tu y Alícia por la Salud (CAL-TAS) Program is a schoolbased pilot that addresses healthy lifestyle needs of Spanish secondary school students with initiatives that research has proven to improve dietary and physical activity behaviors. Objective. The objectives were to perform a Program Impact Pathways (PIP) analysis to describe key activities and processes of the CAL-TAS Program, identify Critical Quality Control Points (CCPs), and identify a suite of common indicators of healthy lifestyles to be applied across participant schools. Methods. The CAL-TAS Program designers and implementation team developed this PIP analysis through an iterative process and presented the results for feedback at the seven-country Healthy Lifestyles Program Evaluation Workshop held in Granada, Spain, 13–14 September 2013, under the auspices of the Mondelēz International Foundation. Results. The team identified three PIP CCPs: teachers’ motivation and training, changes in students’ knowledge of healthy lifestyles, and changes in students’ healthy lifestyle behavior. The selected indicators of the program’s impact on healthy lifestyles are adequacy of food intake, level of knowledge of healthy lifestyles gained, and adequacy of physical activity level according to World Health Organization recommendations. A clear definition of impact indicators, as well as collection of accurate data on healthy lifestyle behaviors and knowledge, is essential to understanding the effectiveness of this program before it can be scaled up. Conclusions. CAL-TAS is an effective secondary school-based program encouraging healthy lifestyles. The PIP analysis was instrumental in identifying CCPs to sustain and improve the quality of the program. The team hopes to sustain and improve the program through these program evaluation recommendations.

Educación social y evaluación: evaluar para mejorar y transformar

En este artículo se desarrollan las características de la evaluación de servicios y programas socioeducativos, entendiendo que ésta debe ser un instrumento de mejora de la acción social, que posibilita identificar los aspectos positivos de una práctica técnico-profesional adecuada y que permite incrementar la autonomía de los profesionales. Asi, se apuntan unas consideraciones sobre el concepto de evaluación y sobre el sentido y finalidad de ésta, considerándola como un elemento de calidad y de mejora de la acción socioeducativa, valorando su utilidad social, destacando la falta de tradición evaluativa en educación social y señalando el carácter dialéctico de la evaluación, la cual siempre incluye, en relación inversamente proporcional, elementos de control y transformación. Posteriormente, se afirma que los diseños de evaluación deben adaptarse a la singularidad y características propias de laeducación social. Y, finalmente, se señalan algunas de las características que mejor definen los diseños de evaluación en educación social.

Processos participatius, governança ambiental i desenvolupament territorial sostenible

Estudio realizado a partir de una estancia en el Centro de Filosofia e Ciências Humanas de la Universidade Federal de Santa Catarina, Brasil, durant entre septiembre y noviembre del 2005. El intercambio con los grupos de trabajo del Programa de Pós-Graduçao Interdisciplinar em Ciências Humanas (UFSCE-Brasil), se ha llevado a cabo con el objetivo de profundizar en las diferentes perspectivas teóricas y analíticas que orientan la reflexión sobre el papel crítico de los investigadores en el área de sociología del conocimiento ambiental científico. Esto ha permitido conocer experiencias-laboratorios de procesos participativos para planear intervenciones en áreas protegidas. Estas orientaciones conceptuales, epistemológicas y metodológicas ayudaran a la candidata a reforzar la aproximación de investigación participativa del proyecto “Avaluació social multicriteri per a la presa de decisions orientades a una gestió conservativa de sistemes agropecuaris i el desenvolupament sostenible de la zona seca i semi-seca del paisatge terrestre protegit de Miraflor-Moropotente (Nicaragua)” que es la línea del trabajo de PhD de la candidata. En especial, las reflexiones teóricas y metodológicas se han centrado en los siguientes temas: aproximación sistemática y basada en los actores para el análisis de sistemas complejos y incertezas, métodos participativos para las evaluaciones integradas de sustentabilidad que apoyan los procesos de toma de decisiones, o el nuevo papel de los investigadores sobre una perspectiva compleja de análisis y diálogo entre los conocimientos científicos y locales.

Política Mundial en Línia

Aquest projecte MQD va servir per crear nou material docent amb un suport digital per a dues assignatures – Política Comparada i Avaluació de la Gestió Pública – en dues llicenciatures diferents – Ciència Política i Periodisme – Un element clau va ser la participació dels estudiants. En ambdós casos, la forma d’ensenyar va canviar de forma substantiva ja que es va dedicar força temps a fer que els estudiants treballessin en el producte final. La principal idea al darrera d’aquesta experiència era que aprenguéssin “fent.” Una altra idea fonamental és que el seu treball es pugui ensenyar per internet a tothom que tingui interès. La utilització d’una pàgina web va donar visibilitat externa al seu treball. Els resultats es poden consultar a http://cpdp.uab.cat/politica/ i http://cpdp.uab.cat/evaluacio/. Aquesta experiència va ser inclosa en el llibre "Cap a l’EEES. Experiències docents innovadores a ciències socials i a ciències humanes" publicat per la UAB.

Debats oberts en el camp de l'avaluació de serveis i programes socials

En aquest article identifiquem els debats principals que en l'actualitat, i segons la nostra opinió, tenen lloc dintre del camp de l'avaluació de serveis i programes socials. Aquests temes de debat són diversos i plurals, i hi ha diverses propostes i reflexions al seu voltant, ja que no tots els autors identifiquen els mateixos temes de debat, alhora que, com és lògic, la seva resolució (la posició adoptada davant de cada polèmica concreta) varia enormement d'un autor a un altre.

Improving Social Understanding of Preschool Children: Evaluation of a Training Program

This study tested the effects of a training program intending to foster social understanding or the capacity which enables them to understand themselves and others in terms of intentions, beliefs, desires, and emotions in children at preschool age. A number of studies have shown that in the context of shared narratives, children are particularly likely to engage in talk about inner states

Energy policies for rural electrification: a social multi-criteria evaluation approach

In this article, a real-world case- study is presented with two general objectives: to give a clear and simple illustrative example of application of social multi-criteria evaluation (SMCE) in the field of rural renewable energy policies, and to help in understanding to what extent and under which circumstances solar energy is suitable for electrifying isolated farmhouses. In this sense, this study might offer public decision- makers some insight on the conditions that favour the diffusion of renewable energy, in order to help them to design more effective energy policies for rural communities.

Social Multi-Criteria Evaluation (SMCE)

The main argument developed here is the proposal of the concept of “Social Multi-Criteria Evaluation” (SMCE) as a possible useful framework for the application of social choice to the difficult policy problems of our Millennium, where, as stated by Funtowicz and Ravetz, “facts are uncertain, values in dispute, stakes high and decisions urgent”. This paper starts from the following main questions: 1. Why “Social” Multi-criteria Evaluation? 2. How such an approach should be developed? The foundations of SMCE are set up by referring to concepts coming from complex system theory and philosophy, such as reflexive complexity, post-normal science and incommensurability. To give some operational guidelines on the application of SMCE basic questions to be answered are: 1. How is it possible to deal with technical incommensurability? 2. How can we deal with the issue of social incommensurability? To answer these questions, by using theoretical considerations and lessons learned from realworld case studies, is the main objective of the present article.

An Atkinson-Gini family of social evaluation functions

We investigate the properties of a family of social evaluation functions and inequality indices which merge the features of the family of Atkinson (1970) and S-Gini (Donaldson and Weymark (1980, 1983), Yitzhaki (1983) and Kakwani (1980)) indices. Income inequality aversion is captured by decreasing marginal utilities, and aversion to rank inequality is captured by rank-dependent ethical weights, thus providing an ethically-flexible dual basis for the assessment of inequality and equity. These ocial evaluation functions can be interpreted as average utility corrected for the illfare of relative deprivation. They can alternatively be understood as averages of altruistic well-being in a population. They moreover have a simple graphical interpretation.

An evaluation of the life-cycle effects of minimum pensions on retirement behavior

In this paper we explore the effects of the minimum pension program on welfare andretirement in Spain. This is done with a stylized life-cycle model which provides a convenient analytical characterization of optimal behavior. We use data from the Spanish Social Security to estimate the behavioral parameters of the model and then simulate the changes induced by the minimum pension in aggregate retirement patterns. The impact is substantial: there is threefold increase in retirement at 60 (the age of first entitlement) with respect to the economy without minimum pensions, and total early retirement (before or at 60) is almost 50% larger.