Use of empowerment evaluation to determine a sustainability plan for a community-based preconception care program

Women With IMPACT (WWI) is a community-based preconception care educational intervention. WWI is being implemented by the Impacting Maternal and Prenatal Care Together (IMPACT) Collaborative and targets zip codes in Harris County, Texas at high risk for infant mortality, low birthweight, and preterm birth. WWI started March 2012 and continues through August 2013. Three workshop series are planned. This study was conducted with participants and facilitators from the first workshop series. This study aimed to 1) evaluate the WWI program using empowerment evaluation, 2) engage all WWI stakeholders in an empowerment evaluation so the method could be adopted as a participatory evaluation process for future IMPACT activities, and 3) develop recommendations for sustainability of the WWI intervention, based on empowerment evaluation findings and results from the pre/post program evaluation completed by WWI participants. Study participants included WWI participants and facilitators and IMPACT Collaborative Steering Committee members. WWI participants were female, 18-35 year-old, non-pregnant residents of zip codes at high risk of adverse birth outcomes. All other study participants were 18 years or older. A two-phased empowerment evaluation (EE) was utilized in this study. Sessions 1-4 were conducted independently of one another – 3 with participants at different sites and one with the facilitators. The fifth session included WWI participant and facilitator representatives, and IMPACT Steering Committee members. Session 5 built upon the work of the other sessions. Observation notes were recorded during each session. Thematic content analysis was conducted on all EE tables and observation notes. Mission statements drafted by each group focused on improvement of physical and mental health through behavior change and empowerment of all participants. The top 5 overall program components were: physical activity, nutrition, self-worth, in-class communication, and stress. Goals for program improvement were set by EE participants for each of these components. Through thematic content analysis of the tables and observation notes, social support emerged as an important theme of the program among all participant groups. Change to a healthy lifestyle emerged as an important theme in terms of program improvement. Two-phased EE provided an opportunity for all program stakeholders to provide feedback regarding important program components and provide suggestions for program improvement. EE, thematic content analysis, pre/post evaluation results, and inherent program knowledge were triangulated to make recommendations to sustain the program once the initial funding ends. ^

L'intégration organisationnelle de la participation : des enjeux locaux pour une santé publique globale

À l’ère de la mondialisation institutionnelle des sociétés modernes, alors que la confluence d’une myriade d’influences à la fois micro et macro-contextuelles complexifient le panorama sociopolitique international, l’intégration de l’idéal participatif par les processus de démocratisation de la santé publique acquiert l’apparence d’une stratégie organisationnelle promouvant la cohésion des multiples initiatives qui se tissent simultanément aux échelles locale et globale. L’actualisation constante des savoirs contemporains par les divers secteurs sociétaux ainsi que la perception sociale de différents risques conduisent à la prise de conscience des limites de la compétence technique des systèmes experts associés au domaine de la santé et des services sociaux. La santé publique, une des responsables légitimes de la gestion des risques modernes à l’échelle internationale, fait la promotion de la création d’espaces participatifs permettant l’interaction mutuelle d’acteurs intersectoriels et de savoirs multiples constamment modifiables. Il s’agit là d’une stratégie de relocalisation institutionnelle de l’action collective afin de rétablir la confiance envers la fiabilité des représentants de la santé publique internationale, qui ne répondent que partiellement aux besoins actuels de la sécurité populationnelle. Dans ce contexte, les conseils locaux de santé (CLS), mis en place à l’échelle internationale dans le cadre des politiques régionales de décentralisation des soins de santé primaires (SSP), représentent ainsi des espaces participatifs intéressants qui renferment dans leur fonctionnement tout un univers de forces de tension paradoxales. Ils nous permettent d’examiner la relation de caractère réciproque existant entre, d’une part, une approche plus empirique par l’analyse en profondeur des pratiques participatives (PP) plus spécifiques et, d’autre part, une compréhension conceptuelle de la mondialisation institutionnelle qui définit les tendances expansionnistes très générales des sociétés contemporaines. À l’aide du modèle de la transition organisationnelle (MTO), nous considérons que les PP intégrées à la gouverne des CLS sont potentiellement porteuses de changement organisationnel, dans le sens où elles sont la condition et la conséquence de nombreuses traductions stratégiques et systémiques essentiellement transformatrices. Or, pour qu’une telle transformation puisse s’accomplir, il est nécessaire de développer les compétences participatives pertinentes, ce qui confère au phénomène participatif la connotation d’apprentissage organisationnel de nouvelles formes d’action et d’intervention collectives. Notre modèle conceptuel semble fournir un ensemble de considérations épistémosociales fort intéressantes et très prometteuses permettant d’examiner en profondeur les dimensions nécessaires d’un renouvellement organisationnel de la participation dans le champ complexe de la santé publique internationale. Il permet de concevoir les interventions complexes comme des réseaux épistémiques de pratiques participatives (RÉPP) rassemblant des acteurs très diversifiés qui s’organisent autour d’un processus de conceptualisation transculturelle de connaissances ainsi que d’opérationnalisation intersectorielle des actions, et ce, par un ensemble de mécanismes d’instrumentalisation organisationnelle de l’apprentissage. De cette façon, le MTO ainsi que la notion de RÉPP permettent de mieux comprendre la création de passages incessants entre l’intégration locale des PP dans la gouverne des interventions complexes de la santé et des services sociaux – tels que les CLS –, et les processus plus larges de réorganisation démocratique de la santé publique dans le contexte global de la mondialisation institutionnelle. Cela pourrait certainement nous aider à construire collectivement l’expression réflexive et manifeste des valeurs démocratiques proposées dans la Déclaration d’Alma-Ata, publiée en 1978, lors de la première Conférence internationale sur les SSP.

La propension des gestionnaires envers les évaluations participatives

Davantage d’évaluations de projets internationaux dans les pays en développement se réalisent pour informer les décisions sur la base de données probantes. L’utilisation des résultats d’évaluation est remise en cause et pour y remédier des évaluations participatives qui incluent à certaines étapes du processus évaluatif des acteurs non évaluateurs sont proposées. Parmi celles-ci, les évaluations participatives pratiques visent principalement à améliorer l’utilisation du processus et des résultats des évaluations. Ces évaluations participatives pratiques seraient obstruées par des attitudes individuelles négatives, ou résistance individuelle au changement, et favorisées par des attitudes individuelles positives, ou propension. Cette thèse propose d’étudier la propension individuelle des gestionnaires envers les évaluations participatives pratiques d’intervention (EPP), les éléments influençant cette propension, et de caractériser des niveaux de propension des individus envers les EPP. Tout d’abord une revue de littérature a proposé une définition multidimensionnelle de la propension envers les EPP comme étant une attitude favorable envers la pratique des EPP qui se décline à chaque étape d’une évaluation sous les volets affectif et cognitif. Les dimensions identifiées théoriquement étaient : apprentissage, travail en groupe, emploi de méthodes systématiques, usage de l’esprit critique. Ces dimensions ont servi de cadre pour la partie empirique de la thèse. Une étude de cas multiples avec les gestionnaires d’une institution de santé en Haïti a été menée pour contextualiser la propension et identifier les éléments d’influence. Les données ont été recueillies à l’aide d’entrevues semi-structurées et de sources documentaires. L’analyse des données concernant l’apprentissage a révélé une prédominance des formes d’apprentissage par l’action et par l’observation. Le travail en groupe se retrouve ancré dans la pratique des gestionnaires administratifs et des gestionnaires cliniques. Les méthodes systématiques se reflètent principalement dans la consultation de plusieurs acteurs ayant de l’intérêt pour la problématique immédiate à solutionner plutôt que par l’outillage méthodologique. L’emploi de méthodes systématiques prend généralement la forme de consultation élargie d’avis pour régler une situation ou prend la forme de tentative de validation des informations reçues. L’esprit critique se déclenche sous stimulation lorsque l’image individuelle, professionnelle, corporative ou organisationnelle est touchée ou lors de suggestions jugées constructives. En plus de contextualiser quatre composantes de la propension individuelle envers les EPP, les gestionnaires se sont positionnés par rapport à la propension de leurs collègues sur la base de la réactivité, plus ou moins réactif vis-à-vis des composantes de la propension individuelle. Ainsi, la propension étudiée empiriquement a laissé émerger deux axes : un axe formalisation et un axe réactivité. L’axe formalisation reprend la contextualisation des quatre composantes de la propension individuelle envers les EPP, soit la forme d’expression des composantes. L’axe réactivité reprend le niveau d’activité déployé dans chaque composante de la propension individuelle, de réactif à plus proactif. De plus, des profils d’individus ayant différents niveaux de propension envers les EPP ont été développés. Des influences favorables et défavorables au niveau de propension envers les EPP ont été identifiées. L’originalité de cette thèse tient dans le fait de se positionner dans un courant récent de réflexion autour de la résistance aux changements et aux évaluations avec un regard positif et d’avoir défini théoriquement et appliqué empiriquement le concept pluridimensionnel de propension individuelle aux EPP. Des profils de niveau de propension individuelle aux EPP et les éléments d’influence favorables et défavorables associés peuvent servir d’outil de diagnostic aux types d’évaluation possibles, servir d’ajustement à la mise en place d’évaluations selon les interlocuteurs, permettre le suivi des changements de niveaux de propension pendant une EPP et servir de sources d’informations pour ajuster les plans d’évaluations participatives.

Agricultura urbana en Bogotá. Una evaluación externa-participativa.

En la última década, uno de los problemas considerados más relevantes de la política pública colombiana es la Seguridad Alimentaria y Nutricional, que contempla no sólo la disponibilidad y el acceso a los alimentos, sino también la utilización y estabilidad (disponibilidad continua) de alimentos sanos, limpios e inocuos para el consumo humano. En este marco, el gobierno de Garzón dio inicio política pública “Bogotá sin indiferencia”, junto con el programa “Bogotá sin Hambre”, que pretendía a través de diversos proyectos garantizar el derecho a la alimentación de la población de escasos recursos; uno de ellos es el proyecto 319 de Agricultura Urbana, el cual presenta continuidad hasta el momento. La presente investigación, realiza una evaluación externa y participativa al proyecto, desentrañando a través de la metodología del marco lógico, los objetivos y metas de dicho proyecto, para seguidamente evaluarlo apoyándose en la propuesta de Cohen y Franco (1992) y García y Ramírez (1994); bajo el supuesto de que su sostenibilidad depende del tipo de huerta, del apoyo institucional y del empoderamiento de los beneficiarios. Desde la mirada de los beneficiarios, se adelantó la evaluación de tres Estudios de Caso que permitieron desvelar los principios que regulan la política pública, las dificultades y problemas estructurales existentes a la misma.

Evaluating sport projects which promote social inclusion for young people: a case study

[EN] This work presents the findings of a participatory research program evaluating the outcomes of an Italian sports program for minors at risk. Using a participatory evaluation approach enabled an evaluation-research close to the real objectives and useful for monitoring and e-planning actions, starting from an initial exploration of the different stakeholders’ views of the project itself. The research design is presented in the form of a case study, emphasizing the continuous involvement of the project’s stakeholders in the evaluation process. The outcomes here presented make evident how the participatory evaluation project allowed a targeted and ongoing monitoring at group level as well as at individual level with the minors involved in the project.

A meta-avaliação como instrumento para a qualificação da avaliação de políticas públicas de saúde

Trata-se da meta-avaliação de um processo avaliativo desenvolvido por secretários e assessores técnicos municipais de uma região de saúde do estado de São Paulo, com foco nos critérios de utilidade e participação. É uma pesquisa qualitativa, cuja base empírica foi 1) o material produzido em sete oficinas realizadas com os representantes municipais, com vistas à avaliação de um aspecto da linha de cuidados em saúde sob a ótica da integralidade; e 2) as entrevistas semiestruturadas realizadas com os mesmos atores após a finalização do processo avaliativo. Para a avaliação do critério de utilidade, utilizou-se principalmente o referencial de KIRKHART (2000), com o objetivo de ampliar a análise para além do uso instrumental dos achados avaliativos e focá-la na identificação de influências múltiplas exercidas por um fenômeno complexo como um processo avaliativo. A análise do critério participação se deu com base no referencial de COUSINS e WHITMORE (1998), buscando a identificação no material empírico de decisões ou aspectos contextuais que fizeram com que a opção participativa fosse aprofundada ou limitada no processo em foco. O trabalho destaca a importância de explicitar pressupostos que baseiam a metodologia da avaliação/ meta-avaliação escolhida, e a necessidade de se buscar referenciais teóricos de análise compatíveis com a opção realizada, frisando a inexistência de posturas neutras ou estudos totalmente objetivos; e a importância de capacitar avaliadores a acompanharem a demanda dos participantes de um processo participativo com a flexibilidade necessária para conferir-lhe o maior aproveitamento possível. Conclui-se pela viabilidade, com vantagens, da realização de processos participativos locais com gestores na Saúde Pública, destacando a possibilidade de ganhos em formação e o enriquecimento dos processos de negociação em nível do território, de forma coerente à política de construção das regiões de saúde no SUS.

Inventário e análise sociológica das políticas públicas de turismo em Angola

As políticas públicas na área do turismo tornaram-se uma prioridade dos governos dos países desenvolvidos e menos desenvolvidos a partir da década de 1970, quando os organismos estatais ligados ao sector do turismo deram início à definição de amplas agendas nacionais para o desenvolvimento da indústria do turismo para períodos de longo prazo, com descrições claras sobre a posição que o turismo ocupa no âmbito do desenvolvimento da economia nacional; sobre as metas que se pretendem alcançar e a forma como elas serão atingidas. O enorme crescimento do turismo, o envolvimento dos governos e os impactos negativos do turismo que foram registados nos países em desenvolvimento ajudou a trazer ao debate académico a análise sobre as políticas públicas do turismo no final dos anos 80 e início de 90 do séc. passado. Neste estudo inventariou-se o quadro legislativo das políticas públicas do turismo em Angola e fez-se o enquadramento sociológico da Política Nacional e do Plano Diretor do turismo em Angola; identificaram-se os atores que intervêm na execução das políticas públicas do turismo em Angola e o seu sentido social, assim como os fatores centrais propiciadores do desenvolvimento social e económico em contexto local (Huíla). Isto permitiu determinar o perfil e tipologias resultantes da contribuição do quadro de Políticas Públicas de turismo para o nível de promoção do desenvolvimento social local em Angola, ajudando-nos a tentar perceber até que ponto as políticas públicas do turismo em Angola se constituem como fator de desenvolvimento social local. Partindo do perfil e tipologias resultantes da contribuição do quadro de Políticas Públicas de turismo e com base nos resultados obtidos através da análise de conteúdo das entrevistas, construiu-se uma proposta de modelo de políticas públicas de turismo propiciadoras do desenvolvimento local sustentável em Angola baseada numa lógica de ação coletiva, capaz de salvaguardar a sustentabilidade económica, política, social e territorial; ABSTRACT: Public policies in tourism became a priority of developed country governments and less developed countries from the 1970s, when the state bodies linked to the tourism sector began the definition of a broad national agenda for the development of the tourism industry for long-term periods, with clear descriptions of the position that tourism occupies in the national economic development; on the goals they want to achieve and how they will be achieved. The tremendous growth of tourism, the involvement of governments and the negative impacts of tourism were registered in developing countries and helped to bring the academic debate analysis on public tourism policies, in the late 80s and early 90s of the past century. In the legislative framework, we inventoried public tourism policies in Angola that later became the sociological framework of the National Policy and Plan for tourism in Angola; we identified the actors involved in the execution of public tourism policies in Angola and its social meaning, as well as the central factors conductive to social and economic development in the local context (Huila). This allowed to determine the profile and types resulting from the tourism Public Policy framework contribution to the level of promotion of local social development in Angola, helping us in this way to try to understand to what extent public tourism policies in Angola work as a local social development factor. From the profile and types resulting from the tourism Public Policy framework contribution and based on the results obtained from the interviews, we constructed a proposed model of public policies which encourage a more sustainable local development kind of tourism in Angola, based on a logic of collective action, able to safeguard the economic, political, social and territorial capitals.

Avaliação participativa de indicadores de solo e sanidade de cultivos em sistemas de produção na Comunidade Pé de Serra Cedro, no semiárido brasileiro.

RESUMO: A avaliação participativa permite inferir se os sistemas agrícolas necessitam de melhorias e quais conhecimentos podem promover incrementos. Esse trabalho objetivou avaliar diferentes sistemas de produção na Comunidade Pé de Serra Cedro, Sobral-CE, utilizando metodologia participativa com agricultores locais através de indicadores de qualidade do solo e sanidade dos cultivos. Os sistemas de produção avaliados foram quatro, com as seguintes descrições: sistema tradicional: plantio de culturas anuais, com queima da área a 3 anos; sistema tradicional + esterco; sistema tradicional + esterco + leucena; e sistema roçado agroecológico. A inserção de práticas edáficas como aplicação de estercos e implantação de leguminosas incrementaram sistemas de produção tradicionais no semiárido cearense, mesmo em curto prazo de avaliação. A utilização de roçados agroecológicos diferenciou-se para indicadores do solo e sanidade dos cultivos em relação aos manejos tradicionais, com indicador médio para atributos do solo de 8,6 e para sanidade de cultivos em 8,4. [Participatory evaluation indicators of soil and crop shealth in production systems in comunity Pé de Serra Cedro in brazilian semi-arid]. Abstract: Participatory evaluation allows us to infer that the agricultural systems need to be improved and what knowledge can promote increments, thus aimed to evaluate different production systems in the Community Pé de Serra Cedro, Sobral, state of Ceará, Brazil, using participatory methodology with local farmers on soil properties and health of crops. The production systems evaluated were four, with the following descriptions: traditional system: planting annual crops, with burning area to 3 years; traditional system + manure; traditional system + manure + Leucaena leucocephala; and scuffed agroecological system. Inserting soil practices such as manure application and implementation of incresead legumes traditional production systems in semiarid region, even in short-term assessment. The use of agroecological scuffed differed for soil propertie sand health of crops over traditional managements with value 8.6 and 8.4 to soil and plant indicators, respectively.

An evaluation of participatory planning at Mapoon Aboriginal community: Opportunities for inclusive local governance

The Queensland Government is increasingly using participatory planning as a means to improve infrastructure and service delivery to Indigenous settlements. In addition to technical and economic goals, participatory planning practice seeks also to achieve social development goals, including empowerment, capacity building, community control and ownership. This article presents the findings of an evaluation of one such planning project, conducted at Old Mapoon in 1995. Despite various efforts to follow participatory processes, the plan had mixed success in achieving social development goals. This suggests some misunderstandings between the practice of participatory planning and the workings of local governance. It also presents some opportunities for participatory planning methods to be integrated with more inclusive forms of governance.

Environmental evaluation of agri-environment schemes using participatory approaches: experiences of testing the Agri-Environmental Footprint Index

The Agri-Environment Footprint Index (AFI) has been developed as a generic methodology to assess changes in the overall environmental impacts from agriculture at the farm level and to assist in the evaluation of European agri-environmental schemes (AES). The methodology is based on multicriteria analysis (MCA) and involves stakeholder participation to provide a locally customised evaluation based on weighted environmental indicators. The methodology was subjected to a feasibility assessment in a series of case studies across the EU. The AFI approach was able to measure significant differences in environmental status between farms that participated in an AES and nonparticipants. Wider environmental concerns, beyond the scheme objectives, were also considered in some case studies and the benefits for identification of unintentional (and often beneficial) impacts of AESs are presented. The participatory approach to AES valuation proved efficient in different environments and administrative contexts. The approach proved to be appropriate for environmental evaluation of complex agri-environment systems and can complement any evaluation conducted under the Common Monitoring and Evaluation Framework. The applicability of the AFI in routine monitoring of AES impacts and in providing feedback to improve policy design is discussed.

Evaluation of promising technologies for soil salinity amelioration in Timpaki (Crete): A participatory approach

Soil salinity management can be complex, expensive, and time demanding, especially in arid and semi-arid regions. Besides taking no action, possible management strategies include amelioration and adaptation measures. Here we apply the World Overview of Conservation Approaches and Technologies (WOCAT) framework for the systematic analysis and evaluation and selection of soil salinisation amelioration technologies in close collaboration with stakeholders. The participatory approach is applied in the RECARE (Preventing and Remediating degradation of soils in Europe through Land Care) project case study of Timpaki, a semiarid region in south-central Crete (Greece) where the main land use is horticulture in greenhouses irrigated by groundwater. Excessive groundwater abstractions have resulted in a drop of the groundwater level in the coastal part of the aquifer, thus leading to seawater intrusion and in turn to soil salinisation. The documented technologies are evaluated for their impacts on ecosystem services, cost, and input requirements using a participatory approach and field evaluations. Results show that technologies which promote maintaining existing crop types while enhancing productivity and decreasing soil salinity are preferred by the stakeholders. The evaluation concludes that rainwater harvesting is the optimal solution for direct soil salinity mitigation, as it addresses a wider range of ecosystem and human well-being benefits. Nevertheless, this merit is offset by poor financial motivation making agronomic measures more attractive to users.

Development of the student placement evaluation form: A tool for assessing student fieldwork performance

Evaluation of students undertaking fieldwork education placements is a critical process in the health professions. As training programs and practice evolve, systems for assessing students need to be reviewed and updated constantly. In 1995, staff of the occupational therapy training program at the University of Queensland, Australia decided to develop a new tool for assessing student fieldwork performance. Using an action research methodology, a team developed the Student Placement Evaluation Form, a flexible and comprehensive criterion-referenced evaluation tool. The present paper examines action research as an appropriate methodology for considering real-life organisational problems in a systematic and participatory manner. The action research cycles undertaken, including preliminary information gathering, tool development, trial stages and current use of the tool, are detailed in the report. Current and future development of the tool is also described.

Participatory assessment of rural livelihoods in the Central Highlands of Vietnam

There is a need for improved monitoring and evaluation (M&E) of participatory research with smallholder farmers, in particular to help differentiate between different types of farm household with different needs. This paper reports some of the results of a study to develop participatory M&E tools for the Forages for Smallholders Project in Southeast Asia, focusing on an upland commune in central Vietnam with a highly diverse crop-livestock system. Participatory rural appraisal techniques were used within a rural livelihoods framework to assess the differing livelihoods of poor, average, and better-off households. There were found to be marked differences between households, particularly in human resources, landholdings, and cattle numbers, affecting the livelihood strategies pursued. The improved understanding of livelihood strategies was gained in a cost-effective way and could be readily used by project participants to monitor the impacts of the introduced forages within the commune, enabling better focusing of the participatory research process on the needs and circumstances of poor farmers. (C) 2003 Elsevier Ltd. All rights reserved.

Breeding for low input conditions and consequences for participatory plant breeding: Examples from tropical maize and wheat

Participatory plant breeding (PPB) has been suggested as an effective alternative to formal plant breeding (FPB) as a breeding strategy for achieving productivity gains under low input conditions. With genetic progress through PPB and FPB being determined by the same genetic variables, the likelihood of success of PPB approaches applied in low input target conditions was analyzed using two case studies from FPB that have resulted in significant productivity gains under low input conditions: (1) breeding tropical maize for low input conditions by CIMMYT, and (2) breeding of spring wheat for the highly variable low input rainfed farming systems in Australia. In both cases, genetic improvement was an outcome of long-term investment in a sustained research effort aimed at understanding the detail of the important environmental constraints to productivity and the plant requirements for improved adaptation to the identified constraints, followed up by the design and continued evaluation of efficient breeding strategies. The breeding strategies used differed between the two case studies but were consistent in their attention to the key determinants of response to selection: (1) ensuring adequate sources of genetic variation and high selection pressures for the important traits at all stages of the breeding program, (2) use of experimental procedures to achieve high levels of heritability in the breeding trials, and (3) testing strategies that achieved a high genetic correlation between performance of germplasm in the breeding trials and under on-farm conditions. The implications of the outcomes from these FPB case studies for realizing the positive motivations for adopting PPB strategies are discussed with particular reference for low input target environment conditions.