Impact evaluations of Federal Trade Commission vertical restraints cases /

Item 535

Developing a participatory impact assessment approach and action research culture within a communication for social change organisation in Nepal

Developing an effective impact evaluation framework, managing and conducting rigorous impact evaluations, and developing a strong research and evaluation culture within development communication organisations presents many challenges. This is especially so when both the community and organisational context is continually changing and the outcomes of programs are complex and difficult to clearly identify.----- This paper presents a case study from a research project being conducted from 2007-2010 that aims to address these challenges and issues, entitled Assessing Communication for Social Change: A New Agenda in Impact Assessment. Building on previous development communication projects which used ethnographic action research, this project is developing, trailing and rigorously evaluating a participatory impact assessment methodology for assessing the social change impacts of community radio programs in Nepal. This project is a collaboration between Equal Access – Nepal (EAN), Equal Access – International, local stakeholders and listeners, a network of trained community researchers, and a research team from two Australian universities. A key element of the project is the establishment of an organisational culture within EAN that values and supports the impact assessment process being developed, which is based on continuous action learning and improvement. The paper describes the situation related to monitoring and evaluation (M&E) and impact assessment before the project began, in which EAN was often reliant on time-bound studies and ‘success stories’ derived from listener letters and feedback. We then outline the various strategies used in an effort to develop stronger and more effective impact assessment and M&E systems, and the gradual changes that have occurred to date. These changes include a greater understanding of the value of adopting a participatory, holistic, evidence-based approach to impact assessment. We also critically review the many challenges experienced in this process, including:----- • Tension between the pressure from donors to ‘prove’ impacts and the adoption of a bottom-up, participatory approach based on ‘improving’ programs in ways that meet community needs and aspirations.----- • Resistance from the content teams to changing their existing M&E practices and to the perceived complexity of the approach.----- • Lack of meaningful connection between the M&E and content teams.----- • Human resource problems and lack of capacity in analysing qualitative data and reporting results.----- • The contextual challenges, including extreme poverty, wide cultural and linguistic diversity, poor transport and communications infrastructure, and political instability.----- • A general lack of acceptance of the importance of evaluation within Nepal due to accepting everything as fate or ‘natural’ rather than requiring investigation into a problem.

A practical guide for ex-ante impact evaluation in fisheries and aquaculture

This guide provides a framework for ex-ante evaluation of fisheries and aquaculture projects in developing countries. Ex-ante impact evaluations check the potential of a project or program to deliver benefits from proposed interventions. Providing extensive annotated literature citations, this guide is designed for use by practitioners who may not be fisheries or aquaculture specialists. The guide uses concepts from results-based management, organized into five modules that structure the investigation and provide insights regarding alignment of the proposed intervention with stakeholder interests, feasibility of design, potential constraints to implementation, possible impact pathways and distributional effects of the intervention. Separately published case studies of investments in Bangladesh, Malawi and Ghana illustrate application of the guide.

Ex-ante impact evaluation: case studies from Malawi, Bangladesh and Ghana

This document presents ex-ante impact evaluations of research for development projects related to aquaculture in Bangladesh, Malawi and Ghana. The Ghana chapter also includes an ex-ante evaluation of a fisheries project. The case studies utilized preliminary versions of guidelines developed specifically for ex-ante evaluations of aquaculture and fisheries projects. The guidelines, found in A Practical Guide for Ex-Ante Impact Evaluations in Fisheries and Aquaculture, are designed to provide an approach for a qualitative examination of the potential for a project to deliver impacts. Using a conceptual framework based on the outcome focus of results-based management, the guidelines stress careful examination of the setting, internal consistency, a sound theory of change, and an examination of stakeholders’ interests and potential partnerships. The case study reports illustrate the variability with which the guidelines may be interpreted and applied. The different teams, operating with limited time and budget that constrained the collection of new data, were forced to utilize existing secondary data and information and consult with key stakeholders to complete their analyses. The varying levels of reporting reflect the differences among the cases in the amounts of existing information and variety of stakeholders potentially involved in the projects being examined.

Clinical and economic outcomes of nutrition interventions across the continuum of care

Optimal nutrition across the continuum of care plays a key role in the short- and long-term clinical and economic outcomes of patients. Worldwide, an estimated one-quarter to one-half of patients admitted to hospitals each year are malnourished. Malnutrition can increase healthcare costs by delaying patient recovery and rehabilitation and increasing the risk of medical complications. Nutrition interventions have the potential to provide cost-effective preventive care and treatment measures. However, limited data exist on the economics and impact evaluations of these interventions. In this report, nutrition and health system researchers, clinicians, economists, and policymakers discuss emerging global research on nutrition health economics, the role of nutrition interventions across the continuum of care, and how nutrition can affect healthcare costs in the context of hospital malnutrition.

Conditional cash transfers, schooling and child labor : micro-simulating bolsa escola

Cash transfers targeted to poor people, but conditional on some behavior on their part, such as school attendance or regular visits to health care facilities, are being adopted in a growing number of developing countries. Even where ex-post impact evaluations have been conducted, a number of policy-relevant counterfactual questions have remained unanswered. These are questions about the potential impact of changes in program design, such as benefit levels or the choice of the means-test, on both the current welfare and the behavioral response of household members. This paper proposes a method to simulate the effects of those alternative program designs on welfare and behavior, based on microeconometrically estimated models of household behavior. In an application to Brazil’s recently introduced federal Bolsa Escola program, we find a surprisingly strong effect of the conditionality on school attendance, but a muted impact of the transfers on the reduction of current poverty and inequality levels.

Avaliação de Impacto em projetos sociais do terceiro setor: uma contribuição da teoria de policy learning

Esta pesquisa analisará o aprendizado em organizações do terceiro setor a partir de dois eixos principais: 1) Aprendizado através de análises empíricas (Avaliação de Impacto) - Pretende-se entender as principais recomendações para o terceiro setor em relação a Avaliação de Impacto e qual o cenário atual dessas práticas no contexto brasileiro. Para isso, foram entrevistadas 50 instituições que fazem parte de uma rede de organizações na área de educação, para entender como a avaliação vem sendo aplicada; 2) Aprendizado através da dimensão de Policy Learning: Social Learning e Instrumental Learning – Estabelecimento de conexão de teorias de aprendizado em políticas públicas com as instituições do terceiro setor e análise de possibilidades de aprendizado através de outras experiências e boas práticas.

Analyse de sensibilité d’un multimodèle hydrologique

Les enjeux hydrologiques modernes, de prévisions ou liés aux changements climatiques, forcent l’exploration de nouvelles approches en modélisation afin de combler les lacunes actuelles et d’améliorer l’évaluation des incertitudes. L’approche abordée dans ce mémoire est celle du multimodèle (MM). L’innovation se trouve dans la construction du multimodèle présenté dans cette étude : plutôt que de caler individuellement des modèles et d’utiliser leur combinaison, un calage collectif est réalisé sur la moyenne des 12 modèles globaux conceptuels sélectionnés. Un des défis soulevés par cette approche novatrice est le grand nombre de paramètres (82) qui complexifie le calage et l’utilisation, en plus d’entraîner des problèmes potentiels d’équifinalité. La solution proposée dans ce mémoire est une analyse de sensibilité qui permettra de fixer les paramètres peu influents et d’ainsi réduire le nombre de paramètres total à caler. Une procédure d’optimisation avec calage et validation permet ensuite d’évaluer les performances du multimodèle et de sa version réduite en plus d’en améliorer la compréhension. L’analyse de sensibilité est réalisée avec la méthode de Morris, qui permet de présenter une version du MM à 51 paramètres (MM51) tout aussi performante que le MM original à 82 paramètres et présentant une diminution des problèmes potentiels d’équifinalité. Les résultats du calage et de la validation avec le « Split-Sample Test » (SST) du MM sont comparés avec les 12 modèles calés individuellement. Il ressort de cette analyse que les modèles individuels, composant le MM, présentent de moins bonnes performances que ceux calés indépendamment. Cette baisse de performances individuelles, nécessaire pour obtenir de bonnes performances globales du MM, s’accompagne d’une hausse de la diversité des sorties des modèles du MM. Cette dernière est particulièrement requise pour les applications hydrologiques nécessitant une évaluation des incertitudes. Tous ces résultats mènent à une amélioration de la compréhension du multimodèle et à son optimisation, ce qui facilite non seulement son calage, mais également son utilisation potentielle en contexte opérationnel.

Mid-term impact estimation on evaluations of rural development programs

Mid-term evaluations are carried out during the implementation of the program and shall indicate whether it is necessary to redirect and make corrections before the ex-post evaluation, or for the next programming period. One of the core elements within these evaluations is the estimation of programs expected impacts. This is especially important for the Commission in order to support sound decision making, but also a very challenging task, as many evaluators have pointed out, mainly due to the lack of available data at the time the study had to be carried out. The aim of this study is therefore to analyze how impact estimation has been done in all European Union regions, as well as the problems encountered by evaluators.

Anti-drug media campaign : ONDCP met most mandates, but evaluations of impact are inconclusive : report to Congressional committees /

"B-281160"--P. 1.

The impact of individualist and collectivist group norms on evaluations of dissenting group members

Two experiments were conducted to investigate the impact of individualist and collectivist norms on evaluations of dissenting group members. In the first experiment (N = 113), group norms prescribing individualism or collectivism were manipulated and participants were asked to evaluate a group member who expressed an attitude dissenting from or concordant with the group. In line with predictions, group members with concordant attitudes were evaluated more positively than group members with dissenting attitudes when norms prescribed collectivism. However, for high identifiers, we found an attenuation of the preference for Concordant over dissenting attitudes when norms prescribed individualism. These findings were replicated in a second experiment (N= 87), where dissent was operationalized in a way that did not reveal the content of the attitude. The discussion focused on the importance of individualist norms for broadening latitudes of acceptable group member behavior. (c) 2005 Elsevier Inc. All rights reserved.

Increasing the rigour and trustworthiness of participatory evaluations : learnings from the field

Participatory evaluation and participatory action research (PAR) are increasingly used in community-based programs and initiatives and there is a growing acknowledgement of their value. These methodologies focus more on knowledge generated and constructed through lived experience than through social science (Vanderplaat 1995). The scientific ideal of objectivity is usually rejected in favour of a holistic approach that acknowledges and takes into account the diverse perspectives, values and interpretations of participants and evaluation professionals. However, evaluation rigour need not be lost in this approach. Increasing the rigour and trustworthiness of participatory evaluations and PAR increases the likelihood that results are seen as credible and are used to continually improve programs and policies.----- Drawing on learnings and critical reflections about the use of feminist and participatory forms of evaluation and PAR over a 10-year period, significant sources of rigour identified include:----- • participation and communication methods that develop relations of mutual trust and open communication----- • using multiple theories and methodologies, multiple sources of data, and multiple methods of data collection----- • ongoing meta-evaluation and critical reflection----- • critically assessing the intended and unintended impacts of evaluations, using relevant theoretical models----- • using rigorous data analysis and reporting processes----- • participant reviews of evaluation case studies, impact assessments and reports.

Differential reporting and the effect on loan evaluations : an experimental study

This study utilises a mexed design laboratory experiment to test the impact of differential reporting on one group of external financial report users-lenders. The results indicate that the judgments of bank loan officers' assessment of the ability of a borrower to repay, are not significantly affected by differential reporting (in this case, presentation on non-GAAP financial reports compared to GAAP financial reports). However, bankers request additional information from borrowers when non-GAAP financial reports are presented.

The impact of susceptibility to informational influence on the effectiveness of consumer testimonials

In this article we examine how a consumer's susceptibility to informative influence (SII) affects the effectiveness of consumer testimonials in print advertising. More specifically, we show that consumers that are high in SII and that seek consumption-relevant information from other people are more influenced by the strength of the testimonial information than the strength of the attribute information. Conversely, consumers low in SII place greater emphasis on the strength of the attribute information when forming their evaluations. Our results show that consumer psychological traits can have an important impact on the acceptance of testimonial advertising. Theoretical and managerial implications of our findings are discussed.