Developing a participatory impact assessment approach and action research culture within a communication for social change organisation in Nepal

Developing an effective impact evaluation framework, managing and conducting rigorous impact evaluations, and developing a strong research and evaluation culture within development communication organisations presents many challenges. This is especially so when both the community and organisational context is continually changing and the outcomes of programs are complex and difficult to clearly identify.----- This paper presents a case study from a research project being conducted from 2007-2010 that aims to address these challenges and issues, entitled Assessing Communication for Social Change: A New Agenda in Impact Assessment. Building on previous development communication projects which used ethnographic action research, this project is developing, trailing and rigorously evaluating a participatory impact assessment methodology for assessing the social change impacts of community radio programs in Nepal. This project is a collaboration between Equal Access – Nepal (EAN), Equal Access – International, local stakeholders and listeners, a network of trained community researchers, and a research team from two Australian universities. A key element of the project is the establishment of an organisational culture within EAN that values and supports the impact assessment process being developed, which is based on continuous action learning and improvement. The paper describes the situation related to monitoring and evaluation (M&E) and impact assessment before the project began, in which EAN was often reliant on time-bound studies and ‘success stories’ derived from listener letters and feedback. We then outline the various strategies used in an effort to develop stronger and more effective impact assessment and M&E systems, and the gradual changes that have occurred to date. These changes include a greater understanding of the value of adopting a participatory, holistic, evidence-based approach to impact assessment. We also critically review the many challenges experienced in this process, including:----- • Tension between the pressure from donors to ‘prove’ impacts and the adoption of a bottom-up, participatory approach based on ‘improving’ programs in ways that meet community needs and aspirations.----- • Resistance from the content teams to changing their existing M&E practices and to the perceived complexity of the approach.----- • Lack of meaningful connection between the M&E and content teams.----- • Human resource problems and lack of capacity in analysing qualitative data and reporting results.----- • The contextual challenges, including extreme poverty, wide cultural and linguistic diversity, poor transport and communications infrastructure, and political instability.----- • A general lack of acceptance of the importance of evaluation within Nepal due to accepting everything as fate or ‘natural’ rather than requiring investigation into a problem.

Learning, evaluation, action and reflection for new technologies, empowerment and rural sustainability (The LEARNERS project)

-

Critically evaluating rural women’s participation and empowerment : An interdisciplinary feminist framework for research and analysis

Community development is increasingly using participatory processes that aim to be inclusive and empowering. However, researchers have found that such processes can have contradictory effects. Australian research has highlighted the significant leadership of rural women in sustainable community and economic development and in the adoption of new communication technologies such as the Internet. A focus on gender in participatory development may therefore lead to more effective programs and policies. This chapter outlines an interdisciplinary feminist framework for critically evaluating the participation and empowerment of rural women. This framework was found effective in evaluating an Australian project that aimed to enhance rural women’s access to communication technologies and to empower its participants. Its multiple theoretical and methodological approaches are outlined. The framework advocates an analysis of diversity and difference and the macro and micro contexts. Some principles and strategies for rural women’s inclusion, participation, empowerment, and for participatory feminist evaluation are outlined.

Increasing the rigour and trustworthiness of participatory evaluations : learnings from the field

Participatory evaluation and participatory action research (PAR) are increasingly used in community-based programs and initiatives and there is a growing acknowledgement of their value. These methodologies focus more on knowledge generated and constructed through lived experience than through social science (Vanderplaat 1995). The scientific ideal of objectivity is usually rejected in favour of a holistic approach that acknowledges and takes into account the diverse perspectives, values and interpretations of participants and evaluation professionals. However, evaluation rigour need not be lost in this approach. Increasing the rigour and trustworthiness of participatory evaluations and PAR increases the likelihood that results are seen as credible and are used to continually improve programs and policies.----- Drawing on learnings and critical reflections about the use of feminist and participatory forms of evaluation and PAR over a 10-year period, significant sources of rigour identified include:----- • participation and communication methods that develop relations of mutual trust and open communication----- • using multiple theories and methodologies, multiple sources of data, and multiple methods of data collection----- • ongoing meta-evaluation and critical reflection----- • critically assessing the intended and unintended impacts of evaluations, using relevant theoretical models----- • using rigorous data analysis and reporting processes----- • participant reviews of evaluation case studies, impact assessments and reports.

Troubling Empowerment : A feminist critique of a rural women and communication technology project

Participatory research methodologies and interactive communication technologies (ICTs) are increasingly seen as offering ways of enhancing women’s empowerment and rural community development. However, some researchers suggest the need for caution about such claims. This book details findings from an evaluation of a feminist action research project that explored the impacts of ICTs for rural women in Queensland, Australia, in terms of personal, business and community development. Using praxis and poststructuralist feminist theories and methodologies, this innovative study presents a rigorous analysis and critique of women's empowerment and participation. This study demonstrates the value of adopting a critical yet pragmatic approach that takes diversity and difference, power-knowledge relations, and the contradictory effects of participation into account. This is argued to enable the development of more effective strategies for women’s empowerment, participation and inclusion. This book should be of particular interest to researchers, postgraduate students, and others working in the fields of communication, gender, and rural development, and feminist evaluation and ethnography.

Using the SWAP to connect water, human rights and mining

It is important that industries’ water interactions respect the human right to water. Historically, within the mining industry there has been a disconnect between the management of sites’ internal water interactions and the consequences of their external impacts, including human rights impacts. This poses a challenge for the mining industry as it attempts to put the Ruggie Guiding Principles for Business and Human Rights into practice, particularly as United Nations has recently recognised the human right to water. A technical framework such as the Minerals Council of Australia’s Water Accounting Framework (WAF) can help to bridge this disconnect and to integrate human rights considerations into business practice by connecting a site’s external and internal water interactions and by encouraging regular monitoring of performance. However, at present the connection is limited since the WAF lacks the capability to formalise a site’s social water context. This work presents the Social Water Assessment Protocol (SWAP), a scoping tool consisting of a set of questions organised into taxonomic themes that capture a site’s social water context and that can be combined with the WAF to better connect human rights with mine water interactions.

New England Youth Speeding Project: A pilot study of young drivers and risky driving: Effective strategies for preventing speeding amongst young Australians aged 16-25 years in the New England Region

Young Australian drivers aged 17 – 25 years are overwhelmingly represented in road fatalities where speed is a factor. In the combined LGAs of Armidale Dumaresq, Guyra, Uralla and Walcha in the 5 years 1999-2003 inclusive, 43% of speeding related casualty crashes involved a young driver aged less than 25 years. This is despite the fact that the 17-25 age group account for only 25% of the driving population in this area. Young male drivers account for the majority of these crashes and also tend to have a higher number of driving offences and accrue more penalties for road traffic offences, especially speeding. By analysing data from questionnaires by male and female participants this research project has been able to evaluate road safety advertisements to determine which ones are most effective to young drivers, what features of these advertisements are effective, how males differ from females in their receptiveness and preferences for road safety advertisements and specifically how to target young people especially young men in conveying road safety messages. Finally this research project has identified factors that are important in the production of media road safety advertisements and has made recommendations for how best to convey effective road safety messages to young Australian drivers in rural areas.

A baseline study of Australia's community recycling enterprises(CRE)

This report presents the findings on a baseline study of Australia's community recycling enterprises(CREs). The study sought to document the activities and impacts of these enterprises and to understand the conditions under which they succeed. The purposes of the research were to generate evidence that can contribute to the development of practice and policy support for CREs, and to provide information that is useful to community groups wishing to establish new CREs. The study included a review of the existing literature in relation to CREs, an online survey of Australian CREs, and in-depth case studies of three CREs from various regions within Australia

Managing health risks of extreme weather events : need for a systematic approach

The Climate Commission recently outlined the trend of major extreme weather events in different regions of Australia, including heatwaves, floods, droughts, bushfires, cyclones and storms. These events already impose an enormous health and financial burden onto society and are projected to occur more frequently and intensely. Unless we act now, further financial losses and increasing health burdens seem inevitable. We seek to highlight the major areas for interdisciplinary investigation, identify barriers and formulate response strategies.

Evaluation and social impact measurement amongst small to medium social enterprises : process, purpose and value

In recent years, the imperative to communicate organisational impacts to a variety of stakeholders has gained increasing importance within all sectors. Despite growing external demands for evaluation and social impact measurement, there has been limited critically informed analysis about the presumed importance of these activities to organisational success and the practical challenges faced by organisations in undertaking such assessment. In this paper, we present the findings from an action research study of five Australian small to medium social enterprises’ practices and use of evaluation and social impact analysis. Our findings have implications for social enterprise operators, policy makers and social investors regarding when, why and at what level these activities contribute to organisational performance and the fulfilment of mission.

The community and social impact of drink driving: Under the limit drink driving rehabilitation program

This video was prepared as a teaching resource for CARRS-Q's Under the Limit Drink Driving Rehabilitation Program

Making a case for social impact assessment in urban development : social impacts and legal disputes in Queensland, Australia

Urban land use planning and policy decisions are often contested, with the multiple stakeholders (business, developers, residents, policymakers and the wider community) frequently holding opposing viewpoints about the issues and best solution. In recent years, however, the participatory process of social impact assessment (SIA) has received significant attention as a way to mitigate conflict, facilitating negotiation and conflict resolution. This paper examines how social impacts have informed development appeals in Australia, focussing on ten cases from the Queensland Planning and Environment Court (QPEC). Half are appeals from community members (typically neighbours) wanting to oppose approvals and half from organisations appealing against City Councils’ decisions to deny their development applications. While legal challenges do not necessarily reflect attitudes and practices, they provide a means to begin to assess how social impacts (although not often explicitly defined as such) inform development related disputes. Based on the nature and outcomes of 10 QPEC cases, we argue that many legal cases could have been avoided if SIA had been undertaken appropriately. First, the issues in each case are clearly social, incorporating impacts on amenity, the character of an area, the needs of different social groups, perceptions of risk and a range of other social issues. Second, the outcomes and recommendations from each case, such as negotiating agreements, modifying plans and accommodating community concerns would have been equally served thorough SIA. Our argument is that engagement at an early stage, utilising SIA, could have likely achieved the same result in a less adversarial and much less expensive and time-consuming environment than a legal case.

Social water assessment protocol : a step towards connecting mining, water and human rights

The human right to water has recently been recognised by both the United Nations General Assembly and the Human Rights Council. As the mining industry interacts with water on multiple levels, it is important that these interactions respect the human right to water. Currently, a disconnect exists between mine site water management practices and the recognition of water from a human rights perspective. The Minerals Council of Australia (MCA) Water Accounting Framework (WAF) has previously been used to strengthen the connection between water management and human rights. This article extends this connection through the use of a Social Water Assessment Protocol (SWAP). The SWAP is scoping tool consisting of a set of questions classified into taxonomic themes under leading topics with suggested sources of data that enable mine sites to better understand the local water context in which they operate. Three of the themes contained in the SWAP – gender, Indigenous peoples and health – are discussed to demonstrate how the protocol may be useful in assisting mining companies to consider their impacts on the human right to water.