Developing a participatory impact assessment approach and action research culture within a communication for social change organisation in Nepal

Developing an effective impact evaluation framework, managing and conducting rigorous impact evaluations, and developing a strong research and evaluation culture within development communication organisations presents many challenges. This is especially so when both the community and organisational context is continually changing and the outcomes of programs are complex and difficult to clearly identify.----- This paper presents a case study from a research project being conducted from 2007-2010 that aims to address these challenges and issues, entitled Assessing Communication for Social Change: A New Agenda in Impact Assessment. Building on previous development communication projects which used ethnographic action research, this project is developing, trailing and rigorously evaluating a participatory impact assessment methodology for assessing the social change impacts of community radio programs in Nepal. This project is a collaboration between Equal Access – Nepal (EAN), Equal Access – International, local stakeholders and listeners, a network of trained community researchers, and a research team from two Australian universities. A key element of the project is the establishment of an organisational culture within EAN that values and supports the impact assessment process being developed, which is based on continuous action learning and improvement. The paper describes the situation related to monitoring and evaluation (M&E) and impact assessment before the project began, in which EAN was often reliant on time-bound studies and ‘success stories’ derived from listener letters and feedback. We then outline the various strategies used in an effort to develop stronger and more effective impact assessment and M&E systems, and the gradual changes that have occurred to date. These changes include a greater understanding of the value of adopting a participatory, holistic, evidence-based approach to impact assessment. We also critically review the many challenges experienced in this process, including:----- • Tension between the pressure from donors to ‘prove’ impacts and the adoption of a bottom-up, participatory approach based on ‘improving’ programs in ways that meet community needs and aspirations.----- • Resistance from the content teams to changing their existing M&E practices and to the perceived complexity of the approach.----- • Lack of meaningful connection between the M&E and content teams.----- • Human resource problems and lack of capacity in analysing qualitative data and reporting results.----- • The contextual challenges, including extreme poverty, wide cultural and linguistic diversity, poor transport and communications infrastructure, and political instability.----- • A general lack of acceptance of the importance of evaluation within Nepal due to accepting everything as fate or ‘natural’ rather than requiring investigation into a problem.

Learning, evaluation, action and reflection for new technologies, empowerment and rural sustainability (The LEARNERS project)

-

Critically evaluating rural women’s participation and empowerment : An interdisciplinary feminist framework for research and analysis

Community development is increasingly using participatory processes that aim to be inclusive and empowering. However, researchers have found that such processes can have contradictory effects. Australian research has highlighted the significant leadership of rural women in sustainable community and economic development and in the adoption of new communication technologies such as the Internet. A focus on gender in participatory development may therefore lead to more effective programs and policies. This chapter outlines an interdisciplinary feminist framework for critically evaluating the participation and empowerment of rural women. This framework was found effective in evaluating an Australian project that aimed to enhance rural women’s access to communication technologies and to empower its participants. Its multiple theoretical and methodological approaches are outlined. The framework advocates an analysis of diversity and difference and the macro and micro contexts. Some principles and strategies for rural women’s inclusion, participation, empowerment, and for participatory feminist evaluation are outlined.

Increasing the rigour and trustworthiness of participatory evaluations : learnings from the field

Participatory evaluation and participatory action research (PAR) are increasingly used in community-based programs and initiatives and there is a growing acknowledgement of their value. These methodologies focus more on knowledge generated and constructed through lived experience than through social science (Vanderplaat 1995). The scientific ideal of objectivity is usually rejected in favour of a holistic approach that acknowledges and takes into account the diverse perspectives, values and interpretations of participants and evaluation professionals. However, evaluation rigour need not be lost in this approach. Increasing the rigour and trustworthiness of participatory evaluations and PAR increases the likelihood that results are seen as credible and are used to continually improve programs and policies.----- Drawing on learnings and critical reflections about the use of feminist and participatory forms of evaluation and PAR over a 10-year period, significant sources of rigour identified include:----- • participation and communication methods that develop relations of mutual trust and open communication----- • using multiple theories and methodologies, multiple sources of data, and multiple methods of data collection----- • ongoing meta-evaluation and critical reflection----- • critically assessing the intended and unintended impacts of evaluations, using relevant theoretical models----- • using rigorous data analysis and reporting processes----- • participant reviews of evaluation case studies, impact assessments and reports.

Troubling Empowerment : A feminist critique of a rural women and communication technology project

Participatory research methodologies and interactive communication technologies (ICTs) are increasingly seen as offering ways of enhancing women’s empowerment and rural community development. However, some researchers suggest the need for caution about such claims. This book details findings from an evaluation of a feminist action research project that explored the impacts of ICTs for rural women in Queensland, Australia, in terms of personal, business and community development. Using praxis and poststructuralist feminist theories and methodologies, this innovative study presents a rigorous analysis and critique of women's empowerment and participation. This study demonstrates the value of adopting a critical yet pragmatic approach that takes diversity and difference, power-knowledge relations, and the contradictory effects of participation into account. This is argued to enable the development of more effective strategies for women’s empowerment, participation and inclusion. This book should be of particular interest to researchers, postgraduate students, and others working in the fields of communication, gender, and rural development, and feminist evaluation and ethnography.

Using the SWAP to connect water, human rights and mining

It is important that industries’ water interactions respect the human right to water. Historically, within the mining industry there has been a disconnect between the management of sites’ internal water interactions and the consequences of their external impacts, including human rights impacts. This poses a challenge for the mining industry as it attempts to put the Ruggie Guiding Principles for Business and Human Rights into practice, particularly as United Nations has recently recognised the human right to water. A technical framework such as the Minerals Council of Australia’s Water Accounting Framework (WAF) can help to bridge this disconnect and to integrate human rights considerations into business practice by connecting a site’s external and internal water interactions and by encouraging regular monitoring of performance. However, at present the connection is limited since the WAF lacks the capability to formalise a site’s social water context. This work presents the Social Water Assessment Protocol (SWAP), a scoping tool consisting of a set of questions organised into taxonomic themes that capture a site’s social water context and that can be combined with the WAF to better connect human rights with mine water interactions.

New England Youth Speeding Project: A pilot study of young drivers and risky driving: Effective strategies for preventing speeding amongst young Australians aged 16-25 years in the New England Region

Young Australian drivers aged 17 – 25 years are overwhelmingly represented in road fatalities where speed is a factor. In the combined LGAs of Armidale Dumaresq, Guyra, Uralla and Walcha in the 5 years 1999-2003 inclusive, 43% of speeding related casualty crashes involved a young driver aged less than 25 years. This is despite the fact that the 17-25 age group account for only 25% of the driving population in this area. Young male drivers account for the majority of these crashes and also tend to have a higher number of driving offences and accrue more penalties for road traffic offences, especially speeding. By analysing data from questionnaires by male and female participants this research project has been able to evaluate road safety advertisements to determine which ones are most effective to young drivers, what features of these advertisements are effective, how males differ from females in their receptiveness and preferences for road safety advertisements and specifically how to target young people especially young men in conveying road safety messages. Finally this research project has identified factors that are important in the production of media road safety advertisements and has made recommendations for how best to convey effective road safety messages to young Australian drivers in rural areas.

A baseline study of Australia's community recycling enterprises(CRE)

This report presents the findings on a baseline study of Australia's community recycling enterprises(CREs). The study sought to document the activities and impacts of these enterprises and to understand the conditions under which they succeed. The purposes of the research were to generate evidence that can contribute to the development of practice and policy support for CREs, and to provide information that is useful to community groups wishing to establish new CREs. The study included a review of the existing literature in relation to CREs, an online survey of Australian CREs, and in-depth case studies of three CREs from various regions within Australia

Managing health risks of extreme weather events : need for a systematic approach

The Climate Commission recently outlined the trend of major extreme weather events in different regions of Australia, including heatwaves, floods, droughts, bushfires, cyclones and storms. These events already impose an enormous health and financial burden onto society and are projected to occur more frequently and intensely. Unless we act now, further financial losses and increasing health burdens seem inevitable. We seek to highlight the major areas for interdisciplinary investigation, identify barriers and formulate response strategies.

Socioeconomic disadvantage and changes in health risk behaviours in Australia: 1989-90 to 2001

Objective. Lower socioeconomic status (SES) is associated in industrialized countries with unhealthy lifestyle characteristics, such as smoking, physical inactivity and being overweight or obese. This paper examines changes over time in the association between SES and smoking status, physical activity and being overweight or obese in Australia. Methods. Data were taken from three successive national health surveys in Australia carried out in 1989-90 (n = 54 576), 1995 (n = 53 828) and 2001 (n = 26 863). Participants in these surveys were selected using a national probability sampling strategy, and aggregated data for geographical areas are used to determine the changing association between SES and lifestyle over time. Findings. Overall, men had less healthy lifestyles, In 2001 inverse SES trends for both men and women showed that those living in lower SES areas were more likely to smoke and to be sedentary and obese, There were some important socioeconomic changes over the period 1989-90 to 2001. The least socioeconomically disadvantaged areas had the largest decrease in the percentage of people smoking tobacco (24% decrease for men and 12% for women) and the largest decrease in the percentage of people reporting sedentary activity levels (25% decrease for men and 22% for women). While there has been a general increase in the percentage over time of those who are overweight or obese, there is a modest trend for being overweight to have increased (by about 16% only among females) among those living in areas of higher SES. Conclusion. Socioeconomic inequalities have been increasing for several key risk behaviours related to health; this suggests that T specific population-based prevention strategies intended to reduce health inequalities are needed.