Developing a participatory impact assessment approach and action research culture within a communication for social change organisation in Nepal

Developing an effective impact evaluation framework, managing and conducting rigorous impact evaluations, and developing a strong research and evaluation culture within development communication organisations presents many challenges. This is especially so when both the community and organisational context is continually changing and the outcomes of programs are complex and difficult to clearly identify.----- This paper presents a case study from a research project being conducted from 2007-2010 that aims to address these challenges and issues, entitled Assessing Communication for Social Change: A New Agenda in Impact Assessment. Building on previous development communication projects which used ethnographic action research, this project is developing, trailing and rigorously evaluating a participatory impact assessment methodology for assessing the social change impacts of community radio programs in Nepal. This project is a collaboration between Equal Access – Nepal (EAN), Equal Access – International, local stakeholders and listeners, a network of trained community researchers, and a research team from two Australian universities. A key element of the project is the establishment of an organisational culture within EAN that values and supports the impact assessment process being developed, which is based on continuous action learning and improvement. The paper describes the situation related to monitoring and evaluation (M&E) and impact assessment before the project began, in which EAN was often reliant on time-bound studies and ‘success stories’ derived from listener letters and feedback. We then outline the various strategies used in an effort to develop stronger and more effective impact assessment and M&E systems, and the gradual changes that have occurred to date. These changes include a greater understanding of the value of adopting a participatory, holistic, evidence-based approach to impact assessment. We also critically review the many challenges experienced in this process, including:----- • Tension between the pressure from donors to ‘prove’ impacts and the adoption of a bottom-up, participatory approach based on ‘improving’ programs in ways that meet community needs and aspirations.----- • Resistance from the content teams to changing their existing M&E practices and to the perceived complexity of the approach.----- • Lack of meaningful connection between the M&E and content teams.----- • Human resource problems and lack of capacity in analysing qualitative data and reporting results.----- • The contextual challenges, including extreme poverty, wide cultural and linguistic diversity, poor transport and communications infrastructure, and political instability.----- • A general lack of acceptance of the importance of evaluation within Nepal due to accepting everything as fate or ‘natural’ rather than requiring investigation into a problem.

Socioeconomic disadvantage and changes in health risk behaviours in Australia: 1989-90 to 2001

Objective. Lower socioeconomic status (SES) is associated in industrialized countries with unhealthy lifestyle characteristics, such as smoking, physical inactivity and being overweight or obese. This paper examines changes over time in the association between SES and smoking status, physical activity and being overweight or obese in Australia. Methods. Data were taken from three successive national health surveys in Australia carried out in 1989-90 (n = 54 576), 1995 (n = 53 828) and 2001 (n = 26 863). Participants in these surveys were selected using a national probability sampling strategy, and aggregated data for geographical areas are used to determine the changing association between SES and lifestyle over time. Findings. Overall, men had less healthy lifestyles, In 2001 inverse SES trends for both men and women showed that those living in lower SES areas were more likely to smoke and to be sedentary and obese, There were some important socioeconomic changes over the period 1989-90 to 2001. The least socioeconomically disadvantaged areas had the largest decrease in the percentage of people smoking tobacco (24% decrease for men and 12% for women) and the largest decrease in the percentage of people reporting sedentary activity levels (25% decrease for men and 22% for women). While there has been a general increase in the percentage over time of those who are overweight or obese, there is a modest trend for being overweight to have increased (by about 16% only among females) among those living in areas of higher SES. Conclusion. Socioeconomic inequalities have been increasing for several key risk behaviours related to health; this suggests that T specific population-based prevention strategies intended to reduce health inequalities are needed.

Water, Communities and Mineral Resource Development: Understanding the Risks and Opportunities

Issues around water – its quality, use, availability and environmental value – can be a major point of tension between mineral projects and local communities. Failure to manage these issues appropriately can jeopardise the obtaining of regulatory approvals for new projects and place at risk the ‘social licence to operate’ of existing operations. Conversely, there may also be significant opportunities for companies to engage constructively with communities over water issues and to make a positive contribution to the sustainable development of these communities. Using case studies, this paper will explore the various types of social risks and opportunities associated with water and mineral resource development and identify key learnings relating to the management of these issues.

Sexual partner preferences: evolutionary imperative, emotional attachment or hedonism?

Data are taken from a representative sample of the Australian population to determine the qualities that are desired in a sexual partner. These qualities are considered in three categories: those reflecting the perceived reproductive value of the partner (evolutionary imperative), the emotional attachment to a partner and the pure pleasure associated with having sex. Subjects completed a telephone-based survey 876 males; 908 females; aged 18-59). The qualities respondents report they most desire in a sexual partner are that the person is someone who cares about them, and whom they love. They also rank highly the criterion that their partner should enjoy sex, and much less highly that they themselves should enjoy the sex. Evolutionary imperatives are ranked fairly low as criteria sought in a sexual partner. Males and females generally expressed similar preferences in a sexual partner, as do persons in different age groups, and persons in different marital status categories. Heterosexual males appear to place a higher emphasis on the physical appearance of a partner when compared with non-heterosexuals. [PUBLICATION ABSTRACT]

Learning, evaluation, action and reflection for new technologies, empowerment and rural sustainability (The LEARNERS project)

-

Critically evaluating rural women’s participation and empowerment : An interdisciplinary feminist framework for research and analysis

Community development is increasingly using participatory processes that aim to be inclusive and empowering. However, researchers have found that such processes can have contradictory effects. Australian research has highlighted the significant leadership of rural women in sustainable community and economic development and in the adoption of new communication technologies such as the Internet. A focus on gender in participatory development may therefore lead to more effective programs and policies. This chapter outlines an interdisciplinary feminist framework for critically evaluating the participation and empowerment of rural women. This framework was found effective in evaluating an Australian project that aimed to enhance rural women’s access to communication technologies and to empower its participants. Its multiple theoretical and methodological approaches are outlined. The framework advocates an analysis of diversity and difference and the macro and micro contexts. Some principles and strategies for rural women’s inclusion, participation, empowerment, and for participatory feminist evaluation are outlined.

Increasing the rigour and trustworthiness of participatory evaluations : learnings from the field

Participatory evaluation and participatory action research (PAR) are increasingly used in community-based programs and initiatives and there is a growing acknowledgement of their value. These methodologies focus more on knowledge generated and constructed through lived experience than through social science (Vanderplaat 1995). The scientific ideal of objectivity is usually rejected in favour of a holistic approach that acknowledges and takes into account the diverse perspectives, values and interpretations of participants and evaluation professionals. However, evaluation rigour need not be lost in this approach. Increasing the rigour and trustworthiness of participatory evaluations and PAR increases the likelihood that results are seen as credible and are used to continually improve programs and policies.----- Drawing on learnings and critical reflections about the use of feminist and participatory forms of evaluation and PAR over a 10-year period, significant sources of rigour identified include:----- • participation and communication methods that develop relations of mutual trust and open communication----- • using multiple theories and methodologies, multiple sources of data, and multiple methods of data collection----- • ongoing meta-evaluation and critical reflection----- • critically assessing the intended and unintended impacts of evaluations, using relevant theoretical models----- • using rigorous data analysis and reporting processes----- • participant reviews of evaluation case studies, impact assessments and reports.

Troubling Empowerment : A feminist critique of a rural women and communication technology project

Participatory research methodologies and interactive communication technologies (ICTs) are increasingly seen as offering ways of enhancing women’s empowerment and rural community development. However, some researchers suggest the need for caution about such claims. This book details findings from an evaluation of a feminist action research project that explored the impacts of ICTs for rural women in Queensland, Australia, in terms of personal, business and community development. Using praxis and poststructuralist feminist theories and methodologies, this innovative study presents a rigorous analysis and critique of women's empowerment and participation. This study demonstrates the value of adopting a critical yet pragmatic approach that takes diversity and difference, power-knowledge relations, and the contradictory effects of participation into account. This is argued to enable the development of more effective strategies for women’s empowerment, participation and inclusion. This book should be of particular interest to researchers, postgraduate students, and others working in the fields of communication, gender, and rural development, and feminist evaluation and ethnography.