Developing a participatory impact assessment approach and action research culture within a communication for social change organisation in Nepal

Developing an effective impact evaluation framework, managing and conducting rigorous impact evaluations, and developing a strong research and evaluation culture within development communication organisations presents many challenges. This is especially so when both the community and organisational context is continually changing and the outcomes of programs are complex and difficult to clearly identify.----- This paper presents a case study from a research project being conducted from 2007-2010 that aims to address these challenges and issues, entitled Assessing Communication for Social Change: A New Agenda in Impact Assessment. Building on previous development communication projects which used ethnographic action research, this project is developing, trailing and rigorously evaluating a participatory impact assessment methodology for assessing the social change impacts of community radio programs in Nepal. This project is a collaboration between Equal Access – Nepal (EAN), Equal Access – International, local stakeholders and listeners, a network of trained community researchers, and a research team from two Australian universities. A key element of the project is the establishment of an organisational culture within EAN that values and supports the impact assessment process being developed, which is based on continuous action learning and improvement. The paper describes the situation related to monitoring and evaluation (M&E) and impact assessment before the project began, in which EAN was often reliant on time-bound studies and ‘success stories’ derived from listener letters and feedback. We then outline the various strategies used in an effort to develop stronger and more effective impact assessment and M&E systems, and the gradual changes that have occurred to date. These changes include a greater understanding of the value of adopting a participatory, holistic, evidence-based approach to impact assessment. We also critically review the many challenges experienced in this process, including:----- • Tension between the pressure from donors to ‘prove’ impacts and the adoption of a bottom-up, participatory approach based on ‘improving’ programs in ways that meet community needs and aspirations.----- • Resistance from the content teams to changing their existing M&E practices and to the perceived complexity of the approach.----- • Lack of meaningful connection between the M&E and content teams.----- • Human resource problems and lack of capacity in analysing qualitative data and reporting results.----- • The contextual challenges, including extreme poverty, wide cultural and linguistic diversity, poor transport and communications infrastructure, and political instability.----- • A general lack of acceptance of the importance of evaluation within Nepal due to accepting everything as fate or ‘natural’ rather than requiring investigation into a problem.

Increasing the rigour and trustworthiness of participatory evaluations : learnings from the field

Participatory evaluation and participatory action research (PAR) are increasingly used in community-based programs and initiatives and there is a growing acknowledgement of their value. These methodologies focus more on knowledge generated and constructed through lived experience than through social science (Vanderplaat 1995). The scientific ideal of objectivity is usually rejected in favour of a holistic approach that acknowledges and takes into account the diverse perspectives, values and interpretations of participants and evaluation professionals. However, evaluation rigour need not be lost in this approach. Increasing the rigour and trustworthiness of participatory evaluations and PAR increases the likelihood that results are seen as credible and are used to continually improve programs and policies.----- Drawing on learnings and critical reflections about the use of feminist and participatory forms of evaluation and PAR over a 10-year period, significant sources of rigour identified include:----- • participation and communication methods that develop relations of mutual trust and open communication----- • using multiple theories and methodologies, multiple sources of data, and multiple methods of data collection----- • ongoing meta-evaluation and critical reflection----- • critically assessing the intended and unintended impacts of evaluations, using relevant theoretical models----- • using rigorous data analysis and reporting processes----- • participant reviews of evaluation case studies, impact assessments and reports.

A participatory design agenda for ubiquitous computing : a case study in dental practice

This paper reflects upon our attempts to bring a participatory design approach to design research into interfaces that better support dental practice. The project brought together design researchers, general and specialist dental practitioners, the CEO of a dental software company and, to a limited extent, dental patients. We explored the potential for deployment of speech and gesture technologies in the challenging and authentic context of dental practices. The paper describes the various motivations behind the project, the negotiation of access and the development of the participant relationships as seen from the researchers' perspectives. Conducting participatory design sessions with busy professionals demands preparation, improvisation, and clarity of purpose. The paper describes how we identified what went well and when to shift tactics. The contribution of the paper is in its description of what we learned in bringing participatory design principles to a project that spanned technical research interests, commercial objectives and placing demands upon the time of skilled professionals.

Co-creating games: A co-evolutionary analysis

ABSTRACT. The phenomenon of consumer co-creation is often framed in terms of whether either economic market forces or socio-cultural non-market forces ultimately dominate. We propose an alternate model of consumer co-creation in terms of co-evolution between markets and non-markets. Our model is based on a recent ethnographic study of a massively multiplayer online game through its development, release and ultimate failure, and cast in terms of two explanatory models: multiple games and social network markets. We conclude that consumer co-creation is indeed complex, but in ways that relate to both emergent market expectations and the evolution of markets, not to the transcendence of markets.

Co-creative expertise : Auran Games and Fury - a case study

This article discusses the ways in which the relations among professional and non-professional participants in co-creative relations are being reconfigured as part of the shift from a closed industrial paradigm of expertise toward open and distributed expertise networks. This article draws on ethnographic consultancy research undertaken throughout 2007 with Auran Games, a Brisbane, Australia based games developer, to explore the co-creative relationships between professional developers and gamers. This research followed and informed Auran’s online community management and social networking strategies for Fury (http://unleashthefury.com), a massively multiplayer online game released in October 2007. This paper argues that these co-creative forms of expertise involve co-ordinating expertises through social-network markets.

Research Monograph: Building Online Participatory Systems: Towards the Community Based Interactive Environmental Decision Support Systems

The importance of broadening community participation in environmental decision-making is widely recognized and lack of participation in this process appears to be a perennial problem. In this context, there have been calls from some academics for the more extensive use of geographic information systems (GIS) and distance learning technologies, accessible via the Internet, as a possible means to inform and empower communities. However, a number of problems exist. For instance, at present the scope for online interaction between policy-makers and citizens is currently limited. Contemporary web-based environmental information systems suffer from this lack of interactivity on the one hand and on the other hand from the apparent complexity for the lay user. This paper explores the issue of online community participation at the local level and attempts to construct a framework for a new (and potentially more effective) model of online participatory decision-making. The key components, system architecture and stages of such a model are introduced. This model, referred to as a ‘Community Based Interactive Environmental Decision Support System’, incorporates advanced information technologies, distance learning and community involvement tools which will be applied and evaluated in the field through a pilot project in Tokyo in the summer of 2002.

Organizational ambidexterity and corporate entrepreneurship : the differential effects on venturing, innovation and renewal processes

Most corporate entrepreneurship studies have focused on either innovation, venturing or strategic renewal making comparison between the antecedents of all three aspects of corporate entrepreneurship difficult. Moreover, studies on corporate entrepreneurship hardly address organizational antecedents, while simultaneously managing and organizing CE and mainstream activities has been seen as a major challenge for incumbent firms. Our findings show that organizational ambidexterity has strong and differential effects on venturing, innovation and renewal. We find, for example, that innovation is affected by horizontal integration, while strategic renewal is significantly influenced by integration on top management team level.

The necessary alignment between technology innovation effectiveness and operational effectiveness

Organisations are increasingly investing in complex technological innovations such as enterprise information systems with the aim of improving the operations of the business, and in this way gaining competitive advantage. However, the implementation of technological innovations tends to have an excessive focus on either technology innovation effectiveness (also known as system effectiveness), or the resulting operational effectiveness; focusing on either one of them is detrimental to the long-term enterprise benefits through failure to achieve the real value of technological innovations. The lack of research on the dimensions and performance objectives that organisations must be focusing on is the main reason for this misalignment. This research uses a combination of qualitative and quantitative, three-stage methodological approach. Initial findings suggest that factors such as quality of information from technology innovation effectiveness, and quality and speed from operational effectiveness are important and significantly well correlated factors that promote the alignment between technology innovation effectiveness and operational effectiveness.

A review of models of spatial innovation infrastructures in support of high growth SMEs

This Paper first provides a review and analysis of the recent trends on innovation infrastructures developed in industrialised countries to promote innovation and competitiveness for high growth SMEs. It specifically aims to examine various spatial models developed to support provision of innovation infrastructure for high growth sector.

Universities, SMEs and innovation frameworks : think global, act local?

Universities are increasingly encouraged to take a leading role in economic development, particularly through innovation. Simultaneously, economic development policy itself is increasingly focused on small and medium-sized enterprises (SMEs), creating overlapping interactions in the roles of government policy, universities and SMEs and the processes of innovation creation and dissemination. This paper examines issues arising from these developments and relating to the key stakeholders (industry, government and universities in particular), the enabling mechanisms (network governance, relevant education, training and learning, and suitable structures), and local and cross-local links. The authors then use quantitative analysis of 450 SMEs in the UK to begin to evaluate the roles of universities and highlight areas for further theoretical development.

The knowledge advantage (K-Adv): unleashing creativity and innovation

The K-Adv has been developed around the concept that it comprises an ICT enabling infrastructure that encompasses ICT hardware and software infrastructure facilities together with an enabling ICT support system; a leadership infrastructure support system that provides the vision for its implementation and the realisation capacity for the vision to be realised; and the necessary people infrastructure that includes the people capabilities and capacities supported by organisational processes that facilitates this resource to be mobilised.

Brite innovation survey : executive summary

This report summarises the fi ndings of an innovation survey of the Australian construction industry undertaken by the BRITE Project of the CRC for Construction Innovation in 2004. The BRITE Innovation Survey can be viewed in full at www.brite.crcci.info.The objective of the BRITE project is to improve the incidence and quality of innovation in the Australian construction industry. Many stakeholders in the industry are sceptical about the potential for innovation and its likely benefi ts. Many also lack the linkages and capabilities required for successful innovation. The BRITE Project is redressing this situation through demonstration and benchmarking activities. The term ‘innovation’ is defi ned as a new or signifi cantly improved technology or advanced business practice. Innovation may be technological or organisational, and it may be new to the world, or just new to the industry or business concerned. The defi nition includes the adoption of existing advancements developed outside a particular business. The survey sample was drawn from 3,500 businesses in the road/bridge and commercial building sectors in New South Wales, Victoria and Queensland, covering main contractors, trade contractors, consultants, suppliers and clients. Onethird of this population was sampled and a response rate of almost 30% was achieved. The survey collected information about respondents’ perceptions of innovation determinants in the industry, comprising various aspects of business strategy and business environment.

Influences on construction innovation : a brief overview of recent literature

This report reviews the most recent literature on construction innovation with the aim of highlighting the primary influences on innovation in the building and construction industry.

Brite Innovation Gallery 2007

In 2006, the BrITE project of the CrC for Construction Innovation researched the learning behaviours of twenty of australia’s most innovative contractors.

Public policy implications of construction innovation research

This report undertakes an exploratory analysis of Construction Innovation research projects in order to answer the question “What are the public policy implications of Construction Innovation research?”