Critical reflections on the use of participatory methodologies to build evaluation capacities in international development organisations

There has been a greater focus on strengthening evaluation capacity building (ECB) within development organisations in recent years. This can be attributed in part to the growing appreciation of the value of participatory and collaborative forms of evaluation. Evaluation is increasingly seen as an ongoing learning process and an important means of strengthening capacity and improving organisational performance (Horton et al., 2003:7). While there are many benefits of using participatory methodologies in ECB projects, our experiences and a review of the literature in this area highlight the many challenges, issues and contradictions that can affect the success of such ECB efforts. We discuss these issues, drawing on our learnings from the ongoing participatory action research (PAR) project 'Assessing Communication for Social Change’ (AC4SC). This four year project, which began in 2007, is a collaboration between communication and development academics and evaluation specialists from two Australian universities and communication for development practitioners and monitoring and evaluation (M&E) staff in the NGO Equal Access Nepal (EAN). The aim is to develop, implement, and evaluate a participatory methodology for assessing the social change impacts of community radio programs produced by EAN. It builds on previous projects that used ethnographic action research (EAR) methodology (Tacchi et al., 2007).

Critical reflections on the use of participatory methodologies to build evaluation capacities in international development organisations

"In this chapter the authors present a critique of Participatory Evaluation as worked in development projects, in this case, in Nepal. The article works between established claims that Participatory Evaluation builds capacity at programmatic and organisational levels, and the specific experiences of these claims in the authors’ current work. They highlight the need to address key difficulties such as high turn-over of staff and resulting loss of capacity to engage in Participatory Evaluation, and the difficulty of communication between academic as compared with local practical wisdoms. A key issue is the challenge of addressing the inevitable issues of power inequities that such approaches encounter. While Participatory Evaluation has been around for some time, it has only enjoyed more widespread recognition of its value in comparatively recent times, with its uptake in international development environments. To this extent, the practice is still in its early stages of development, and Jo, June and Michael’s work contributes to strengthening and more comprehensively understanding it. With regard to the meta-theme of this publication, this chapter is an example of how context not only influences the methodology to be used and the praxis of how it is to be used, but contributes to early explication of the core nature of an emerging methodology."

A governance approach to integrated rural tourism: factors influencing organisational performance and tourism support of local development organisations

Ao longo das últimas três décadas, o envolvimento das comunidades na formulação de políticas locais tem vindo a ganhar cada vez mais atenção como uma abordagem sustentável para o desenvolvimento rural na União Europeia (UE) e no mundo. Emergendo da globalização, novas estruturas de governação têm desafiado a base territorial restricta da autoridade do Estado soberano através do envolvimento de uma rede complexa e de autoorganização de atores governamentais e não-governamentais na tomada de decisões coletivas. A reestruturação territorial e institucional das zonas rurais, associada à expansão da governança rural, ganhou atenção considerável na literatura. No entanto, o potencial de empregar princípios de governança como fatores que determinam as direções de desenvolvimento rural através de desempenho organizacional e apoio no turismo não tem sido amplamente explorado na literatura. Deste modo, o principal objetivo desta tese consiste no emprego de ‘integração’, ‘participação’ e ‘empowerment’ como fatores críticos que influenciam os rumos do desenvolvimento rural (1) através do desempenho organizacional das organizações de governança rural e (2) apoio no turismo de organizações de desenvolvimento rural tendo em vista a validação da abordagem de governança para o turismo integrado. Ao longo deste duplo objectivo geral, a tese é dividida numa componente qualitativa de ‘desempenho’ e numa componente quantitativa de ‘apoio’. Seguindo uma abordagem sistemática baseada num sistema conceptual, foram realizadas 38 entrevistas em profundidade com pessoas chave envolvendo gestores do programa LEADER da UE na Hungria (34% do número total de Grupos de Ação Local [GAL]), seguido por um levantamento de campo transversal realizado através de um sistema de recolha de dados na Internet, tendo resultado em 662 questionários válidos para uma taxa de resposta de 63.6%. Os resultados da componente “desempenho” revelaram padrões na implementação dos princípios de governança, que por sua vez permitiram a identificação de fatores que permitem e restringem o desempenho organizacional. Os resultados da componente “apoio” permitiram destacar que o ponto de vista de redes de desenvolvimento local nos princípios de governança não é homogéneo. Diferenças significativas foram encontradas entre organizações responsáveis pelo planeamento e os grupos de aconselhamento. Contudo, os resultados sugeriram que a dimensão sustentável de turismo rural integrado é um prognosticador da contribuição do turismo para o desenvolvimento global da comunicade e para o apoio do turismo ao longo das redes de desenvolvimento local. Este estudo responde a uma necessidade crescente de investigação, que resulta da proliferação à escala mundial de formações de governança em sistemas de administração pública, tanto no lado dos investigadores como no lado dos praticantes.

Resilient responses to climate change: exploring organisational learning in networked development organisations

Drawing from the organisational learning and governance literature, this paper assesses four internationally networked governmental and non‐governmental organisations in the UK addressing climate change. We analyse how those concerned understand the climate change crisis, what mechanisms are put in place to address information flows, and what evidence there is of learning through sharing information between the organisational headquarters and their regional offices. The most striking finding is the evidence of learning that largely depends on ad‐hoc informal processes and shadow networks.

CAP Reform vs WTO: Crop Diversification or Crop Rotation? : Legal opinion prepared by Dr. Christian Häberli at the request of APRODEV, the Association of World Council of Churches related Development Organisations in Europe

The European Commission’s proposals for the Legislative Framework of the Common Agricultural Policy (CAP) in the period 2014-2020 include, inter alia, the introduction of a “strong greening component”. For the first time, all EU farmers in receipt of support are to “go beyond the requirements of cross compliance and deliver environmental and climate benefits as part of their everyday activities crop diversification as a contribution to all EU farmers in receipt of support go beyond the requirements of cross compliance and deliver environmental and climate benefits as part of their everyday activities.” In a legal opinion prepared at the request of APRODEV, the Association of World Council of Churches related Development Organisations in Europe (www.aprodev.eu), Christian Häberli examines the WTO implications of this proposal, as compared with an alternative proposal to rather link direct payments to crop rotation. The conclusions are twofold: 1. Crop rotation is at least as likely to be found Green Box-compatible as crop diversification. Moreover, it will be more difficult to argue that crop diversification is “not more than minimally production-distorting” because it entails for most farmers less cost and work. 2. Even if (either of the two cropping schemes) were to be found “amber”, the EU would not have to relinquish this conditionality. This is because the direct payments involved would in all likelihood not, together with the other price support instruments, exceed the amount available under the presently scheduled maximum.

Domains of faith impact: how “faith” is perceived to shape faith-based international development organisations

Increasing interest in faith-based international development organisations (FBOs) recently has improved understanding of these agencies. One reason for complex, often contradictory findings is the lack of frameworks analysing the interactions of worldviews on organisational structures, processes, and behaviours of agencies, and development outcomes. We utilise Lincoln's (2003. Holy Terrors: Thinking about Religion after September 11. Chicago: University of Chicago Press) four “domains of religion” to explore how the literature reports faith impacting the shape of development FBOs’ structures, behaviours, and outcomes. Literature suggests faith has a significant impact upon these agencies. We outline very specific similarities and differences, highlighting the importance of nuanced analysis of faith's role in FBOs. Further research is needed to build more evidence around these impacts of faith on FBOs

Accountability beyond the headlines : why not-for-profit organisations need to communicate their own expenditure stories

This paper analyses the expenditure patterns of 97 Australian international aid and development organisations, and examines the extent to which they disclose information about their expenditure in order to discharge their accountability. Not-for-profit (NFP) expenditure attracts media attention, with perceptions of excessive costs potentially damaging stakeholder trust in NFP organisations. This makes it important for organisations to be proactive in communicating their expenditure stories to stakeholders, rather than being judged on their performance by standardised expenditure metrics. By highlighting what it costs to ensure longer-term operational capability, NFP organisations will contribute to the discharge of their financial accountability and play a part in educating all stakeholders about the dangers of relying on a single metric.

Offshore Sourcing in Software Development: Case Studies of Finnish-Russian Cooperation

The study examines international cooperation in product development in software development organisations. The software industry is known for its global nature and knowledge-intensity, which makes it an interesting setting to examine international cooperation in. Software development processes are increasingly distributed worldwide, but for small or even medium-sized enterprises, typical for the software industry, such distribution of operations is often possible only in association with crossing the company’s boundaries. The strategic decision-making of companies is likely to be affected by the characteristics of the industry, and this includes decisions about cooperation or sourcing. The objective of this thesis is to provide a holistic view on factors affecting decisions about offshore sourcing in software development. Offshore sourcing refers to a cooperative mode of offshoring, where a firm does not establish its own presence in a foreign country, but utilises a local supplier. The study examines product development activities that are distributed across organisational and geographical boundaries. The objective can be divided into two subtopics: general reasons for international cooperation in product development and particular reasons for cooperation between Finnish and Russian companies. The focus is on the strategic rationale at the company level, in particular in small and medium-sized enterprises. The theoretical discourse of the study builds upon the literature on international cooperation and networking, with particular focus on cooperation with foreign suppliers and within product development activities. The resource-based view is also discussed, as heterogeneity and interdependency of the resources possessed by different firms are seen as factors motivating international cooperation. Strategically, sourcing can be used to access resources possessed by an industrial network, to enhance the product development of a firm, or to optimise its cost structure. In order to investigate the issues raised by the theoretical review, two empirical studies on international cooperation in software product development have been conducted. The emphasis of the empirical part of the study is on cooperation between Finnish and Russian companies. The data has been gathered through four case studies on Finnish software development organisations and four case studies on Russian offshore suppliers. Based on the material from the case studies, a framework clarifying and grouping the factors that influence offshore sourcing decisions has been built. The findings indicate that decisions regarding offshore sourcing in software development are far more complex than generally assumed. The framework provides a holistic view on factors affecting decisions about offshore sourcing in software development, capturing the multidimensionality of motives for entering offshore cooperation. Four groups of factors emerged from the data: A) strategy-related aspects, B) aspects related to resources and capabilities, C) organisation-related aspects, and D) aspects related to the entrepreneur or management. By developing a holistic framework of decision factors, the research offers in-depth theoreticalunderstanding of offshore sourcing rationale in product development. From the managerial point of view, the proposed framework sums up the issues that a firm should pay attention to when contemplating product development cooperation with foreign suppliers. Understanding different components of sourcing decisions can lead to improved preconditions for strategising and engaging in offshore cooperation. A thorough decisionmaking process should consider all the possible benefits and risks of product development cooperation carefully.

Rural women and local economic development in south-west Victoria

In the 1990s, the appearance of women in leadership roles in local economic development organisations in small south-west Victorian towns heralded a change in gender relations in rural Australia. This paper contributes to an understanding of this process by investigating the actions and motives of women in leadership roles in small rural towns in south-west Victoria. The paper begins by establishing a framework of analysis based upon a notion of ‘paradigms in progress’. The argument is that in an increasingly interconnected world broader economic, social and political concerns encroach upon local cultures. In this process, older social paradigms or popularly accepted models for how the world works are either transformed, discarded or replaced on different levels. The different levels to which this paper refers are the macromodels of patriarchy, the mesomodels of economic development and the micromodels of leadership. It is the way that these levels intersect and how they are being changed that informs the explanation of women and leadership in south-west Victoria. The paper applies this framework to an analysis of interviews with 15 women in small towns in south-west Victoria. The paper concludes that women in the south-west have been able both to feminise the politics of local economic development as well as reposition the feminine in local social discourses.

Selecting the 'invisible' user interface development tool

Developers of interactive software are confronted by an increasing variety of software tools to help engineer the interactive aspects of software applications. Typically resorting to ad hoc means of tool selection, developers are often dissatisfied with their chosen tool on account of the fact that the tool lacks required functionality or does not fit seamlessly within the context in which it is to be used. This paper describes a system for evaluating the suitability of user interface development tools for use in software development organisations and projects such that the selected tool appears ‘invisible’ within its anticipated context of use. The paper also outlines and presents the results of an informal empirical study and a series of observational case studies of the system.

A strategic approach to mitigating the impacts of wild canids: proposed activities of the Invasive Animals Cooperative Research Centre

Wild canids (wild dogs and European red foxes) cause substantial losses to Australian livestock industries and environmental values. Both species are actively managed as pests to livestock production. Contemporaneously, the dingo proportion of the wild dog population, being considered native, is protected in areas designated for wildlife conservation. Wild dogs particularly affect sheep and goat production because of the behavioural responses of domestic sheep and goats to attack, and the flexible hunting tactics of wild dogs. Predation of calves, although less common, is now more economically important because of recent changes in commodity prices. Although sometimes affecting lambing and kidding rates, foxes cause fewer problems to livestock producers but have substantial impacts on environmental values, affecting the survival of small to medium-sized native fauna and affecting plant biodiversity by spreading weeds. Canid management in Australia relies heavily on the use of compound 1080-poisoned baits that can be applied aerially or by ground. Exclusion fencing, trapping, shooting, livestock-guarding animals and predator calling with shooting are also used. The new Invasive Animals Cooperative Research Centre has 40 partners representing private and public land managers, universities, and training, research and development organisations. One of the major objectives of the new IACRC is to apply a strategic approach in order to reduce the impacts of wild canids on agricultural and environmental values in Australia by 10%. In this paper, the impacts, ecology and management of wild canids in Australia are briefly reviewed and the first cooperative projects that will address IACRC objectives for improving wild dog management are outlined.

Applying an Agility/Discipline Assessment for a Small Software Organisation

The adoption of agile software development methodologies may appear to be a rather straightforward process yielding instantly improved software in less time and increasingly satisfied customers. This paper will show that such a notion is a misunderstanding and can be harmful to small software development organisations. A more reasonable approach involves a careful risk assessment and framework for introducing agile practices to address specific risks. A case study with a small software development organisation is provided to show the assessment in practice and the resulting risk mitigation strategies for process improvement.

History of the Geelong Regional Commission

This thesis is the first systematic history of the Geelong Regional Commission (GRC), and only the second history of a regional development organisation formed as a result of the growth centres policy of the Commonwealth Labor Government in the first half of the 1970s. In particular, the thesis examines the historical performance of the GRC from the time of its establishment in August 1977 to its abolition in May 1993. The GRC Commissioners were subject to ongoing criticism by some elements of the region's political, business, rural and local government sectors. This criticism focused on the Commissioners' policies on land-use planning, their interventionist stance on industrial land development, major projects and industry protection and their activities in revitalising the Geelong central business district. This thesis examines these criticisms in the light of the Commission's overall performance. This thesis found that, as a statutory authority of the Victorian Government, the GRC was successful over its lifetime, when measured against the requirements of the Geelong Regional Commission Act, the Commission's corporate planning objectives and performance indicators, the corporate performance standards of private enterprise in the late 1990s, and the performance indicator standards of today's regional economic development organisations in the United States of America, parts of the United Kingdom and Australia. With the change of Government in Victoria in October 1992 came a new approach to regional development. The new Government enacted legislation to amalgamate six of the nine local government councils of the Geelong region and returned regional planning responsibilities to the newly formed City of Greater Geelong Council. The new Government also made economic development a major objective of local government. As a result, the raison d'etre for the GRC came to an end and the organisation was abolished.