Critical reflections on the use of participatory methodologies to build evaluation capacities in international development organisations

There has been a greater focus on strengthening evaluation capacity building (ECB) within development organisations in recent years. This can be attributed in part to the growing appreciation of the value of participatory and collaborative forms of evaluation. Evaluation is increasingly seen as an ongoing learning process and an important means of strengthening capacity and improving organisational performance (Horton et al., 2003:7). While there are many benefits of using participatory methodologies in ECB projects, our experiences and a review of the literature in this area highlight the many challenges, issues and contradictions that can affect the success of such ECB efforts. We discuss these issues, drawing on our learnings from the ongoing participatory action research (PAR) project 'Assessing Communication for Social Change’ (AC4SC). This four year project, which began in 2007, is a collaboration between communication and development academics and evaluation specialists from two Australian universities and communication for development practitioners and monitoring and evaluation (M&E) staff in the NGO Equal Access Nepal (EAN). The aim is to develop, implement, and evaluate a participatory methodology for assessing the social change impacts of community radio programs produced by EAN. It builds on previous projects that used ethnographic action research (EAR) methodology (Tacchi et al., 2007).

Critical reflections on the use of participatory methodologies to build evaluation capacities in international development organisations

"In this chapter the authors present a critique of Participatory Evaluation as worked in development projects, in this case, in Nepal. The article works between established claims that Participatory Evaluation builds capacity at programmatic and organisational levels, and the specific experiences of these claims in the authors’ current work. They highlight the need to address key difficulties such as high turn-over of staff and resulting loss of capacity to engage in Participatory Evaluation, and the difficulty of communication between academic as compared with local practical wisdoms. A key issue is the challenge of addressing the inevitable issues of power inequities that such approaches encounter. While Participatory Evaluation has been around for some time, it has only enjoyed more widespread recognition of its value in comparatively recent times, with its uptake in international development environments. To this extent, the practice is still in its early stages of development, and Jo, June and Michael’s work contributes to strengthening and more comprehensively understanding it. With regard to the meta-theme of this publication, this chapter is an example of how context not only influences the methodology to be used and the praxis of how it is to be used, but contributes to early explication of the core nature of an emerging methodology."

Evaluating the use of a very large-scale presentation and collaboration framework

In this paper we describe the use and evaluation of CubIT, a multi-user, very large-scale presentation and collaboration framework. CubIT is installed at the Queensland University of Technology’s (QUT) Cube facility. The “Cube” is an interactive visualisation facility made up of five very large-scale interactive multi-panel wall displays, each consisting of up to twelve 55-inch multi-touch screens (48 screens in total) and massive projected display screens situated above the display panels. The paper outlines the unique design challenges, features, use and evaluation of CubIT. The system was built to make the Cube facility accessible to QUT’s academic and student population. CubIT enables users to easily upload and share their own media content, and allows multiple users to simultaneously interact with the Cube’s wall displays. The features of CubIT are implemented via three user interfaces, a multi-touch interface working on the wall displays, a mobile phone and tablet application and a web-based content management system. The evaluation reveals issues around the public use and functional scope of the system.

Mothers influencing mothers : the use of virtual discussion boards and their influence on consumption

Mothers represent a large segment of marketing dollars and traditionally, word of mouth was spread from mother to mother in a face-to-face environment, such as the school car park or mother’s groups. As families have evolved, so too has the traditional mother’s group. Limited academic studies have explored online mothers’ groups and how they impact on consumption. In order to explore the nature of this online influence and how mothers are influenced by other mothers online, a study was conducted through the use of observation and qualitative questioning. The data suggests that trust between mothers is generally high and mothers tend to trust the opinions of other mothers when they recommend a product. This is similar in other reference group contexts, however, mothers are communicating about brands frequently and influencing behaviour. This leads to a number of managerial and theoretical implications discussed in the paper.

The work of Media Arts in the age of digital production

This chapter uses as a beginning point Walter Benjamin’s famous essay ‘The work of art in the age of technological reproducibility’(1935/2008) to discuss Media Arts education. It locates ‘Media Arts’ at the intersection of three key ideas: 1) media arts products as objects for popular and everyday consumption and intervention by individuals and broader audiences; 2) materiality and how individuals use their bodies and technologies to produce, combine and share digital materials and; 3) the construction of aesthetic knowledge and how this relates to critical and conceptual thinking. These ideas are discussed in the context of the development of curriculum for students at all ages of schooling, with specific attention given to the knowledge and skills students might develop within Media Arts education in primary schools. Examples from a Media Arts project in a primary school in Australia – where a new Media Arts national curriculum has been developed –are provided to illustrate the key ideas discussed in the chapter.

Chroma Key Theatre : an examination of similarities and divergences in the use of Green Screen in two experimental theatre works

This paper examines the frame as it contributes to the debate on contemporary intermedial theatre and performance practices in light of increasing astriction between filmic and theatrical discourses. Informed by Auslander (1999), Lehmann (2006), and Giesekam (2007), and through an extrapolation of the tenets Eckersall, Gretchen and Scheer identify in the theory of New Media Dramaturgy, it will analyse two recent works of experimental theatre-making. RUFF (2013), a New York produced solo performance by one of the world’s leading female performers, explores her experiences of having a stroke. Total Dik! (2013), produced in Brisbane, Australia, is an interdisciplinary collaborative performance that examines aspects of dictatorship. They are clearly very different works yet there are a number of significant theatrical similarities in their use of Chroma Key technology and live compositing as material scenic devices. These works overtly and evocatively draw on the cinematic technique and technology of Chroma Key to augment and reveal the tensions and overlaps in their production processes.

Sing fox to me : an investigation into the "use" of Down Syndrome in both the Down Syndrome and Gothic novel

This project investigates the current borders around and within, what I have in this exegesis termed, "the Down Syndrome novel", using a close reading analysis of literary texts containing characters with Down syndrome and contextualised by theoretical works drawn from both disability and literary theory. This practice-led thesis introduces and discusses select fictional characters with Down syndrome from numerous genres, revealing them as highly contained, or "boundaried", spoken for, and generally used for narrative conflict rather than included as individuals with agency and a legitimate, autonomous voice and narrative point of view. In reframing the Australian landscape as "disabled" this exegesis illustrates that the Australian Gothic novel can shift, and sometimes even remove, the boundary around characters with intellectual disabilities, allowing a space where the stories of characters with Down syndrome can emerge.

Facebook for adults ? A longitudinal study of MBA student’s use of an enterprise social network for collaborative learning

The rapid pace of social media means that our understanding of the way in which it facilitates the learning process continues to lag. The findings of a longitudinal study of an executive MBA cohort over the period of eight months in their use of the social media application is presented. Over time the ownership and use of the Yammer site shifted to become student driven and facilitated. The motivations behind the site’s use, perceived advantages and disadvantages and changes in usage patterns are documented. The case provides a useful insight into the way in which students used this technology to facilitate their learning goals and how patterns of behaviour changed in response to the changing needs of the cohort.

Green: Exploring the aestheticized use of chroma-key techniques and technologies in two intermedial productions

Peggy Shaw’s RUFF, (USA 2013) and Queensland Theatre Company’s collaboration with Queensland University of Technology, Total Dik!, (Australia 2013) overtly and evocatively draw on an aestheticized use of the cinematic techniques and technologies of Chroma Key to reveal the tensions in their production and add layers to their performances. In doing so they offer invaluable insight where the filmic and theatrical approaches overlap. This paper draws on Eckersall, Grehan and Scheer’s New Media Dramaturgy (2014) to reposition the frame as a contribution to intermedial theatre and performance practices in light of increasing convergence between seemingly disparate discourses. In RUFF, the scenic environment replicates a chroma-key ‘studio’ which facilitates the reconstruction of memory displaced after a stroke. RUFF uses the screen and projections to recall crooners, lounge singers, movie stars, rock and roll bands, and an eclectic line of eccentric family members living inside Shaw. While the show pays tribute to those who have kept her company across decades of theatrical performance, use of non-composited chroma-key technique as a theatrical device and the work’s taciturn revelation of the production process during performance, play a central role in its exploration of the juxtaposition between its reconstructed form and content. In contrast Total Dik! uses real-time green screen compositing during performance as a scenic device. Actors manipulate scale models, refocus cameras and generate scenes within scenes in the construction of the work’s examination of an isolated Dictator. The ‘studio’ is again replicated as a site for (re)construction, only in this case Total Dik! actively seeks to reveal the process of production as the performance plays out. Building on RUFF, and other works such as By the Way, Meet Vera Stark, (2012) and Hotel Modern’s God’s Beard (2012), this work blends a convergence of mobile technologies, models, and green screen capture to explore aspects of transmedia storytelling in a theatrical environment (Jenkins, 2009, 2013). When a green screen is placed on stage, it reads at once as metaphor and challenge to the language of theatre. It becomes, or rather acts, as a ‘sign’ that alludes to the nature of the reconstructed, recomposited, manipulated and controlled. In RUFF and in Total Dik!, it is also a place where as a mode of production and subsequent reveal, it adds weight to performance. These works are informed by Auslander (1999) and Giesenkam (2007) and speak to and echo Lehmann’s Postdramatic Theatre (2006). This paper’s consideration of the integration of studio technique and live performance as a dynamic approach to multi-layered theatrical production develops our understanding of their combinatory use in a live performance environment.

The use of metabolomics to monitor simultaneous changes in metabolic variables following supramaximal low volume high intensity exercise

High Intensity Exercise (HIE) stimulates greater physiological remodeling when compared to workload matched low-moderate intensity exercise. This study utilized an untargeted metabolomics approach to examine the metabolic perturbations that occur following two workload matched supramaximal low volume HIE trials. In a randomized order, 7 untrained males completed two exercise protocols separated by one week; 1) HIE150%: 30 x 20s cycling at 150% VO2peak, 40s passive rest; 2) HIE300%: 30 x 10s cycling at 300% VO2peak, 50 s passive rest. Total exercise duration was 30 minutes for both trials. Blood samples were taken at rest, during and immediately following exercise and at 60 minutes post exercise. Gas chromatography-mass spectrometry (GC-MS) analysis of plasma identified 43 known metabolites of which 3 demonstrated significant fold changes (HIE300% compared to the HIE150% value) during exercise, 14 post exercise and 23 at the end of the recovery period. Significant changes in plasma metabolites relating to lipid metabolism [fatty acids: dodecanoate (p=0.042), hexadecanoate (p=0.001), octadecanoate (p=0.001)], total cholesterol (p=0.001), and glycolysis [lactate (p=0.018)] were observed following exercise and during the recovery period. The HIE300% protocol elicited greater metabolic changes relating to lipid metabolism and glycolysis when compared to HIE150% protocol. These changes were more pronounced throughout the recovery period rather than during the exercise bout itself. Data from the current study demonstrate the use of metabolomics to monitor intensity-dependent changes in multiple metabolic pathways following exercise. The small sample size indicates a need for further studies in a larger sample cohort to validate these findings.