Critical reflections on the use of participatory methodologies to build evaluation capacities in international development organisations

There has been a greater focus on strengthening evaluation capacity building (ECB) within development organisations in recent years. This can be attributed in part to the growing appreciation of the value of participatory and collaborative forms of evaluation. Evaluation is increasingly seen as an ongoing learning process and an important means of strengthening capacity and improving organisational performance (Horton et al., 2003:7). While there are many benefits of using participatory methodologies in ECB projects, our experiences and a review of the literature in this area highlight the many challenges, issues and contradictions that can affect the success of such ECB efforts. We discuss these issues, drawing on our learnings from the ongoing participatory action research (PAR) project 'Assessing Communication for Social Change’ (AC4SC). This four year project, which began in 2007, is a collaboration between communication and development academics and evaluation specialists from two Australian universities and communication for development practitioners and monitoring and evaluation (M&E) staff in the NGO Equal Access Nepal (EAN). The aim is to develop, implement, and evaluate a participatory methodology for assessing the social change impacts of community radio programs produced by EAN. It builds on previous projects that used ethnographic action research (EAR) methodology (Tacchi et al., 2007).

Collaborative resource development for energy efficiency education

BACKGROUND There is a growing volume of open source ‘education material’ on energy efficiency now available however the Australian government has identified a need to increase the use of such materials in undergraduate engineering education. Furthermore, there is a reported need to rapidly equip engineering graduates with the capabilities in conducting energy efficiency assessments, to improve energy performance across major sectors of the economy. In January 2013, building on several years of preparatory action-research initiatives, the former Department of Industry, Innovation, Climate Change, Science, Research and Tertiary Education (DIICCSRTE) offered $600,000 to develop resources for energy efficiency related graduate attributes, targeting Engineers Australia college disciplines, accreditation requirements and opportunities to address such requirements. PURPOSE This paper discusses a $430,000 successful bid by a university consortium led by QUT and including RMIT, UA, UOW, and VU, to design and pilot several innovative, targeted open-source resources for curriculum renewal related to energy efficiency assessments, in Australian engineering programs (2013-2014), including ‘flat-pack’, ‘media-bites’, ‘virtual reality’ and ‘deep dive’ case study initiatives. DESIGN/ METHOD The paper draws on literature review and lessons learned by the consortium partners in resource development over the last several years to discuss methods for selecting key graduate attributes and providing targeted resources, supporting materials, and innovative delivery options to assist universities deliver knowledge and skills to develop such attributes. This includes strategic industry and key stakeholders engagement. The paper also discusses processes for piloting, validating, peer reviewing, and refining these resources using a rigorous and repeatable approach to engaging with academic and industry colleagues. RESULTS The paper provides an example of innovation in resource development through an engagement strategy that takes advantage of existing networks, initiatives, and funding arrangements, while informing program accreditation requirements, to produce a cost-effective plan for rapid integration of energy efficiency within education. By the conference, stakeholder workshops will be complete. Resources will be in the process of being drafted, building on findings from the stakeholder engagement workshops. Reporting on this project “in progress” provides a significant opportunity to share lessons learned and take on board feedback and input. CONCLUSIONS This paper provides a useful reference document for others considering significant resource development in a consortium approach, summarising benefits and challenges. The paper also provides a basis for documenting the second half of the project, which comprises piloting resources and producing a ‘good practice guide’ for energy efficiency related curriculum renewal.

Teaching fractions to adult learners enrolled in a civil construction course : knowledge, action and materials action in tandem

This paper investigates the teaching and learning of fractions to Indigenous adult learners in a Civil Construction Certificate Course. More specifically it explores why the use of materials is critical to building knowledge and understanding. This focus is important for two reasons. First, it allows for considerations of a trainer’s approach for teaching fractions and, second it provides insights into how adult learners can be supported with representing their practical experiences of fractions to make generalisation thus building on their knowledge and learning experiences. The paper draws on teaching episodes from an Australian Research Council funded Linkage project that investigates how mathematics is taught and learned in Certificate Courses, here, Certificate 11 in Civil Construction. Action research and decolonising methods (Smith, 1999) were used to conduct the research. Video excerpts which feature one trainer and three students are analysed and described. Findings from the data indicate that adult learners need to be supported with materials to assist with building their capacity to know and apply understandings of fractions in a range of contexts, besides construction. Without materials and where fractions are taught via pen and paper tasks, students are less likely to retain and apply fraction ideas to their Certificate Course. Further they are less likely to understand decimals because of limited understanding of fractions.

Engineering education for sustainable development : a review of international progress

Since the late 1980s there have been increasing calls around the world for embedding sustainability content throughout engineering curricula, particularly over the past decade. However in general there has been little by way of strategic or systematic integration within programs offered by higher education institutions(HEIs). Responding to a growing awareness towards the issues surrounding sustainability, a number of professional engineering institutions (PEIs) internationally have placed increasing emphasis on policies and initiatives relating to the role of engineering in addressing 21st Century challenges. This has resulted in some consideration towards integrating sustainable development into engineering curricula as envisaged by accreditation guidelines. This paper provides a global overview of such accreditation developments, highlighting emerging sustainability competencies (or ‘graduate attributes’) and places these in the context of relevant PEI declarations, initiatives, policies, codes of ethics and guideline publications. The paper concludes by calling for urgent action by PEIs, including strategic accreditation initiatives that promote timely curriculum renewal towards EESD.

Applying threshold learning theory to teach sustainable business practice in post-graduate engineering education

This paper presents the results of a qualitative action-research inquiry into how a highly diverse cohort of post-graduate students could develop significant capacity in sustainable development within a single unit (course), in this case a compulsory component of four built environment masters programs. The method comprised applying threshold learning theory within the technical discipline of sustainable development, to transform student understanding of sustainable business practice in the built environment. This involved identifying a number of key threshold concepts, which once learned would provide a pathway to having a transformational learning experience. Curriculum was then revised, to focus on stepping through these targeted concepts using a scaffolded, problem-based-learning approach. Challenges included a large class size of 120 students, a majority of international students, and a wide span of disciplinary backgrounds across the spectrum of built environment professionals. Five ‘key’ threshold learning concepts were identified and the renewed curriculum was piloted in Semester 2 of 2011. The paper presents details of the study and findings from a mixed-method evaluation approach through the semester. The outcomes of this study will be used to inform further review of the course in 2012, including further consideration of the threshold concepts. In future, it is anticipated that this case study will inform a framework for rapidly embedding sustainability within curriculum.

Research Data Management Update on National Programs: New infrastructure and opportunities

Presentation by Dr Joe Young, ITS-HPC and Research Support, Managing your research data seminar, 2012

Engaging creativity through an action learning and action research process to develop an Indigenous art exhibition

In most art exhibitions, the creative part of the exhibition is assumed to be the artworks on display. But for the Capricornia Arts Mob’s first collective art exhibition in Rockhampton during NAIDOC Week in 2012, the process of developing the exhibition became the focus of creative action learning and action research. In working together to produce a multi-media exhibition, we learned about the collaborative processes and time required to develop a combined exhibition. We applied Indigenous ways of working – including yarning, cultural respect, cultural protocols, mentoring young people, providing a culturally safe working environment and sharing both time and food – to develop our first collective art exhibition. We developed a process that allowed us to ask deep questions, engage in a joint journey of learning, and develop our collective story. This paper explores the processes that the Capricornia Arts Mob used to develop the exhibition for NAIDOC 2012.

The association between adolescent self-reported physical activity and wellness : the missing piece for youth wellness programs

Purpose Potential positive associations between youth physical activity and wellness scores could emphasize the value of youth physical activity engagement and promotion interventions, beyond the many established physiological and psychological benefits of increased physical activity. The purpose of this study was to explore the associations between adolescents' self-reported physical activity and wellness. Methods This investigation included 493 adolescents (165 males and 328 females) aged between 12 and 15 years. The participants were recruited from six secondary schools of varying socioeconomic status within a metropolitan area. Students were administered the Five-Factor Wellness Inventory and the International Physical Activity Questionnaire for Adolescents to assess both wellness and physical activity, respectively. Results Data indicated that significant associations between physical activity and wellness existed. Self-reported physical activity was shown to be positively associated with four dimensions including friendship, gender identity, spirituality, and exercise—the higher order factor physical self and total wellness, and negatively associated with self-care, self-worth, love, and cultural identity. Conclusion This study suggests that relationships exist between self-reported physical activity and various elements of wellness. Future research should use controlled trials of physical activity and wellness to establish causal links among youth populations. Understanding the nature of these relationships, including causality, has implications for the justification of youth physical activity promotion interventions and the development of youth physical activity engagement programs.

Planes, trains, automobiles and the action per quod servitium amisit

The action per quod servitium amisit compensates an employer for the loss of an employee’s services, where such loss is caused due to the commission of a tort by a third party which injures the employee. Although not commonly pleaded, such actions often arise when employees are harmed due to transportation accidents. For example, where allowed, physical injury caused by the negligent driving of automobiles, and the psychiatric injury suffered by an engine driver upon averting a collision with a motorcyclist crossing before an oncoming train...

School-based physical activity programs for adolescent wellness improvement : an investigation of the association between wellness and physical activity

This thesis by publication included seven manuscripts that advanced contemporary understanding of the association between physical activity and wellness among adolescents. The findings suggested that due to potential interrelatedness between various aspects of wellness, changes in physical activity may also influence co-existing wellness domains; highlighting the potential for physical activity interventions to have a broad range of benefits among youth. These findings also added to the body of literature supporting the potential inclusion of physical activity as a component within multifaceted youth wellness programs. Findings reported in this thesis have implications for those seeking to initiate youth wellness interventions.

Free for all : a case study examining implementation factors of one-to-one device programs

Despite significant investment in school one-to-one device programs, little is known about which aspects of program implementation work and why. Through a comparison of two implementation models, adopter-diffusion and saturation, and using existing data from the One Laptop per Child Australia laptop program, we explored how factors of implementation may affect device diffusion, learning and educational outcomes, and program sustainability in schools. In this article we argue that more focused research into implementation of one-to-one device programs, moving beyond comparisons of “devices versus without devices,” is needed to provide reliable data to inform future program funding and advance this area of research.

Physical activity levels among children attending after-school programs

Purpose To describe the physical activity (PA) levels of children attending after-school programs, 2) examine PA levels in specific after-school sessions and activity contexts, and 3) evaluate after-school PA differences in groups defined by sex and weight status. Methods One hundred forty-seven students in grades 3-6 (mean age: 10.1 +/- 0.7, 54.4% male, 16.5% overweight (OW), 22.8% at-risk for OW) from seven after-school programs in the midwestern United States wore Actigraph GT1M accelerometers for the duration of their attendance to the program. PA was objectively assessed on six occasions during an academic year (three fall and three spring). Stored activity counts were uploaded to a customized data-reduction program to determine minutes of sedentary (SED), light (LPA), moderate (MPA), vigorous (VPA), and moderate-to-vigorous (MVPA) physical activity. Time spent in each intensity category was calculated for the duration of program attendance, as well as specific after-school sessions (e.g., free play, snack time). Results On average, participants exhibited 42.6 min of SED, 40.8 min of LPA, 13.4 min of MPA, and 5.3 min of VPA. The average accumulation of MVPA was 20.3 min. Boys exhibited higher levels of MPA, VPA, and MVPA, and lower levels of SED and LPA, than girls. OW and at-risk-for-OW students exhibited significantly less VPA than nonoverweight students, but similar levels of LPA, MPA, and MVPA. MVPA levels were significantly higher during free-play activity sessions than during organized or structured activity sessions. Conclusion After-school programs seem to be an important contributor to the PA of attending children. Nevertheless, ample room for improvement exists by making better use of existing time devoted to physical activity.

Resilience and opportunity : regions and the roll-out of Australia's greenhouse gas abatement programs. A manual for Queensland's NRM regions

Voluntary and compliance markets for forest carbon and other (emission avoidance and biosequestration) activities are growing internationally and across Australia. Queensland and its Natural Resource Management (NRM) regions have an opportunity to take a variety of actions to help guide these markets to secure multiple landscape benefits and to build landscape resilience in the face of climate change. As the national arrangements for offsets within Australia’s Clean Energy Package (CEP) and emissions trading environment emerge, Queensland’s regions can prepare themselves and their landholding communities to take advantage of these opportunities to deliver improved climate resilience in their regional landscapes.

Unlocking the "reminder" potential when viewers pause programs : results from a laboratory test of a new online medium

The branded pause advertisement is a recently developed online television-advertising format that displays a full-screen still-image banner ad whenever a viewer pauses a streaming-video program. This study used a controlled lab experiment to compare the effectiveness of branded pause advertisements with normal online television advertisements. The results demonstrate that branded pause advertisements are effective but only when combined with a long-exposure advertisement for the same brand. Despite their short exposure time, pause advertisements function as effective reminders, building awareness through repeat exposure. The findings of the current study were similar regardless of whether pause advertisements were activated as a result of viewers’ pausing at a time of their own choosing or whether viewers were interrupted.