Critical reflections on the use of participatory methodologies to build evaluation capacities in international development organisations

There has been a greater focus on strengthening evaluation capacity building (ECB) within development organisations in recent years. This can be attributed in part to the growing appreciation of the value of participatory and collaborative forms of evaluation. Evaluation is increasingly seen as an ongoing learning process and an important means of strengthening capacity and improving organisational performance (Horton et al., 2003:7). While there are many benefits of using participatory methodologies in ECB projects, our experiences and a review of the literature in this area highlight the many challenges, issues and contradictions that can affect the success of such ECB efforts. We discuss these issues, drawing on our learnings from the ongoing participatory action research (PAR) project 'Assessing Communication for Social Change’ (AC4SC). This four year project, which began in 2007, is a collaboration between communication and development academics and evaluation specialists from two Australian universities and communication for development practitioners and monitoring and evaluation (M&E) staff in the NGO Equal Access Nepal (EAN). The aim is to develop, implement, and evaluate a participatory methodology for assessing the social change impacts of community radio programs produced by EAN. It builds on previous projects that used ethnographic action research (EAR) methodology (Tacchi et al., 2007).

goDesign Express 2011 Workshop

The goDesign Express 2011 Workshop was a design immersion workshop run by the Queensland University of Technology (QUT) Built Environment and Engineering Faculty during three weeks of 70-minute art class periods/sessions in August/September 2011 at Morayfield State High School, for 80 Grade 10 and 64 Grade 11 art students and two teachers, and October 2011 at Narangba Valley State High School for 60 Grade 10 and 30 Grade 11 art students and two teachers. Funded and administrated through QUT’s Widening Participation Program, which supports outreach activities to increase tertiary enrolments for under represented groups (such as low-SES, rural and indigenous students), the program utilised two activities from Day 1 of the highly successful 3-day goDesign Travelling Workshop Program for Regional Secondary Students (http://eprints.qut.edu.au/47747/). In contrast to this program, which was facilitated by two tertiary design educators, the goDesign Express 2011 Workshop was facilitated primarily by three tertiary interior design/architecture students, with assistance from a design educator. This action research study aimed to facilitate an awareness in young people, of the value of design thinking skills in generating strategies to solve local community challenges. It also aimed to investigate the value of collaboration between secondary school students and teachers, and tertiary design students and educators, in inspiring post-secondary pathways for school students, professional development for schoolteachers, and alternative career prospects and leadership skills for tertiary design students. During the workshop, secondary students and teachers explored, analysed and reimagined their local community through a series of scaffolded problem solving activities around the theme of ‘place’. Students worked individually and in groups designing graphics, fashion and products, and utilising sketching, making, communication, collaboration and presentation skills to improve their design process, while considering social, cultural and environmental opportunities for their local community. The workshop was mentioned in a news article in the local Caboolture Shire Herald newspaper.

Design Pressure Test 2013 Workshop

Design Pressure Test 2013 was a full-day intensive design immersion creative event run on Saturday 3 August 2013, at the QUT Faculty of Creative Industries J Block Design Lab Workshop in Brisbane, Australia, for 25 self-selected high-achieving junior and middle school (year 5-9) students, as part of the Queensland Academies ‘Young Scholars’ Program. Facilitated by tertiary interior design, fashion design and industrial design educators, technicians and six tertiary interior design and fashion design students, the workshop explored design process, environmental impact, the material properties and structural integrity of cardboard, construction techniques, and the production and evaluation of furniture design prototypes. This action research study aimed to facilitate an awareness in young people, of the role and scope of design within our society, the environmental ramifications of design decisions, and the value of design thinking skills in generating strategies to solve basic to complex challenges. It also aimed to investigate the value of collaboration between junior and middle school students, tertiary design educators and students and industry professionals in design awareness, and inspiring post-secondary pathways and idea generation for education. During the creative event, students utilised mathematics skills and developed sketching, making, communication, presentation and collaboration skills to improve their design process, while considering social, cultural and environmental opportunities. Through a series of hands-on collaborative design experiments, participants explored in teams of five, the opportunities available using cardboard as a material – inspiring both functional and aesthetic design solutions. Underpinned by the State Library of Queensland Design Minds Website ‘inquire, ideate and implement’ model of design thinking, the experiments culminated in the development of a detailed client brief, the design and fabrication of a furniture item for seating, and then a team presentation of prototypes to a panel of judges from the professions of architecture, interior design and industrial design, viewed also by parents. The final test for structural integrity was measured by the hoisting down of an adult body weight onto the fabricated seat. The workshop was filmed for the television program ‘Totally Wild’ for dissemination nationally (over 200,000 viewing audience) of the value of design and the Design Minds model to a wider target youth audience.

Embedding nature into cities – a case study of economic lessons from Singapore

Built environment design around the world faces a number of 21st Century challenges such as rising urban heat island effect and rising pollution, which are further worsened by consequences of climate change and increasing urban populations. Such challenges have caused cities around the globe to investigate options that can help to significantly reduce the environmental pressures from current and future development, requiring new areas of innovation. One such area is ‘Biophilic Urbanism’, which refers to the use of natural elements as design features in urban centres to assist efforts to address climate change issues in rapidly growing economies. Singapore is an illustration of a thriving economy that exemplifies the value of embedding nature into its built environment. The significance of urban green space has been recognised in Singapore as early as the 1960s when Lee Kuan Yew embarked on the ‘Garden City’ concept. 50 years later, Singapore has achieved its Garden City goal and is now entering a new era of sustainability, to create a ‘City in a Garden’. Although the economics of such efforts is not entirely understood, the city of Singapore has continued to pursue visions of becoming a biophilic city. Indeed, there appears to be important lessons to be learned from a city that has challenged the preconceived notion that protecting vegetation in a city is not economically viable. Hence, this paper will discuss the case study of Singapore to highlight the drivers, along with the economic considerations identified along the way. The conclusions have implications for expanding the notion of biophilic urbanism, particularly in the Australian context by discussing the lessons learned from this city. The research is part of Sustainable Built Environment National Research Centre, and has been developed in collaboration with the Curtin University Sustainability Policy Institute.

An ICT Implementation Strategy for Primary Schools in Fiji

Information and Communication Technology (ICT) has been embraced with hope and optimism in both developing and developed countries. While in the developed countries most citizens have access to one or many of the devices which utilize this technology (e.g. desktop, laptop, tablet, mobile phone), in developing countries this “luxury” can only be afforded by a privileged few. The use of these technologies in primary schools in developing countries is low. This is due to the fact that there are other bigger issues that some of these countries have to grapple with such as meeting the basic health and education needs of its citizens. Quality primary education and global development partnerships are two of the eight Millennium Development Goals of the United Nations (UNDP, 2012). Many Governments, NGO’s, service organizations, and individuals in developing countries are always looking at ways in which the disparity (not just in terms of ICT) can be narrowed. There has to be a greater collaboration between stakeholders in developing and developed countries (Mutonyi & Norton, 2007). How do stakeholders from developed countries engage with partners in developing countries to deliver meaningful and relevant outcomes for primary school students using ICT? As a first step getting the key stakeholders on side is critical. In the Fijian context, schools are managed and run by committees who are members of the community. Therefore, getting the committee on side together with the head-teachers and teachers is critical. Conversations about teaching and learning with technology can then follow with greater ease. The sustainability of any innovative approaches is also an essential element of this equation. Through this lens, this chapter investigates how ICT can be implemented in primary schools in Fiji. It proposes a three-layered approach which focuses on: (1) the community, school leadership, and teachers; (2) content, pedagogy, and technology, and (3) sustainability.

Design Minds Refresh Toolkit

The Design Minds Refresh Toolkit was one of six K7-12 secondary school design toolkits commissioned by the State Library of Queensland (SLQ) Asia Pacific Design Library (APDL), to facilitate the delivery of the Stage 1 launch of its Design Minds online platform (www.designminds.org.au) partnership initiative with Queensland Government Arts Queensland and the Smithsonian Cooper-Hewitt National Design Museum, on June 29, 2012. Design Minds toolkits are practical guides, underpinned by a combination of one to three of the Design Minds model phases of ‘Inquire’, ‘Ideate’ and ‘Implement’ (supported by at each stage with structured reflection), to enhance existing school curriculum and empower students with real life design exercises, within the classroom environment. Toolkits directly identify links to Naplan, National Curriculum, C2C and Professional Standards benchmarks, as well as the student capabilities of successful and creative 21st century citizens they seek to engender through design thinking. Inspired by ideas from a design project for second year Interior Design students at QUT School of Design, this toolkit explores, through five distinct exercises, different design tools and ways to approach the future design of environments (bathrooms) to facilitate the daily washing ritual, while addressing diverse and changing social, cultural, technological and environmental challenges. The Design Minds Refresh Toolkit particularly aims to promote ‘Lateral Thinking’ attitudes and empathy as an approach to create unusual and sustainable solutions to future problems that may affect our daily behavioural routines, and the spaces that facilitate them. More generally, it aims to facilitate awareness in young people, of the role of design in society and the value of design thinking skills in generating strategies to solve basic to complex systemic challenges, as well as to inspire post-secondary pathways and idea generation for education. The toolkit encourages students and teachers to develop sketching, making, communication, presentation and collaboration skills to improve their design process, as well as explore further inquiry (background research) to enhance the ideation exercises. Exercise 1 focuses on the ‘Inquire’ and ‘Ideate’ phases, Exercise 2 and 3 build on ideation skills, and Exercise 4 and 5 concentrate on the ‘Implement’ phase. Depending on the intensity of the focus, the unit of work could be developed over a 4-5 week program (approximately 10-12 x 60 minute lessons/workshops) or as smaller workshops treated as discrete learning experiences. The toolkit is available for public download from http://designminds.org.au/refresh/ on the Design Minds website. Exercise 2 (Other People’s Shoes) and Exercise 3 (The Future Bathroom) of the toolkit were used as content for the inaugural Design Minds Professional Development Workshop on June 28, 2012 to pre-launch the website to Queensland teachers.

Design Minds The Big Picture Toolkit

The Design Minds The Big Picture Toolkit was one of six K7-12 secondary school design toolkits commissioned by the State Library of Queensland (SLQ) Asia Pacific Design Library (APDL), to facilitate the delivery of the Stage 1 launch of its Design Minds online platform (www.designminds.org.au) partnership initiative with Queensland Government Arts Queensland and the Smithsonian Cooper-Hewitt National Design Museum, on June 29, 2012. Design Minds toolkits are practical guides, underpinned by a combination of one to three of the Design Minds model phases of ‘Inquire’, ‘Ideate’ and ‘Implement’ (supported by at each stage with structured reflection), to enhance existing school curriculum and empower students with real life design exercises, within the classroom environment. Toolkits directly identify links to Naplan, National Curriculum, C2C and Professional Standards benchmarks, as well as the student capabilities of successful and creative 21st century citizens they seek to engender through design thinking. Inspired by the Unlimited: Designing for the Asia Pacific Generation Workshop 2010 (http://eprints.qut.edu.au/47762/), this toolkit explores, through three distinct exercises, ‘design for the other 90%’, addressing tools and approaches to diverse and changing social, cultural, technological and environmental challenges. The Design Minds The Big Picture Toolkit challenges students to be active agents for change and to think creatively and optimistically about solutions to future global issues that deliver social, economic and environmental benefits. More generally, it aims to facilitate awareness in young people, of the role of design in society and the value of design thinking skills in generating strategies to solve basic to complex systemic challenges, as well as to inspire post-secondary pathways and idea generation for education. The toolkit encourages students and teachers to develop sketching, making, communication, presentation and collaboration skills to improve their design process, as well as explore further inquiry (background research) to enhance the ideation exercises. Exercise 1 focuses on the ‘Inquire’ phase, Exercise 2 the ‘Inquire’ and ‘Ideate’ phases, and Exercise 3 concentrates on the ‘Implement’ phase. Depending on the intensity of the focus, the unit of work could be developed over a 4-5 week program (approximately 4-6 x 60 minute lessons/workshops) or as smaller workshops treated as discrete learning experiences. The toolkit is available for public download from http://designminds.org.au/the-big-picture/ on the Design Minds website.

Design Minds Tomorrow's Classroom Toolkit

The Design Minds Tomorrow’s Classroom Toolkit was one of six K7-12 secondary school design toolkits commissioned by the State Library of Queensland (SLQ) Asia Pacific Design Library (APDL), to facilitate the delivery of the Stage 1 launch of its Design Minds online platform (www.designminds.org.au) partnership initiative with Queensland Government Arts Queensland and the Smithsonian Cooper-Hewitt National Design Museum, on June 29, 2012. Design Minds toolkits are practical guides, underpinned by a combination of one to three of the Design Minds model phases of ‘Inquire’, ‘Ideate’ and ‘Implement’ (supported by at each stage with structured reflection), to enhance existing school curriculum and empower students with real life design exercises, within the classroom environment. Toolkits directly identify links to Naplan, National Curriculum, C2C and Professional Standards benchmarks, as well as the student capabilities of successful and creative 21st century citizens they seek to engender through design thinking. This toolkit explores, through four distinct exercises, different design tools and ways to approach the future design of environments (classrooms/schools) to facilitate the Reggio Emilia philosophy of learning, while addressing diverse and changing social, cultural, technological and environmental challenges. The Design Minds Tomorrow’s Classroom Toolkit encourages students to explore architecture and interior design, and to think about their (life-long) learning as a product of inspiring interactions with people and the environments around them, and that their potential role in contributing to both delightful and functional design solutions requires a deep understanding of the user experience. More generally, it aims to facilitate awareness in young people, of the role of design in society and the value of design thinking skills in generating strategies to solve basic to complex systemic challenges, as well as to inspire post-secondary pathways and idea generation for education. The toolkit encourages students and teachers to develop sketching, making, communication, presentation and collaboration skills to improve their design process, as well as explore further inquiry (background research) to enhance the ideation exercises. Exercise 1 focuses on the ‘Inquire’ and ‘Ideate’ phases, Exercise 2 on the ‘Inquire’, Exercise 3 builds on ideation skills, and Exercise 4 concentrates on the ‘Implement’ phase. Depending on the intensity of the focus, the unit of work could be developed over a 2-5 week program (approximately 4-10 x 60 minute lessons/workshops) or as smaller workshops treated as discrete learning experiences. The toolkit is available for public download from http://designminds.org.au/tomorrows-classroom/ on the Design Minds website. This toolkit inspired the authorship and facilitation of a 2-day design workshop entitled Learning Environment 2050 at John Paul College, Daisy Hill, Brisbane on the 15-16 August 2013. 120 Grade 7 students and their teachers, under the mentorship of two design academics, 3 QUT design students and a professional architect, as part of a QUT School of Design Project Week community engagement activity, explored the formulation of a participatory design brief for the redesign of the school’s Wesley Precinct (including classrooms, a sustainable farm and recreation areas).

Turning points in narratives of research design : research innovation stimulating unique responses to existing challenges for beginning rural teachers

This paper explores methodological turning points in researching narratives of early career resilience mediated by the complexities of remote teaching. Innovative, flexible and discursive research design facilitated exploration of emerging narratives using digital technologies. Data were regularly interrogated with participant-researchers to reveal the undercurrents of imbued meaning. Dialogue with participant-researchers enhanced interpretations of data plots and text-based explanations of narrative turning points, providing valuable insights throughout analysis. Reflections on the affordances and tensions in this process illustrate the significance of innovation but also the complexities associated with online collaboration. Consequently, empowering the participant-researchers throughout the life of the research was critical in understanding their narratives of teaching.

Non-formal techniques for early assessment of design ideas for services

Designing systems for multiple stakeholders requires frequent collaboration with multiple stakeholders from the start. In many cases at least some stakeholders lack a professional habit of formal modeling. We report observations from student design teams as well as two case studies, respectively of a prototype for supporting creative communication to design objects, and of stakeholder-involvement in early design. In all observations and case studies we found that non-formal techniques supported strong collaboration resulting in deep understanding of early design ideas, of their value and of the feasibility of solutions.

A Triple Bottom Line Planning Tool for Measuring Sustainability : A Systems Approach to Sustainability Using the Australian Dairy Industry as a Case Study

Sustainability is a key driver for decisions in the management and future development of organisations and industries. However, quantifying and comparing sustainability across the triple bottom line (TBL) of economy, environment and social impact, has been problematic. There is a need for a tool which can measure the complex interactions within and between the environmental, economic and social systems which affect the sustainability of an industry in a transparent, consistent and comparable way. The authors acknowledge that there are currently numerous ways in which sustainability is measured and multiple methodologies in how these measurement tools were designed. The purpose of this book is to showcase how Bayesian network modelling can be used to identify and measure environmental, economic and social sustainability variables and to understand their impact on and interaction with each other. This book introduces the Sustainability Scorecard, and describes it through a case study on sustainability of the Australian dairy industry. This study was conducted in collaboration with the Australian dairy industry.

Promoting resilience and effective workplace functioning in international students in health courses

The purpose of this project was to improve the quality of the learning experiences of international students in nursing, public health and nutrition and dietetics, both at university and in the clinical setting. The university worked in partnership with three major metropolitan health care facilities/services in Queensland to develop a framework and resources designed to promote quality work-integrated learning experiences for international students and clinical supervisory staff. The Resilience in International Student Education (RISE) model consists of student and staff workshops complemented by a purpose-built Cultural Connections for Learning (CCL) website that provides access to a wide variety of information and other learning resources. Quantitative and qualitative evaluations indicate that the approach is highly valued by participants as it promotes useful dialogue, sharing of experiences and greater understanding regarding quality learning experiences for international students in the health workplace. It provides an ideal springboard for promoting collaboration between international students and clinical supervisors in the workplace. The resources developed have the potential to enhance student learning as well as clinical teaching. The challenge will be to achieve continued progress within international student education through the development of sustainable strategies to embed the program within the context of individual curricula.

The re-introduction project

The Re-introduction Project began with an art-science research residency in 2012, funded through the Australian 'Synapse' art-science residency program. It was developed in partnership with the Australian Wildlife Conservancy, Australia's largest private conservation agency and their South-East regional scientist Matt Hayward and conducted through a series of seven high intensity field-trips to AWC’s remote properties in VIC, NSW and SA. These trips coincided with key times at which the AWC’s mobile scientific teams were undertaking intensive scientific activities. The program coincided with specific events that senior scientist collaborator Dr Matt Hayward led in 2012 at Mallee Regions (Yookamurra, Scotia and Buckaringa), Lake Eyre Basin (Kalamurina) and Sydney (North Head). The initial outcome of the project was the work Pitfall (An Opportunistic Survey) - a new media installation created in light, media, object, text and sound presented near the AWC headquarters at Mildura in far NW Victoria. Pitfall built upon ideas and cross disciplinary processes developed during this residency/collaboration with Australian Wildlife Conservancy inspired by working with their ecological scientists during pitfall-trap survey events used to survey small mammals and invertebrates. ‘Pitfall’ was designed in response to a playful survey that I asked the AWC scientists to engage with around ideas of avoiding ecological pitfalls into the future. This continually-evolving artwork was built from multiple screens, a tabletop landscape mapped with projections, fibre optics, 3D spatial sound and infrared night imagery.

Lean construction, building information modelling and sustainability

This paper investigates the mutual relations of three current drivers of construction: lean construction, building information modelling and sustainability. These drivers are based on infrequently occurring changes, only incidentally simultaneous, in their respective domains. It is contended that the drivers are mutually supportive and thus synergistic. They are aligned in the sense that all require, promote or enable collaboration. It is argued that these three drivers should be implemented in a unified manner for rapid and robust improvements in construction industry performance and the quality of the constructed facilities and their benefits for stakeholders and wider society.

CIB White Paper on IDDS Integrated Design & Delivery Solutions

CIB is developing a priority theme, now termed Improving Construction and Use through Integrated Design & Delivery Solutions (IDDS). The IDDS working group for this theme adopted the following definition: Integrated Design and Delivery Solutions use collaborative work processes and enhanced skills, with integrated data, information, and knowledge management to minimize structural and process inefficiencies and to enhance the value delivered during design, build, and operation, and across projects. The design, construction, and commissioning sectors have been repeatedly analysed as inefficient and may or may not be quite as bad as portrayed; however, there is unquestionably significant scope for IDDS to improve the delivery of value to clients, stakeholders (including occupants), and society in general, simultaneously driving down cost and time to deliver operational constructed facilities. Although various initiatives developed from computer‐aided design and manufacturing technologies, lean construction, modularization, prefabrication and integrated project delivery are currently being adopted by some sectors and specialisations in construction; IDDS provides the vision for a more holistic future transformation. Successful use of IDDS requires improvements in work processes, technology, and people’s capabilities to span the entire construction lifecycle from conception through design, construction, commissioning, operation, refurbishment/ retrofit and recycling, and considering the building’s interaction with its environment. This vision extends beyond new buildings to encompass modifications and upgrades, particularly those aimed at improved local and area sustainability goals. IDDS will facilitate greater flexibility of design options, work packaging strategies and collaboration with suppliers and trades, which will be essential to meet evolving sustainability targets. As knowledge capture and reuse become prevalent, IDDS best practice should become the norm, rather than the exception.