Critical reflections on the use of participatory methodologies to build evaluation capacities in international development organisations

There has been a greater focus on strengthening evaluation capacity building (ECB) within development organisations in recent years. This can be attributed in part to the growing appreciation of the value of participatory and collaborative forms of evaluation. Evaluation is increasingly seen as an ongoing learning process and an important means of strengthening capacity and improving organisational performance (Horton et al., 2003:7). While there are many benefits of using participatory methodologies in ECB projects, our experiences and a review of the literature in this area highlight the many challenges, issues and contradictions that can affect the success of such ECB efforts. We discuss these issues, drawing on our learnings from the ongoing participatory action research (PAR) project 'Assessing Communication for Social Change’ (AC4SC). This four year project, which began in 2007, is a collaboration between communication and development academics and evaluation specialists from two Australian universities and communication for development practitioners and monitoring and evaluation (M&E) staff in the NGO Equal Access Nepal (EAN). The aim is to develop, implement, and evaluate a participatory methodology for assessing the social change impacts of community radio programs produced by EAN. It builds on previous projects that used ethnographic action research (EAR) methodology (Tacchi et al., 2007).

Living City 2013 Workshop

Living City 2013 Workshop, as part of a school term’s design-based curriculum connected to the KGSC/QUT Design Excellence Program and run from 11 February – 1 May, 2013, was essentially a three-day place-based urban design immersion workshop program for 25 Year 11 Visual Art and Design Students and 2 Teachers from Kelvin Grove State College (KGSC) held at both Queensland University of Technology (QUT) Gardens Point Campus and The Edge, State Library of Queensland. Mentored by 4 design professionals, 2 tertiary design academics, 2 public artists, and 12 QUT tertiary design students, the workshop explored youth-inspired public space design solutions for the active Brisbane City Council redevelopment site of Queens Wharf Road precinct. As well as the face-to-face workshops, for Living City 2013, an interactive web environment was introduced to enable students to connect with each other and program mentors throughout the course of the program. The workshop, framed within notions of ecological, economic, social and cultural sustainability, aimed to raise awareness of the layered complexity and perspectives involved in the design of shared city spaces and to encourage young people to voice their own concerns as future citizens about the shape and direction of their city. The program commenced with an introductory student briefing by stakeholders and mentors at KGSC on 11 February, an introduction to site appraisal and site visit held at QUT and Queens Wharf Road on 20 February, and a follow up site analysis session on 6 March. Day 1 Workshop on April 17 at the Edge, State Library of Queensland, as part of the Design Minds partnership (http://designminds.org.au/kelvin-grove-state-college-excellence-in-art-design/), focused on mentoring team development of a concept design for a range of selected sites. Two workshops on April 22 and 23 at QUT, to develop these designs and presentation schemes, followed this. The workshop program culminated in a visual presentation of concept design ideas and discussion with a public audience in the Ideas Gallery on The Deck, King George Square during the Brisbane City Council City Centre Master Plan Ideas Fiesta on 1 May, 2013, as referenced in the Ideas Fiesta Wrap-up Report (http://www.brisbane.qld.gov.au/planning-building/planning-guidelines-tools/city-centre-master-plan/city-centre-master-plan-ideas-fiesta). Students were introduced to design methodology, team thinking strategies, the scope of design practices and professions, presentation skills and post-secondary pathways, while participating teachers acquired content and design learning strategies transferable in many other contexts. The program was fully documented on the Living City website (http://www.livingcity.net.au/LC2013x/index.html) and has been recognised by the Brisbane City Council Youth Strategy 2014-2019 as a best practice model for making Brisbane a well-designed, subtropical city.

Design Minds Tomorrow's Classroom Toolkit

The Design Minds Tomorrow’s Classroom Toolkit was one of six K7-12 secondary school design toolkits commissioned by the State Library of Queensland (SLQ) Asia Pacific Design Library (APDL), to facilitate the delivery of the Stage 1 launch of its Design Minds online platform (www.designminds.org.au) partnership initiative with Queensland Government Arts Queensland and the Smithsonian Cooper-Hewitt National Design Museum, on June 29, 2012. Design Minds toolkits are practical guides, underpinned by a combination of one to three of the Design Minds model phases of ‘Inquire’, ‘Ideate’ and ‘Implement’ (supported by at each stage with structured reflection), to enhance existing school curriculum and empower students with real life design exercises, within the classroom environment. Toolkits directly identify links to Naplan, National Curriculum, C2C and Professional Standards benchmarks, as well as the student capabilities of successful and creative 21st century citizens they seek to engender through design thinking. This toolkit explores, through four distinct exercises, different design tools and ways to approach the future design of environments (classrooms/schools) to facilitate the Reggio Emilia philosophy of learning, while addressing diverse and changing social, cultural, technological and environmental challenges. The Design Minds Tomorrow’s Classroom Toolkit encourages students to explore architecture and interior design, and to think about their (life-long) learning as a product of inspiring interactions with people and the environments around them, and that their potential role in contributing to both delightful and functional design solutions requires a deep understanding of the user experience. More generally, it aims to facilitate awareness in young people, of the role of design in society and the value of design thinking skills in generating strategies to solve basic to complex systemic challenges, as well as to inspire post-secondary pathways and idea generation for education. The toolkit encourages students and teachers to develop sketching, making, communication, presentation and collaboration skills to improve their design process, as well as explore further inquiry (background research) to enhance the ideation exercises. Exercise 1 focuses on the ‘Inquire’ and ‘Ideate’ phases, Exercise 2 on the ‘Inquire’, Exercise 3 builds on ideation skills, and Exercise 4 concentrates on the ‘Implement’ phase. Depending on the intensity of the focus, the unit of work could be developed over a 2-5 week program (approximately 4-10 x 60 minute lessons/workshops) or as smaller workshops treated as discrete learning experiences. The toolkit is available for public download from http://designminds.org.au/tomorrows-classroom/ on the Design Minds website. This toolkit inspired the authorship and facilitation of a 2-day design workshop entitled Learning Environment 2050 at John Paul College, Daisy Hill, Brisbane on the 15-16 August 2013. 120 Grade 7 students and their teachers, under the mentorship of two design academics, 3 QUT design students and a professional architect, as part of a QUT School of Design Project Week community engagement activity, explored the formulation of a participatory design brief for the redesign of the school’s Wesley Precinct (including classrooms, a sustainable farm and recreation areas).

Developing learning cohorts for postgraduate research degrees

Development of researchers through higher degree research studies is a high priority in most universities. Yet, research about supervision as pedagogy and models of supervision is only recently gained increasing attention. Charged with producing good researchers within very limited resources, academics are constantly looking for more efficient models of supervision for higher degree research students. A cohort model of supervision promises several efficiencies, but we argue that its success lies importantly on how well the cohort is developed specifically for higher degree research studies. We drew on a growing body of literature on higher degree research supervision to design, implement and evaluate our approach to developing a cohort of seven students enrolled in the Master of Education (Research) degree. Our approach included four provisions: initial residential workshop, development of a learning community, nourishing scholarship, and ongoing learning opportunities. The four provisions resulted in gradually developing an environment and culture that students found very supportive and nurturing. This paper is based on the findings from data collected from student evaluations in the first year of studies, feedback from the cohort’s sponsor, and our reflective notes. The evaluation substantiated the value in investing time and resources for purposely developing a cohort for higher degree research studies. Whether the cohorts are sponsored or not, universities will still need to invest time and resources for cohort development if a cohort model is intended to gain wider efficiencies in supervision of higher degree research students.

Beyond online preprints : formalization of open initiatives in China

A growing number of online journals and academic platforms are adopting light peer review or 'publish then filter' models of scholarly communication. These approaches have the advantage of enabling instant exchanges of knowledge between academics and are part of a wider search for alternatives to traditional peer review and certification processes in scholarly publishing. However, establishing credibility and identifying the correct balance between communication and scholarly rigour remains an important challenge for digital communication platforms targeting academic communities. This paper looks at a highly influential, government-backed, open publishing platform in China: Science Paper Online, which is using transparent post-publication peer-review processes to encourage innovation and address systemic problems in China's traditional academic publishing system. There can be little doubt that the Chinese academic publishing landscape differs in important ways from counterparts in the United States and Western Europe. However, this article suggests that developments in China also provide important lessons about the potential of digital technology and government policy to facilitate a large-scale shift towards more open and networked models of scholarly communication.

Reframe : QUT's evaluation framework survey business rules

Reframe is changing our approach to the evaluation of courses, units, teaching and student experience at QUT. We are moving away from a single survey tool to a richer, more holistic and customisable approach. This approach will help our academics design and deliver high-quality learning experiences, and review the impact of their teaching practice on student learning. Through it, we will also be able to provide more timely access to specialised support and meet external reporting requirements.

Amateur Media : Social, Cultural and Legal Perspectives

The rise of Web 2.0 has pushed the amateur to the forefront of public discourse, public policy and media scholarship. Typically non-salaried, non-specialist and untrained in media production, amateur producers are now seen as key drivers of the creative economy. But how do the activities of citizen journalists, fan fiction writers and bedroom musicians connect with longer traditions of extra-institutional media production? This edited collection provides a much-needed interdisciplinary contextualisation of amateur media before and after Web 2.0. Surveying the institutional, economic and legal construction of the amateur media producer via a series of case studies, it features contributions from experts in the fields of law, economics and media studies based in the UK, Europe and Singapore. Each section of the book contains a detailed case study on a selected topic, followed by two further pieces providing additional analysis and commentary. Using an extraordinary array of case studies and examples, from YouTube to online games, from subtitling communities to reality TV, the book is neither a celebration of amateur production nor a denunciation of the demise of professional media industries. Rather, this book presents a critical dialogue across law and the humanities, exploring the dynamic tensions and interdependencies between amateur and professional creative production. This book will appeal to both academics and students of intellectual property and media law, as well as to scholars and students of economics, media, cultural and internet studies.

Implementing lean in construction: Lean construction and BIM-CIRIA Guide C725

Building Information Modelling (BIM) and Lean construction have existed as two different initiatives to improve construction, with distinct communities and interests. In the last 10 years or so, both have started to diffuse into advanced practice, with accelerating speed. However, recently the insight has gained strength, first among pioneering practitioners and then among academics, that these two initiatives have a considerable mutual synergy and that it is highly advantageous to implement them jointly. In view of this, there are increasing needs to make BIM champions and users aware of Lean principles, methods and tools, as well as Lean champions and implementers aware of the functionalities of BIM. This guide is intended to provide a means to fulfill these needs.

Beyond BIM: It’s not the end of the road!

Over several decades, academics around the world have investigated the necessary tools, techniques, and conditions which would allow BIM (building information modeling) to become a positive force in the world of construction. As the research results matured, BIM started to become commercially available. Researchers and many in industry soon realized that BIM, as a technological innovation, was, in and of itself, not the end point in the journey. The technical adoption of BIM has to be supported by process and culture change within organizations to make a real impact on a project (for example, see AECbytes Viewpoint #35 by Chuck Eastman, Paul Teicholz, Rafael Sacks and Kathleen Liston). Current academic research aims to understand the steps beyond BIM, which will help chart the future of our industry over the coming decades. This article describes an international research effort in this area, coordinated by the Integrated Design and Delivery Solutions (IDDS) initiative of the CIB (International Council for Research and Innovation in Building and Construction). We hope that it responds to and extends the discussion initiated by Brian Lighthart in AECbytes Viewpoint #56, which asked about who is charting future BIM directions.

Teaching and assessing ethics and social responsibility in undergraduate science : a position paper

Institutional graduate capabilities and discipline threshold learning outcomes require science students to demonstrate ethical conduct and social responsibility. However, neither the teaching nor the assessment of these concepts is straightforward. Australian chemistry academics participated in a workshop in 2013 to discuss and develop teaching and assessment in these areas and this paper reports on the outcomes of that workshop. Controversial issues discussed included: How broad is the mandate of the teacher, how should the boundaries between personal values and ethics be drawn, and how can ethics be assessed without moral judgement? In this position paper, I argue for a deep engagement with ethics and social justice, achieved through case studies and assessed against criteria that require discussion and debate. Strategies to effectively assess science students’ understanding of ethics and social responsibility are detailed.

Gender, sexuality, and rurality in the mining industry

Sexuality is a subject that has been, at best, marginal in the significant body of literature that has examined gender and mining in contemporary Western nations. This is despite the fact that academics have circled, if not almost bumped into the topic in closely related discussions of hegemonic masculinity and mining work, and of patriarchal familial relations and mining communities. This scholarship has documented what has been and remains women’s primary relationship to mining—that is, as a “mining wife.” How patriarchal relations are manifest in and emerge from this state of affairs has been critiqued with research on the gendered implications of housing arrangements in mining towns, the division of household labor, changing shift-work mining rosters, and the gendered consequences of strikes and mine closures (Williams 1981; Gibson 1992; Gibson-Graham 1996; Rhodes 2005; McDonald, Mayes, and Pini 2012). Despite the centrality of the heterosexual relationship—and indeed heteronormativity—to these discussions, scholars of gender and mining have had little to say on the subject of sexuality. In response to this lacuna, this chapter takes an exploratory lens to the subject of sexuality and the mining industry. We approach the task from the perspective that the mining industry is gendered as masculine. That is, definitions of mining mobilize around masculinized notions of physicality, technical competence with machinery, and strength, as well as emphasize the harshness and dirtiness of the work (Mayes and Pini 2010).

Why we should not cut P.E.

Thinking of cutting physical education? Think again. Even as we bemoan children's sedentary lifestyles, we often sacrifice school-based physical education in the name of providing more time for academics. In 2006, only 3.8 percent of elementary schools, 7.9 percent of middle schools, and 2.1 percent of high schools offered students daily physical education or its equivalent for the entire school year (Lee, Burgeson, Fulton, & Spain, 2007). We believe this marked reduction in school-based physical activity risks students' health and can't be justified on educational or ethical grounds. We'll get to the educational grounds in a moment. As to ethical reasons for keeping physical activity part of our young people's school days, consider the fact that childhood obesity is now one of the most serious health issues facing U.S. children (Ogden et al., 2006). School-based physical education programs engage students in regular physical activity and help them acquire skills and habits necessary to pursue an active lifestyle. Such programs are directly relevant to preventing obesity. Yet they are increasingly on the chopping block.

Engagement as dialogue : presenting a pragmatic perspective

‘Engagement’ is one of the buzzwords of 21st century public relations theory and practice. Yet the concept of engagement remains frustratingly nebulous and intangible, lacking clear definition and consistent use. This paper suggests that the concept of dialogue can provide public relations practitioners and academics with a framework for defining engagement that allows deep insights into the range of ideas and contexts it covers. Specifically, this paper argues for the use of a pragmatic practitioner perspective on dialogue as a lens through which to study engagement. Current literature clearly articulates the normative and prescriptive perspectives on dialogue in public relations, but leaves the story of the reality of the practitioner experience of dialogue largely untold. New research tells this ‘missing’ story of the practitioner perspective on dialogue, which in turn offers some insights into the forms and functions of engagement in practice. Dialogue is seen as encompassing three different types of public relations practice: informing stakeholders of organisational decisions and receiving their feedback; consulting with stakeholders on the strategies and tactics used by organisations to achieve their chosen goals; and including stakeholder input in the making of decisions on what organisational goals should be. Adopting this pragmatic practitioner perspective on dialogue to view engagement provides scaffolding that is strong enough to encourage development of a consistent definition of its meaning; while still allowing the freedom and scope necessary to develop deep and rich understanding of the phenomenon.

The 3rd Knowledge Cities World Summit Proceedings

FROM KCWS 2010 Ch airs and Summit Proceeding Ed ito rs ‘Knowledge’ is a resource, which relies on the past for a better future. In the 21st century, more than ever before, cities around the world depend on the knowledge of their citizens, their institutions and their firms and enterprises. The knowledge image, the human competence and the reputation of their public and private institutions and corporations profiles a city. It attracts investment, qualified labour and professionals, as well as students and researchers. And it creates local life spaces and professional milieus, which offer the quality of life to the citizens that are seeking to cope with the challenges of modern life in a competitive world. Integrating knowledge-based development in urban strategies and policies, beyond the provision of schools and locations for higher education, has become a new ambitious arena of city politics. Coming from theory to practice, and bringing together the manifold knowledge stakeholders in a city and preparing joint visions for the knowledge city is a new challenge for city managers, urban planners and leaders of the civic society . It requires visionary power, creativity, holistic thinking, the willingness to cooperate with all groups of the local civil society, and the capability to moderate communication processes to overcome conflicts and to develop joint action for a sustainable future. This timely Melbourne 2010 – The Third Knowledge City World Summit makes an important reminder that ‘knowledge’ is the key notion in the 21st Century development. Considering this notion, the summit aims to shed light on the multi-faceted dimensions and various scales of building the ‘knowledge city’ and on ‘knowledge-based development’ paradigms. At this summit, the theoretical and practical maturing of knowledge-based development paradigms will be advanced through the interplay between the world’s leading academic’s theories and the practical models and strategies of practitioners’ and policy makers’ drawn from around the world. As chairs of The Melbourne 2010 Summit, we have compiled this summit proceeding in order to disseminate the knowledge generated and shared in Melbourne with the wider research, governance, and practice communities. The papers in the proceedings reflect the broad range of contributions to the summit. They report on recent developments in planning and managing knowledge cities and ICT infrastructure, they assess the role of knowledge institutions in regional innovation systems and of the intellectual capital of cities and regions; they describe the evolution of knowledge-based approaches to urban development in differing cultural environments; they finally bridge the discourse on the knowledge city to other urban development paradigms such as the creative city, the ubiquitous city or the compact city. The diversity of papers presented shows how different scholars from planning cultures around the world interpret the knowledge dimension in urban and regional development. All papers of this proceeding have gone through a double-blind peer review process and been reviewed by our summit editorial review and advisory board members. We cordially thank the members of the Summit Proceeding Editorial Review and Advisory Board for their diligent work in the review of the papers. We hope the papers in this proceeding will inspire and make a significant contribution to the research, governance, and practice circles.

The 4th Knowledge Cities World Summit Proceedings

FROM KCWS 2011 CHAIRS AND SUMMIT PROCEEDING EDITORS In recent years, with the impact of global knowledge economy, a more comprehensive development approach has gained significant popularity. This new development approach, so called ‘knowledgebased development’, is different from its traditional predecessor. With a much more balanced focus on all of the four key development domains – economic, enviro-urban, institutional, and sociocultural – this contemporary approach, aims to bring economic prosperity, environmental sustainability and local institutional competence with a just socio-spatial order to our cities and regions. The ultimate goal of knowledge-based development is to produce a city purposefully designed to encourage the continuous production, circulation and commercialisation of social and scientific knowledge – this will in turn establish a ‘knowledge city’. A city following the ‘knowledge city’ concept embarks on a strategic mission to firmly encourage and nurture locally focussed innovation, science and creativity within the context of an expanding knowledge economy and society. In this regard a ‘knowledge city’ can be seen as an integrated city, which physically and institutionally combines the functions of a science and technology park with civic and residential functions and urban amenities. It also offers one of the effective paradigms for the sustainable cities of our time. This fourth edition of KCWS – The 4th Knowledge Cities World Summit 2011 – makes an important reminder that the 'knowledge city' concept is a key notion in the 21st Century development. Considering this notion, the Summit sheds light on the multi-faceted dimensions and various scales of building a ‘knowledge city’ via 'knowledge-based development' paradigm by particularly focusing on the overall Summit theme of ‘Knowledge Cities for Future Generations’. At this summit, the theoretical and practical maturing of knowledge-based development paradigms are advanced through the interplay between the world’s leading academics’ theories and the practical models and strategies of practitioners’ and policy makers’ drawn from around the world. This summit proceeding is compiled in order to disseminate the knowledge generated and shared in KCWS 2011 with the wider research, governance, and practice communities the knowledge cocreated in this summit. All papers of this proceeding have gone through a double-blind peer review process and been reviewed by our summit editorial review and advisory board members. We, organisers of the summit, cordially thank the members of the Summit Proceeding Editorial Review and Advisory Board for their diligent work in the review of the papers. We hope the papers in this proceeding will inspire and make a significant contribution to the research, governance, and practice circles.