Exploring the Possibilities and Methodological Challenges of Evaluation Practice : A Democratic Question

In our exploration of the methodological possibilities and challenges of evaluation practice that foregrounds a democratic approach, we argue that having sensitivity to participants’ different positions, ideological perspectives, and values, and an understanding of the existing power relationships are paramount for the evaluators if the evaluation is to achieve its goals. This chapter draws on our experiences as evaluators in Australia, where school leaders and teachers are currently experiencing significant curriculum and assessment changes, and now work in a context of heightened accountability. Our evaluation practices with schools are used to illustrate how democratic practices can be incorporated into evaluation in ways that provide opportunities and support for school self-evaluation. It is paramount to recognise that evaluation is a political and ideological practice, and therefore is not a neutral process. Our argument is that it remains the responsibility of evaluators to design spaces that build sustainable relationships with participants and the targets of the programmes being evaluated; ensure that dialogue and deliberation are valued between all stakeholders; represent a range of interests; and give a service back to the evaluated communities by offering understandings and promoting reflective practice and informed decision-making throughout programme implementation.

Academic Development Program : QUT University Wide

The QUT Sessional Academic Program (SAP) has scaffolded levels, each with experience-appropriate objectives: • SAP 1: Introduction to Learning and Teaching aims to develop confidence and build awareness of pedagogy and managing class-room scenarios. • SAP 2: Learning and Teaching in Large Units focuses on aligning curriculum and assessment through learning activities and builds a community of teaching practice with sessionals and subject coordinators. • SAP 3: Developing your Teaching Practice focuses on whole of university and classroom strategies to ensure student success through effective feedback; reflective practice and learning communities. • SAP 4: Enhancing your Teaching Practice applies these factors to teaching success. In conjunction with: • Sessional Career Advancement Development: for Higher Degree Research students/ sessional staff who aspire to become academics provides guidance on developing an academic portfolio in teaching, research and service. And • Sessional Academic Success program providing ongoing, local support (see separate nomination). A critical factor in its success is its praxis approach. Theoretical principles are modelled. Eg, ‘active learning’ is explained and modelled through learning activities, which participants evaluate ‘on the fly’ against the criteria of learning, engagement and connection with peers. The topics ‘learning communities’ and ‘reflective practice’ are explored as a learning community–then applied in participants’ classes, with reflections shared in the next session. This produces a ‘meta-awareness’ of theory and principles, as they are explained, applied in practice, and critically analysed for their effectiveness in workshops.

Theorizing why in e-learning – a frontier for cognitive engagement

Asking why is an important foundation of inquiry and fundamental to the development of reasoning skills and learning. Despite this, and despite the relentless and often disruptive nature of innovations in information and communications technology (ICT), sophisticated tools that directly support this basic act of learning appear to be undeveloped, not yet recognized, or in the very early stages of development. Why is this so? To this question, there is no single satisfactory answer; instead, numerous plausible explanations and related questions arise. After learning something, however, explaining why can be revealing of a person’s understanding (or lack of it). What then differentiates explanation from information; and, explanatory from descriptive content? What ICT scaffolding might support inquiry instigated by why-questioning? What is the role of reflective practice in inquiry-based learning? These and other questions have emerged from this investigation and underscore that why-questions often propagate further questions and are a catalyst for cognitive engagement and dialogue. This paper reports on a multi-disciplinary, theoretical investigation that informs the broad discourse on e-learning and points to a specific frontier for design and development of e-learning tools. Probing why reveals that versatile and ambiguous semantics present the core challenge – asking, learning, knowing, understanding, and explaining why.

The art of co-creative media : an Australian survey

This article describes how - in the processes of responding to participatory storytelling practices - community, public service, and to a lesser extent, commercial media institutions are themselves negotiated and changed. Although there are significant variations in the conditions, durability, extent, motivations and quality of these developments and their impacts, they nonetheless increase the possibilities and pathways of participatory media culture. This description first frames digital storytelling as a ‘co-creative’ media practice. It then discusses the role of community arts and cultural development (CACD) practitioners and networks as co-creative media intermediaries, and then considers their influence in Australian broadcast and Internet media. It looks at how participatory storytelling methods are evolving in the Australian context and explores some of the implications for cultural inclusion arising from a shared interest in ‘co-creative’ media methods and approaches.

WATER - a series of photographs by Louise Grayson

This body of photographic work has been created to firstly, explore a new approach to practice-led research that uses an “action genre” approach to reflective practice (Lemke) and secondly, to visually explore human interaction with the fundamental item in life - water. The first of these is based on the contention that to understand the meanings inherent in photographs we cannot look merely at the end result. It is essential to keep looking at the actions of practitioners, and the influences upon them, to determine how external influences affect the meaning potential of editorial photographs (Grayson, 2012). WATER therefore, provides an ideal platform to reflect upon the actions and influences involved in creating work within the photographic genre of photojournalism. It enables this practitioner to reflect on each stage of production to gain a better understanding of how external influences impact the narrative potential within images created. There are multi-faceted influences experienced by photographers who are creating images that, in turn, are part of constructing and presenting the narrative potential of editorial photographs. There is an important relationship between professional photographers and the technical, cultural, economic and institutional forces that impinge upon all stages of production and publication. What results is a greater understanding of technical, cultural, economic and institutional forces that impinge upon all stages of production and publication. Therefore, to understand the meanings inherent in photographs within WATER, I do not look merely at the end result. It provides a case study looking at my actions in the filed, and the influences upon me, to determine how external influences affect the meaning potential of these photographs (Grayson, 2012). As a result, this project adds to the body of scholarship around the definition of Photojournalism, how it has adapted to the current media environment and provides scope for further research into emerging new genres within editorial photography, such as citizen photojournalism. Concurrently, the photographs themselves were created to visually explore how there remains a humanistic desire to interact with the natural form of water even while living a modern cosmopolitan life around it. Taking a photojournalistic approach to exploring this phenomenon, the images were created by “capturing moments as they happened” with no posing or setting up of images. This serendipitous approach to the photographic medium provides the practitioner with at least an attempt to direct the subjectivity contained explicitly in photographs. What results is a series of images that extend the visual dialogue around the role of water within modern humanistic lifestyles and how it remains an integral part of our society’s behaviors. It captures important moments that document this relationship at this time of modern development. The resulting works were exhibited and published as part of the Head On Photo Festival, Australia's largest photo festival and the world's second largest festival in Sydney 20-24 May 2013. The WATER series of images were curated by three Magnum members; Ian Berry, Eli Reed and Chris Steele-Perkins. Magnum is a highly regarded international photographic co-operative with editorial offices in New York, London, Paris and Tokyo. There was a projection of the works as part of the official festival programme, presented to both members of the public and Sydney’s photography professionals. In addition, a sample of images from the WATER series was chosen for inclusion in the Magnum-published hardcover book. References Grayson, Louise. 2012. “Editorial photographs and patterns of practice.” Journalism Practice. Accessed: http://www.tandfonline.com/doi/abs/10.1080/17512786.2012.726836#.UbZN-L--1RQ Lemke, Jay. 1995. Textual Politics: Discourse and Social Dynamics. London: Taylor & Francis.

Professional conversations : a collaborative approach to support policy implementation, professional learning and practice change in ECEC

In 2012, Australia introduced a new National Quality Framework, comprising enhanced quality expectations for early childhood education and care services, two national learning frameworks and a new Assessment and Rating System spanning child care centres, kindergartens and preschools, family day care and outside school hours care. This is the linchpin in a series of education reforms designed to support increased access to higher quality early childhood education and care (ECEC) and successful transition to school. As with any policy change, success in real terms relies upon building shared understanding and the capacity of educators to apply new knowledge and to support change and improved practice within their service. With this in mind, a collaborative research project investigated the efficacy of a new approach to professional learning in ECEC: the professional conversation. This paper reports on the trial and evaluation of a series of professional conversations to support implementation of one element of the NQF, the Early Years Learning Framework (DEEWR,2009), and their capacity to promote collaborative reflective practice, shared understanding, and improved practice in ECEC. Set against the backdrop of the NQF, this paper details the professional conversation approach, key challenges and critical success factors, and the learning outcomes for conversation participants. Findings support the efficacy of this approach to professional learning in ECEC, and its capacity to support policy reform and practice change in ECEC.

Advancing practice in critical care : a model of knowledge integration

Aim The aim of this paper was to discuss the potential development of a conceptual model of knowledge integration pertinent to critical care nursing practice. A review of the literature identified that reflective practice appeared to be at the forefront of professional development. Background It could be argued that advancing practice in critical care has been superseded by the advanced practice agenda. Some would suggest that advancing practice is focused on the core attributes of an individual’s practice, which then leads onto advanced practice status. However, advancing practice is more of a process than identifiable skills and as such is often negated when viewing the development of practitioners to the advanced practice level. For example, practice development initiatives can be seen as advancing practice for the masses, which ensures that practitioners are following the same level and practice of care. The question here is, are they developing individually? Relevance to clinical practice What this paper presents is that reflection may not be best suited to advancing practice if the individual practitioner does not have a sound knowledge base both theoretically and experientially. The knowledge integration model presented in this study uses multiple learning strategies that are focused in practice to develop practice, e.g. the use of work-based learning and clinical supervision. To demonstrate the models application, an exemplar of an issue from practice shows its relevance from a practical perspective. Conclusions In conclusion, further knowledge acquisition and its relationship with previously held theory and experience will enable individual practitioners to advance their own practice as well as being a resource for others.

Refining a teaching pattern: Reflection around artefacts

This book is about understanding the nature and application of reflection in higher education. It provides a theoretical model to guide the implementation of reflective learning and reflective practice across multiple disciplines and international contexts in higher education. The book presents research into the ways in which reflection is both considered and implemented in different ways across different professional disciplines, while maintaining a common purpose to transform and improve learning and/or practice. Chapter 13 'Refining a Teaching Pattern: Reflection Around Artefacts' explores reflective practices of an artefact, in this case fashion design garment samples.

Staging childhoods : experiments in authentic theatre making practice with children

This practice-led PhD project investigates the ways in which society positions children through a broad set of social, cultural and historical considerations and examines these within the frame of theatre making. The study proposes a model of practice that moves beyond participant empowerment toward a more dynamic understanding of the creative process that sees adults and children working together to create mainstream artistic product. It contends that this model creates conditions conducive to authentic theatre making practice with children as evidenced in the researcher’s original performance work Joy Fear and Poetry.

Lived experience and devised theatre practice : a study of Australian and Norwegian theatre students' devised theatrical practice

This study explores the incorporation of young people's lived experience upon the creative dynamics in the development of devised performance practice. By employing Vygotsky's creativity theory to devising processes the role of lived experience is analyzed through three case studies located in two theatre education colleges in Norway and Australia. The study demonstrates how young peoples' life experience is a primary resource that is developed and reasoned upon in the creative performance practice. A key finding of the study is the identification of two distinct type of performance outcome in devised theatre practice, described as "livsbasert/life-based" and "egenskapt/self-made" that will enable devised theatre to have a more nuanced understanding of both process and product in the Nordic context.

The ethics, aesthetics and practical politics of ownership in co-creative media

What is ‘best practice’ when it comes to managing intellectual property rights in participatory media content? As commercial media and entertainment business models have increasingly come to rely upon the networked productivity of end-users (Banks and Humphreys 2008) this question has been framed as a problem of creative labour made all the more precarious by changing employment patterns and work cultures of knowledge-intensive societies and globalising economies (Banks, Gill and Taylor 2014). This paper considers how the problems of ownership are addressed in non-commercial, community-based arts and media contexts. Problems of labour are also manifest in these contexts (for example, reliance on volunteer labour and uncertain economic reward for creative excellence). Nonetheless, managing intellectual property rights in collaborative creative works that are created in community media and arts contexts is no less challenging or complex than in commercial contexts. This paper takes as its focus a particular participatory media practice known as ‘digital storytelling’. The digital storytelling method, formalised by the Centre for Digital Storytelling (CDS) from the mid-1990s, has been internationally adopted and adapted for use in an open-ended variety of community arts, education, health and allied services settings (Hartley and McWilliam 2009; Lambert 2013; Lundby 2008; Thumin 2012). It provides a useful point of departure for thinking about a range of collaborative media production practices that seek to address participation ‘gaps’ (Jenkins 2006). However the outputs of these activities, including digital stories, cannot be fully understood or accurately described as user-generated content. For this reason, digital storytelling is taken here to belong to a category of participatory media activity that has been described as ‘co-creative’ media (Spurgeon 2013) in order to improve understanding of the conditions of mediated and mediatized participation (Couldry 2008). This paper reports on a survey of the actual copyrighting practices of cultural institutions and community-based media arts practitioners that work with digital storytelling and similar participatory content creation methods. This survey finds that although there is a preference for Creative Commons licensing a great variety of approaches are taken to managing intellectual property rights in co-creative media. These range from the use of Creative Commons licences (for example, Lambert 2013, p.193) to retention of full copyrights by storytellers, to retention of certain rights by facilitating organisations (for example, broadcast rights by community radio stations and public service broadcasters), and a range of other shared rights arrangements between professional creative practitioners, the individual storytellers and communities with which they collaborate, media outlets, exhibitors and funders. This paper also considers how aesthetic and ethical considerations shape responses to questions of intellectual property rights in community media arts contexts. For example, embedded in the CDS digital storytelling method is ‘a critique of power and the numerous ways that rank is unconsciously expressed in engagements between classes, races and gender’ (Lambert 117). The CDS method privileges the interests of the storyteller and, through a transformative workshop process, aims to generate original individual stories that, in turn, reflect self-awareness of ‘how much the way we live is scripted by history, by social and cultural norms, by our own unique journey through a contradictory, and at times hostile, world’ (Lambert 118). Such a critical approach is characteristic of co-creative media practices. It extends to a heightened awareness of the risks of ‘story theft’ and the challenges of ownership and informs ideas of ‘best practice’ amongst creative practitioners, teaching artists and community media producers, along with commitments to achieving equitable solutions for all participants in co-creative media practice (for example, Lyons-Reid and Kuddell nd.). Yet, there is surprisingly little written about the challenges of managing intellectual property produced in co-creative media activities. A dialogic sense of ownership in stories has been identified as an indicator of successful digital storytelling practice (Hayes and Matusov 2005) and is helpful to grounding the more abstract claims of empowerment for social participation that are associated with co-creative methods. Contrary to the ‘change from below’ philosophy that underpins much thinking about co-creative media, however, discussions of intellectual property usually focus on how methods such as digital storytelling contribute to the formation of copyright law-compliant subjects, particularly when used in educational settings (for example, Ohler nd.). This also exposes the reliance of co-creative methods on the creative assets storytellers (rather than on the copyrighted materials of the media cultures of storytellers) as a pragmatic response to the constraints that intellectual property right laws impose on the entire category of participatory media. At the level of practical politics, it also becomes apparent that co-creative media practitioners and storytellers located in copyright jurisdictions governed by ‘fair use’ principles have much greater creative flexibility than those located in jurisdictions governed by ‘fair dealing’ principles.

Pedagogy of Desire

Despite major inroads in demystifying creativity for the non-design disciplines, there has been little movement in the design disciplines themselves beyond traditional paradigms. This is particularly noticeable in design education where traditional pedagogical approaches persist despite the emergence of new experimental pedagogies. In response, this research aims to explore what a pedagogy of desire can offer and what this means in terms of curriculum development; learning environments; teaching approaches and staff development. Specifically, it seeks to: understand more fully the notion of desire and how students’ and teachers’ desires can be exploited in creative and productive ways; to further explore the relationship between risk (through experiencing uncertainties and anxieties) and pleasure (through assuming the subversive position of knowing); to identify and explore how to negotiate personal, professional and organisational implications; and to develop appropriate evaluation mechanisms.

'Women on a Wiki’ : the role of interactive websites in reflective learning practices for undergraduate women’s health students

Aim Our pedagogical research addressed the following research questions: 1) Can shared ‘cyber spaces’, such as a ‘wiki’, be occupied by undergraduate women’s health students to improve their critical thinking skills? 2) What are the learning processes via which this occurs? 3) What are the implications of this assessment trial for achieving learning objectives and outcomes in future public health undergraduate courses? Methods The students contributed written, critical reflections (approximately 250 words) to the Wiki each week following the lecture. Students reflected on a range of topics including the portrayal of women in the media, femininity, gender inequality, child bearing and rearing, domestic violence, mental health, Indigenous women, older women, and LGBTIQ communities. Their entries were anonymous, but visible to their peers. Each wiki entry contained a ‘discussion tab’ wherein online conversations were initiated. We used a social constructivist approach to grounded theory to analyse the 480 entries posted over the semester. (http://pub336womenshealth.wikispaces.com/) Results The social constructivist approach initiated by Vygotsky (1978) and further developed by Jonasson (1994) was used to analyse the students’ contributions in relation to four key thematic outcomes including: 1) Complexities in representations across contexts; 2) Critical evaluation in real world scenarios; 3) Reflective practice based on experience, and; 4) Collaborative co-construction of knowledge. Both text and image/visual contributions are provided as examples within each of these learning processes. A theoretical model depicting the interactive learning processes that occurred via discussion of the textual and visual stimulus is presented.

The use of multimodal technologies to enhance reflective writing in teacher education

For preservice teachers new to the teaching profession, reflective practice can be a difficult process. Yet reflective writing, once mastered, has the capacity to support preservice teachers to make connections between teaching theory and professional practice, and to start to take control of their own professional learning journey. The reflective practice described in this chapter was scaffolded through a framework for writing, the use of annotated work samples and explicit teaching. This approach was enhanced through multimodal resources including written peer assessment, audio teacher feedback and a video recording of the class presentation. The video footage assisted the preservice teachers to reconcile the feedback that they received from multiple sources. This chapter describes and analyses the implementation of the PRT Pattern (Prompting Reflection using Technology). Results of this practice revealed that the multiple forms of feedback assisted the preservice teachers to analyse their performance in terms of their developing professional identity and practice.