Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Solo life to Second Life : the design of physical and virtual learning spaces inspired by the drama classroom

This paper explores the design of virtual and physical learning spaces developed for students of drama and theatre studies. What can we learn from the traditional drama workshop that will inform the design of drama and theatre spaces created in technology-mediated learning environments? The authors examine four examples of spaces created for online, distance and on-campus students and discuss the relationship between the choice of technology, the learning and teaching methods, and the outcomes for student engagement. Combining insights from two previous action research projects, the discussion focuses on the physical space used for contemporary drama workshops, supplemented by Web 2.0 technologies; a modular online theatre studies course; the blogging space of students creating a group devised play; and the open and immersive world of Second Life, where students explore 3D simulations of historical theatre sites. The authors argue that the drama workshop can be used as inspiration for the design of successful online classrooms. This is achieved by focusing on students’ contributions to the learning as individuals and group members, the aesthetics and mise-en-scene of the learning space, and the role of mobile and networked technologies. Students in this environment increase their capacity to become co-creators of knowledge and to achieve creative outcomes. The drama workshop space in its physical and virtual forms is seen as a model for classrooms in other disciplines, where dynamic, creative and collaborative spaces are required.

Beyond knowledge : an insight into the practice of a learning support teacher

Increasingly, schools are being asked to meet the challenges of providing inclusive classrooms for all children. Inclusion is no longer about special education for a special group of students. It is about school improvement in order to bring about the changes that are needed to classroom practices to ensure the improvement of student learning outcomes. Inclusion is no longer a policy initiative. Rather it has been transformed to become a process that moves a school towards inclusive practices that will result in school improvement, heightened student learning outcomes and greater opportunities for all students to gain equal access to education. This study focuses on the challenge of diversity as it translates into implementing inclusive practices across two secondary school contexts. I have undertaken this research in my role as a Learning Support Teacher over a period of five years. Central to my research is a constructivist ontology and a practice epistemology that aligns with a practitioner research methodology of action research. Seven generalisable propositions have emerged from this research that inform the strategies I am using to more easily accommodate legislated inclusivitiy. These propositions include: 1. School communities need to share a common understanding of equity. 2. The school principal must provide overt leadership in moving towards an inclusive school culture. 3. A whole-school approach is needed to narrow the gap between inclusion rhetoric and classroom practice. 4. Pedagogical reform is the most effective strategy for catering for diverse student learning needs. 5. Differentiating curriculum is achieved when collaborative planning teams develop appropriate units of work. 6. School communities need to make a commitment to gather, share and manage relevant information concerning students. 7. The Learning Support Teacher needs to be repositioned within a curriculum planning team.

Action for change? Embedding Aboriginal and Torres Strait Islander perspectives in early childhood education curricula

This thesis focuses on non-Indigenous educators’ work around embedding Indigenous perspectives in early childhood education curricula. In place of reporting examples of ‘good’ educational practice, the study questions how whiteness and racism continue to operate in diversity work that is seen to be productive and inclusive. The thesis argues for a more comprehensive framework for embedding Indigenous perspectives in before-school contexts to support educators’ efforts. New strategies for professional development are also suggested to support changes in disciplinary knowledge and pedagogy.

High-risk, high-stake relationships: building effective industry-university partnerships for Work Integrated Learning (WIL)

Many industry peak and professional bodies advocate students undertake professional work placements as a key work integrated learning (WIL) experience in accredited university degree courses. However, mismatched expectations and gaps in the way industry partners (IPs) are supported during these work placements can place these high-stake alliances at risk. A review of models and strategies supporting industry partners indicates many are contingent on the continued efforts of well-networked individuals in both universities and IP organisations to make these connections work. It is argued that whilst these individuals are highly valued they often end up representing a whole course or industry perspective, not just their area of expertise. Sustainable partnership principles and practices with shared responsibility across stakeholder groups are needed instead. This paper provides an overview of work placement approaches in the disciplines of business, engineering and urban development at an Australian, metropolitan university. Employing action research and participatory focus group methodologies, it gathers and articulates recommendations from associated IPs on practical suggestions and strategies to improve relationships and the resultant quality of placements.

A state-wide systems approach to embedding the learning and teaching of sustainability in teacher education

Education systems have a key role to play in preparing future citizens to engage in sustainable living practices and help create a more sustainable world. Many schools throughout Australia have begun to develop whole-school approaches to sustainability education that are supported by national and state policies and curriculum frameworks. Preservice teacher education, however, lags behind in building the capacity of new teachers to initiate and implement such approaches (ARIES, 2010). This proposed project seeks to develop a state-wide systems approach to embedding Education for Sustainability (EfS) in teacher education that is aligned with the Australian National Curriculum and the aspirations for EfS in the Melbourne Declaration and other national documents. Representatives from all teacher education institutions and other agents of change in the Queensland education system will be engaged in a multilevel systems approach, involving collaboration at the state, institutional and course levels, to develop curriculum practices that reflect a shared vision of EfS.

A threshold concepts focus to curriculum design: supporting student learning through application of variation theory

This project develops and evaluates a model of curriculum design that aims to assist student learning of foundational disciplinary ‘Threshold Concepts’. The project uses phenomenographic action research, cross-institutional peer collaboration and the Variation Theory of Learning to develop and trial the model. Two contrasting disciplines (Physics and Law) and four institutions (two research-intensive and two universities of technology) were involved in the project, to ensure broad applicability of the model across different disciplines and contexts. The Threshold Concepts that were selected for curriculum design attention were measurement uncertainty in Physics and legal reasoning in Law. Threshold Concepts are key disciplinary concepts that are inherently troublesome, transformative and integrative in nature. Once understood, such concepts transform students’ views of the discipline because they enable students to coherently integrate what were previously seen as unrelated aspects of the subject, providing new ways of thinking about it (Meyer & Land 2003, 2005, 2006; Land et al. 2008). However, the integrative and transformative nature of such threshold concepts make them inherently difficult for students to learn, with resulting misunderstandings of concepts being prevalent...

Applying threshold learning theory to teach sustainable business practice in post-graduate engineering education

This paper presents the results of a qualitative action-research inquiry into how a highly diverse cohort of post-graduate students could develop significant capacity in sustainable development within a single unit (course), in this case a compulsory component of four built environment masters programs. The method comprised applying threshold learning theory within the technical discipline of sustainable development, to transform student understanding of sustainable business practice in the built environment. This involved identifying a number of key threshold concepts, which once learned would provide a pathway to having a transformational learning experience. Curriculum was then revised, to focus on stepping through these targeted concepts using a scaffolded, problem-based-learning approach. Challenges included a large class size of 120 students, a majority of international students, and a wide span of disciplinary backgrounds across the spectrum of built environment professionals. Five ‘key’ threshold learning concepts were identified and the renewed curriculum was piloted in Semester 2 of 2011. The paper presents details of the study and findings from a mixed-method evaluation approach through the semester. The outcomes of this study will be used to inform further review of the course in 2012, including further consideration of the threshold concepts. In future, it is anticipated that this case study will inform a framework for rapidly embedding sustainability within curriculum.

Undertaking practice-led research through a Queensland-wide women’s history project

This paper focuses on a practice-led research project where the author as artist/researcher participates in a Queensland-wide women’s history project to celebrate Queensland’s Suffrage Centenary in 2005. The author participated in the Women’s Historical Shoebox Collection, where Queensland women were invited to decorate and fill a shoebox with personal and symbolic items that speak about their lives and the lives of their women forebears. This paper explores the practice-led research process that enabled the artist/researcher to design and assemble her contribution. Fredericks describes the iterative process of developing the shoebox and the themes that developed through her artistic practice. She also describes the content of her shoebox and explains the symbolism underpinning the items. The Women’s Historical Shoebox Collection is now owned by the State Library of Queensland and the Jessie Street National Women’s Library.

Learning about inclusion from developing countries : using the index for inclusion

There is a need for a more critical perspective and reporting about the value of taking a model of inclusion developed in western countries and based upon the human rights ethos applying it in developing countries. This chapter will report firstly on how the Index for Inclusion (hereinafter referred to as the Index) was used in Australia as a tool for review and development; and secondly how the process of using the Index is adjusted for use in the Pacific Islands and other developing nations in collaborative and culturally sensitive ways to support and evaluate progress towards inclusive education. Examples are provided from both contexts to demonstrate the impact of the Index as an effective tool to support a more inclusive response to diversity in schools.

Collaborative learning in the rural Indonesian craft industry

The research explores the potential for participatory and collaborative approaches in working with the Indonesian glass-bead rural craft industry, which currently struggles to sustain its business. Contextual inquiry and participatory action research were used to understand the local context, including motivations, barriers and opportunities and to collaboratively develop strategies for advancement and innovation. The study documents participatory design projects undertaken to make, sell and promote hedonic products. It identifies the importance of understanding local context and individual craftsperson aspirations in designing collaborative support programs. It also provides an in depth insight into the Indonesian rural craft industry.

Dance teaching and learning in context : activating the head, heart and hands

Traditionally, the art of teaching dance has largely been a skill transferred from teacher to student. This master-apprentice paradigm encourages the passing on of technical and artistic traditions associated with the various genres of dance. Whilst this approach supports the passing of the flame of the art form from generation to generation, it has, in part, limited the teaching pedagogy that informs dance as an art form. The future of dance teaching is reliant on teachers’ engagement with the further development of inquiry learning and reflective practice skills within the dance studio. This paper charts one component of a reflective pedagogy, Head, Heart, Hands (Pstalozzi as cited in Rud 2006), developed as a result of an action research project, within a suite of three units across a three-year undergraduate teacher-training course for school, community and studio dance teachers.

Learning through feedback loop metaphors

The metaphor of a feedback loop underpinned a significant curriculum change in a first year teacher-education unit. Assessment for Learning (AfL) practices such as discussing examples of previous student work and giving peer feedback were embedded within the curriculum design. The metaphor of a feedback loop connected these AfL practices into a purposeful process that informed student learning as well as tutor learning about student understanding, that then informed the next teaching episode. Student teachers (n=350) in twelve tutorial groups taught by eight university tutors were able to develop a shared understanding of quality performances before completing each assessment task. As well as providing ongoing insights to improve teaching, data from this action research project enabled the participant tutor-researchers to interrogate the concept of feedback loops. The researchers theorised sociocultural feedback loops as emergent, entangled and dynamic moves in a dance of knowing during which participants negotiated meaning and identities of capability.

Practice-based learning in community contexts: A collaborative exploration of pedagogical principles

The primary focus of this chapter is an exploration of four pedagogical principles emerging from a practice-based learning lab. Following an overview of community engaged learning and the Lab approach, the chapter is structured around a discussion of pedagogical principles related to (1) collaboration, (2) interdisciplinarity, (3) complexity and uncertainty and (4) reflection. Through a participatory action research (PAR) framework, students, academics and community partners have worked to identify and refine what it takes to support students negotiate complexity and uncertainty inherent in problems facing communities. It also examines the pedagogical strategies employed to facilitate collaboration across disciplines and professional contexts in ways that leverage difference and challenge values and practices.