Kaleidoscope : shaping a better future through a stakeholder approach to widespread organisational change

The main focus of ‘Kaleidoscope: Reframing evaluation through a stakeholder approach to sustainable, cultural change in Higher Education’ is to develop a set of principles to guide user-led engagement in widespread organisational change and maximise its impact. The word kaleidoscope represents the unique lens through which each institution will need to view their cultural specificity and local context through an extensive process of collaboration and engagement, followed by communication and dissemination. Kaleidoscope has particular relevance when new approaches to learning and teaching evaluation are introduced by tertiary institutions. Building on the Reframe Project, which involved three years of user-led consultation and was designed to meet stakeholders’ needs, QUT successfully introduced a new evaluation framework in 2013 across the university. Reframe was evidence based, involved scholarly reflection and was founded on a strong theoretical framework. The evolution of the evaluation framework included analysis of scholarly literature and environmental scans across the higher education sector (Alderman, et al., 2012), researched development of conceptual theory (Alderman, et al., in press 2013), incorporated the stakeholder voice and framed within project management principles (Alderman & Melanie, 2012). Kaleidoscope’s objectives are for QUT to develop its research-based stakeholder approach to distil the successful experience exhibited in the Reframe Project into a transferable set of guidelines for use by other tertiary institutions across the sectors. These guidelines will assist others to design, develop, and deploy, their own culturally specific widespread organisational change informed by stakeholder engagement and organisational buy-in. It is intended that these guidelines will promote, support and enable other tertiary institutions to embark on their own projects and maximise the impact. In correlation with a our conference paper, this round table presents the Draft Guidelines and Framework ready for external peer review by evaluation practitioners, as part of Kaleidoscope’s dissemination (Hinton & Gannaway, 2011) applying illuminative evaluation theory (Parlett & Hamilton, 1976), through conference workshops and linked round table discussions (Shapiro, et al., 1983; Jacobs, 2000).

Peer review of teaching practice and resources : exploring new spaces to embrace cultural change

The implementation of systematic peer review as a professional development activity, and as a support for educational design activities is under-utilised in many Australian higher education institutions. This case study reports on the first stages of planning and implementation of an institution-wide project to enhance teaching and learning quality at a remote and regional university, where one of the major strategies for improvement is peer review. Through a systematic process of staff engagement in peer review, within and from outside the organisation, a substantial change in flexible learning is envisaged. A mix of new and different learning spaces are to be used in the project, including blended learning spaces for academic development. This paper describes the research framework that will guide the peer review process and examines the early findings of the design-based research. Leadership, awareness raising and development of a supportive community of inquiry are seen as key components for successful implementation of peer review. In addition, unique contextual elements add to the complexity of designing for transformative change within such a relatively new organization.

Exploring the experiences of embedding Indigenous knowledge and perspectives on teaching practicum through interpretive phenomenology

In this paper, we discuss interpretive/hermeneutic phenomenology as a theoretical approach to explore the experiences of three stakeholder groups in embedding Indigenous knowledge and perspectives on teaching practicum, a project sponsored by ALTC. We begin by asking the phenomenological question ‘what is your experience of practice teaching?’ An open, explorative, phenomenological framework seeks the meanings of experiences, not truths, from the participants’ words themselves. Interpretive phenomenology is particularly suitable to explore educational experiences (Grumet, 1992; M. van Manen, 1990), as it provides rich ground for listening to the stakeholders’ lived experience and documenting it for interpretation. In an interpretive process, perspectives on lifeworlds, worldview and lenses get highlighted (Cunningham & Stanley, 2003). We establish how through various project stages, interpretive phenomenology gets to the essence of practice teaching experience creating a pedagogical ‘understanding’ of the essential nature of shared experience as lived by the participants (M van Manen, 2002). Thereby, it foregrounds voices of agency, dissent, acceptance and resistance. We consider how our research study focuses on the pedagogic voice of Indigenous pre-service teachers and the recognition of complex pedagogic fields in Indigenous education. We explain how this study seeks insights into their evaluation of pedagogic relations with two other education stakeholders – their practicum supervising teachers at schools and university staff involved practicum experience. As such, our study aims to support and develop long term, future-oriented opportunities for Indigenous pre-service teachers to embed Indigenous knowledge in the curricula. We conclude with some projections into the discourse on how Indigenous knowledge (IK) and perspectives might be diversely exemplified in pre-service teachers’ professional works (particularly E-portfolios). We speculate how this change could in turn maximise opportunities for Indigenous pre-service teachers, their supervising teachers and university staff to demonstrate leadership in their field through the creation of future tangible products such as units of work, resources, assessment and reflection tools. The processes contextualising the cultural interface of competing knowledge systems (Nakata, 2007) provide important analytical tools for understanding issues affecting student-teacher-mentor relationships occurring on practicum.

Complex Modelling in the Primary and Middle School Years : An Interdisciplinary Approach

The world’s increasing complexity, competitiveness, interconnectivity, and dependence on technology generate new challenges for nations and individuals that cannot be met by continuing education as usual. With the proliferation of complex systems have come new technologies for communication, collaboration, and conceptualisation. These technologies have led to signifi cant changes in the forms of mathematical and scientifi c thinking required beyond the classroom. Modelling, in its various forms, can develop and broaden students’ mathematical and scientific thinking beyond the standard curriculum. This chapter first considers future competencies in the mathematical sciences within an increasingly complex world. Consideration is then given to interdisciplinary problem solving and models and modelling, as one means of addressing these competencies. Illustrative case studies involving complex, interdisciplinary modelling activities in Years 1 and 7 are presented.

A model for research supervision of international students in engineering and information technology disciplines

A large proportion (over 12 per cent) of international and non-English speaking background (NESB) postgraduate research students enrol in engineering and information technology (IT) programs in Australian universities. They find themselves in an advanced research culture, and are technically and scientifically challenged early in their programs. This is in addition to cultural, social and religious isolation and linguistic barriers they have to contend with. The project team surveyed this cohort at QUT and UWA, on the hypothesis that they face challenges that are more discipline-specific. The results of the survey indicate that existing supervisory frameworks which are limited to linguistic contexts are not fully assisting these students and supervisors to achieve high quality research. The goal of this project is to extend these supervisory frameworks to a holistic model that will address the unique needs and supervisory issues these students face in engineering and IT disciplines. The model will be useable by all other Australian universities.

Examining workload models in online and blended teaching

Over the past decade, most Australian universities have moved increasingly towards online course delivery for both undergraduate and graduate programs. In almost all cases, elements of online teaching are part of routine teaching loads. Yet detailed and accurate workload data are not readily available. As a result, institutional policies on academic staff workload are often guided more by untested assumptions about reduction of costs per student unit, rather than being evidence-based, with the result that implementation of new technologies for online teaching has resulted in poorly defined workload expectations. While the academics in this study often revealed a limited understanding of their institutional workload formulas, which in Australia are negotiated between management and the national union through their local branches, the costs of various types of teaching delivery have become a critical issue in a time of increasing student numbers, declining funding, pressures to increase quality and introduce minimum standards of teaching and curriculum, and substantial expenditure on technologies to support e-learning. There have been relatively few studies on the costs associated with workload for online teaching, and even fewer on the more ubiquitous ‘blended’, ‘hybrid’ or ‘flexible’ modes, in which face-to-face teaching is supplemented by online resources and activities. With this in mind the research reported here has attempted to answer the following question: What insights currently inform Australian universities about staff workload when teaching online?

A CLASS act : the teaching team approach to subject coordination

Advancing the development of good practice around the teaching team has been the focus of a recently completed, nationally funded Australian grant entitled Coordinators Leading Advancement of Sessional Staff (CLASS). The project focused on developing leadership capacity of subject coordinators to provide supportive contexts for sessional staff to enhance their knowledge of teaching practice and contribute to subject improvement through a team approach. An action learning approach and notions of distributed leadership underpinned the activities of the teaching teams in the program. This paper provides an overview of a practical approach, led by the subject coordinator, to engaging sessional staff through the facilitation of a supportive network within the teaching team. It addresses some of the gaps identified in the recent literature which includes lack of role clarity for all members of the team and provides some examples of initiatives that teams engaged with to address some of the challenges identified. Resources to support this approach were developed and are shared through the project website. Recommendations for future direction include improved policy and practice at the institutional level, better recognition and reward for subject coordinators and resourcing to support the participation and professional development needs of sessional staff.

A rural health education, training and research network

The purpose of the Rural Health Education, Training and Research Network is to support the education and training of rural health practitioners and research in rural health through the optimum use of appropriate information and communication technologies to link and inform all individuals and organisation involved in the teaching, planning and delivery of health care in rural and remote Queensland. The health care of people in rural areas has the potential to be enhanced, through providing the rural and remote health professionals in Queensland with the same access to educational and training opportunities as their metropolitan colleagues. This consultative, coordinated approach should be cost-effective through both increasing awareness and utilisation of existing and developing networks, and through more efficient and rational use of both the basic and sophisticated technologies which support them. Technological hardware, expertise and infrastructure are already in place in Queensland to support a Rural Health Education, Training and Research Network, but are not being used to their potential, more often due to a lack of awareness of their existence and utility than to their perceived costs. Development of the network has commenced through seeding funds provided by Queensland Health. Future expansion will ensure access by health professionals to existing networks within Queensland. This paper explores the issues and implications of a network for rural health professionals in Queensland and potentially throughout Australia, with a specific focus on the implications for rural and isolated health professional.

Approaches to inquiry teaching : elementary teacher’s perspectives

Learning science through the process of inquiry is advocated in curriculum documents across many jurisdictions. However, a number of studies suggest that teachers struggle to help students engage in inquiry practices. This is not surprising as many teachers of science have not engaged in scientific inquiry and possibly hold naïve ideas about what constitutes scientific inquiry. This study investigates teachers’ self-reported approaches to teaching science through inquiry. Phenomenographic interviews undertaken with 20 elementary teachers revealed teachers identified six approaches to teaching for inquiry, clustered within three categories. These approaches were categorized as Free and Illustrated Inquiry as part of experience-centered category, Solution and Method Inquiry as part of problem-centered category, and Topic and Chaperoned Inquiry as part of a question-centered category. This study contributes to our theoretical understanding of how teachers approach Inquiry Teaching, and suggests fertile areas of future research into this valued and influential phenomenon broadly known as “Inquiry Teaching”.

The ABCs of teaching alphabet knowledge : affordances and challenges of ‘weaving’ visible and invisible pedagogies

As researchers interested in the pursuit of high quality/high equity literacy learning outcomes, we focus on the learning experiences of five early years French students, with a special regard for those who are already considered as being at-risk of educational failure. We narrow the empirical focus to a single lesson on a mechanical concept of print, that is matching lower and upper case alphabet letters. In doing so, we examine a deeply philosophical question: Which pedagogical practices dis/enable what sorts of early years students as literacy learners? We extend Cazden’s (2006) notion of ‘weaving’ knowledge across dimensions of knowing to describe how the case study teacher ‘weaves’ visible and invisible pedagogies over the four movements of a lesson. The findings reveal different pedagogical framings (Bernstein, 1996) have potentially different cognitive and social effects that constitute different kinds of literacy knowledge and oppressive subject positions for at-risk students (Young, 1990).

The Effective and The Evocative : A Spectrum of Creative Practice Research

In the expanding literature on creative practice research, art and design are often described as a unified field. They are bracketed together (art-and-design), referred to as interchangeable terms (art/design), and nested together, as if the practices of one domain encompass the other. However it is possible to establish substantial differences in research approaches. In this chapter we argue that core distinctions arise out of the goals of the research, intentions invested in the resulting “artefacts” (creative works, products, events), and the knowledge claims made for the research outcomes. Moreover, these fundamental differences give rise to a number of contingent attributes of the research such as the forming contexts, methodological approaches, and ways of evidencing and reporting new knowledge. We do not strictly ascribe these differences to disciplinary contexts. Rather, we use the terms effective practice research and evocative practice research to describe the spirit of the two distinctive research paradigms we identify. In short, effective practice research (often pursued in design fields) seeks a solution (or resolution) to a problem identified with a particular community, and it produces an artefact that addresses this problem by effecting change (making a situation, product or process more efficient or effective in some way). On the other hand, evocative practice research (often pursued by creative arts fields) is driven by individual pre-occupations, cultural concerns or human experience more broadly. It produces artefacts that evoke affect and resonance, and are poetically irreducible in meaning. We cite recent examples of creative research projects that illustrate the distinctions we identify. We then go on to describe projects that integrate these modes of research. In this way, we map out a creative research spectrum, with distinct poles as well as multiple hybrid possibilities. The hybrid projects we reference are not presented as evidence an undifferentiated field. Instead, we argue that they integrate research modes in deliberate, purposeful and distinctive ways: employing effective practice research methods in the production of evocative artefacts or harnessing evocative (as well as effective) research paradigms to effect change.

Acquiring ‘doctorateness’ in the creative industries : an Australian perspective on professional research doctorates

Over the last two decades, particularly in Australia and the UK, the doctoral landscape has changed considerably with increasingly hybridised approaches to methodologies and research strategies as well as greater choice of examinable outputs. This paper provides an overview of doctoral practices that are emerging in the creative industries context, from a predominantly Australian perspective, with a focus on practice-led approaches within the Doctor of Philosophy and recent developments in professional doctorates. The paper examines some of the diverse theoretical principles which foreground the practitioner/researcher, methodological approaches that incorporate tacit knowledge and reflective practice together with qualitative strategies, blended learning delivery modes, and flexible doctoral outputs;and how these are shaping this shifting environment towards greater research-based industry outputs. The discussion is based around a single extended case study of the Doctor of Creative Industries at Queensland University of Technology (QUT) as one model of an interdisciplinary professional research doctorate.

Challenges of elementary science teaching: an Australian perspective

This chapter profiles research that has explored the role of affect in the teaching of science in Australia particularly on primary or elementary science education. Affect is a complex set of characteristics that relate to the interactions between an individual’s knowledge and emotional responses to a stimulus. Thus, there are many dimensions and theoretical frameworks that inform our understanding of how and why people behave in particular ways.

Objectifying the Subjective : Assessment and Feedback in Creative Arts Studio Learning and Teaching

This paper examines the Assessment and Feedback aspects of Studio Teaching as Creative Arts pedagogy. Prompted by USQ’s newly offered Bachelor of Creative Arts (BCA), the author has developed an Assessment Matrix specifically designed to satisfy a number of imperatives, including: • ‘objectifying’ the subjective aspects of creative practice as assessable coursework/research • providing the means by which accurate, detailed, personalised and confidential feedback may be provided to students individually • providing consistent, accurate, meaningful assessment records for student, lecturer, and institution • ensuring consistency, continuity, and transparency of assessment processes and records to satisfy quality audits • minimising marking and assessment time, whilst maximising assessment integrity and depth • requiring only basic level skills and knowledge of a computer application already in common use (Microsoft Excel) • adaptability to a range of creative courses ‐ across disciplines This Assessment Matrix has been in development (and trialled) since January 2009.

Technological tools for science classrooms : choosing and using for productive and sustainable teaching and learning experiences

In this age of rapidly evolving technology, teachers are encouraged to adopt ICTs by government, syllabus, school management, and parents. Indeed, it is an expectation that teachers will incorporate technologies into their classroom teaching practices to enhance the learning experiences and outcomes of their students. In particular, regarding the science classroom, a subject that traditionally incorporates hands-on experiments and practicals, the integration of modern technologies should be a major feature. Although myriad studies report on technologies that enhance students’ learning outcomes in science, there is a dearth of literature on how teachers go about selecting technologies for use in the science classroom. Teachers can feel ill prepared to assess the range of available choices and might feel pressured and somewhat overwhelmed by the avalanche of new developments thrust before them in marketing literature and teaching journals. The consequences of making bad decisions are costly in terms of money, time and teacher confidence. Additionally, no research to date has identified what technologies science teachers use on a regular basis, and whether some purchased technologies have proven to be too problematic, preventing their sustained use and possible wider adoption. The primary aim of this study was to provide research-based guidance to teachers to aid their decision-making in choosing technologies for the science classroom. The study unfolded in several phases. The first phase of the project involved survey and interview data from teachers in relation to the technologies they currently use in their science classrooms and the frequency of their use. These data were coded and analysed using Grounded Theory of Corbin and Strauss, and resulted in the development of a PETTaL model that captured the salient factors of the data. This model incorporated usability theory from the Human Computer Interaction literature, and education theory and models such as Mishra and Koehler’s (2006) TPACK model, where the grounded data indicated these issues. The PETTaL model identifies Power (school management, syllabus etc.), Environment (classroom / learning setting), Teacher (personal characteristics, experience, epistemology), Technology (usability, versatility etc.,) and Learners (academic ability, diversity, behaviour etc.,) as fields that can impact the use of technology in science classrooms. The PETTaL model was used to create a Predictive Evaluation Tool (PET): a tool designed to assist teachers in choosing technologies, particularly for science teaching and learning. The evolution of the PET was cyclical (employing agile development methodology), involving repeated testing with in-service and pre-service teachers at each iteration, and incorporating their comments i ii in subsequent versions. Once no new suggestions were forthcoming, the PET was tested with eight in-service teachers, and the results showed that the PET outcomes obtained by (experienced) teachers concurred with their instinctive evaluations. They felt the PET would be a valuable tool when considering new technology, and it would be particularly useful as a means of communicating perceived value between colleagues and between budget holders and requestors during the acquisition process. It is hoped that the PET could make the tacit knowledge acquired by experienced teachers about technology use in classrooms explicit to novice teachers. Additionally, the PET could be used as a research tool to discover a teachers’ professional development needs. Therefore, the outcomes of this study can aid a teacher in the process of selecting educationally productive and sustainable new technology for their science classrooms. This study has produced an instrument for assisting teachers in the decision-making process associated with the use of new technologies for the science classroom. The instrument is generic in that it can be applied to all subject areas. Further, this study has produced a powerful model that extends the TPACK model, which is currently extensively employed to assess teachers’ use of technology in the classroom. The PETTaL model grounded in data from this study, responds to the calls in the literature for TPACK’s further development. As a theoretical model, PETTaL has the potential to serve as a framework for the development of a teacher’s reflective practice (either self evaluation or critical evaluation of observed teaching practices). Additionally, PETTaL has the potential for aiding the formulation of a teacher’s personal professional development plan. It will be the basis for further studies in this field.