Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

Peer review of teaching practice and resources : exploring new spaces to embrace cultural change

The implementation of systematic peer review as a professional development activity, and as a support for educational design activities is under-utilised in many Australian higher education institutions. This case study reports on the first stages of planning and implementation of an institution-wide project to enhance teaching and learning quality at a remote and regional university, where one of the major strategies for improvement is peer review. Through a systematic process of staff engagement in peer review, within and from outside the organisation, a substantial change in flexible learning is envisaged. A mix of new and different learning spaces are to be used in the project, including blended learning spaces for academic development. This paper describes the research framework that will guide the peer review process and examines the early findings of the design-based research. Leadership, awareness raising and development of a supportive community of inquiry are seen as key components for successful implementation of peer review. In addition, unique contextual elements add to the complexity of designing for transformative change within such a relatively new organization.

R U there yet? using virtual classrooms to transform teaching practice

Access to quality higher education is challenging for many Western Australians that live outside the metropolitan area. In 2010, the School of Education moved to flexible delivery of a fully online Bachelor of Education degree for their non -metropolitan students. The new model of delivery allows access for students from any location provided they have a computer and an internet connection. A number of academic staff had previously used an asynchronous environment to deliver learning modules housed within a learning management system (LMS) but had not used synchronous software with their students. To enhance the learning environment and to provide high quality learning experiences to students learning at a distance, the adoption of synchronous software (Elluminate Live) was introduced. This software is a real-time virtual classroom environment that allows for communication through Voice over Internet Protocol (VoIP) and videoconferencing, along with a large number of collaboration tools to engage learners. This research paper reports on the integration of a live e-learning solution into the current LMS environment. Qualitative data were collected from academic staff through informal interviews and participant observation. The findings discuss (i) perceived level of support; (ii) identification of strategies used to create an effective online teacher presence; (iii) the perceived impact on the students' learning outcomes; and (iv) guidelines for professional development to enhance pedagogy within the live e-learning environment.

Transforming teaching practice through virtual classrooms: A study of staff and student views of synchronous learning

Australia is a vast land and access to quality higher education is challenging for many Australians that live outside the larger metropolitan areas. In 2010, the School of Education at an Australian university (Curtin University in Western Australia) moved to flexible delivery of a fully online Bachelor of Education degree for their rural students. The new model of delivery allows access for students from any location provided they have a computer and an internet connection.A number of teaching staff had previously used an asynchronous environment to deliver learning modules housed within a learning management system (LMS) but had not used synchronous software with their students. To enhance the learning environment and to provide high quality learning experiences to students learning at a distance, the adoption of synchronous software (Elluminate Live) was introduced. This software is a real-time virtual classroom environment that allows for communication through Voice over Internet Protocol (VoIP) and video conferencing, alongside a large number of collaboration tools to engage learners.This research paper reports on the integration of a live e-learning solution into the current Learning Management System (LMS) environment. Staff were interviewed about their perceptions and a questionnaire was administered to a sample of students to identify their experience with the synchronous software in order to inform future practice.

Curriculum design innovation in flexible science teaching

In this paper you will be introduced to a number of principles which can be used to inform good teaching practice and rigorous curriculum design. Principles relate to: * Application of a common sequence of events for how learners learn; * Accommodating different learning styles; * Adopting a purposeful approach to teaching and learning; * Using assessment as a central driving force in the curriculum and as an organising structure leading to coherence of teaching and learning approach; and * The increasing emphasis that is being placed on the development of generic graduate competencies over and above discipline content knowledge. The principles are particularly significant in relation to adult learning. The paper will use three specific applications as illustrations to help you to learn how these principles can be applied. The illustrations are taken from a second year subject in supercomputing that uses scientific case studies. The subject has been developed (with support from Silicon Graphics Inc. and Intel) to be taught entirely via the Internet.

Making use of pedagogic models as reflective catalysts for investigating pedagogic practice

The notion of pedagogy for anyone in the teaching profession is innocuous. The term itself, is steeped in history but the details of the practice can be elusive. What does it mean for an academic to be embracing pedagogy? The problem is not limited to academics; most teachers baulk at the introduction of a pedagogic agenda and resist attempts to have them reflect on their classroom teaching practice, where ever that classroom might be constituted. This paper explores the application of a pedagogic model (Education Queensland, 2001) which was developed in the context of primary and secondary teaching and was part of a schooling agenda to improve pedagogy. As a teacher educator I introduced the model to classroom teachers (Hill, 2002) using an Appreciative Inquiry (Cooperrider and Srivastva 1987) model and at the same time applied the model to my own pedagogy as an academic. Despite being instigated as a model for classroom teachers, I found through my own practitioner investigation that the model was useful for exploring my own pedagogy as a university academic (Hill, 2007, 2008). Cooperrider, D.L. and Srivastva, S. (1987) Appreciative inquiry in organisational life, in Passmore, W. and Woodman, R. (Eds) Research in Organisational Changes and Development (Vol 1) Greenwich, CT: JAI Press. Pp 129-69 Education Queensland (2001) School Reform Longitudinal Study (QSRLS), Brisbane, Queensland Government. Hill, G. (2002, December ) Reflecting on professional practice with a cracked mirror: Productive Pedagogy experiences. Australian Association for Research in Education Conference. Brisbane, Australia. Hill, G. (2007) Making the assessment criteria explicit through writing feedback: A pedagogical approach to developing academic writing. International Journal of Pedagogies and Learning 3(1), 59-66. Hill, G. (2008) Supervising Practice Based Research. Studies in Learning, Evaluation, Innovation and Development, 5(4), 78-87

Shifting the technology context : career-change entrants’ transition into teaching

Becoming a teacher in technology-rich classrooms is a complex and challenging transition for career-change entrants. Those with generic or specialist Information and Communication Technology (ICT) expertise bring a mindset about purposeful uses of ICT that enrich student learning and school communities. The transition process from a non-education environment is both enhanced and constrained by shifting the technology context of generic or specialist ICT expertise, developed through a former career as well as general life experience. In developing an understanding of the complexity of classrooms and creating a learner centred way of working, perceptions about learners and learning evolve and shift. Shifts in thinking about how ICT expertise supports learners and enhances learning preceded shifts in perceptions about being a teacher, working with colleagues, and functioning in schools that have varying degrees of intensity and impact on evolving professional identities. Current teacher education and school induction programs are seen to be falling short of meeting the needs of career-change entrants and, as a flow on, the students they nurture. Research (see, for example, Tigchelaar, Brouwer, & Korthagen, 2008; Williams & Forgasz, 2009) highlights the value of generic and specialist expertise career-change teachers bring to the profession and draws attention to the challenges such expertise begets (Anthony & Ord, 2008; Priyadharshini & Robinson-Pant, 2003). As such, the study described in this thesis investigated perceptions of career-change entrants, who have generic (Mishra & Koehler, 2006) or specialist expertise, that is, ICT qualifications and work experience in the use of ICT. The career-change entrants‘ perceptions were sought as they shifted the technology context and transitioned into teaching in technology-rich classrooms. The research involved an interpretive analysis of qualitative data and quantitative data. The study used the explanatory case study (Yin, 1994) methodology enriched through grounded theory processes (Strauss & Corbin, 1998), to develop a theory about professional identity transition from the perceptions of the participants in the study. The study provided insights into the expertise and experiences of career change entrants, particularly in relation to how professional identities that include generic and specialist ICT knowledge and expertise were reconfigured while transitioning into the teaching profession. This thesis presents the Professional Identity Transition Theory that encapsulates perceptions about teaching in technology-rich classrooms amongst a selection of the increasing number of career-change entrants. The theory, grounded in the data, (Strauss & Corbin, 1998) proposes that career-change entrants experience transition phases of varying intensity that impact on professional identity, retention and development as a teacher. These phases are linked to a shift in perceptions rather than time as a teacher. Generic and specialist expertise in the use of ICT is a weight of the past and an asset that makes the transition process more challenging for career-change entrants. The study showed that career-change entrants used their experiences and perceptions to develop a way of working in a school community. Their way of working initially had an adaptive orientation focussed on immediate needs as their teaching practice developed. Following a shift of thinking, more generative ways of working focussed on the future emerged to enable continual enhancement and development of practice. Sustaining such learning is a personal, school and systemic challenge for the teaching profession.

High-challenge teaching for senior English as an Additional Language (EAL) learners in times of change

This paper will present a brief overview of the recent shifts within English and EAL/D (English as an additional language/dialect) curriculum documents and their focus on critical literacy, using the Queensland context as a case in point. The English syllabus landscape in Queensland has continued to morph in recent years. From 2002 to 2009, teachers of senior English and English as an Additional Language (EAL/D) have witnessed no less than four separate syllabus documents that impact on their daily work. The Australian Curriculum, when finally implemented, will also require teachers to navigate and grapple with its particular obligations and affordances. The combined effect of the shifts and tensions between recent policy documents has led to confusion about exactly how to cater for EAL/D learners in mainstream English. We discuss the possible effects of this on teachers as the agents of policy implementation and argue that in spite of such contradictions, EAL/D teachers can productively use syllabus frameworks to craft pedagogy to cater for their EAL/D learners’ language and literacy needs. Following this, we present aspects of the teaching practice of four teachers of senior EAL/D, who provide intellectually-engaging, critical literacy pedagogy that takes into account the language proficiency level of their learners, within the required curriculum. Such practice provides teachers with valuable pedagogic possibilities to meet EAL/D learners’ needs within continually varying policy terrain.

Changing personal epistemologies in early childhood pre-service teachers using an integrated teaching program

This study investigated changes in pre-service teachers’ personal epistemologies as they engaged in an integrated teaching program. Personal epistemology refers to individual beliefs about the nature of knowing and knowledge and has been shown to influence teaching practice. An integrated approach to teaching, based on both an implicit and explicit focus on personal epistemology, was developed by an academic team within a Bachelor of Education (Early Childhood). The teaching program integrated content across four units of study, modelling personal epistemologies implicitly through collaborative reflexive practice. The students were also required to engage in explicit reflections on their personal epistemologies. Quantitative measures of personal epistemology were collected at the beginning and end of the semester using the Epistemological Beliefs Survey (EBS) to assess changes across the teaching period. Results indicated that pre-service teachers’ epistemological beliefs about the integration of knowledge became more sophisticated over the course of the teaching period. Qualitative data included pre-service teachers’ responses to open ended questions and field experience journal reflections about their perceptions of the teaching program and were collected at the end of the semester. These data showed that pre-service teachers held different conceptions about learning as integration, which provided a more nuanced understanding of the EBS data. Understanding pre-service teachers’ epistemological beliefs provides promising directions for teacher preparation and professional enrichment.

Theorising a model for teaching and assessing reflective learning in higher education

The importance of reflection in higher education, and across disciplinary fields is widely recognised; it is generally included in university graduate attributes, professional standards and program objectives. Furthermore, reflection is commonly embedded into assessment requirements in higher education subjects, often without necessary scaffolding or clear expectations for students. Despite the rhetoric around the importance of reflection for ongoing learning, there is scant literature on any systematic, developmental approach to teaching reflective learning across higher education programs/courses. Given that professional or academic reflection is not intuitive, and requires specific pedagogic intervention to do well, a program/course-wide approach is essential. This paper draws on current literature to theorise a new, transferable and customisable model for teaching and assessing reflective learning across higher education, which foregrounds and explains the pedagogic field of higher education as a multi-dimensional space. We argue that explicit and strategic pedagogic intervention, supported by dynamic resources, is necessary for successful, broad-scale approaches to reflection in higher education.

Peer partnership to enhance scholarship of teaching : a case study

This paper reports on the outcomes of a peer partnership program trialled at the Queensland University of Technology (QUT), Australia. The program was designed based on a community of practice methodology to bring together academic staff for the purpose of advancing teaching practice. The program encouraged professional and supportive environments for the purpose of critical reflection and personal development. The belief was that quality teaching is core business and vital to university organisational goals. Peer partnership programs support improvement in teaching and learning. Participants in the program reported the program enhanced their commitment and insight into teaching and that there is willingness to be involved if supported by colleagues and an organisation. Feedback from participants in the program was positive and outcomes arising from the QUT Peer Partnership Project were the development of an online peer partner tool-kit, staff development training, an instructional DVD and integration of the project goals within QUT staff development programs.

Reflections around artefacts : using a deliberative approach to teaching reflective practices in fashion

While asking students to think reflectively is a desirable teaching goal, it is often fraught with complexity and sometimes poorly implemented in higher education. Here we describe an approach to academic reflective practice that fitted well within an existing design subject in fashion education and was perceived as effective in enhancing student learning outcomes. In many design based disciplines it is essential to evaluate, through a reflective lens, the quality of tangible design outcomes - referred to as artefacts in this case. Fashion studio based practice (unlike many other theory based disciplines) requires an artefact to be viewed, in order to initiate the reflective process. This reflection is not solely limited to reflective writing - the reflection happens through sight, touch and other non traditional approaches. Fashion students were asked to reflect before, during and after the development of an artefact and through a variety of media a review of the first garment prototype, called 'Sample Review', occurred. This teaching approach has been formalised as a "pedagogic pattern" in order to abstract successful experience for re use by other university teachers in different contexts. This case study fits within the broader project outlined in Paper 1. In this presentation we explore some of the complexities associated with teaching academic reflection along with the value in representing successful practices as pedagogical patterns. The teaching practice and student outcomes associated with the case study will be described. Finally, we shall argue that the pedagogical pattern, called 'Reflection Around Artefacts', can be applied in diverse discipline areas, and especially where students are engaged and reflecting on the design of an artefact(such as an assignment that includes the making of a professionally-relevant product).

Teaching in a nutshell : navigating your teacher education program as a stdent teacher

Teacher education programs bridge the interests of two worlds - the world of educational theory and the world of teaching practice. Despite teacher educators’ best attempts to convince pre-service teachers that theory and practice are linked, it is often during their practicum placements when pre-service teachers claim that their ‘real’ learning takes place. It is also on practicum when students teachers face (and are surprised by) the ‘extensive decision-making role of the teacher, the emotional aspects of teaching, and the sheer volume of work’ (p.4). Kosnick and Beck’s new book Teaching in a Nutshell utilises the authors’ extensive research with beginning teachers to help students ‘navigate’ their way through their programs. Identifying what they have found in their research to be the seven key priorities for teachers, each chapter follows a helpful structure beginning with an overview of current thinking in the priority area, followed by a case study of a beginning teacher showing how s/he implements the strategy...