Building and sustaining a culture to support peer review of teaching

1. Background/context This presentation will report on emerging results from a two phase project funded by the Australian Learning and Teaching Council (ALTC). The project was designed in partnership with five universities and aimed to embed peer review within the local teaching and learning culture by using a distributive leadership framework. 2. The initiative/practice The presentation will highlight research outcomes that bring together both the fundamentals of peer review of teaching with the broader contextual elements of Integration, Leadership and Development. It will be demonstrated that peer review of teaching can be implemented and have advantages for academic staff, teaching evaluation and an organisation if attention is given to strategies that influence the contexts and cultures of teaching. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment. Results demonstrate achievements that can be obtained through working to foster conditions needed for sustainable leadership and change. The work has implications for policy, research, teaching development and student outcomes and has potential application world-wide. 3. Method(s) of evaluative data collection and analysis The 2 phase project collected focus group and questionnaire data to inform research results that were analysed using a thematic qualitative approach and statistical exploration. 4. Evidence of effectiveness The presentation will demonstrate the effectiveness of distributive leadership and strategic approaches to working for cultural change through the presentation of project findings.

Developing a culture to support peer review of teaching in higher education

This presentation addresses issues related to leadership, academic development and scholarship of teaching and learning, and highlights research funded by the Australian Office of Learning and Teaching (OLT) designed to embed and sustain peer review of teaching within the culture of 5 Australian universities: Queensland University of Technology, University of Technology, Sydney, University of Adelaide, Curtin University, and Charles Darwin University. Peer review of teaching in higher education will be emphasised as a professional process for providing feedback on teaching and learning practice, which if sustained, can become an effective ongoing strategy for academic development (Barnard et al, 2011; Bell, 2005; Bolt and Atkinson, 2010; McGill & Beaty 2001, 1992; Kemmis & McTaggart, 2000). The research affirms that using developmental peer review models (Barnard et al, 2011; D'Andrea, 2002; Hammersley-Fletcher & Orsmond, 2004) can bring about successful implementation, especially when implemented within a distributive leadership framework (Spillane & Healey, 2010). The project’s aims and objectives were to develop leadership capacity and integrate peer review as a cultural practice in higher education. The research design was a two stage inquiry process over 2 years. The project began in July 2011 and encompassed a development and pilot phase followed by a cascade phase with questionnaire and focus group evaluation processes to support ongoing improvement and measures of outcome. Leadership development activities included locally delivered workshops complemented by the identification and support of champions. To optimise long term sustainability, the project was implemented through existing learning and teaching structures and processes within the respective partner universities. Research outcomes highlight the fundamentals of peer review of teaching and the broader contextual elements of integration, leadership and development, expressed as a conceptual model for embedding peer review of teaching within higher education. The research opens a communicative space about introduction of peer review that goes further than simply espousing its worth and introduction. The conceptual model highlights the importance of development of distributive leadership capacity, integration of policies and processes, and understanding the values, beliefs, assumptions and behaviors embedded in an organizational culture. The presentation overviews empirical findings that demonstrate progress to advance peer review requires an ‘across-the-board’ commitment to embed change, and inherently demands a process that co-creates connection across colleagues, discipline groups, and the university sector. Progress toward peer review of teaching as a cultural phenomenon can be achieved and has advantages for academic staff, scholarship, teaching evaluation and an organisation, if attention is given to strategies that influence the contexts and cultures of teaching practice. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment and has a focus on scholarship of teaching. The work is ongoing and has implication for policy, research, teaching development and student outcomes, and has potential application world-wide.

Teaching Teachers for the Future (TTF) Project TPACK Survey : summary of the key findings

This paper presents a summary of the key findings of the TTF TPACK Survey developed and administered for the Teaching the Teachers for the Future (TTF) Project implemented in 2011. The TTF Project, funded by an Australian Government ICT Innovation Fund grant, involved all 39 Australian Higher Education Institutions which provide initial teacher education. TTF data collections were undertaken at the end of Semester 1 (T1) and at the end of Semester 2 (T2) in 2011. A total of 12881 participants completed the first survey (T1) and 5809 participants completed the second survey (T2). Groups of like-named items from the T1 survey were subject to a battery of complementary data analysis techniques. The psychometric properties of the four scales: Confidence - teacher items; Usefulness - teacher items; Confidence - student items; Usefulness- student items, were confirmed both at T1 and T2. Among the key findings summarised, at the national level, the scale: Confidence to use ICT as a teacher showed measurable growth across the whole scale from T1 to T2, and the scale: Confidence to facilitate student use of ICT also showed measurable growth across the whole scale from T1 to T2. Additional key TTF TPACK Survey findings are summarised.

A threshold concepts focus to curriculum design: supporting student learning through application of variation theory

This project develops and evaluates a model of curriculum design that aims to assist student learning of foundational disciplinary ‘Threshold Concepts’. The project uses phenomenographic action research, cross-institutional peer collaboration and the Variation Theory of Learning to develop and trial the model. Two contrasting disciplines (Physics and Law) and four institutions (two research-intensive and two universities of technology) were involved in the project, to ensure broad applicability of the model across different disciplines and contexts. The Threshold Concepts that were selected for curriculum design attention were measurement uncertainty in Physics and legal reasoning in Law. Threshold Concepts are key disciplinary concepts that are inherently troublesome, transformative and integrative in nature. Once understood, such concepts transform students’ views of the discipline because they enable students to coherently integrate what were previously seen as unrelated aspects of the subject, providing new ways of thinking about it (Meyer & Land 2003, 2005, 2006; Land et al. 2008). However, the integrative and transformative nature of such threshold concepts make them inherently difficult for students to learn, with resulting misunderstandings of concepts being prevalent...

Teaching colour theory online : challenges, opportunities and experiences [Abstract]

Over the past decade, various paradigm shifts and challenges have rapidly changed learning and teaching in higher education including meeting student expectation for more engaging, more interactive learning experiences, the increased focus in the tertiary sector to deliver content online, and dealing with the complexities of fast-changing technologies. Rising to these challenges and responding to them is a complex and multi-faceted task. This paper discusses a case study undertaken applying a framework drawn from engineering education teaching and learning methods using the concept of academagogy, which is learner-centric, actively empowering students in building effective learning and engages facilitators in meaningful teaching and delivery methods.

Learning and teaching epidemiology with audience response technology

Background The learning and teaching of epidemiology is core to many public health programs. Many students find the content of epidemiology, and specifically risk of bias assessment, challenging to learn. Howbeit, learning is enhanced when knowledge is able to be acquired from an active-learning, hands-on experience. Methods The innovative use of wireless audience response technology “clickers” was incorporated into the lectures of the university’s post-graduate epidemiology units and the tailored epidemiological modules delivered for professional disciplines (e.g. optometry). Clickers were used to apply several pedagogical approaches of active learning including peer-instruction and real-world simulation. Students were also assessed for their gain in knowledge within the lecture (pre-post) and their perceptions of how the use of clickers helped them learn. The routine university-wide end of semester Insight Survey provided further information of the student’s satisfaction with the approach. Results The technology was useful in identifying deficits of knowledge of key concepts either before or after instruction. Where key concepts were re-tested post-lecture, as expected, knowledge increased significantly and provided immediate feed-back to students. Across the lecture series, typically 85% of students identified the technology helped them learn, increased their opportunity to interact with the lecturer, and recommend their use for future classes. The Insight Survey report identified 93% of respondents identified the unit in which clickers were consistently used provided good learning opportunities. Numerous student comments supported the teaching method. Conclusions Epidemiological subject matter lends itself to incorporation of audience response technology. The use of the technology to facilitate interactive voting provides an instant response and participation of everyone to enhance the classroom experience. The pedagogical approach increases students’ knowledge and increases their satisfaction with the unit.

Teaching and using analogy in law

Analogy plays a central role in legal reasoning, yet how to analogize is poorly taught and poorly practiced. We all recognize when legal analogies are being made: when a law professor suggests a difficult hypothetical in class and a student tentatively guesses at the answer based on the cases she read the night before, when an attorney advises a client to settle because a previous case goes against him, or when a judge adopts one precedent over another on the basis that it better fits the present case. However, when it comes to explaining why certain analogies are compelling, persuasive, or better than the alternative, lawyers usually draw a blank. The purpose of this article is to provide a simple model that can be used to teach and to learn how analogy actually works, and what makes one analogy superior to a competing analogy. The model is drawn from a number of theories of analogy making in cognitive science. Cognitive science is the “long-term enterprise to understand the mind scientifically.” The field studies the mechanisms that are involved in cognitive processes like thinking, memory, learning, and recall; and one of its main foci has been on how people construct analogies. The lessons from cognitive science theories of analogy can be applied to legal analogies to give students and lawyers a better understanding of this fundamental process in legal reasoning.

Developing a culture of peer review of teaching through a distributive leadership approach

Teaching is a core function of higher education and must be effective if it is to provide students with learning experiences that are stimulating, challenging and rewarding Obtaining feedback on teaching is indispensable to enhancing the quality of learning design, facilitating personal and/or professional development and maximising student learning outcomes. Peer review of teaching has the potential to improve the quality of teaching at tertiary level, by encouraging critical reflection on teaching, innovation in teaching practice and scholarship of teaching at all academic levels. However, embedding peer review within the culture of teaching and learning is a significant challenge that requires sustained commitment from senior leadership as well as those in leadership roles within local contexts.

Good practice report : clinical teaching

Clinical experience, or experience in the ‘real world’ of practice, is a fundamental component of many health professional courses. It often involves students undertaking practical experience in clinical workplace settings, typically referred to as clinical placements, under the supervision of health professionals. Broadly speaking, the role of clinical supervisors, or teachers, is aimed at assisting students to integrate the theoretical and skills based components of the curriculum within the context of patient/client care (Erstzen et al 2009). Clinical experience also provides students with the opportunity to assimilate the attitudes, values and skills which they require to become appropriately skilled professionals in the environments in which they will eventually practise. However, clinical settings are particularly challenging learning environments for students. Unlike classroom learning, students in the clinical setting frequently find themselves involved in unplanned and often complex activities with patients and other health care providers, being supervised by a variety of clinical staff who have very different methods and styles of teaching, and negotiating bureaucratic or hierarchical structures in busy clinical workplaces where they may only be spending a limited amount of time. Kilminster et al (2007) also draw attention to tensions that may exist between the learning needs of students and the provision of quality care or need to prevent harm to the patient (e.g. Elkind et al 2007). All of these factors complicate the realisation of clinical education goals and underscore the need for effective clinical teaching practices that maximise student learning in clinical environments. This report provides a summary of work that has been achieved in relation to ALTC projects and fellowships associated with clinical teaching, and a review of scholarly publications relevant to this field. The report also makes recommendations based on issues identified and/or where further work is indicated. The projects and fellowships reviewed cover a range of discipline areas including Biology, Paramedic Practice, Clinical Exercise Physiology, Occupational Therapy, Speech Pathology, Physiotherapy, Pharmacy, Nursing and Veterinary Science. The main areas of focus cover issues related to curriculum, particularly in relation to industry expectations of ‘work-ready’ graduates and the implications for theoretical and practical, or clinical preparation; development of competency assessment tools that are nationally applicable across discipline-specific courses; and improvement of clinical learning through strategies targeting the clinical learning environment, building the teaching capacity of clinical supervisors and/or enhancing the clinical learning/teaching process.

Enhancing student learning in the workplace through developing the leadership capabilities of clinical supervisors in the nursing discipline

The purpose of this project was to build the leadership capacity of clinical supervisors in the nursing discipline by developing, implementing and systematically embedding a leadership model into the structure and practice of student supervision. The University worked in partnership with three major metropolitan hospitals in Queensland to develop a framework and professional development program incorporating leadership and clinical supervision. The Leadership and Clinical Education (LaCE) program consisted of two structured workshops complemented by individual personal development projects undertaken by participants. Participants were supported in these activities with a purpose-built website that provides access to a wide variety of information and other learning resources. Quantitative and qualitative evaluations indicated that the approach was highly valued by participants, as it promoted useful peer dialogue, sharing of experiences and personal development in relation to assisting leadership development and student learning in the workplace. The LaCE program provides an ideal springboard for introducing the development of welltrained leaders into the clinical workplace. The resources developed have the potential to provide ongoing support for clinical supervisors to improve the learning of undergraduate nursing student. The challenge will be to achieve continued innovation within clinical education through sustainable leadership programs.

Teaching Teachers for the Future : an Australian government national project

This paper describes the Teaching Teachers of the Future (TTF) Project – a national project funded ($8.8mil AUD) by the Australian Government. The project was aimed at building the capacity of student teachers to use technology to improve student learning outcomes. It discusses the aims and objectives of the project, its genesis in a changing educational and political landscape, the use of TPACK as a theoretical scaffold, and briefly reports on the operations of the various components and part-ners. Further, it discusses the research opportunities afforded by the project includ-ing a national survey of all PSTs in Australia gauging their TPACK confidence and the use of the Most Significant Change (MSC) methodology. Finally the paper dis-cusses the outcomes of the project and its future.

Teaching pharmacy students how to manage effectively in a highly competitive environment

Aims To evaluate if a revamped business management course for 4th year undergraduate pharmacy students had achieved the course aims of not only improving pharmacy students’ perceived understanding of pharmacy business management topics but also increasing their confidence in their business management knowledge and skills. Background Student feedback from previous years had indicated that the cohort had struggled to translate theoretical business management concepts learned in the classroom into practice in the workplace. To address this problem the course has been changed to a ‘flipped classroom’ format with face-to-face time focusing on case-based scenarios and interactive classroom discussion with some role plays. Method Both course assessment throughout the semester and a student survey informed the evaluation process. Results After completing the course, students felt they had increased their knowledge of business management concepts but many indicated that they lacked the confidence to undertake basic management functions. Conclusions Further course restructuring is required with a greater focus on skills development.

Translations of industry-based student learning and academic performances

We hypothesized that Industry based learning and teaching, especially through industry assigned student projects or training programs, is an integral part of science, technology, engineering and mathematics (STEM) education. In this paper we show that industry-based student training and experience increases students’ academic performances independent to the organizational parameters and contexts. The literature on industry-based student training focuses on employability and the industry dimension, and neglects in many ways the academic dimension. We observed that the association factors between academic attributes and contributions of industry-based student training are central and vital to the technological learning experiences. We explore international initiatives and statistics collected of student projects in two categories: Industry based learning performances and on campus performances. The data collected were correlated to five (5) universities in different industrialized countries, e.g., Australia N=545, Norway N=279, Germany N=74, France N=107 and Spain N=802 respectively. We analyzed industry-based student training along with company assigned student projects compared with in comparisons to campus performance. The data that suggests a strong correlation between industry-based student training per se and improved performance profiles or increasing motivation shows that industry-based student training increases student academic performance independent of organizational parameters and contexts. The programs we augmented were orthogonal to each other however, the trend of the students’ academic performances are identical. An isolated cohort for the reported countries that opposed our hypothesis warrants further investigation.

Contribution of industry-based student learning performance for the STEM education

We hypothesized that Industry based learning and teaching, especially through company assigned student projects or training programs, is an integral part of science, technology, engineering and mathematics (STEM) education. In this paper we show that industry-based student training and experience increases students’ academic performances independent to the organizational parameters and contexts. The literature on industry-based student training focuses on employability and the industry dimension, and neglects in many ways the academic dimension. We observed that the association factors between academic attributes and contributions of industry-based student training are central and vital to the technological learning experiences. We explore international initiatives and statistics collected of student projects in two categories: Industry based learning performances and on campus performances. The data collected were correlated to five (5) universities in different industrialized countries, e.g., Australia N=545 projects, Norway N=279, Germany N=74, France N=107 and Spain N=802. We analyzed industry-based student training along with company assigned student projects compared with in comparisons to campus performance. The data that suggests a strong correlation between industry-based student training per se and improved performance profiles or increasing motivation shows that industry-based student training increases student academic performance independent of organizational parameters and contexts. The programs we augmented were orthogonal to each other however, the trend of the students’ academic performances are identical. An isolated cohort for the reported countries that opposed our hypothesis warrants further investigation.

Teaching basic finance with Excel, and without pain

The five quantities of interest in elementary finance problems are present value, future value, amount of periodic payment, number of periods and the rate of compound interest per period. A recursive approach to computing each of these five quantities in a modern version of Excel, for the case of ordinary annuities, is described. The aim is to increase student understanding and build confidence in the answer obtained, and this may be achieved with only linear relationships and in cases where student knowledge of algebra is essentially zero. Annuity problems may be solved without use of logarithms and black-box intrinsic functions; these being used only as check mechanisms. The author has had success with the method at Bond University and surrounding high schools in Queensland, Australia.