Establishing a framework for transforming student engagement, success and retention in higher education institutions [Final Report]

The perennial issues of student engagement, success and retention (SESR) in higher education continue to attract attention as key indicators of learning and teaching quality. This project aimed to establish and provide a holistic framework that would allow higher education institutions (HEIs) manage and improve their student engagement and retention strategies and programs. The framework and main project deliverable is a Maturity Model (MM) for Student Engagement, Success and Retention (SESR-MM). The project involved three Australian universities with experience and reputations in SESR activities: Queensland University of Technology (lead institution), the University of Queensland and Griffith University, working cooperatively to develop and trial the project deliverables. Project findings suggest that the SESR-MM has the potential to positively transform the holistic—academic, social and personal—engagement experiences of students in Australian universities, and that the SESR-MM is a useful mechanism for sharing good practice and improving programs designed to enhance the student experience.

Automatic classification of free-text radiology reports to identify limb fractures using machine learning and the SNOMED CT ontology

Objective To develop and evaluate machine learning techniques that identify limb fractures and other abnormalities (e.g. dislocations) from radiology reports. Materials and Methods 99 free-text reports of limb radiology examinations were acquired from an Australian public hospital. Two clinicians were employed to identify fractures and abnormalities from the reports; a third senior clinician resolved disagreements. These assessors found that, of the 99 reports, 48 referred to fractures or abnormalities of limb structures. Automated methods were then used to extract features from these reports that could be useful for their automatic classification. The Naive Bayes classification algorithm and two implementations of the support vector machine algorithm were formally evaluated using cross-fold validation over the 99 reports. Result Results show that the Naive Bayes classifier accurately identifies fractures and other abnormalities from the radiology reports. These results were achieved when extracting stemmed token bigram and negation features, as well as using these features in combination with SNOMED CT concepts related to abnormalities and disorders. The latter feature has not been used in previous works that attempted classifying free-text radiology reports. Discussion Automated classification methods have proven effective at identifying fractures and other abnormalities from radiology reports (F-Measure up to 92.31%). Key to the success of these techniques are features such as stemmed token bigrams, negations, and SNOMED CT concepts associated with morphologic abnormalities and disorders. Conclusion This investigation shows early promising results and future work will further validate and strengthen the proposed approaches.

Developing a culture to support peer review of teaching in higher education

This presentation addresses issues related to leadership, academic development and scholarship of teaching and learning, and highlights research funded by the Australian Office of Learning and Teaching (OLT) designed to embed and sustain peer review of teaching within the culture of 5 Australian universities: Queensland University of Technology, University of Technology, Sydney, University of Adelaide, Curtin University, and Charles Darwin University. Peer review of teaching in higher education will be emphasised as a professional process for providing feedback on teaching and learning practice, which if sustained, can become an effective ongoing strategy for academic development (Barnard et al, 2011; Bell, 2005; Bolt and Atkinson, 2010; McGill & Beaty 2001, 1992; Kemmis & McTaggart, 2000). The research affirms that using developmental peer review models (Barnard et al, 2011; D'Andrea, 2002; Hammersley-Fletcher & Orsmond, 2004) can bring about successful implementation, especially when implemented within a distributive leadership framework (Spillane & Healey, 2010). The project’s aims and objectives were to develop leadership capacity and integrate peer review as a cultural practice in higher education. The research design was a two stage inquiry process over 2 years. The project began in July 2011 and encompassed a development and pilot phase followed by a cascade phase with questionnaire and focus group evaluation processes to support ongoing improvement and measures of outcome. Leadership development activities included locally delivered workshops complemented by the identification and support of champions. To optimise long term sustainability, the project was implemented through existing learning and teaching structures and processes within the respective partner universities. Research outcomes highlight the fundamentals of peer review of teaching and the broader contextual elements of integration, leadership and development, expressed as a conceptual model for embedding peer review of teaching within higher education. The research opens a communicative space about introduction of peer review that goes further than simply espousing its worth and introduction. The conceptual model highlights the importance of development of distributive leadership capacity, integration of policies and processes, and understanding the values, beliefs, assumptions and behaviors embedded in an organizational culture. The presentation overviews empirical findings that demonstrate progress to advance peer review requires an ‘across-the-board’ commitment to embed change, and inherently demands a process that co-creates connection across colleagues, discipline groups, and the university sector. Progress toward peer review of teaching as a cultural phenomenon can be achieved and has advantages for academic staff, scholarship, teaching evaluation and an organisation, if attention is given to strategies that influence the contexts and cultures of teaching practice. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment and has a focus on scholarship of teaching. The work is ongoing and has implication for policy, research, teaching development and student outcomes, and has potential application world-wide.

A threshold concepts focus to curriculum design: supporting student learning through application of variation theory

This project develops and evaluates a model of curriculum design that aims to assist student learning of foundational disciplinary ‘Threshold Concepts’. The project uses phenomenographic action research, cross-institutional peer collaboration and the Variation Theory of Learning to develop and trial the model. Two contrasting disciplines (Physics and Law) and four institutions (two research-intensive and two universities of technology) were involved in the project, to ensure broad applicability of the model across different disciplines and contexts. The Threshold Concepts that were selected for curriculum design attention were measurement uncertainty in Physics and legal reasoning in Law. Threshold Concepts are key disciplinary concepts that are inherently troublesome, transformative and integrative in nature. Once understood, such concepts transform students’ views of the discipline because they enable students to coherently integrate what were previously seen as unrelated aspects of the subject, providing new ways of thinking about it (Meyer & Land 2003, 2005, 2006; Land et al. 2008). However, the integrative and transformative nature of such threshold concepts make them inherently difficult for students to learn, with resulting misunderstandings of concepts being prevalent...

Metacognitive instruction : global and local shifts in considering listening input

A key shift of thinking for effective learning and teaching of listening input has been seen and organized in education locally and globally. This study has probed whether metacognitive instruction through a pedagogical cycle shifts high-intermediate students' English language learning and English as a second language (ESL) teacher's teaching focus on listening input. Twenty male Iranian students with an age range of 18 to 24 received a guided methodology including metacognitive strategies (planning, monitoring, and evaluation) for a period of three months. This study has used the strategies and probed the importance of metacognitive instruction through interviewing both the teacher and the students. The results have shown that metacognitive instruction helped both the ESL teacher's and the students' shift of thinking about teaching and learning listening input. This key shift of thinking has implications globally and locally for classroom practices of listening input.

Editorial : Action research, action learning and community services

This edition of ALARj has a focus on the contribution of action learning and action research to the development of community services, particularly nonprofits. The landscape of community services has been changing rapidly in recent decades, and can be typified by the notion of complexity. Complexity in the nature of issues that services seek to respond to, complexity in the policy environment and systems of support that have tended to silo and compartmentalise problems and people, and complexity in the institutional location non-profit services occupy in ‘helping’ those who are seen as ‘in need’ or marginalised. In addition to being typified by complexity the environment in which community services are located is dynamic, undergoing profound and ongoing change as neo-liberal approaches to understanding and responding to human need, which emphasise the individualisation of risk, and market principles such as choice, competition and innovation, drive social policy. How can long held values of empowerment, care, inclusivity and benefit to individuals and communities have expression in community services as they grapple with the challenges of being viable and relevant in such a dynamically changing environment? This edition brings together a range of contributions which speak to these challenges. The thematic through these is that processes are needed which engage services and communities in ongoing processes of inquiry about how they can best proceed in contexts typified by complexity and change. Action learning and action research can provide processes of this character.

Enhancing learning in large undergraduate classes using custom made audio-visual cases

This is an exploratory study into the effective use of embedding custom made audiovisual case studies (AVCS) in enhancing the student’s learning experience. This paper describes a project that used AVCS for a large divergent cohort of undergraduate students, enrolled in an International Business course. The study makes a number of key contributions to advancing learning and teaching within the discipline. AVCS provide first hand reporting of the case material, where the students have the ability to improve their understanding from both verbal and nonverbal cues. The paper demonstrates how AVCS can be embedded in a student-centred teaching approach to capture the students’ interest and to enhance a deep approach to learning by providing real-world authentic experience.

Developing a culture of peer review of teaching through a distributive leadership approach

Teaching is a core function of higher education and must be effective if it is to provide students with learning experiences that are stimulating, challenging and rewarding Obtaining feedback on teaching is indispensable to enhancing the quality of learning design, facilitating personal and/or professional development and maximising student learning outcomes. Peer review of teaching has the potential to improve the quality of teaching at tertiary level, by encouraging critical reflection on teaching, innovation in teaching practice and scholarship of teaching at all academic levels. However, embedding peer review within the culture of teaching and learning is a significant challenge that requires sustained commitment from senior leadership as well as those in leadership roles within local contexts.

Good practice report : clinical teaching

Clinical experience, or experience in the ‘real world’ of practice, is a fundamental component of many health professional courses. It often involves students undertaking practical experience in clinical workplace settings, typically referred to as clinical placements, under the supervision of health professionals. Broadly speaking, the role of clinical supervisors, or teachers, is aimed at assisting students to integrate the theoretical and skills based components of the curriculum within the context of patient/client care (Erstzen et al 2009). Clinical experience also provides students with the opportunity to assimilate the attitudes, values and skills which they require to become appropriately skilled professionals in the environments in which they will eventually practise. However, clinical settings are particularly challenging learning environments for students. Unlike classroom learning, students in the clinical setting frequently find themselves involved in unplanned and often complex activities with patients and other health care providers, being supervised by a variety of clinical staff who have very different methods and styles of teaching, and negotiating bureaucratic or hierarchical structures in busy clinical workplaces where they may only be spending a limited amount of time. Kilminster et al (2007) also draw attention to tensions that may exist between the learning needs of students and the provision of quality care or need to prevent harm to the patient (e.g. Elkind et al 2007). All of these factors complicate the realisation of clinical education goals and underscore the need for effective clinical teaching practices that maximise student learning in clinical environments. This report provides a summary of work that has been achieved in relation to ALTC projects and fellowships associated with clinical teaching, and a review of scholarly publications relevant to this field. The report also makes recommendations based on issues identified and/or where further work is indicated. The projects and fellowships reviewed cover a range of discipline areas including Biology, Paramedic Practice, Clinical Exercise Physiology, Occupational Therapy, Speech Pathology, Physiotherapy, Pharmacy, Nursing and Veterinary Science. The main areas of focus cover issues related to curriculum, particularly in relation to industry expectations of ‘work-ready’ graduates and the implications for theoretical and practical, or clinical preparation; development of competency assessment tools that are nationally applicable across discipline-specific courses; and improvement of clinical learning through strategies targeting the clinical learning environment, building the teaching capacity of clinical supervisors and/or enhancing the clinical learning/teaching process.

Enhancing student learning in the workplace through developing the leadership capabilities of clinical supervisors in the nursing discipline

The purpose of this project was to build the leadership capacity of clinical supervisors in the nursing discipline by developing, implementing and systematically embedding a leadership model into the structure and practice of student supervision. The University worked in partnership with three major metropolitan hospitals in Queensland to develop a framework and professional development program incorporating leadership and clinical supervision. The Leadership and Clinical Education (LaCE) program consisted of two structured workshops complemented by individual personal development projects undertaken by participants. Participants were supported in these activities with a purpose-built website that provides access to a wide variety of information and other learning resources. Quantitative and qualitative evaluations indicated that the approach was highly valued by participants, as it promoted useful peer dialogue, sharing of experiences and personal development in relation to assisting leadership development and student learning in the workplace. The LaCE program provides an ideal springboard for introducing the development of welltrained leaders into the clinical workplace. The resources developed have the potential to provide ongoing support for clinical supervisors to improve the learning of undergraduate nursing student. The challenge will be to achieve continued innovation within clinical education through sustainable leadership programs.

Promoting resilience and effective workplace functioning in international students in health courses

The purpose of this project was to improve the quality of the learning experiences of international students in nursing, public health and nutrition and dietetics, both at university and in the clinical setting. The university worked in partnership with three major metropolitan health care facilities/services in Queensland to develop a framework and resources designed to promote quality work-integrated learning experiences for international students and clinical supervisory staff. The Resilience in International Student Education (RISE) model consists of student and staff workshops complemented by a purpose-built Cultural Connections for Learning (CCL) website that provides access to a wide variety of information and other learning resources. Quantitative and qualitative evaluations indicate that the approach is highly valued by participants as it promotes useful dialogue, sharing of experiences and greater understanding regarding quality learning experiences for international students in the health workplace. It provides an ideal springboard for promoting collaboration between international students and clinical supervisors in the workplace. The resources developed have the potential to enhance student learning as well as clinical teaching. The challenge will be to achieve continued progress within international student education through the development of sustainable strategies to embed the program within the context of individual curricula.

Supporting future curriculum leaders in embedding Indigenous knowledge on teaching practicum

This report documents the outcomes of the OLT funded project on Supporting Future Curriculum Leaders in Embedding Indigenous Knowledges on Teaching Practicum. This project investigated the learning and teaching relationships between pre-service teachers and their supervisors on practicum, with pre-service teachers who were specifically engaged (Aboriginal and Torres Strait Islander and non-Indigenous pre-service teachers studying the Indigenous Studies minor) with embedding Indigenous knowledge and perspectives in their teaching practice. It explored the negotiations of expectations, role modelling and the interactions that occur between pre-service teachers, their supervising teachers and QUT staff involved in supporting teaching practicum. The intent was to design a model to develop long term, future-oriented opportunities for teachers to develop expertise in embedding Indigenous knowledge and perspectives in curriculum, pedagogy and assessment.

Engaging creativity through an action learning and action research process to develop an Indigenous art exhibition

In most art exhibitions, the creative part of the exhibition is assumed to be the artworks on display. But for the Capricornia Arts Mob’s first collective art exhibition in Rockhampton during NAIDOC Week in 2012, the process of developing the exhibition became the focus of creative action learning and action research. In working together to produce a multi-media exhibition, we learned about the collaborative processes and time required to develop a combined exhibition. We applied Indigenous ways of working – including yarning, cultural respect, cultural protocols, mentoring young people, providing a culturally safe working environment and sharing both time and food – to develop our first collective art exhibition. We developed a process that allowed us to ask deep questions, engage in a joint journey of learning, and develop our collective story. This paper explores the processes that the Capricornia Arts Mob used to develop the exhibition for NAIDOC 2012.

Learning and development opportunities as a tool for the retention of volunteers : a motivation perspective

The growing reliance on volunteers in Australia has heightened the need for non-profit organisations to retain these valuable resources. However, the current literature on volunteer retention is limited. One potential way volunteers can be retained is by providing learning and development opportunities (LDOs). This study investigates the relationship between volunteer perceptions of LDOs, their motivations for volunteering, and retention. Analyses revealed significant main effects for LDOs and volunteer motivations on retention and several interactive effects demonstrating that LDOs can have differential effects on retention depending on the reasons for volunteering.

Complete and competent engineers : a coaching model to developing holistic graduates

The growing gap between engineering practice and engineering has been identified at the level of certain essential skills needed among practising engineers but not developed through the current education system. Coaching approach to learning and teaching has been proven to be an effective way to develop people in the workplace. A pilot coaching program is proposed to engineering students at Queensland University of Technology to enable holistic growth in order to better integrate them to the work force and society at large. The success measures and insights gained will be published on completion of the program. It is hoped that the outcomes of this study will better inform curriculum design and development in the engineering disciplines towards better transition between engineering education and engineering practice.