The application of learning analytics to improve learning: Questions from the academy

Since 2007, close collaboration between the Learning and Teaching Unit’s Academic Quality and Standards team and the Department of Reporting and Analysis’ Business Objects team resulted in a generational approach to reporting where QUT established a place of trust. This place of trust is where data owners are confident in date storage, data integrity, reported and shared. While the role of the Department of Reporting and Analysis focused on the data warehouse, data security and publication of reports, the Academic Quality and Standards team focused on the application of learning analytics to solve academic research questions and improve student learning. Addressing questions such as: • Are all students who leave course ABC academically challenged? • Do the students who leave course XYZ stay within the faculty, university or leave? • When students withdraw from a unit do they stay enrolled on full or part load or leave? • If students enter through a particular pathway, what is their experience in comparison to other pathways? • With five years historic reporting, can a two-year predictive forecast provide any insight? In answering these questions, the Academic Quality and Standards team then developed prototype data visualisation through curriculum conversations with academic staff. Where these enquiries were applicable more broadly this information would be brought into the standardised reporting for the benefit of the whole institution. At QUT an annual report to the executive committees allows all stakeholders to record the performance and outcomes of all courses in a snapshot in time or use this live report at any point during the year. This approach to learning analytics was awarded the Awarded 2014 ATEM/Campus Review Best Practice Awards in Tertiary Education Management for The Unipromo Award for Excellence in Information Technology Management.

Let's do it: A framework to investigate the affordances of experimental learning environments

BACKGROUND Experimental learning, traditionally conducted in on-campus laboratory venues, is the cornerstone of science and engineering education. In order to ensure that engineering graduates are exposed to ‘real-world’ situations and attain the necessary professional skill-sets, as mandated by course accreditation bodies such as Engineers Australia, face-to-face laboratory experimentation with real equipment has been an integral component of traditional engineering education. The online delivery of engineering coursework endeavours to mimic this with remote and simulated laboratory experimentation. To satisfy student and accreditation requirements, the common practice has been to offer equivalent remote and/or simulated laboratory experiments in lieu of the ones delivered, face-to face, on campus. The current implementations of both remote and simulated laboratories tend to be specified with a focus on technical characteristics, instead of pedagogical requirements. This work attempts to redress this situation by developing a framework for the investigation of the suitability of different experimental educational environments to deliver quality teaching and learning. PURPOSE For the tertiary education sector involved with technical or scientific training, a research framework capable of assessing the affordances of laboratory venues is an important aid during the planning, designing and evaluating stages of face-to-face and online (or cyber) environments that facilitate student experimentation. Providing quality experimental learning venues has been identified as one of the distance-education providers’ greatest challenges. DESIGN/METHOD The investigation draws on the expertise of staff at three Australian universities: Swinburne University of Technology (SUT), Curtin University (Curtin) and Queensland University of Technology (QUT). The aim was to analyse video recorded data, in order to identify the occurrences of kikan-shido (a Japanese term meaning ‘between desks instruction’ and over-the-shoulder learning and teaching (OTST/L) events, thereby ascertaining the pedagogical affordances in face-to-face laboratories. RESULTS These will be disseminated at a Master Class presentation at this conference. DISCUSSION Kikan-shido occurrences did reflect on the affordances of the venue. Unlike with other data collection methods, video recorded data and its analysis is repeatable. Participant bias is minimised or even eradicated and researcher bias tempered by enabling re-coding by others. CONCLUSIONS Framework facilitates the identification of experiential face-to-face learning venue affordances. Investigation will continue with on-line venues.

The development and evaluation of an innovative nursing practice model to improve undergraduate nursing students' competence in paediatric physical assessment

Introduction The purpose of this study was to develop, implement and evaluate the impact of an educational intervention, comprising an innovative model of clinical decisionmaking and educational delivery strategy for facilitating nursing students‘ learning and development of competence in paediatric physical assessment practices. Background of the study Nursing students have an undergraduate education that aims to produce graduates of a generalist nature who demonstrate entry level competence for providing nursing care in a variety of health settings. Consistent with population morbidity and health care roles, paediatric nursing concepts typically form a comparatively small part of undergraduate curricula and students‘ exposure to paediatric physical assessment concepts and principles are brief. However, the nursing shortage has changed traditional nursing employment patterns and new graduates form the majority of the recruitment pool for paediatric nursing speciality staff. Paediatric nursing is a popular career choice for graduates and anecdotal evidence suggests that nursing students who select a clinical placement in their final year intend to seek employment in paediatrics upon graduation. Although concepts of paediatric nursing are included within undergraduate curriculum, students‘ ability to develop the required habits of mind to practice in what is still regarded as a speciality area of practice is somewhat limited. One of the areas of practice where this particularly impacts is in paediatric nursing physical assessment. Physical assessment is a fundamental component of nursing practice and competence in this area of practice is central to nursing students‘ development of clinical capability for practice as a registered nurse. Timely recognition of physiologic deterioration of patients is a key outcome of nurses‘ competent use of physical assessment strategies, regardless of the practice context. In paediatric nursing contexts children‘s physical assessment practices must specifically accommodate the child‘s different physiological composition, function and pattern of clinical deterioration (Hockenberry & Barrera, 2007). Thus, to effectively manage physical assessment of patients within the paediatric practice setting nursing students need to integrate paediatric nursing theory into their practice. This requires significant information processing and it is in this process where students are frequently challenged. The provision of rules or models can guide practice and assist novice-level nurses to develop their capabilities (Benner, 1984; Benner, Hooper-Kyriakidis & Stannard, 1999). Nursing practice models are cognitive tools that represent simplified patterns of expert analysis employing concepts that suit the limited reasoning of the inexperienced, and can represent the =rules‘ referred to by Benner (1984). Without a practice model of physical assessment students are likely to be uncertain about how to proceed with data collection, the interpretation of paediatric clinical findings and the appraisal of findings. These circumstances can result in ad hoc and unreliable nursing physical assessment that forms a poor basis for nursing decisions. The educational intervention developed as part of this study sought to resolve this problem and support nursing students‘ development of competence in paediatric physical assessment. Methods This study utilised the Context Input Process Product (CIPP) Model by Stufflebeam (2004) as the theoretical framework that underpinned the research design and evaluation methodology. Each of the four elements in the CIPP model were utilised to guide discrete stages of this study. The Context element informed design of the clinical decision-making process, the Paediatric Nursing Physical Assessment model. The Input element was utilised in appraising relevant literature, identifying an appropriate instructional methodology to facilitate learning and educational intervention delivery to undergraduate nursing students, and development of program content (the CD-ROM kit). Study One employed the Process element and used expert panel approaches to review and refine instructional methods, identifying potential barriers to obtaining an effective evaluation outcome. The Product element guided design and implementation of Study Two, which was conducted in two phases. Phase One employed a quasiexperimental between-subjects methodology to evaluate the impact of the educational intervention on nursing students‘ clinical performance and selfappraisal of practices in paediatric physical assessment. Phase Two employed a thematic analysis and explored the experiences and perspectives of a sample subgroup of nursing students who used the PNPA CD-ROM kit as preparation for paediatric clinical placement. Results Results from the Process review in Study One indicated that the prototype CDROM kit containing the PNPA model met the predetermined benchmarks for face validity and the impact evaluation instrumentation had adequate content validity in comparison with predetermined benchmarks. In the first phase of Study Two the educational intervention did not result in statistically significant differences in measures of student performance or self-appraisal of practice. However, in Phase Two qualitative commentary from students, and from the expert panel who reviewed the prototype CD-ROM kit (Study One, Phase One), strongly endorsed the quality of the intervention and its potential for supporting learning. This raises questions regarding transfer of learning and it is likely that, within this study, several factors have influenced students‘ transfer of learning from the educational intervention to the clinical practice environment, where outcomes were measured. Conclusion In summary, the educational intervention employed in this study provides insights into the potential e-learning approaches offer for delivering authentic learning experiences to undergraduate nursing students. Findings in this study raise important questions regarding possible pedagogical influences on learning outcomes, issues within the transfer of theory to practice and factors that may have influenced findings within the context of this study. This study makes a unique contribution to nursing education, specifically with respect to progressing an understanding of the challenges faced in employing instructive methods to impact upon nursing students‘ development of competence. The important contribution transfer of learning processes make to students‘ transition into the professional practice context and to their development of competence within the context of speciality practice is also highlighted. This study contributes to a greater awareness of the complexity of translating theoretical learning at undergraduate level into clinical practice, particularly within speciality contexts.

Scaffolding an EFL (English as a foreign language) ‘effective writing’ class in a hybrid learning community

This study sought to establish and develop innovative instructional procedures, in which scaffolding can be expanded and applied, in order to enhance learning of English as a Foreign Language (EFL) writing skills in an effective hybrid learning community (a combination of face-to-face and online modes of learning) at the university where the researcher is working. Many educational experts still believe that technology has not been harnessed to its potential to meet the new online characteristics and trends. There is also an urgency to reconsider the pedagogical perspectives involved in the utilisation of online learning systems in general and the social interactions within online courses in particular that have been neglected to date. An action research design, conducted in two cycles within a duration of four months, was utilised throughout this study. It was intended not only to achieve a paradigm shift from transmission-absorption to socio-constructivist teaching/learning methodologies but also to inform practice in these technology-rich environments. Five major findings emerged from the study. First, the scaffolding theory has been extended. Two new scaffolding types (i.e., quasi-transcendental scaffolding and transcendental scafolding), two scaffolding aspects (i.e., receptive and productive) and some scaffolding actions (e.g., providing a stimulus, awareness, reminder, or remedy) for EFL writing skills in an effective hybrid learning community have been identified and elaborated on. Second, the EFL ‘Effective Writing’ students used the scaffolds implemented in a hybrid environment to enhance and enrich their learning of writing of English essays. The online activities, conducted after the F2F sessions most of the time, gave students greater opportunities to both reinforce and expand the knowledge they had acquired in the F2F mode. Third, a variety of teaching techniques, different online tasks and discussion topics utilised in the two modes bolstered the students’ interests and engagement in their knowledge construction of how to compose English-language essays. Fourth, through the scaffolded activities, the students learned how to scaffold themselves and thus became independent learners in their future endeavours of constructing knowledge. Fifth, the scaffolding-to-scaffold activities provided the students with knowledge on how to effectively engage in transcendental scaffolding actions and facilitate the learning of English writing skills by less able peers within the learning community. Thus, the findings of this current study extended earlier understandings of scaffolding in an EFL hybrid learning environment and will contribute to the advancement of future ICT-mediated courses in terms of their scaffolding pedagogical aspects.

A tale of six fish: achieving social presence through discussion forums in an offline learning environment

It is widely held, through the Socratic tradition, that discussion is at the heart of learning. Moderated discussion forums have been shown to replicate the debate, argument and verbal defence of viewpoints that we have come to expect in face-to-face learning environments and that we generally accept to underpin learning. While much has been written about discussion forums in educational settings, particularly in how to moderate and promote effective interaction with students at a distance, this paper takes a different approach. It looks at how forums may be used to support face-to-face learning in the contemporary context of the massification of on-campus classes. Further to this, it will argue for discussion forums as an indicator of social presence in the learning environment. It will cautiously conclude that, through purposeful design, this form of asynchronous communication has a valuable role to play in creating a positive and supportive environment for students entering university. Discussion forums are tools with a versatility yet to be fully exploited.

Good Practice Report : Blended Learning

In early 2011, the Australian Learning and Teaching Council Ltd (ALTC) commissioned a series of Good Practice Reports on completed ALTC projects and fellowships. This report will: • Provide a summative evaluation of the good practices and key outcomes for teaching and learning from completed ALTC projects and fellowships relating to blended learning • Include a literature review of the good practices and key outcomes for teaching and learning from national and international research • Identify areas in which further work or development are appropriate. The literature abounds with definitions; it can be argued that the various definitions incorporate different perspectives, but there is no single, collectively accepted definition. Blended learning courses in higher education can be placed somewhere on a continuum, between fully online and fully face-to-face courses. Consideration must therefore be given to the different definitions for blended learning presented in the literature and by users and stakeholders. The application of this term in these various projects and fellowships is dependent on the particular focus of the team and the conditions and situations under investigation. One of the key challenges for projects wishing to develop good practice in blended learning is the lack of a universally accepted definition. The findings from these projects and fellowships reveal the potential of blended learning programs to improve both student outcomes and levels of satisfaction. It is clear that this environment can help teaching and learning engage students more effectively and allow greater participation than traditional models. Just as there are many definitions, there are many models and frameworks that can be successfully applied to the design and implementation of such courses. Each academic discipline has different learning objectives and in consequence there can’t be only one correct approach. This is illustrated by the diversity of definitions and applications in the ALTC funded projects and fellowships. A review of the literature found no universally accepted guidelines for good practice in higher education. To inform this evaluation and literature review, the Seven Principles for Good Practice in Undergraduate Education, as outlined by Chickering and Gamson (1987), were adopted: 1. encourages contacts between students and faculty 2. develops reciprocity and cooperation among students 3. uses active learning techniques 4. gives prompt feedback 5. emphasises time on task 6. communicates high expectations 7. respects diverse talents and ways of learning. These blended learning projects have produced a wide range of resources that can be used in many and varied settings. These resources include: books, DVDs, online repositories, pedagogical frameworks, teaching modules. In addition there is valuable information contained in the published research data and literature reviews that inform good practice and can assist in the development of courses that can enrich and improve teaching and learning.

Should we still lecture? Reconsidering pedagogical approaches to promote student engagement, challenging the traditional lecture

The dynamic interplay between existing learning frameworks: people, pedagogy, learning spaces and technology is challenging the traditional lecture. A paradigm is emerging from the correlation of change amongst these elements, offering new possibilities for improving the quality of the learning experience. For many universities, the design of physical learning spaces has been the focal point for blending technology and flexible learning spaces to promote learning and teaching. As the pace of technological change intensifies, affording new opportunities for engaging learners, pedagogical practice in higher education is not comparatively evolving. The resulting disparity is an opportunity for the reconsideration of pedagogical practice for increased student engagement in physical learning spaces as an opportunity for active learning. This interplay between students, staff and technology is challenging the value for students in attending physical learning spaces such as the traditional lecture. Why should students attend for classes devoted to content delivery when streaming and web technologies afford more flexible learning opportunities? Should we still lecture? Reconsideration of pedagogy is driving learning design at Queensland University of Technology, seeking new approaches affording increased student engagement via active learning experiences within large lectures. This paper provides an overview and an evaluation of one of these initiatives, Open Web Lecture (OWL), an experimental web based student response application developed by Queensland University of Technology. OWL seamlessly integrates a virtual learning environment within physical learning spaces, fostering active learning opportunities. This paper will evaluate the pilot of this initiative through consideration of effectiveness in increasing student engagement through the affordance of web enabled active learning opportunities in physical learning spaces.

Should we still lecture? Reconsidering pedagogical approaches to promote student engagement, challenging the traditional lecture

The dynamic interplay between existing learning frameworks: people, pedagogy, learning spaces and technology is challenging the traditional lecture. A paradigm is emerging from the correlation of change amongst these elements, offering new possibilities for improving the quality of the learning experience. For many universities, the design of physical learning spaces has been the focal point for blending technology and flexible learning spaces to promote learning and teaching. As the pace of technological change intensifies, affording new opportunities for engaging learners, pedagogical practice in higher education is not comparatively evolving. The resulting disparity is an opportunity for the reconsideration of pedagogical practice for increased student engagement in physical learning spaces as an opportunity for active learning. This interplay between students, staff and technology is challenging the value for students in attending physical learning spaces such as the traditional lecture. Why should students attend for classes devoted to content delivery when streaming and web technologies afford more flexible learning opportunities? Should we still lecture? Reconsideration of pedagogy is driving learning design at Queensland University of Technology, seeking new approaches affording increased student engagement via active learning experiences within large lectures. This paper provides an overview and an evaluation of one of these initiatives, Open Web Lecture (OWL), an experimental web based student response application developed by Queensland University of Technology. OWL seamlessly integrates a virtual learning environment within physical learning spaces, fostering active learning opportunities. This paper will evaluate the pilot of this initiative through consideration of effectiveness in increasing student engagement through the affordance of web enabled active learning opportunities in physical learning spaces.

A holistic blended design studio model : a basis for exploring and expanding learning opportunities

While the studio environment has been promoted as an ideal educational setting for project-based disciplines, few qualitative studies have been undertaken in a comprehensive way (Bose, 2007). This study responds to this need by adopting Grounded Theory methodology in a qualitative comparative approach. The research aims to explore the limitations and benefits of a face-to-face (f2f) design studio as well as a virtual design studio (VDS) as experienced by architecture students and educators at an Australian university in order to find the optimal combination for a blended environment to maximize learning. The main outcome is a holistic multidimensional blended model being sufficiently flexible to adapt to various setting, in the process, facilitating constructivist learning through self-determination, self-management, and personalization of the learning environment.

Managing distraction in 21st century learning environments

First year students attend face-to-face classes armed with an arsenal of internet enabled digital devices. The conundrum is that while these devices offer scope for enhancing opportunities for engagement in face-to-face learning, they may simultaneously distract students away from learning and compound isolation issues. This paper considers how to best to use these devices for maximum engagement in first year face-to-face learning so as to assist students in connecting with other learners and instructors within the learning environment

Managing distraction and attention in diverse cohorts : 21st century challenges to law student engagement

It is imperative that we consider the use of current and emerging technologies in terms of the nature of our learners, the physical environment of the lecture theatre, and how technology may help to support appropriate pedagogies that facilitate the capturing of student attention in active engaging learning experiences. It is argued that a re-evaluation of pedagogy is required to address the tech-savy traits of the 21st century learner and the extent to which their mobile devices are capable of not only distracting them from learning but also enhancing face-to-face learning experiences.

Mastery Motivation in Children with Down Syndrome : Promoting and Sustaining Interest in Learning

Motivation is central to children’s learning. Without persistent effort, especially in the face of failure, and an eagerness to engage in challenging tasks, individuals are unlikely to learn as effectively as they might. Because of their cognitive impairments, children with Down syndrome will almost certainly have difficulties with learning. These difficulties will be ameliorated somewhat by strong engagement with learning activities whereas problems with motivation are likely to further jeopardise their academic progress as well as potentially limiting achievements in other areas of life. In this chapter we begin with a general overview of motivation. Using the framework of mastery motivation, we review the relatively small amount of research about children with Down syndrome. We identify the individual characteristics and features of children’s environments that are likely to be related to lower or higher levels of mastery motivation. In the final section, we consider implications for educators and then draw together the findings to provide a set of recommendations for future research.

A holistic model for blended learning

While the studio environment has been promoted as an ideal educational setting for project-based disciplines, few qualitative studies have been undertaken in a comprehensive way (Bose, 2007). This study responds to this need by adopting Grounded Theory methodology in a qualitative comparative approach. The research aims to explore the limitations and benefits of a face-to-face (f2f) design studio as well as a virtual design studio (VDS) as experienced by architecture students and educators at an Australian university in order to find the optimal combination for a blended environment to maximize learning. The main outcome is a holistic multidimensional blended model being sufficiently flexible to adapt to various setting, in the process, facilitating constructivist learning through self-determination, self-management, and personalization of the learning environment.

A holistic, institution-wide approach to building sessional staff capacity

Sessional Academics enhance students’ learning experience by bringing a diverse range of perspectives and expertise into the classroom. As industry specialists, research students, and recent graduates who have excelled in their courses, they complement the discipline expertise of career academics. With increasing casualization of the academic workforce, Sessional Academics now deliver the majority of face-to-face undergraduate teaching in Australian Universities. To enable them to realize their full potential as effective contributors to student learning and course quality, universities need to offer effective training and access to advice and support and facilitate engagement in university life. However, in the face of complex and diverse contexts, overwhelming numbers, and the transitory nature of sessional cohorts, few universities have developed a comprehensive, systematic approach. During the past three years at QUT, we have set out to develop a multifaceted approach to Sessional Academic support and development. In this paper I will explain why and how we have done so, and describe the range of strategies and programs we have developed. They include a central academic development program, which is structured and scaffolded with learning objectives and outcomes, and aligned with a graduate certificate in Academic Practice; a Sessional Academic Success program, which deploys experienced, school-based sessional academic success advisors to provide local support, build a sense of community, and offer discipline focused academic development; an online, dialogic communication strategy; and opportunities to present and be acknowledged for good learning and teaching practices. Together, these strategies have impacted on sessional academics’ confidence, learning and teaching capacity, reflection and engagement.

Rethinking connectedness : an investigation into the access of teacher professional learning in regional and remote Western Australia

Many teachers working in remote and regional areas have limited access to collegial support networks. This research aimed to examine the existing strategies that were being undertaken by the Department of Education in Western Australia, to provide professional learning to teachers in regional and remote areas. It was important to establish the perceptions of teachers’ access to professional learning from those working at the coalface in geographically dispersed areas. Consequently, the possible opportunity for improving the amount and variety of professional learning, through the application of both synchronous and asynchronous technologies was proposed. The study was guided by the primary research question: “In what ways might technology be used to support professional development of regional and remote teachers in Western Australia?” Generating descriptions of current practice of professional learning along with the teacher perceptions were central to this research endeavour. The study relied on a mixed method research approach in order to attend to the research question. The data were collected in phases, referred to as an explanatory mixed methods design. Quantitative data were collected from 104 participants to provide a general picture of the research problem. To further refine this general picture, qualitative data were collected through interviews and e-interviews of 10 teachers. Participants in the study included graduate teachers, teachers who had taught more than two years, senior teachers and Level Three teachers from seven teaching districts within Western Australia. An investigation into current practice was included in this phase and technologies available to support a professional learning community over distance were documented. The final phase incorporated the formulation of a conceptual framework where a model was developed to facilitate the successful implementation of a professional learning community through the application of synchronous and asynchronous technologies. The study has identified that travel time in order to access professional development is significant and impacts on teachers’ personal time. There are limited relief teachers available in these isolated areas which impacts on the opportunities to access professional development. Teachers face inequities, in terms of promotion, because professional development is explicitly linked to promotional opportunities. Importantly, it was found that professional learning communities are valued, but are often limited by small staff numbers at the geographic locality of the school. Teachers preferred to undertake professional learning in the local context of their district, school or classroom and this professional learning must be established at the need of the individual teacher in line with the school priorities. Teachers reported they were confident in using technology and accessing professional development online if required, however, much uncertainty surrounded the use of web 2.0 technologies for this purpose. The recommendations made from the study are intended to identify how a professional learning community might be enhanced through synchronous and asynchronous technologies.