Learning analytics from distance learning

Presentation at M25 Learning Technology Group, FutureLearn, 15 November 2017

How should we measure online learning activity?

The proliferation of Web-based learning objects makes finding and evaluating resources a considerable hurdle for learners to overcome. While established learning analytics methods provide feedback that can aid learner evaluation of learning resources, the adequacy and reliability of these methods is questioned. Because engagement with online learning is different from other Web activity, it is important to establish pedagogically relevant measures that can aid the development of distinct, automated analysis systems. Content analysis is often used to examine online discussion in educational settings, but these instruments are rarely compared with each other which leads to uncertainty regarding their validity and reliability. In this study, participation in Massive Open Online Course (MOOC) comment forums was evaluated using four different analytical approaches: the Digital Artefacts for Learning Engagement (DiAL-e) framework, Bloom's Taxonomy, Structure of Observed Learning Outcomes (SOLO) and Community of Inquiry (CoI). Results from this study indicate that different approaches to measuring cognitive activity are closely correlated and are distinct from typical interaction measures. This suggests that computational approaches to pedagogical analysis may provide useful insights into learning processes.

Development of an institutional framework to guide transitions into enhanced blended learning in higher education

The rapidly changing digital landscape is having a significant influence on learning and teaching. Our study assesses the response of one higher education institution (HEI) to the changing digital landscape and its transition into enhanced blended learning, which seeks to go beyond the early implementation stage to make the most effective use of online learning technologies to enhance the student experience and student learning outcomes. Evidence from a qualitative study comprising 20 semi-structured interviews, informed by a literature review, has resulted in the development of a holistic framework to guide HEIs transitioning into enhanced blended learning. The proposed framework addresses questions relating to the why (change agents), what (institutional considerations), how (organisational preparedness) and who (stakeholders) of transitions into enhanced blended learning. The involvement of all stakeholder groups is essential to a successful institutional transition into enhanced blended learning.

Collaborative technologies, higher order thinking and self-sufficient learning: A case study of adult learners

The inclusion of online elements in learning environments is becoming commonplace in Post Compulsory Education. A variety of research into the value of such elements is available, and this study aims to add further evidence by looking specifically at the use of collaborative technologies such as online discussion forums and wikis to encourage higher order thinking and self-sufficient learning. In particular, the research examines existing pedagogical models including Salmon’s five-stage model, along with other relevant literature. A case study of adult learners in community-based learning centres forms the basis of the research, and as a result of the findings, an arrow model is suggested as a framework for online collaboration that emphasises the learner, mentions pre-course preparation and then includes three main phases of activity: post, interact and critique. This builds on Salmon’s five-stage model and has the benefit of being flexible and responsive, as well as allowing for further development beyond the model, particularly in a blended learning environment.

Association for Learning Technology Annual Survey 2017 Data and Report

This is the fourth Association for Learning Technology (ALT) Annual Survey. As with previous years, the survey was advertised predominately to ALT Members but at the same time promoted publically, and responses were collected between December 2017 and January 2018. The ALT Annual Survey contains a common core of questions asked in all annual surveys. This year the survey was supplemented with additional questions specifically aimed at gaining feedback for Certified Member of ALT (CMALT) framework and to identify other priorities 2018.