How should we measure online learning activity?

The proliferation of Web-based learning objects makes finding and evaluating resources a considerable hurdle for learners to overcome. While established learning analytics methods provide feedback that can aid learner evaluation of learning resources, the adequacy and reliability of these methods is questioned. Because engagement with online learning is different from other Web activity, it is important to establish pedagogically relevant measures that can aid the development of distinct, automated analysis systems. Content analysis is often used to examine online discussion in educational settings, but these instruments are rarely compared with each other which leads to uncertainty regarding their validity and reliability. In this study, participation in Massive Open Online Course (MOOC) comment forums was evaluated using four different analytical approaches: the Digital Artefacts for Learning Engagement (DiAL-e) framework, Bloom's Taxonomy, Structure of Observed Learning Outcomes (SOLO) and Community of Inquiry (CoI). Results from this study indicate that different approaches to measuring cognitive activity are closely correlated and are distinct from typical interaction measures. This suggests that computational approaches to pedagogical analysis may provide useful insights into learning processes.

A review of predictive factors of student success in and satisfaction with online learning

Students perceive online courses differently than traditional courses. Negative perceptions can lead to unfavourable learning outcomes including decreased motivation and persistence. Throughout this review, a broad range of factors that affect performance and satisfaction within the online learning environment for adult learners will be examined including learning outcomes, instructional design and learner characteristics, followed by suggestions for further research, and concluding with implications for online learning pertinent to administrators, instructors, course designers and students. Online learning may not be appropriate for every student. Identifying particular characteristics that contribute to online success versus failure may aid in predicting possible learning outcomes and save students from enrolling in online courses if this type of learning environment is not appropriate for them. Furthermore, knowing these learner attributes may assist faculty in designing quality online courses to meet students’ needs. Adequate instructional methods, support, course structure and design can facilitate student performance and satisfaction.