How should we measure online learning activity?

The proliferation of Web-based learning objects makes finding and evaluating resources a considerable hurdle for learners to overcome. While established learning analytics methods provide feedback that can aid learner evaluation of learning resources, the adequacy and reliability of these methods is questioned. Because engagement with online learning is different from other Web activity, it is important to establish pedagogically relevant measures that can aid the development of distinct, automated analysis systems. Content analysis is often used to examine online discussion in educational settings, but these instruments are rarely compared with each other which leads to uncertainty regarding their validity and reliability. In this study, participation in Massive Open Online Course (MOOC) comment forums was evaluated using four different analytical approaches: the Digital Artefacts for Learning Engagement (DiAL-e) framework, Bloom's Taxonomy, Structure of Observed Learning Outcomes (SOLO) and Community of Inquiry (CoI). Results from this study indicate that different approaches to measuring cognitive activity are closely correlated and are distinct from typical interaction measures. This suggests that computational approaches to pedagogical analysis may provide useful insights into learning processes.

Participant association and emergent curriculum in a MOOC: can the community be the curriculum?

We investigated how participants associated with each other and developed community in a Massive Open Online Course (MOOC) about Rhizomatic Learning (Rhizo14). We compared learner experiences in two social networking sites (SNSs), Facebook and Twitter. Our combination of thematic analysis of qualitative survey data with analysis of participant observation, activity data, archives and visualisation of SNS data enabled us to reach a deeper understanding of participant perspectives and explore SNS use. Community was present in the course title and understood differently by participants. In the absence of explanation or discussion about community early in the MOOC, a controversy between participants about course expectations emerged that created oppositional discourse. Fall off in activity in MOOCs is common and was evident in Rhizo14. As the course progressed, fewer participants were active in Facebook and some participants reported feelings of exclusion. Despite this, activity in Facebook increased overall. The top 10 most active participants were responsible for 47% of total activity. In the Rhizo14 MOOC, both community and curriculum were expected to emerge within the course. We suggest that there are tensions and even contradictions between ‘Community Is the Curriculum’ and Deleuze and Guattari's principles of the rhizome, mainly focussed on an absence of heterogeneity. These tensions may be exacerbated by SNSs that use algorithmic streams. We propose the use of networking approaches that enable negotiation and exchange to encourage heterogeneity rather than emergent definition of community.

The space for social media in structured online learning

In this paper, we explore the benefits of using social media in an online educational setting, with a particular focus on the use of Facebook and Twitter by participants in a Massive Open Online Course (MOOC) developed to enable educators to learn about the Carpe Diem learning design process. We define social media as digital social tools and environments located outside of the provision of a formal university-provided Learning Management System. We use data collected via interviews and surveys with the MOOC participants as well as social media postings made by the participants throughout the MOOC to offer insights into how participants’ usage and perception of social media in their online learning experiences differed and why. We identified that, although some participants benefitted from social media by crediting it, for example, with networking and knowledge-sharing opportunities, others objected or refused to engage with social media, perceiving it as a waste of their time. We make recommendations for the usage of social media for educational purposes within MOOCs and formal digital learning environments.

The educational problem that MOOCs could solve: professional development for teachers of disadvantaged students

The demographics of massive open online course (MOOC) analytics show that the great majority of learners are highly qualified professionals, and not, as originally envisaged, the global community of disadvantaged learners who have no access to good higher education. MOOC pedagogy fits well with the combination of instruction and peer community learning found in most professional development. A UNESCO study therefore set out to test the efficacy of an experimental course for teachers who need but do not receive high-quality continuing professional development, as a way of exploiting what MOOCs can do indirectly to serve disadvantaged students. The course was based on case studies around the world of information and communication technology (ICT) in primary education and was carried out to contribute to the UNESCO “Education For All” goal. It used a co-learning approach to engage the primary teaching community in exploring ways of using ICT in primary education. Course analytics, forums and participant surveys demonstrated that it worked well. The paper concludes by arguing that this technology has the power to tackle the large-scale educational problem of developing the primary-level teachers needed to meet the goal of universal education.

A Design Guide for Open Online Courses

This guide is a comprehensive summary of how we went about creating Citizen Maths, an open online maths course and service. The guide shares our design principles and the techniques we used to put them into practice. Our aim is to provide – with the appropriate ‘translation’ – a resource that will be useful to to other teams who are developing online education initiatives.

Some aspects of grading Java code submissions in MOOCs

Recently, massive open online courses (MOOCs) have been offering a new online approach in the field of distance learning and online education. A typical MOOC course consists of video lectures, reading material and easily accessible tests for students. For a computer programming course, it is important to provide interactive, dynamic, online coding exercises and more complex programming assignments for learners. It is expedient for the students to receive prompt feedback on their coding submissions. Although MOOC automated programme evaluation subsystem is capable of assessing source programme files that are in learning management systems, in MOOC systems there is a grader that is responsible for evaluating students’ assignments with the result that course staff would be required to assess thousands of programmes submitted by the participants of the course without the benefit of an automatic grader. This paper presents a new concept for grading programming submissions of students and improved techniques based on the Java unit testing framework that enables automatic grading of code chunks. Some examples are also given such as the creation of unique exercises by dynamically generating the parameters of the assignment in a MOOC programming course combined with the kind of coding style recognition to teach coding standards.

Fostering postgraduate student engagement: online resources supporting self-directed learning in a diverse cohort

The research question for this study was: ‘Can the provision of online resources help to engage and motivate students to become self-directed learners?’ This study presents the results of an action research project to answer this question for a postgraduate module at a research-intensive university in the United Kingdom. The analysis of results from the study was conducted dividing the students according to their programme degree – Masters or PhD – and according to their language skills. The study indicated that the online resources embedded in the module were consistently used, and that the measures put in place to support self-directed learning (SDL) were both perceived and valued by the students, irrespective of their programme or native language. Nevertheless, a difference was observed in how students viewed SDL: doctoral students seemed to prefer the approach and were more receptive to it than students pursuing their Masters degree. Some students reported that the SDL activity helped them to achieve more independence than did traditional approaches to teaching. Students who engaged with the online resources were rewarded with higher marks and claimed that they were all the more motivated within the module. Despite the different learning experiences of the diverse cohort, the study found that the blended nature of the course and its resources in support of SDL created a learning environment which positively affected student learning.

A review of predictive factors of student success in and satisfaction with online learning

Students perceive online courses differently than traditional courses. Negative perceptions can lead to unfavourable learning outcomes including decreased motivation and persistence. Throughout this review, a broad range of factors that affect performance and satisfaction within the online learning environment for adult learners will be examined including learning outcomes, instructional design and learner characteristics, followed by suggestions for further research, and concluding with implications for online learning pertinent to administrators, instructors, course designers and students. Online learning may not be appropriate for every student. Identifying particular characteristics that contribute to online success versus failure may aid in predicting possible learning outcomes and save students from enrolling in online courses if this type of learning environment is not appropriate for them. Furthermore, knowing these learner attributes may assist faculty in designing quality online courses to meet students’ needs. Adequate instructional methods, support, course structure and design can facilitate student performance and satisfaction.