The role of learning design and learning analytics in MOOCs

The last couple of years there has been a lot of attention for MOOCs. More and more universities start offering MOOCs. Although the open dimension of MOOC indicates that it is open in every aspect, in most cases it is a course with a structure and a timeline within which learning activities are positioned. There is a contradiction there. The open aspect puts MOOCs more in the non-formal professional learning domain, while the course structure takes it into the formal, traditional education domain. Accordingly, there is no consensus yet on solid pedagogical approaches for MOOCs. Something similar can be said for learning analytics, another upcoming concept that is receiving a lot of attention. Given its nature, learning analytics offers a large potential to support learners in particular in MOOCs. Learning analytics should then be applied to assist the learners and teachers in understanding the learning process and could predict learning, provide opportunities for pro-active feedback, but should also results in interventions aimed at improving progress. This paper illustrates pedagogical and learning analytics approaches based on practices developed in formal online and distance teaching university education that have been fine-tuned for MOOCs and have been piloted in the context of the EU-funded MOOC projects ECO (Elearning, Communication, Open-Data: http://ecolearning.eu) and EMMA (European Multiple MOOC Aggregator: http://platform.europeanmoocs.eu).

Learning design guided learning analytics in MOOCs

Poster presentation for our paper Brouns, F., & Firssova, O. (2016, October).The role of learning design and learning analytics in MOOCs. Paper presented at 9th EDEN Research Workshop, Oldenburg, Germany.

Game Learning Analytics: Learning Analytics for Serious Games

Video games have become one of the largest entertainment industries, and their power to capture the attention of players worldwide soon prompted the idea of using games to improve education. However, these educational games, commonly referred to as serious games, face different challenges when brought into the classroom, ranging from pragmatic issues (e.g. a high development cost) to deeper educational issues, including a lack of understanding of how the students interact with the games and how the learning process actually occurs. This chapter explores the potential of data-driven approaches to improve the practical applicability of serious games. Existing work done by the entertainment and learning industries helps to build a conceptual model of the tasks required to analyze player interactions in serious games (gaming learning analytics or GLA). The chapter also describes the main ongoing initiatives to create reference GLA infrastructures and their connection to new emerging specifications from the educational technology field. Finally, it explores how this data-driven GLA will help in the development of a new generation of more effective educational games and new business models that will support their expansion. This results in additional ethical implications, which are discussed at the end of the chapter.

Education and self-regulation of learning for gifted pupils: Systemic design and development.

Gifted pupils differ from their age-mates with respect to development potential, actual competencies, self-regulatory capabilities, and learning styles in one or more domains of competence. The question is how to design and develop education that fits and further supports such characteristics and competencies of gifted pupils. Analysis of various types of educational interventions for gifted pupils reflects positive cognitive or intellectual effects and differentiated social comparison or group-related effects on these pupils. Systemic preventive combination of such interventions could make these more effective and sustainable. The systemic design is characterised by three conditional dimensions: differentiation of learning materials and procedures, integration by and use of ICT support, and strategies to improve development and learning. The relationships to diagnostic, instructional, managerial, and systemic learning aspects are expressed in guidelines to develop or transform education. The guidelines imply the facilitation of learning arrangements that provide flexible self-regulation for gifted pupils. A three-year pilot in Dutch nursery and primary school is conducted to develop and implement the design in collaboration with teachers. The results constitute prototypes of structured competence domains and supportive software. These support the screening of entry characteristics of all four-year old pupils and assignment of adequate play and learning processes and activities throughout the school career. Gifted and other pupils are supported to work at their actual achievement or competency levels since their start in nursery school, in self-regulated learning arrangements either in or out of class. Each pupil can choose other pupils to collaborate with in small groups, at self-chosen tasks or activities, while being coached by the teacher. Formative evaluation of the school development process shows that the systemic prevention guidelines seem to improve learning and social progress of gifted pupils, including their self-regulation. Further development and implementation steps are discussed.

Unraveling networked learning initiatives: an analytic framework

Networked learning happens naturally within the social systems of which we are all part. However, in certain circumstances individuals may want to actively take initiative to initiate interaction with others they are not yet regularly in exchange with. This may be the case when external influences and societal changes require innovation of existing practices. This paper proposes a framework with relevant dimensions providing insight into precipitated characteristics of designed as well as ‘fostered or grown’ networked learning initiatives. Networked learning initiatives are characterized as “goal-directed, interest-, or needs based activities of a group of (at least three) individuals that initiate interaction across the boundaries of their regular social systems”. The proposed framework is based on two existing research traditions, namely 'networked learning' and 'learning networks', comparing, integrating and building upon knowledge from both perspectives. We uncover some interesting differences between definitions, but also similarities in the way they describe what ‘networked’ means and how learning is conceptualized. We think it is productive to combine both research perspectives, since they both study the process of learning in networks extensively, albeit from different points of view, and their combination can provide valuable insights in networked learning initiatives. We uncover important features of networked learning initiatives, characterize actors and connections of which they are comprised and conditions which facilitate and support them. The resulting framework could be used both for analytic purposes and (partly) as a design framework. In this framework it is acknowledged that not all successful networks have the same characteristics: there is no standard ‘constellation’ of people, roles, rules, tools and artefacts, although there are indications that some network structures work better than others. Interactions of individuals can only be designed and fostered till a certain degree: the type of network and its ‘growth’ (e.g. in terms of the quantity of people involved, or the quality and relevance of co-created concepts, ideas, artefacts and solutions to its ‘inhabitants’) is in the hand of the people involved. Therefore, the framework consists of dimensions on a sliding scale. It introduces a structured and analytic way to look at the precipitation of networked learning initiatives: learning networks. Successive research on the application of this framework and feedback from the networked learning community is needed to further validate it’s usability and value to both research as well as practice.

Recommending peers for learning: Matching on dissimilarity in interpretations to provoke breakdown

People recommenders are a widespread feature of social networking sites and educational social learning platforms alike. However, when these systems are used to extend learners’ Personal Learning Networks, they often fall short of providing recommendations of learning value to their users. This paper proposes a design of a people recommender based on content-based user profiles, and a matching method based on dissimilarity therein. It presents the results of an experiment conducted with curators of the content curation site Scoop.it!, where curators rated personalized recommendations for contacts. The study showed that matching dissimilarity of interpretations of shared interests is more successful in providing positive experiences of breakdown for the curator than is matching on similarity. The main conclusion of this paper is that people recommenders should aim to trigger constructive experiences of breakdown for their users, as the prospect and potential of such experiences encourage learners to connect to their recommended peers.

Bootcamp EMMA MOOC Assessment for learning in practice

Formative assessment or assessment for learning is a relevant theme for teachers and educationalists. Formative assessment is a valuable tool for supporting the learning process. It is applied during learning and offers you more and better opportunities to guide your students. Formative assessment allows for more individual and/or personalised guidance. In this MOOC Assessment for learning in practice we will provide you with theory and guidelines for knowledge construction on the topic of formative assessment while offering support in designing assessments that can be applied as a tool for learning and training of competences. In this MOOC you can learn what formative assessment is, learn to differentiate between summative and formative assessment, and how formative assessment can contribute to the learning of your pupils or students. Design of rubrics, the role and functions of feedback, the use of technology for formative assessment are the topics of the MOOC.

Unraveling networked learning initiatives: an analytic framework

Networked learning happens naturally within the social systems of which we are all part. However, in certain circumstances individuals may want to actively take initiative to initiate interaction with others they are not yet regularly in exchange with. This may be the case when external influences and societal changes require innovation of existing practices. This paper proposes a framework with relevant dimensions providing insight into precipitated characteristics of designed as well as ‘fostered or grown’ networked learning initiatives. Networked learning initiatives are characterized as “goal-directed, interest-, or needs based activities of a group of (at least three) individuals that initiate interaction across the boundaries of their regular social systems”. The proposed framework is based on two existing research traditions, namely 'networked learning' and 'learning networks', comparing, integrating and building upon knowledge from both perspectives. We uncover some interesting differences between definitions, but also similarities in the way they describe what ‘networked’ means and how learning is conceptualized. We think it is productive to combine both research perspectives, since they both study the process of learning in networks extensively, albeit from different points of view, and their combination can provide valuable insights in networked learning initiatives. We uncover important features of networked learning initiatives, characterize actors and connections of which they are comprised and conditions which facilitate and support them. The resulting framework could be used both for analytic purposes and (partly) as a design framework. In this framework it is acknowledged that not all successful networks have the same characteristics: there is no standard ‘constellation’ of people, roles, rules, tools and artefacts, although there are indications that some network structures work better than others. Interactions of individuals can only be designed and fostered till a certain degree: the type of network and its ‘growth’ (e.g. in terms of the quantity of people involved, or the quality and relevance of co-created concepts, ideas, artefacts and solutions to its ‘inhabitants’) is in the hand of the people involved. Therefore, the framework consists of dimensions on a sliding scale. It introduces a structured and analytic way to look at the precipitation of networked learning initiatives: learning networks. Successive research on the application of this framework and feedback from the networked learning community is needed to further validate it’s usability and value to both research as well as practice.

Social media integration for the purpose of self-regulated learning

In this study, design based research in a teacher design team is performed. Teachers who intend to use social media to extend their school class teaching, are confronted with a lack of clear guidelines that inform them how to utilize them effectively. In this study, we aim at formulating such guidelines and testing their usefulness. First, opportunities to facilitate self-regulated learning (SRL) in higher education through the use of social media are elaborated in a literature study. Second, these opportunities are translated into teacher education to search for stimulating and limiting factors within the design, resulting in guidelines for effective social media integration.

Designing Massive Open Online Learning Processes: The importance of the social element

This is a pre-print for personal use only. Please refer to the Springer website for the official, published version http://www.springer.com/978-3-662-52923-2

Professional development of teacher-educators towards transformative learning

This study explores the specific characteristics of teacher-educator professional development interventions that enhance their transformative learning towards stimulating the inquiry-based attitude of students. An educational design research method was followed. Firstly, in partnership with five experienced educators, a professional development programme was designed, tested and redesigned. Secondly, a qualitative multiple case study was conducted to examine the active ingredients of the designed interventions with regard to educators changes in beliefs and behaviour. The study was carried out in four different educational settings in which 20 educators participated during nine months. Data sources included videos, questionnaires, interviews and written personal theories of practice. The analyses indicated that aligned self-study interventions on a personal, peer and group level guided by a trained facilitator supported the intended leaning.

Learning for self-regulation: Improving instructional benefits for pupils, teachers, parents, schools, and society at large

Compulsory education laws oblige primary and secondary schools to give each pupil positive encouragement in, for example, social, emotional, cognitive, creative, and ethical respects. This is a fairly smooth process for most pupils, but it is not as easy to achieve with others. A pattern of pupil, home or family, and school variables turns out to be responsible for a long-term process that may lead to a pupil’s dropping out of education. A systemic approach will do much to introduce more clarity into the diagnosis, potential reduction and possible prevention of some persistent educational problems that express themselves in related phenomena, for example low school motivation and achievement; forced underachievement of high ability pupils; concentration of bullying and violent behaviour in and around some types of classes and schools; and drop-out percentages that are relatively constant across time. Such problems have a negative effect on pupils, teachers, parents, schools, and society alike. In this address, I would therefore like to clarify some of the systemic causes and processes that we have identified between specific educational and pupil characteristics. Both theory and practice can assist in developing, implementing, and checking better learning methods and coaching procedures, particularly for pupils at risk. This development approach will take time and require co-ordination, but it will result in much better processes and outcomes than we are used to. First, I will diagnose some systemic aspects of education that do not seem to optimise the learning processes and school careers of some types of pupils in particular. Second, I will specify cognitive, social, motivational, and self-regulative aspects of learning tasks and relate corresponding learning processes to relevant instructional and wider educational contexts. I will elaborate these theoretical notions into an educational design with systemic instructional guidelines and multilevel procedures that may improve learning processes for different types of pupils. Internet-based Information and Communication Technology, or ICT, also plays a major role here. Third, I will report on concrete developments made in prototype research and trials. The development process concerns ICT-based differentiation of learning materials and procedures, and ICT-based strategies to improve pupil development and learning. Fourth, I will focus on the experience gained in primary and secondary educational practice with respect to implementation. We can learn much from such practical experience, in particular about the conditions for developing and implementing the necessary changes in and around schools. Finally, I will propose future research. As I hope to make clear, theory-based development and implementation research can join forces with systemic innovation and differentiated assessment in educational practice, to pave the way for optimal “learning for self-regulation” for pupils, teachers, parents, schools, and society at large.