Learning design guided learning analytics in MOOCs

Poster presentation for our paper Brouns, F., & Firssova, O. (2016, October).The role of learning design and learning analytics in MOOCs. Paper presented at 9th EDEN Research Workshop, Oldenburg, Germany.

Applying standards to systematize learning analytics in serious games

Learning Analytics is an emerging field focused on analyzing learners’ interactions with educational content. One of the key open issues in learning analytics is the standardization of the data collected. This is a particularly challenging issue in serious games, which generate a diverse range of data. This paper reviews the current state of learning analytics, data standards and serious games, studying how serious games are tracking the interactions from their players and the metrics that can be distilled from them. Based on this review, we propose an interaction model that establishes a basis for applying Learning Analytics into serious games. This paper then analyzes the current standards and specifications used in the field. Finally, it presents an implementation of the model with one of the most promising specifications: Experience API (xAPI). The Experience API relies on Communities of Practice developing profiles that cover different use cases in specific domains. This paper presents the Serious Games xAPI Profile: a profile developed to align with the most common use cases in the serious games domain. The profile is applied to a case study (a demo game), which explores the technical practicalities of standardizing data acquisition in serious games. In summary, the paper presents a new interaction model to track serious games and their implementation with the xAPI specification.

Game Learning Analytics: Learning Analytics for Serious Games

Video games have become one of the largest entertainment industries, and their power to capture the attention of players worldwide soon prompted the idea of using games to improve education. However, these educational games, commonly referred to as serious games, face different challenges when brought into the classroom, ranging from pragmatic issues (e.g. a high development cost) to deeper educational issues, including a lack of understanding of how the students interact with the games and how the learning process actually occurs. This chapter explores the potential of data-driven approaches to improve the practical applicability of serious games. Existing work done by the entertainment and learning industries helps to build a conceptual model of the tasks required to analyze player interactions in serious games (gaming learning analytics or GLA). The chapter also describes the main ongoing initiatives to create reference GLA infrastructures and their connection to new emerging specifications from the educational technology field. Finally, it explores how this data-driven GLA will help in the development of a new generation of more effective educational games and new business models that will support their expansion. This results in additional ethical implications, which are discussed at the end of the chapter.

Learning analytics from distance learning

Presentation at M25 Learning Technology Group, FutureLearn, 15 November 2017

Can you tell if they're learning?

The proliferation of Web-based learning objects makes finding and evaluating online resources problematic. While established Learning Analytics methods use Web interaction to evaluate learner engagement, there is uncertainty regarding the appropriateness of these measures. In this paper we propose a method for evaluating pedagogical activity in Web-based comments using a pedagogical framework, and present a preliminary study that assigns a Pedagogical Value (PV) to comments. This has value as it categorises discussion in terms of pedagogical activity rather than Web interaction. Results show that PV is distinct from typical interactional measures; there are negative or insignificant correlations with established Learning Analytics methods, but strong correlations with relevant linguistic indicators of learning, suggesting that the use of pedagogical frameworks may produce more accurate indicators than interaction analysis, and that linguistic rather than interaction analysis has the potential to automatically identify learning behaviour.

(Lifelong) learning in your pocket?

Der Beitrag fokussiert die Entwicklung, den Einsatz und die Nutzung von innovativen Technologien zur Unterstützung von Bildungsszenarien in Schule, Hochschule und Weiterbildung. Ausgehend von den verschiedenen Phasen des Corporate Learning, Social Learning, Mobile Learning und Intelligent Learning wird in einem ersten Abschnitt das Nutzungsverhalten von Technologien durch Kinder, Jugendliche und (junge) Erwachsene in Schule, Studium und Lehre betrachtet. Es folgt die Darstellung technologischer Entwicklungen auf Basis des Technology Life Cycle und die Konsequenzen von unterschiedlichen Entwicklungszuständen und Reifegraden von Technologien wie Content Learning Management, sozialen Netzwerken, mobilen Endgeräten, multidimensionalen und -modalen Räumen bis hin zu Anwendungen augmentierter Realität und des Internets der Dinge, Dienste und Daten für den Einsatz und die Nutzung in Bildungsszenarien. Nach der Darstellung von Anforderungen an digitale Technologien hinsichtlich Inhalte, Didaktik und Methodik wie etwa hinsichtlich der Erstellung von Inhalten, deren Wiederverwendung, Digitalisierung und Auffindbarkeit sowie Standards werden methodische Hinweise zur Nutzung digitaler Technologien zur Interaktion von Lernenden, von Lehrenden, sozialer Interaktion, kollaborativem Autorieren, Kommentierung, Evaluation und Begutachtung gegeben. Abschließend werden - differenziert für Schule und Hochschule - Erkenntnisse zu Rahmenbedingungen, Einflussgrößen, hemmenden und fördernden Faktoren sowie Herausförderungen bei der Einführung und nachhaltigen Implementation digitaler Technologien im schulischen Unterricht, in Lehre, Studium und Weiterbildung im Überblick zusammengefasst.

The first time delivery of the first link learning series using Skype and YouTube

Introduction: This case study documented the experiences of informal and service providers who participated in the first time delivery of the First Link Learning Series from May–August 2013 in Newfoundland and Labrador. The aim of this study was to understand how informal caregivers of people with dementia experience this Internet mediated health resource, and how Skype and YouTube can be used as tools for the Alzheimer Society of Newfoundland and Labrador to effectively deliver the First Link Learning Series. Methods: Sources of data included key informant interviews (n=3), pre- study and post-study interviews with informal dementia caregivers (n=2), institutional documentation, field notes, and YouTube analytics. Framework Analysis was used to make meaning of the qualitative data, and descriptive statistics were used to report on quantitative outcomes. Findings: Between 3% and 17% of registered First Link clients attended the learning series sessions, however only two caregivers participated using Skype or YouTube. Framework Analysis revealed three shared themes: access, connection and privacy. Discussion: The themes helped to begin building theory about barriers and facilitators to Internet mediated health resources for informal dementia caregivers. Experiences of service providers using the Internet to support clients served to begin building a case for the appropriateness of these media. A modified version of Dansky et al.’s (2006) theoretical framework for evaluating E-Health research that situates the person/user in the model, helped guide discussion and propose future directions for the study of Internet based health resources for informal dementia caregivers.

How should we measure online learning activity?

The proliferation of Web-based learning objects makes finding and evaluating resources a considerable hurdle for learners to overcome. While established learning analytics methods provide feedback that can aid learner evaluation of learning resources, the adequacy and reliability of these methods is questioned. Because engagement with online learning is different from other Web activity, it is important to establish pedagogically relevant measures that can aid the development of distinct, automated analysis systems. Content analysis is often used to examine online discussion in educational settings, but these instruments are rarely compared with each other which leads to uncertainty regarding their validity and reliability. In this study, participation in Massive Open Online Course (MOOC) comment forums was evaluated using four different analytical approaches: the Digital Artefacts for Learning Engagement (DiAL-e) framework, Bloom's Taxonomy, Structure of Observed Learning Outcomes (SOLO) and Community of Inquiry (CoI). Results from this study indicate that different approaches to measuring cognitive activity are closely correlated and are distinct from typical interaction measures. This suggests that computational approaches to pedagogical analysis may provide useful insights into learning processes.

Modellus: Learning Physics with Mathematical Modelling

Tese de doutoramento em Ciências da Educação, área de Teoria Curricular e Ensino das Ciências

La incidencia de la toma de apuntes sobre el aprendizaje significativo. Un estudio de enseñanza superior.= The incidence of notetaking on meaningful learning. A study of higher education.

En este estudio presentamos una experiencia llevada a cabo con estudiantes de la asignatura “Psicología de la Educación” de diferentes centros universitarios. Tomando como marco de referencia las teorías constructivistas del aprendizaje, el objetivo de nuestro trabajo se centra en comprobar la incidencia de la utilización de diferentes estrategias de enseñanza por parte del profesor y de determinadas estrategias de aprendizaje en el proceso de registrar la información por parte de los estudiantes, en la significatividad del aprendizaje. Los resultados obtenidos muestran que en los grupos donde los profesores han utilizado estrategias de enseñanza diferentes a la clase magistral, se ha producido un cambio positivo en las respuestas de los estudiantes o se ha mantenido el mismo nivel, mientras que el grupo donde se ha utilizado una metodología magistral, el nivel de respuesta es inferior. Así mismo, hemos podido observar como los grupos de estudiantes que utilizan las estrategias de aprendizaje seleccionadas para tomar apuntes mejoran su nivel de respuestas, lo cual no se produce en el grupo control

An indicator framework for assessing livelihood resilience in the context of social–ecological dynamics

Livelihood resilience draws attention to the factors and processes that keep livelihoods functioning despite change and thus enriches the livelihood approach which puts people, their differential capabilities to cope with shocks and how to reduce poverty and improve adaptive capacity at the centre of analysis. However, the few studies addressing resilience from a livelihood perspective take different approaches and focus only on some dimensions of livelihoods. This paper presents a framework that can be used for a comprehensive empirical analysis of livelihood resilience. We use a concept of resilience that considers agency as well as structure. A review of both theoretical and empirical literature related to livelihoods and resilience served as the basis to integrate the perspectives. The paper identifies the attributes and indicators of the three dimensions of resilience, namely, buffer capacity, self-organisation and capacity for learning. The framework has not yet been systematically tested; however, potentials and limitations of the components of the framework are explored and discussed by drawing on empirical examples from literature on farming systems. Besides providing a basis for applying the resilience concept in livelihood-oriented research, the framework offers a way to communicate with practitioners on identifying and improving the factors that build resilience. It can thus serve as a tool for monitoring the effectiveness of policies and practices aimed at building livelihood resilience.

ReaderBench goes Online: A Comprehension-Centered Framework for Educational Purposes

In this paper we introduce the online version of our ReaderBench framework, which includes multi-lingual comprehension-centered web services designed to address a wide range of individual and collaborative learning scenarios, as follows. First, students can be engaged in reading a course material, then eliciting their understanding of it; the reading strategies component provides an in-depth perspective of comprehension processes. Second, students can write an essay or a summary; the automated essay grading component provides them access to more than 200 textual complexity indices covering lexical, syntax, semantics and discourse structure measurements. Third, students can start discussing in a chat or a forum; the Computer Supported Collaborative Learning (CSCL) component provides indepth conversation analysis in terms of evaluating each member’s involvement in the CSCL environments. Eventually, the sentiment analysis, as well as the semantic models and topic mining components enable a clearer perspective in terms of learner’s points of view and of underlying interests.

Designing networked learning for innovation: A dimension perspective

In her presentation, Emmy discusses a case study where a teacher group is followed in its innovative attempt to start up a new curriculum. Searching for guidelines to facilitate knowledge-creating teacher groups, the ‘Dimensions of Social Learning (DSL) Framework’ is applied as a starting point to assess the group's social configuration. To supplement the DSL Framework towards knowledge creation, social capital and value creation theories were studied. This has resulted in an extended framework that can bring the knowledge creation of teacher groups into view.

Seqins: a sequencing tool for educational resources

The teaching-learning process is increasingly focused on the combination of the paradigms “learning by viewing” and “learning by doing.” In this context, educational resources, either expository or evaluative, play a pivotal role. Both types of resources are interdependent and their sequencing would create a richer educational experience to the end user. However, there is a lack of tools that support sequencing essentially due to the fact that existing specifications are complex. The Seqins is a sequencing tool of digital resources that has a fairly simple sequencing model. The tool communicates through the IMS LTI specification with a plethora of e-learning systems such as learning management systems, repositories, authoring and evaluation systems. In order to validate Seqins we integrate it in an e-learning Ensemble framework instance for the computer programming learning.

Sequencing educational resources with Seqins

Existing adaptive educational hypermedia systems have been using learning resources sequencing approaches in order to enrich the learning experience. In this context, educational resources, either expository or evaluative, play a central role. However, there is a lack of tools that support sequencing essentially due to the fact that existing specifications are complex. This paper presents Seqins as a sequencing tool of digital educational resources. Seqins includes a simple and flexible sequencing model that will foster heterogeneous students to learn at different rhythms. The tool communicates through the IMS Learning Tools Interoperability specification with a plethora of e-learning systems such as learning management systems, repositories, authoring and automatic evaluation systems. In order to validate Seqins we integrate it in an e-learning Ensemble framework instance for the computer programming learning domain.