Applying standards to systematize learning analytics in serious games

Learning Analytics is an emerging field focused on analyzing learners’ interactions with educational content. One of the key open issues in learning analytics is the standardization of the data collected. This is a particularly challenging issue in serious games, which generate a diverse range of data. This paper reviews the current state of learning analytics, data standards and serious games, studying how serious games are tracking the interactions from their players and the metrics that can be distilled from them. Based on this review, we propose an interaction model that establishes a basis for applying Learning Analytics into serious games. This paper then analyzes the current standards and specifications used in the field. Finally, it presents an implementation of the model with one of the most promising specifications: Experience API (xAPI). The Experience API relies on Communities of Practice developing profiles that cover different use cases in specific domains. This paper presents the Serious Games xAPI Profile: a profile developed to align with the most common use cases in the serious games domain. The profile is applied to a case study (a demo game), which explores the technical practicalities of standardizing data acquisition in serious games. In summary, the paper presents a new interaction model to track serious games and their implementation with the xAPI specification.

What's in it for us? A case study research about micro sense making processes through the eyes of front line employees, during culture change implementation

Abstract How employees make sense of change is a very complex process. Recently, academics have neglected to research sense making activities in a micro culture implementation context, through the eyes of front line employees. In contrast to a macro view, a micro perspective limits researchers to only look at an individual, departmental or group level. By doing so, we can zoom in on the details of sense making processes that employees use in their daily work life. A macro (organisational) view is based on the notion that there is a general integrated culture that can be found in all organisational units and departments. It is assumed that culture can be researched by using the entire organisation as one single research entity. This thesis challenges this assumption. In case of planned change it is usually the management community who are in charge of the change intervention. Because of their formal hierarchical position, they have the power to abort or initiate change programs. It is perhaps therefore that researchers tend to be focused on the management community rather than on lower level organisational members, such as front line employees. Apart from the micro view, scholars also neglected to research culture change implementation through the eyes of front line employees. This thesis is an attempt to fill these two gaps that currently exists in academic change management publications. The main research question is therefore: From a micro point of view how do front-line employees make sense of the impact of culture change, during the implementation phase? This thesis starts with a literature review which exposes the two main gaps. The most important outcome of this review is that only 2% of the research articles dealt with culture implementation, through the eyes of front line employees. A conceptual research model is built on the integrated sense making theory of Weber and Manning (2001) and the micro variables of Raelin and Cataldo (2011). These theories emphasize elements of sense making in a daily working context. It is likely that front line employees can identify themselves with research elements such as tasks, skills practices, involvement and behaviour. Front line employees were selected, because as lower level organisational members they are usually the change recipients. They are further away from the change initiating scene (usually the management of an organisation) and form a potential sense making ‘hotspot’ that could provide new academic insights. In order to carry out the primary research, two case organisations were selected in the leisure industry. A participative case study research method was chosen. This meant that the researcher worked in the concerning departments of the case organisations. The goal was to observe and interview front line employees, while they were performing their jobs. The most important advantage of this approach is that the researcher temporarily becomes one with the organisation and is therefore able to acquire both formal and informal narratives that front line employees use during sense making activities. It was found that front line employees make sense of organisational change by using a practical approach. They make sense of the change program by carrying out new tasks, developing new skills and sharing best practices. The most noticeable conclusion was that sense making activities predominantly take place at an individual level in relation to change acceptance. Organisational members tend to create a mental equation in order to weigh the advantages against the disadvantages. They evaluate whether the concerning change program is beneficial to them or not. For future research a sense making scheme model is suggested that is based on two methods: an introspection and an action method.

Bootcamp EMMA MOOC Assessment for learning in practice

Formative assessment or assessment for learning is a relevant theme for teachers and educationalists. Formative assessment is a valuable tool for supporting the learning process. It is applied during learning and offers you more and better opportunities to guide your students. Formative assessment allows for more individual and/or personalised guidance. In this MOOC Assessment for learning in practice we will provide you with theory and guidelines for knowledge construction on the topic of formative assessment while offering support in designing assessments that can be applied as a tool for learning and training of competences. In this MOOC you can learn what formative assessment is, learn to differentiate between summative and formative assessment, and how formative assessment can contribute to the learning of your pupils or students. Design of rubrics, the role and functions of feedback, the use of technology for formative assessment are the topics of the MOOC.

Newcomer Integration in Online Knowledge Communities: Exploring the Role of Dialogic Textual Complexity

Using online knowledge communities (OKCs) as informal learning environments poses the question how likely these will integrate newcomers as peripheral participants. Previous research has identified surface characteristics of the OKC dialog as integrativity predictors. Yet, little is known about the role of dialogic textual complexity. This contribution proposes a comprehensive approach based on previously validated textual complexity indexes and applies it to predict OKC integrativity. The dialog analysis of N = 14 blogger communities with a total of 1937 participants identified three main components of textual complexity: dialog participation, structure and cohesion. From these, dialog cohesion was higher in integrative OKCs, thus significantly predicting OKC integrativity. This result adds to previous OKC research by uncovering the depth of OKC discourse. For educational practice, the study suggests a way of empowering learners by automatically assessing the integrativity of OKCs in which they may attempt to participate and access community knowledge.

Het effect van formele en informele feedback op het innovatievermogen van organisaties

Little attention in literature so far has been given to the impact of feedback on organizational development and change. As well as the impact of feedback on the innovation power of organizations. The capacity of innovation of organizations however may be seen as a crucial capacity of organizations to survive in competitive markets. Prior studies towards the impacts of feedback have more often analyzed formal and informal feedback separately, other than analyzing them together in one study. This master thesis develops and explores a model to assess the possible impact of both formal and informal feedback on the capacity of innovation within organizations. The master thesis is the closing assignment of a Master Study Management at the Open Universiteit Nederland. The general question of the single-case study is: What is the impact of formal and informal feedback on the capacity of innovation of companies? The explored model in the study is a combination of the model of Lawson and Samson (2001) about the capacity of innovation and the framework model of Pitkänen and Lukka (2011) about formal and informal feedback. The single-case study is performed at Yellowbrick, a Dutch company which offers consumers an online parking service, suitable for the use on smartphones. The single-case study is performed twofold by semi-structured interviews and a survey. Although conclusions may not be generalized, because of the limitations of the study and the particularly small investigated group, some findings may be suitable for further investigation. In the study was found that feedback has an impact on the capacity of innovation. Formal feedback scored higher than informal feedback when asked about the impact on the capacity of innovation. The study also found multiple ‘new’ kinds of feedback used by organizations, other than the more ‘traditional’ forms of feedback, such as team meetings and bilateral meetings. Further on was analyzed that when employees find themselves more involved in the process of an innovation, they also seem to score the organization higher on the capacity of this innovation.

Education and self-regulation of learning for gifted pupils: Systemic design and development.

Gifted pupils differ from their age-mates with respect to development potential, actual competencies, self-regulatory capabilities, and learning styles in one or more domains of competence. The question is how to design and develop education that fits and further supports such characteristics and competencies of gifted pupils. Analysis of various types of educational interventions for gifted pupils reflects positive cognitive or intellectual effects and differentiated social comparison or group-related effects on these pupils. Systemic preventive combination of such interventions could make these more effective and sustainable. The systemic design is characterised by three conditional dimensions: differentiation of learning materials and procedures, integration by and use of ICT support, and strategies to improve development and learning. The relationships to diagnostic, instructional, managerial, and systemic learning aspects are expressed in guidelines to develop or transform education. The guidelines imply the facilitation of learning arrangements that provide flexible self-regulation for gifted pupils. A three-year pilot in Dutch nursery and primary school is conducted to develop and implement the design in collaboration with teachers. The results constitute prototypes of structured competence domains and supportive software. These support the screening of entry characteristics of all four-year old pupils and assignment of adequate play and learning processes and activities throughout the school career. Gifted and other pupils are supported to work at their actual achievement or competency levels since their start in nursery school, in self-regulated learning arrangements either in or out of class. Each pupil can choose other pupils to collaborate with in small groups, at self-chosen tasks or activities, while being coached by the teacher. Formative evaluation of the school development process shows that the systemic prevention guidelines seem to improve learning and social progress of gifted pupils, including their self-regulation. Further development and implementation steps are discussed.

Nurturing communities of inquiry: A formative study of the DojoIBL platform

Full paper presented at EC-TEL 2016