Performance assessment in serious games: Compensating for the effects of randomness

This paper is about performance assessment in serious games. We conceive serious gaming as a process of player-lead decision taking. Starting from combinatorics and item-response theory we provide an analytical model that makes explicit to what extent observed player performances (decisions) are blurred by chance processes (guessing behaviors). We found large effects both theoretically and practically. In two existing serious games random guess scores were found to explain up to 41% of total scores. Monte Carlo simulation of random game play confirmed the substantial impact of randomness on performance. For valid performance assessments, be it in-game or post-game, the effects of randomness should be included to produce re-calibrated scores that can reasonably be interpreted as the players´ achievements.

Education and self-regulation of learning for gifted pupils: Systemic design and development.

Gifted pupils differ from their age-mates with respect to development potential, actual competencies, self-regulatory capabilities, and learning styles in one or more domains of competence. The question is how to design and develop education that fits and further supports such characteristics and competencies of gifted pupils. Analysis of various types of educational interventions for gifted pupils reflects positive cognitive or intellectual effects and differentiated social comparison or group-related effects on these pupils. Systemic preventive combination of such interventions could make these more effective and sustainable. The systemic design is characterised by three conditional dimensions: differentiation of learning materials and procedures, integration by and use of ICT support, and strategies to improve development and learning. The relationships to diagnostic, instructional, managerial, and systemic learning aspects are expressed in guidelines to develop or transform education. The guidelines imply the facilitation of learning arrangements that provide flexible self-regulation for gifted pupils. A three-year pilot in Dutch nursery and primary school is conducted to develop and implement the design in collaboration with teachers. The results constitute prototypes of structured competence domains and supportive software. These support the screening of entry characteristics of all four-year old pupils and assignment of adequate play and learning processes and activities throughout the school career. Gifted and other pupils are supported to work at their actual achievement or competency levels since their start in nursery school, in self-regulated learning arrangements either in or out of class. Each pupil can choose other pupils to collaborate with in small groups, at self-chosen tasks or activities, while being coached by the teacher. Formative evaluation of the school development process shows that the systemic prevention guidelines seem to improve learning and social progress of gifted pupils, including their self-regulation. Further development and implementation steps are discussed.

Mobile authoring of open educational resources for authentic learning scenarios

The proliferation of smartphones in the last decade and the number of publications in the field of authoring systems for computer-assisted learning depict a scenario that needs to be explored in order to facilitate the scaffolding of learning activities across contexts. Learning resources are traditionally designed in desktop-based authoring systems where the context is mostly restricted to the learning objective, capturing relevant case characteristics, or virtual situation models. Mobile authoring tools enable learners and teachers to foster universal access to educational resources not only providing channels to share, remix or re-contextualize these, but also capturing the context in-situ and in-time. As a further matter, authoring educational resources in a mobile context is an authentic experience where authors can link learning with their own daily life activities and reflections. The contribution of this manuscript is fourfold: first, the main barriers for ubiquitous and mobile authoring of educational resources are identified; second, recent research on mobile authoring tools is reviewed, and 10 key shortcomings of current approaches are identified; third, the design of a mobile environment to author educational resources (MAT for ARLearn) is presented, and the results of an evaluation of usability and hedonic quality are presented; fourth, conclusions and a research agenda for mobile authoring are discussed.