Structured reflection breaks embedded in an online course – effects on learning experience, time on task and performance

The purpose of this article is to gain an insight into the effects of practicing short, frequent,and structured reflection breaks interspersed with the learning material in a computer-based course. To that end, the study sets up a standardized control trial with two groups of secondary school pupils. The study shows that while performance is not affected by these embedded “reflection rituals,” they significantly impact time on task and perceived learning. The study also suggests that the exposure to such built-in opportunities for reflection modifies the engagement with the content and fosters the claimed readiness for application of a similar reflective approach to learning in other occasions.

Performance assessment in serious games: Compensating for the effects of randomness

This paper is about performance assessment in serious games. We conceive serious gaming as a process of player-lead decision taking. Starting from combinatorics and item-response theory we provide an analytical model that makes explicit to what extent observed player performances (decisions) are blurred by chance processes (guessing behaviors). We found large effects both theoretically and practically. In two existing serious games random guess scores were found to explain up to 41% of total scores. Monte Carlo simulation of random game play confirmed the substantial impact of randomness on performance. For valid performance assessments, be it in-game or post-game, the effects of randomness should be included to produce re-calibrated scores that can reasonably be interpreted as the players´ achievements.