Performance assessment in serious games: Compensating for the effects of randomness

This paper is about performance assessment in serious games. We conceive serious gaming as a process of player-lead decision taking. Starting from combinatorics and item-response theory we provide an analytical model that makes explicit to what extent observed player performances (decisions) are blurred by chance processes (guessing behaviors). We found large effects both theoretically and practically. In two existing serious games random guess scores were found to explain up to 41% of total scores. Monte Carlo simulation of random game play confirmed the substantial impact of randomness on performance. For valid performance assessments, be it in-game or post-game, the effects of randomness should be included to produce re-calibrated scores that can reasonably be interpreted as the players´ achievements.

Making sense of game based user data: learning analytics in applied games

Digital learning games are useful educational tools with high motivational potential. With the application of games for instruction there comes the need of acknowledging learning game experiences also in the context of educational assessment. Learning analytics provides new opportunities for supporting assessment in and of educational games. We give an overview of current learning analytics methods in this field and reflect on existing challenges. An approach of providing reusable software assets for interaction assessment and evaluation in games is presented. This is part of a broader initiative of making available advanced methodologies and tools for supporting applied game development.

Evaluation of Serious Games: A Holistic Approach

Digital games constitute a major emerging technology that is expected to enter mainstream educational use within a few years. The highly engaging and motivating character of such games bears great potential to support immersive, meaningful, and situated learning experiences. To seize this potential, meaningful quality and impact measurements are indispensible. Although there is a growing body of evidence on the efficacy of games for learning, evaluation is often poorly designed, incomplete, biased, if not entirely absent. Well-designed evaluations demonstrating the educational effect as well as the return on investment of serious games may foster broader adoption by educational institutions and training providers, and support the development of the serious game industry. The European project RAGE introduces a comprehensive and multi-perspective framework for serious game evaluation, which is presented in this paper.

D7.2 - Summary report of Value Chain analysis

The results presented in this deliverable depict relevant aspects of the EU based Applied Game industry and its competitive landscape. This preliminary overview of the primary target market for the RAGE ecosystem identifies some of the key issues to be further investigated by the RAGE WP7 team through stakeholders/market consultations commencing in year 2 of the project. These findings will form as an integral part of the baseline needed to formulate a sustainable exploitation strategy for the RAGE assets and ecosystem.

D7.1 - Summary Report of Business Models

This report provides a comparative analysis of the existing and emergent Business models currently employed in the Entertainment digital game industry (referred to in this report as the Leisure industry) and the “serious”, or in the context of the RAGE project and this report, the Applied Games industry. In conjunction with the accompanying WP 7.2 report providing a value chain analysis this report will inform the development of a business mode or models for the proposed RAGE ecosystem.