From engagement to outcomes: measuring the impact of researcher training using the rugby team impact framework

This study addresses our approach to the difficult task of measuring the impact of an eLearning service, the Graduate Virtual Research Environment (GVRE), provided to doctoral students at a UK University since October 2009. The GVRE provides research students with access to a training needs analysis tool which is linked to a repository of video learning resources created by academics and experienced research students. This paper explores the use of the Rugby Team Impact Framework as a guide to measuring impact and our use of a number of techniques to gather evidence about the changes resulting from use of the GVRE. The framework gives four levels of evidence, starting with simple measures of provision, through attendance, interest and to outcomes. As with other research, we found the former easy to assess but the outcomes harder to define. We conclude with a critical evaluation of our research process and outcomes.