From engagement to outcomes: measuring the impact of researcher training using the rugby team impact framework

This study addresses our approach to the difficult task of measuring the impact of an eLearning service, the Graduate Virtual Research Environment (GVRE), provided to doctoral students at a UK University since October 2009. The GVRE provides research students with access to a training needs analysis tool which is linked to a repository of video learning resources created by academics and experienced research students. This paper explores the use of the Rugby Team Impact Framework as a guide to measuring impact and our use of a number of techniques to gather evidence about the changes resulting from use of the GVRE. The framework gives four levels of evidence, starting with simple measures of provision, through attendance, interest and to outcomes. As with other research, we found the former easy to assess but the outcomes harder to define. We conclude with a critical evaluation of our research process and outcomes.

Supporting the learning and networking experiences of doctoral students

This study explores the impact of a Graduate Virtual Research Environment (GVRE) on the learning and networking experiences of research students. The GVRE was established to support and enhance research skills and employability training across a university. It provides an extensive range of resources including video reflections based on the experiences of students and staff; GVRE members are encouraged to comment and engage in discussions on these resources. Our work is framed using social theories of learning and the role of communities in the support and development of research students. In particular, we are interested in exploring the challenges involved in developing communities and networks for students whose main focus is their individual research. The GVRE was made available to over 600 students and in this research we explore its impact on the experiences of research students. In particular, we investigate four questions: (a) what impact does the students use of the GVRE have on the development of their research skills; (b) what impact does membership of the GVRE have on the networks and communities of research students; (c) how do research students view the relationships between their research skills training programme, their individual research and the GVRE; and (d) how do research students currently use social media. We use an interpretivist approach and our data sources include site statistics, responses to a questionnaire and also feedback from a focus group. Our findings indicate that networking remains an issue and students suggested approaches to facilitating this using the GVRE: (1) A clearer pathway from skills need identification to skills acquisition; (2) Rewards for activities around networking - possibly through credit on the training scheme; (3) Activities that would involve research directly. Feedback on the GVRE indicated that it is valued by research students as it facilitates the development of their research skills. In terms of marketing the GVRE to research students important factors identified were: the ease of access to the site, the overview it gives of the PhD process; and the value of the site to students around the defining moments of their studies when the students felt they needed additional advice and guidance.

Networked learning ten years on: the rise of the virtual graduate school

The aim of this paper is to reflect on how conceptions of networked learning have changed, particularly in relation to educational practices and uses of technology, that can nurture new ideas of networked learning to sustain multiple and diverse communities of practice in institutional settings. Our work is framed using two theoretical frameworks: Giddens's (1984) structuration theory and Callon & Latour's (1981) Actor Network Theory as critiqued by Fox (2005) in relation to networked learning. We use these frameworks to analyse and critique ideas of networked learning embodied in both cases. We investigate three questions: (a) the role of individual agency in the development of networked learning; (b) the impact of technological developments on approaches to supporting students within institutional infrastructures; and (c) designing networked learning to incorporate Web 2.0 practices that sustain multiple communities and foster engagement with knowledge in new ways. We use an interpretivist approach by drawing on experiential knowledge of the Masters programme in Networked Collaborative Learning and the decision making process of designing the virtual graduate schools. At this early stage, we have limited empirical data related to the student experience of networked learning in current and earlier projects. Our findings indicate that the use of two different theoretical frameworks provided an essential tool in illuminating, situating and informing the process of designing networked learning that involves supporting multiple and diverse communities of practice in institutional settings. These theoretical frameworks have also helped us to analyze our existing projects as case studies and to problematize and begin to understand the challenges we face in facilitating the participation of research students in networked learning communities of practice and the barriers to that participation. We have also found that this process of theorizing has given us a way of reconceptualizing communities of practice within research settings that have the potential to lead to new ideas of networked learning.