From engagement to outcomes: measuring the impact of researcher training using the rugby team impact framework

This study addresses our approach to the difficult task of measuring the impact of an eLearning service, the Graduate Virtual Research Environment (GVRE), provided to doctoral students at a UK University since October 2009. The GVRE provides research students with access to a training needs analysis tool which is linked to a repository of video learning resources created by academics and experienced research students. This paper explores the use of the Rugby Team Impact Framework as a guide to measuring impact and our use of a number of techniques to gather evidence about the changes resulting from use of the GVRE. The framework gives four levels of evidence, starting with simple measures of provision, through attendance, interest and to outcomes. As with other research, we found the former easy to assess but the outcomes harder to define. We conclude with a critical evaluation of our research process and outcomes.

Supporting the learning and networking experiences of doctoral students

This study explores the impact of a Graduate Virtual Research Environment (GVRE) on the learning and networking experiences of research students. The GVRE was established to support and enhance research skills and employability training across a university. It provides an extensive range of resources including video reflections based on the experiences of students and staff; GVRE members are encouraged to comment and engage in discussions on these resources. Our work is framed using social theories of learning and the role of communities in the support and development of research students. In particular, we are interested in exploring the challenges involved in developing communities and networks for students whose main focus is their individual research. The GVRE was made available to over 600 students and in this research we explore its impact on the experiences of research students. In particular, we investigate four questions: (a) what impact does the students use of the GVRE have on the development of their research skills; (b) what impact does membership of the GVRE have on the networks and communities of research students; (c) how do research students view the relationships between their research skills training programme, their individual research and the GVRE; and (d) how do research students currently use social media. We use an interpretivist approach and our data sources include site statistics, responses to a questionnaire and also feedback from a focus group. Our findings indicate that networking remains an issue and students suggested approaches to facilitating this using the GVRE: (1) A clearer pathway from skills need identification to skills acquisition; (2) Rewards for activities around networking - possibly through credit on the training scheme; (3) Activities that would involve research directly. Feedback on the GVRE indicated that it is valued by research students as it facilitates the development of their research skills. In terms of marketing the GVRE to research students important factors identified were: the ease of access to the site, the overview it gives of the PhD process; and the value of the site to students around the defining moments of their studies when the students felt they needed additional advice and guidance.

Networked learning ten years on: the rise of the virtual graduate school

The aim of this paper is to reflect on how conceptions of networked learning have changed, particularly in relation to educational practices and uses of technology, that can nurture new ideas of networked learning to sustain multiple and diverse communities of practice in institutional settings. Our work is framed using two theoretical frameworks: Giddens's (1984) structuration theory and Callon & Latour's (1981) Actor Network Theory as critiqued by Fox (2005) in relation to networked learning. We use these frameworks to analyse and critique ideas of networked learning embodied in both cases. We investigate three questions: (a) the role of individual agency in the development of networked learning; (b) the impact of technological developments on approaches to supporting students within institutional infrastructures; and (c) designing networked learning to incorporate Web 2.0 practices that sustain multiple communities and foster engagement with knowledge in new ways. We use an interpretivist approach by drawing on experiential knowledge of the Masters programme in Networked Collaborative Learning and the decision making process of designing the virtual graduate schools. At this early stage, we have limited empirical data related to the student experience of networked learning in current and earlier projects. Our findings indicate that the use of two different theoretical frameworks provided an essential tool in illuminating, situating and informing the process of designing networked learning that involves supporting multiple and diverse communities of practice in institutional settings. These theoretical frameworks have also helped us to analyze our existing projects as case studies and to problematize and begin to understand the challenges we face in facilitating the participation of research students in networked learning communities of practice and the barriers to that participation. We have also found that this process of theorizing has given us a way of reconceptualizing communities of practice within research settings that have the potential to lead to new ideas of networked learning.

Four years on: a longitudinal study assessing the impact of a virtual community of practice

This paper explores the long term impact of a virtual learning community (VLC) from the perspective of community members and their employing organization. It argues that membership potentially has a significant impact on individual identities and careers, and that managed communities provide an important means for strategic workforce development. The study evaluates the impact of membership of a VLC over a four year period within the context of the theoretical frameworks of communities of practice and identity theory. The concept of boundary crossing is also explored in relation to VLCs. The paper considers the benefits to host organisations in supporting structured VLCs as a means of enabling workforce development and supporting change and innovation.

E-learners’ experiences of time

This paper explores the experiences of e-learners participating in continuing professional development programmes in three UK universities. Data was collected using questionnaires, discussion group postings and informal telephone interviews. These were analysed using two approaches to content analysis: a coding scheme and metaphors. Findings indicated that: e-learners reconstruct their approaches to time management at an early stage in their programme; the e-learners developed different time management strategies (planned, opportunistic, planned/opportunistic); and metaphors illustrated their underlying experiences of time. These provide the basis of recommendations for e-tutors. Finally, the paper explores methodological issues and outlines some implications for practice.

Comfort, confidence and confidentiality: the experiences of two e-learners

This paper is based on the authors’ experiences as e-learners on a MEd in Collaborative Networked Learning during 2000-2002. Although this course was delivered completely online, a strong sense of community developed early and continued as a key theme throughout the two years of the course. Our paper examines how this sense of community was facilitated and maintained, based on narrative analysis of our learning journals and personal recollections.

High level student autonomy in a virtual learning environment

This case study explores the experiences of a group of students (the authors) working as a tutor-less group (TLG) that developed during a web-based MEd programme. We describe the development and life cycle of the TLG, the experiences of the students and the effects on those who continued to work in a tutored environment. Members of the TLG demonstrated high levels of autonomy and group work. The relationship between the TLG and communities of practice is considered.