A case study of the effectiveness of the electronic survey as a research tool for measuring students' experience of e-learning

This paper uses a case study approach to consider the effectiveness of the electronic survey as a research tool to measure the learner voice about experiences of e-learning in a particular institutional case. Two large scale electronic surveys were carried out for the Student Experience of e-Learning (SEEL) project at the University of Greenwich in 2007 and 2008, funded by the UK Higher Education Academy (HEA). The paper considers this case to argue that, although the electronic web-based survey is a convenient method of quantitative and qualitative data collection, enabling higher education institutions swiftly to capture multiple views of large numbers of students regarding experiences of e-learning, for more robust analysis, electronic survey research is best combined with other methods of in-depth qualitative data collection. The advantages and disadvantages of the electronic survey as a research method to capture student experiences of e-learning are the focus of analysis in this short paper, which reports an overview of large-scale data collection (1,000+ responses) from two electronic surveys administered to students using surveymonkey as a web-based survey tool as part of the SEEL research project. Advantages of web-based electronic survey design include flexibility, ease of design, high degree of designer control, convenience, low costs, data security, ease of access and guarantee of confidentiality combined with researcher ability to identify users through email addresses. Disadvantages of electronic survey design include the self-selecting nature of web-enabled respondent participation, which tends to skew data collection towards students who respond effectively to email invitations. The relative inadequacy of electronic surveys to capture in-depth qualitative views of students is discussed with regard to prior recommendations from the JISC-funded Learners' Experiences of e-Learning (LEX) project, in consideration of the results from SEEL in-depth interviews with students. The paper considers the literature on web-based and email electronic survey design, summing up the relative advantages and disadvantages of electronic surveys as a tool for student experience of e-learning research. The paper concludes with a range of recommendations for designing future electronic surveys to capture the learner voice on e-learning, contributing to evidence-based learning technology research development in higher education.

The eLIDA CAMEL nomadic model of collaborative partnership for a community of practice in design for learning

A nomadic collaborative partnership model for a community of practice (CoP) in Design for Learning (D4L) can facilitate successful innovation and continuing appraisals of effective professional practice, stimulated by a 'critical friend' assigned to the project. This paper reports on e-learning case studies collected by the JISC-funded UK eLIDA CAMEL Design for Learning Project. The project implemented and evaluated learning design (LD) tools in higher and further education within the JISC Design for Learning pedagogic programme (2006-07). Project partners trialled professional user evaluations of innovative e-learning tools with learning design function, collecting D4L case studies and LD sequences in post-16/HE contexts using LAMS and Moodle. The project brought together learning activity sequences within a collaborative e-learning community of practice based on the CAMEL (Collaborative Approaches to the Management of e-Learning) model, contributing to international D4L developments. This paper provides an overview of project outputs in e-learning innovations, including evaluations from teachers and students. The paper explores intentionality in the development of a CoP in design for learning, reporting on trials of LD and social software that bridged tensions between formalised intra-institutional e-learning relationships and inter-institutional professional project team dynamic D4L practitioner interactions. Following a brief report of D4L case studies and feedback, the catalytic role of the 'critical friend' is highlighted and recommended as a key ingredient in the successful development of a nomadic model of communities of practice for managing professional e-learning projects. eLIDA CAMEL Partners included the Association of Learning Technology (ALT), JISC infoNet, three universities and five FE/Sixth Form Colleges. Results reported to JISC demonstrated D4L e-learning innovations by practitioners, illuminated by the role of the 'critical friend'. The project also benefited from formal case study evaluations and the leading work of ALT and JISC infoNet in the development of the CAMEL model.

Student Experience of E-Learning (SEEL)

The Student Experience of E-Learning project (SEEL) was an institutional response to the university’s HEA/JISC Benchmarking exercise (Ryan and Kandler, 2007). The study had a social constructivist approach which recognised the importance of listening to the student voice (JISC 2007) within the University of Greenwich context, to interpret the student experience of e-learning. Nearly 1000 students responded to an online survey on their approaches to, and their use of, learning technology. The quantitative and qualitative questions used included identifying study patterns, using specific online tools, within the context of learning and beyond, and student’s attitudes towards using e-learning in their studies. Initially, individual responses to questions were analysed in depth, giving a general indication of the student experience. Further depth was applied through a filtering mechanism, beginning with a cross-slicing of individual student responses to produce cameos. Audio logs and individual interviews were drawn from these cameos. Analysis of the cameos is in progress but has already revealed some unexpected results. There was a mismatch between students’ expectations of the university’s use of technology and their experiences and awareness of its possible use in other contexts. Students recognised the importance of social interaction as a vehicle for learning (Vygotsky 1978, Bruner 2006) but expressed polarised views on the use of social networking sites such as Facebook for e-learning. Their experiences in commercial contexts led them to see the university VLE as unimaginative and the tutors’ use of it as lacking in vision. Whereas analysis of the individual questions provided a limited picture, the cameos gave a truer reflection of the students lived experiences and identified a gulf between the university’s provision and the students’ expectation of e-learning and their customary use of technology. However it is recognised that the very nature of an online survey necessarily excludes students who chose not to engage, either through lack of skills or through disillusionment and this would constitute a separate area for study.

The specification and design of an interactive virtual environment for use in teacher training

The original concept was to create a 'simulation' which would provide trainee teachers, specializing in Information and Communications Technology (ICT) with the opportunity to explore a primary school environment. Within the simulation, factors affecting the development and implementation of ICT would be modelled so that trainees would be able to develop the skills, knowledge and understanding necessary to identify appropriate strategies to overcome the limitations. To this end, we have developed Allsorts Primary - the prototype of a simulated interactive environment, representing a typical primary school

A framework for e-learning: a blended solution?: current developments in technology-assisted education

This paper describes a Framework for e-Learning and presents the findings of a study investigating whether the use of Blended Learning can fulfill or at least accommodate some of the human requirements presently neglected by current e-Learning systems. This study evaluates the in-house system: Teachmat, and discusses how the use of Blended Learning has become increasingly prevalent as a result of its enhancement and expansion, its relationship to the human and pedagogical issues, and both the positive and negative implications of this reality. [From the Authors]

Use of Web Logs (Blogs) in Learning Environments: Blogs for Student Support

Innovation in technology and communications and particularly the advent of the Web is changing the structure of teaching and learning today. While there is much debate about the use of technology in learning and how e-learning is creating new approaches to delivery of learning there is been very little if any work on the use of of the emerging technologies in providing student support through their learning process. This paper reports on research and development undertaken by the eCentre based at the University of Greenwich School Of Computing in designing and developing a "Project Blog System" in order to address some long standing issues related to supervision of final year degree student projects. The paper will report on the methodology used to design the system and will discuss some of the results from students and staff evaluation of the system developed.

A UK perspective on e-learning: an overview of the "workflow" and "reusable learning object" approach in the UK eUniversities project

The UK government started the UK eUniversities project in order to create a virtual campus for online education provisions, competing in a global market. The UKeU (WWW.ukeu.com) claims to "have created a new approach to e-learning" which "opens up a range of exciting opportunities for students, business and industry worldwide" to obtain both postgraduate and undergraduate qualifications. Although there has been many promises about the e-learning revolution using state-of-the-art multimedia technology, closer scrutiny of what is being delivered reveals that many of the e-learning models currently being used are little more than the old text based computer aided learning running on a global network. As part of the UKeU project a consortium of universities have been involved in developing a two year foundation degree from 2004. We look at the approach taken by the consortium in developing global e-learning provisions and the problems and the pitfalls that lay ahead.

Innovations in learning and teaching approaches using game technologies - can "The Movies" teach how to make a movie?

The use of games technology in education is not a new phenomenon. Even back in the days of 286 processors, PCs were used in some schools along with (what looks like now) primitive simulation software to teach a range of different skills and techniques – from basic programming using Logo (the turtle style car with a pen at the back that could be used to draw on the floor – always a good way of attracting the attention of school kids!) up to quite sophisticated replications of physical problems, such as working out the trajectory of a missile to blow up an enemies’ tank. So why are games not more widely used in education (especially in FE and HE)? Can they help to support learners even at this advanced stage in their education? We aim to provide in this article an overview of the use of game technologies in education (almost as a small literature review for interested parties) and then go more in depth into one particular example we aim to introduce from this coming academic year (Sept. 2006) to help with teaching and assessment of one area of our Multimedia curriculum. Of course, we will not be able to fully provide the reader with data on how successful this is but we will be running a blog (http://themoviesineducation.blogspot.com/) to keep interested parties up to date with the progress of the project and to hopefully help others to set up similar solutions themselves. We will also only consider a small element of the implementation here and cover how the use of such assessment processes could be used in a broader context. The use of a game to aid learning and improve achievement is suggested because traditional methods of engagement are currently failing on some levels. By this it is meant that various parts of the production process we normally cover in our Multimedia degree are becoming difficult to monitor and continually assess.

Creating a suitable and successful solution for the integration of podcasting and vidcasting in a higher education e-learning environment

A small research project is currently taking place within a department of the University of Greenwich. The project involves using current technology (Apple’s xServe, iPhones, iPod touch, Podcast Producer application and some 3rd party capture software) with the intention to provide a solution for quick and simple podcasting. This paper also aims to investigate the use of podcasting to help promote and extend the e-learning provision within the school. In short this project aims to justify the use of podcasting as a teaching and learning tool to help enhance student learning while identifying the most appropriate manner to integrate podcasting within an e-learning environment.

Thinking inside the box: why the World Bank is not learning

An analysis of how the World Bank has maintained a position supportive of multinational strategies for privatisation of water.

"Practise what we preach": a social constructivist approach to blended learning

This presentation reports on the formal evaluation, through questionnaires, of a new Level 1 undergraduate course, for 130 student teachers, that uses blended learning. The course design seeks to radicalise the department’s approach to teaching, learning and assessment and use students as change agents. Its structure and content, model social constructivist approaches to learning. Building on the student’s experiences of and, reflections on, previous learning, promotes further learning through the support of “able others” (Vygotsky 1978), facilitating and nurturing a secure community of practice for students new to higher education. The course’s design incorporates individual, paired, small and large group activities and exploits online video, audio and text materials. Course units begin and end with face-to-face tutor-led activities. Online elements, including discussions and formative submissions, are tutor-mediated. Students work together face-to-face and online to read articles, write reflections, develop presentations, research and share experiences and resources. Summative joint assignments and peer assessments emphasise the value of collaboration and teamwork for academic, personal and professional development. Initial informal findings are positive, indicating that students have engaged readily with course content and structure, with few reporting difficulties accessing or using technology. Students have welcomed the opportunity to work together to tackle readings in a new genre, pilot presentation skills and receive and give constructive feedback to peers. Course tutors have indicated that depth and quality of study are evident, with regular online formative submissions enabling tutors to identify and engage directly with student’s needs, provide feedback and develop appropriately designed distance and face-to-face teaching materials. Pastoral tutors have indicated that students have reported non-engagement of peers, leading to the rapid application of academic or personal support. Outcomes of the formal evaluation will inform the development of Level 2 and 3 courses and influence the department’s use of blended learning.

Exploration of the student experience of e-learning: beginning to bridge the learning divide

Introduction This proposal aims, through debate within symposium to explore the student experience of e-learning. The team facilitating the discussion will draw upon their experience of an HEA funded pathfinder project, the main aim of which was to collect learner stories about their experience of using technology in their everyday learning activities at the University of Greenwich across a range of programmes, levels, locations and student groups. Method The project design responded to the growing body of student voice literature and then utilised and built upon the JISC-funded studies that focussed on understanding the learner perspectives on the role of technology in learning, namely: • the LEX study which investigated a broad spectrum of technology use by eliciting rich data about learners’ feelings, beliefs and intentions towards e-learning (Creanor et al, 2006); • the LXP studies which explored disciplinary differences in uses of technology by university students through a variety of methodologies (Conole et al, 2006). Results The symposium will be organised as a round table discussion that will be structured into three sections: • Designing an online survey tool, and the results of our survey. • Exploring student stories. • What can learned from the project and taking the findings back to enhance learning. To stimulate discussion each section will start by asking the participants to discuss and debate a particular question, this will be followed by an interactive presentation by the respective member of the project team who will share the findings of the project and invite contributions to the resulting discussion from personal perspectives. The questions are: • What is effective learning within a context of digital technology? • What are the myths and truths about the identity of today's learners? • What practical changes need to happen in order to see real change? Conclusion The final section of the symposium will invite contributions from the participants in order to collate the views and perspectives of all the participants in order to focus the discussion on the following: • The issues that have arisen as a result of the round table debates. • New speculative approaches to enhancing the student experience. • A controversial stand to the future of Higher Education teaching and learning and the role and integration of technology within that education. The symposium will provide an opportunity to explore the predictive value of Student Experience of E-Learning Laboratory (SEEL) project.

The Students' Experience of E-learning

The Student Experience of E-learning Laboratory (SEEL) is a three year initiative that seeks to develop the University’s capacity to discover more about the impact of e-learning on our students in an attempt to narrow the gap between the digital natives and immigrants (Prensky, 2001). In its first year the project team have gathered data on the student experience of using technology in support of their learning from across the University. Initial analysis suggests we should listen more carefully to our students and may need to review some of our current practices in relation to e-learning and explore some new ways of working. In this workshop we will outline some of the findings and consider implications for our future practice.

Experts on e-learning: insights gained from listening to the student voice!

The Student Experience of e-Learning Laboratory (SEEL) project at the University of Greenwich was designed to explore and then implement a number of approaches to investigate learners’ experiences of using technology to support their learning. In this paper members of the SEEL team present initial findings from a University-wide survey of nearly a 1000 students. A selection of 90 ‘cameos’, drawn from the survey data, offer further insights into personal perceptions of e-learning and illustrate the diversity of students experiences. The cameos provide a more coherent picture of individual student experience based on the totality of each person’s responses to the questionnaire. Finally, extracts from follow-up case studies, based on interviews with a small number of students, allow us to ‘hear’ the student voice more clearly. Issues arising from an analysis of the data include student preferences for communication and social networking tools, views on the ‘smartness’ of their tutors’ uses of technology and perceptions of the value of e-learning. A primary finding and the focus of this paper, is that students effectively arrive at their own individualised selection, configuration and use of technologies and software that meets their perceived needs. This ‘personalisation’ does not imply that such configurations are the most efficient, nor does it automatically suggest that effective learning is occurring. SEEL reminds us that learners are individuals, who approach learning both with and without technology in their own distinctive ways. Hearing, understanding and responding to the student voice is fundamental in maximising learning effectiveness. Institutions should consider actively developing the capacity of academic staff to advise students on the usefulness of particular online tools and resources in support of learning and consider the potential benefits of building on what students already use in their everyday lives. Given the widespread perception that students tend to be ‘digital natives’ and academic staff ‘digital immigrants’ (Prensky, 2001), this could represent a considerable cultural challenge.