Measuring performance of virtual learning environment system in higher education

Purpose – The purpose of this paper is to measure the performance of commercial virtual learning environment (VLE) systems, which helps the decision makers to select the appropriate system for their institutions. Design/methodology/approach – This paper develops an integrated multiple criteria decision making approach, which combines the analytic hierarchy process (AHP) and quality function deployment (QFD), to evaluate and select the best system. The evaluating criteria are derived from the requirements of those who use the system. A case study is provided to demonstrate how the integrated approach works. Findings – The major advantage of the integrated approach is that the evaluating criteria are of interest to the stakeholders. This ensures that the selected system will achieve the requirements and satisfy the stakeholders most. Another advantage is that the approach can guarantee the benchmarking to be consistent and reliable. From the case study, it is proved that the performance of a VLE system being used at the university is the best. Therefore, the university should continue to run the system in order to support and facilitate both teaching and learning. Originality/value – It is believed that there is no study that measures the performance of VLE systems, and thus decision makers may have difficulties in system evaluation and selection for their institutions.

A virtual learning environment for operations management:Assessing the student's perspective

This paper describes a project aimed at assessing the experience of a virtual learning environment (VLE) among students studying courses in operations management. The project was supported by the Higher Education Funding Council for England (HEFCE) under its Teaching Quality Enhancement Fund (TQEF). The main aim of the project was through the use of a questionnaire to establish the student experience of using a VLE through an examination of the learning and technical features which they encountered. The study also examines the approaches to learning adopted by the students, through the inclusion of a shortened version of the approaches and study skills inventory for students (ASSIST) which the students were asked to complete.

Supplementing the virtual learning environment for information systems graduate education

DUE TO COPYRIGHT RESTRICTIONS ONLY AVAILABLE FOR CONSULTATION AT ASTON UNIVERSITY LIBRARY AND INFORMATION SERVICES WITH PRIOR ARRANGEMENT

Engaging tutors in using e-repositories for learning and teaching

Universities which set up online repositories for the management of learning and teaching resources commonly find that uptake is poor. Tutors are often reluctant to upload their materials to e-repositories, even though the same tutors are happy to upload resources to the virtual learning environment (e.g. Blackboard, Moodle, Sakai) and happy to upload their research papers to the university’s research publications repository. The paper reviews this phenomenon and suggests constructive ways in which tutors can be encouraged to engage with an e-repository. The authors have recently completed a major project “Developing Repositories at Worcester” which is part of a group of similar projects in the UK. The paper includes the feedback and the lessons learned from these projects, based on the publications and reports they have produced. They cover ways of embedding repository use into institutional working practice, and give examples of different types of repository designed to meet the needs of those using different kinds of learning and teaching resources. As well as this specific experience, the authors summarise some of the main findings from UK publications, in particular the December 2008 report of Joint Information Systems Committee: Good intentions: improving the evidence base in support of sharing learning materials and Online Innovation in Higher Education, Ron Cooke’s report to a UK government initiative on the future of Higher Education. The issues covered include the development of Web 2.0 style repositories rather than conventionally structured ones, the use of tags rather than metadata, the open resources initiative, the best use for conventional repositories, links to virtual learning environments, and the processes for the management and support of repositories within universities. In summary the paper presents an optimistic, constructive view of how to embed the use of e-repositories into the working practices of university tutors. Equally, the authors are aware of the considerable difficulties in making progress and are realistic about what can be achieved. The paper uses evidence and experience drawn from those working in this field to suggest a strategic vision in which the management of e-learning resources is productive, efficient and meets the needs of both tutors and their students.

An assessment of the learning benefits of using a web-based learning environment when teaching accounting

The impact and use of information and communication technology on learning outcomes for accounting students is not well understood. This study investigates the impact of design features of Blackboard 1 used as aWeb-based Learning Environment (WBLE) in teaching undergraduate accounting students. Specifically, this investigation reports on a number of Blackboard design features (e.g. delivery of lecture notes, announcements, online assessment and model answers) used to deliver learning materials regarded as necessary to enhance learning outcomes. Responses from 369 on-campus students provided data to develop a regression model that seeks to explain enhanced participation and mental effort. The final regression shows that student satisfaction with the use of a WBLE is associated with five design features or variables. These include usefulness and availability of lecture notes, online assessment, model answers, and online chat.

Content-based VLE designs improve learning efficiency in constructivist statistics education

Background: We introduced a series of computer-supported workshops in our undergraduate statistics courses, in the hope that it would help students to gain a deeper understanding of statistical concepts. This raised questions about the appropriate design of the Virtual Learning Environment (VLE) in which such an approach had to be implemented. Therefore, we investigated two competing software design models for VLEs. In the first system, all learning features were a function of the classical VLE. The second system was designed from the perspective that learning features should be a function of the course's core content (statistical analyses), which required us to develop a specific-purpose Statistical Learning Environment (SLE) based on Reproducible Computing and newly developed Peer Review (PR) technology. Objectives: The main research question is whether the second VLE design improved learning efficiency as compared to the standard type of VLE design that is commonly used in education. As a secondary objective we provide empirical evidence about the usefulness of PR as a constructivist learning activity which supports non-rote learning. Finally, this paper illustrates that it is possible to introduce a constructivist learning approach in large student populations, based on adequately designed educational technology, without subsuming educational content to technological convenience. Methods: Both VLE systems were tested within a two-year quasi-experiment based on a Reliable Nonequivalent Group Design. This approach allowed us to draw valid conclusions about the treatment effect of the changed VLE design, even though the systems were implemented in successive years. The methodological aspects about the experiment's internal validity are explained extensively. Results: The effect of the design change is shown to have substantially increased the efficiency of constructivist, computer-assisted learning activities for all cohorts of the student population under investigation. The findings demonstrate that a content-based design outperforms the traditional VLE-based design. © 2011 Wessa et al.

Lecturers' experiences of assessing generic skills in an active learning environment for engineering education in Malaysia - Emergent findings

The aim of this paper is to explore the engineering lecturers' experiences of generic skills assessment within an active learning context in Malaysia. Using a case-study methodology, lecturers' assessment approaches were investigated regarding three generic skills; verbal communication, problem solving and team work. Because of the importance to learning of the assessment of such skills it is this assessment that is discussed. The findings show the lecturers' initial feedback to have been generally lacking in substance, since they have limited knowledge and experience of assessing generic skills. Typical barriers identified during the study included; generic skills not being well defined, inadequate alignment across the engineering curricula and teaching approaches, assessment practices that were too flexible, particular those to do with implementation; and a failure to keep up to date with industrial requirements. The emerging findings of the interviews reinforce the arguments that there is clearly much room for improvement in the present state of generic skills assessment.

Greening operations management:an online sustainable procurement course for practitioners

In the Operations Management field, sustainable procurement has emerged as a way to green the purchasing and supply process. This paper explores issues in sustainable procurement training. The authors formed an interdisciplinary team to design, deliver and evaluate a training programme to promote and develop sustainable procurement in the United Kingdom health sector. Particular features of the project were its engagement with evolving and contested understandings of sustainable procurement and of the underlying concept of sustainable development and its recognition that relevant knowledge in the field is both incomplete and widely diffused through the procurement community. Eight practitioner groups worked together on themes to develop their understanding of sustainable procurement using the Blackboard virtual learning environment. Group interviews were conducted upon completion of the course and again three months later to explore qualitatively participants' experience of learning and implementing sustainable procurement. Although the course was delivered to practitioners, it might be modified for undergraduate and graduate students as it comprised the use of online activities in virtual learning environments, case studies and a broad range of literature. The course was also particularly significant in the context of contemporary policy moves in the United Kingdom and elsewhere to promote the role of higher education institutions in delivering workplace-based, high-skills education consistent with strategic policy considerations (see, for example, DIUS, 2008).

The attitudes of students and academic staff towards electronic course support:are we convergent?

The present study investigates the views and attitudes of both the students and staff with regard to the usefulness of electronic course support throughout all four years of the MPharm programme at Aston University. Students were sampled between January and March 2001 using a self-completion questionnaire administered during the start of a practical or tutorial class. All internal academic staff were interviewed using a semi-structured interview format. Response rates were 100 and 89.5%, respectively. The study found that students rapidly embraced the use of electronic course support within the undergraduate programme, although they view its role as augmenting traditional course delivery. This view was mirrored by the academic staff, although only around a half currently place their material on the University's virtual learning environment (VLE), WebCT. The failure of staff to completely embrace the VLE is grounded in a lack of confidence and ability in its use. A majority of the academic staff indicated that they wish to be trained further in the use of information technology. Academic institutions need to understand and meet these needs in parallel with the introduction of any electronic course support.

Do educators need educating?

Actual text: I was recently at the Spanish College of Optometry biennial conference and attended a meeting of contact lens lecturers from around Spain and Portugal. We discussed various ideas, mainly about how to share good practice and improve standards. What came to my mind was ‘is there a blueprint for training trainers?’ Well probably not but there are many things that we need to acknowledge such as the way students learn for example. Many educators themselves were taught by lecturers who would write on a blackboard or use acetate on an overhead projector, then came the 35 mm slide era followed by the Powerpoint era. More recently there is a move towards a much more integrated approach of various teaching methods. At my university our contact lens and anterior eye lectures generally follow a format where a narrated Powerpoint lecture is uploaded onto our internal virtual learning environment. This narrated version of the slides is designed to give the didactic element of the topic. The students listen to that before attending an interactive seminar on that topic. The seminar is also recorded so that students can listen to that afterwards. The seminar is designed to give additional information, such as case reports, or to clarify key points or for live demonstrations. It is a good way of doubling the contact time with the students without imposing further on an already packed formal timetable as the students can work in their own time. One problem that we noticed with this approach was that attendance can vary. If the students feel that they will gain something from the interactive seminar then they are more likely to attend – exam tips usually win them over! At the Spanish meeting the educators decided that they wanted to have regular meetings. The industry colleagues in attendance said that they were happy to help but could not necessarily give money, but they could offer meeting rooms, pay for lunch and evening meals. They even said that that they were happy to host meetings and invite other companies too (except to manufacturing plants). In the UK the British Committee of Contact Lens Educators (BUCCLE) meets for one day on three occasions in the year. The American Optometric Contact Lens Educators (AOCLE) meets annually at a three day event. Both these organisations get some help from industry. BUCCLE usually has one of its meetings at a university, one at a company training centre/manufacturing plant/national headquarters and one meeting the day before the BCLA annual conference. BUCCLE usually has its pre-BCLA meeting in conjunction with the International Association of Contact Lens Educators (IACLE). So when educators meet what would they discuss; well probably the focus should be on education rather than actual contact lens knowledge. For example sharing ideas on how to teach toric lens fitting would be better than discussing the actual topic of toric lenses itself. Most universities will have an education department with an expert who could share ideas on how to use the internet in teaching or how to structure lectures or assessments etc. In the past I have helped with similar training programmes in other countries and sharing good practice in pedagogy is always a popular topic. Anyone who is involved in education in the field of contact lenses should look at the IACLE web page and look out for the IACLE World Congress in 2015 in the days preceding the BCLA. Finally, IACLE, AOCLE and BUCCLE all exist as a result of generous educational grants from contact lens companies and anyone interested in finding out more about should refer to their respective web pages.