Measuring performance of virtual learning environment system in higher education

Purpose – The purpose of this paper is to measure the performance of commercial virtual learning environment (VLE) systems, which helps the decision makers to select the appropriate system for their institutions. Design/methodology/approach – This paper develops an integrated multiple criteria decision making approach, which combines the analytic hierarchy process (AHP) and quality function deployment (QFD), to evaluate and select the best system. The evaluating criteria are derived from the requirements of those who use the system. A case study is provided to demonstrate how the integrated approach works. Findings – The major advantage of the integrated approach is that the evaluating criteria are of interest to the stakeholders. This ensures that the selected system will achieve the requirements and satisfy the stakeholders most. Another advantage is that the approach can guarantee the benchmarking to be consistent and reliable. From the case study, it is proved that the performance of a VLE system being used at the university is the best. Therefore, the university should continue to run the system in order to support and facilitate both teaching and learning. Originality/value – It is believed that there is no study that measures the performance of VLE systems, and thus decision makers may have difficulties in system evaluation and selection for their institutions.

Engaging tutors in using e-repositories for learning and teaching

Universities which set up online repositories for the management of learning and teaching resources commonly find that uptake is poor. Tutors are often reluctant to upload their materials to e-repositories, even though the same tutors are happy to upload resources to the virtual learning environment (e.g. Blackboard, Moodle, Sakai) and happy to upload their research papers to the university’s research publications repository. The paper reviews this phenomenon and suggests constructive ways in which tutors can be encouraged to engage with an e-repository. The authors have recently completed a major project “Developing Repositories at Worcester” which is part of a group of similar projects in the UK. The paper includes the feedback and the lessons learned from these projects, based on the publications and reports they have produced. They cover ways of embedding repository use into institutional working practice, and give examples of different types of repository designed to meet the needs of those using different kinds of learning and teaching resources. As well as this specific experience, the authors summarise some of the main findings from UK publications, in particular the December 2008 report of Joint Information Systems Committee: Good intentions: improving the evidence base in support of sharing learning materials and Online Innovation in Higher Education, Ron Cooke’s report to a UK government initiative on the future of Higher Education. The issues covered include the development of Web 2.0 style repositories rather than conventionally structured ones, the use of tags rather than metadata, the open resources initiative, the best use for conventional repositories, links to virtual learning environments, and the processes for the management and support of repositories within universities. In summary the paper presents an optimistic, constructive view of how to embed the use of e-repositories into the working practices of university tutors. Equally, the authors are aware of the considerable difficulties in making progress and are realistic about what can be achieved. The paper uses evidence and experience drawn from those working in this field to suggest a strategic vision in which the management of e-learning resources is productive, efficient and meets the needs of both tutors and their students.

Organisational learning - a critical systems thinking discipline

Original Paper European Journal of Information Systems (2001) 10, 135–146; doi:10.1057/palgrave.ejis.3000394 Organisational learning—a critical systems thinking discipline P Panagiotidis1,3 and J S Edwards2,4 1Deloitte and Touche, Athens, Greece 2Aston Business School, Aston University, Aston Triangle, Birmingham, B4 7ET, UK Correspondence: Dr J S Edwards, Aston Business School, Aston University, Aston Triangle, Birmingham, B4 7ET, UK. E-mail: j.s.edwards@aston.ac.uk 3Petros Panagiotidis is Manager responsible for the Process and Systems Integrity Services of Deloitte and Touche in Athens, Greece. He has a BSc in Business Administration and an MSc in Management Information Systems from Western International University, Phoenix, Arizona, USA; an MSc in Business Systems Analysis and Design from City University, London, UK; and a PhD degree from Aston University, Birmingham, UK. His doctorate was in Business Systems Analysis and Design. His principal interests now are in the ERP/DSS field, where he serves as project leader and project risk managment leader in the implementation of SAP and JD Edwards/Cognos in various major clients in the telecommunications and manufacturing sectors. In addition, he is responsible for the development and application of knowledge management systems and activity-based costing systems. 4John S Edwards is Senior Lecturer in Operational Research and Systems at Aston Business School, Birmingham, UK. He holds MA and PhD degrees (in mathematics and operational research respectively) from Cambridge University. His principal research interests are in knowledge management and decision support, especially methods and processes for system development. He has written more than 30 research papers on these topics, and two books, Building Knowledge-based Systems and Decision Making with Computers, both published by Pitman. Current research work includes the effect of scale of operations on knowledge management, interfacing expert systems with simulation models, process modelling in law and legal services, and a study of the use of artifical intelligence techniques in management accounting. Top of pageAbstract This paper deals with the application of critical systems thinking in the domain of organisational learning and knowledge management. Its viewpoint is that deep organisational learning only takes place when the business systems' stakeholders reflect on their actions and thus inquire about their purpose(s) in relation to the business system and the other stakeholders they perceive to exist. This is done by reflecting both on the sources of motivation and/or deception that are contained in their purpose, and also on the sources of collective motivation and/or deception that are contained in the business system's purpose. The development of an organisational information system that captures, manages and institutionalises meaningful information—a knowledge management system—cannot be separated from organisational learning practices, since it should be the result of these very practices. Although Senge's five disciplines provide a useful starting-point in looking at organisational learning, we argue for a critical systems approach, instead of an uncritical Systems Dynamics one that concentrates only on the organisational learning practices. We proceed to outline a methodology called Business Systems Purpose Analysis (BSPA) that offers a participatory structure for team and organisational learning, upon which the stakeholders can take legitimate action that is based on the force of the better argument. In addition, the organisational learning process in BSPA leads to the development of an intrinsically motivated information organisational system that allows for the institutionalisation of the learning process itself in the form of an organisational knowledge management system. This could be a specific application, or something as wide-ranging as an Enterprise Resource Planning (ERP) implementation. Examples of the use of BSPA in two ERP implementations are presented.

The digital divide and ICT learning in rural communities:examples of good practice service delivery

This article aims to gain a greater understanding of relevant and successful methods of stimulating an ICT culture and skills development in rural areas. The paper distils good practice activities, utilizing criteria derived from a review of the rural dimensions of ICT learning, from a range of relevant initiatives and programmes. These good practice activities cover: community resource centres providing opportunities for ‘tasting’ ICTs; video games and Internet Cafe´s as tools removing ‘entry barriers’; emphasis on ‘user management’ as a means of creating ownership; service delivery beyond fixed locations; use of ICT capacities in the delivery of general services; and selected use of financial support.

Ethnic diversity as a multilevel construct:the combined effects of dissimilarity, group diversity, and societal status on learning performance in work groups

The authors present a model of the multilevel effects of diversity on individual learning performance in work groups. For ethnically diverse work groups, the model predicts that group diversity elicits either positive or negative effects on individual learning performance, depending on whether a focal individual’s ethnic dissimilarity from other group members is high or low. By further considering the societal status of an individual’s ethnic origin within society (Anglo versus non-Anglo for our U.K. context), the authors hypothesize that the model’s predictions hold more strongly for non-Anglo group members than for Anglo group members. We test this model with data from 412 individuals working on a 24-week business simulation in 87 four- to seven-person groups with varying degrees of ethnic diversity. Two of the three hypotheses derived from the model received full support and one hypothesis received partial support. Implications for theory development, methods, and practice in applied group diversity research are discussed.

Learning with other health professions in the United Kingdom MPharm degree:Multidisciplinary and placement education

This paper reviews the approach to multidisciplinary and placement education in UK schools of pharmacy. The methodology involved triangulation of course documentation, staff interviews and a final year student survey. Staff members were supportive of multidisciplinary learning. The advantages were development of a wider appreciation of the students? future professional role and better understanding of the roles of other professional groups. The barriers were logistics (student numbers; multiple sites; different timetables), the achievement of balanced numbers between disciplines and engagement of students from all participating disciplines. Placement education was offered by all schools, predominantly in hospital settings. Key problems were funding and the lack of staff resources. Currently, multidisciplinary learning within the UK for pharmacy students is inadequate and is coupled with relatively low levels of placement education. In order for things to change, there should be a review of funding and support from government and the private sector employers.

Using secondary knowledge to support decision tree classification of retrospective clinical data

Retrospective clinical data presents many challenges for data mining and machine learning. The transcription of patient records from paper charts and subsequent manipulation of data often results in high volumes of noise as well as a loss of other important information. In addition, such datasets often fail to represent expert medical knowledge and reasoning in any explicit manner. In this research we describe applying data mining methods to retrospective clinical data to build a prediction model for asthma exacerbation severity for pediatric patients in the emergency department. Difficulties in building such a model forced us to investigate alternative strategies for analyzing and processing retrospective data. This paper describes this process together with an approach to mining retrospective clinical data by incorporating formalized external expert knowledge (secondary knowledge sources) into the classification task. This knowledge is used to partition the data into a number of coherent sets, where each set is explicitly described in terms of the secondary knowledge source. Instances from each set are then classified in a manner appropriate for the characteristics of the particular set. We present our methodology and outline a set of experiential results that demonstrate some advantages and some limitations of our approach. © 2008 Springer-Verlag Berlin Heidelberg.

Moving from HRM to knowledge productivity:a study of whether and how organizations become learning organizations

Practitioners and academics are in broad agreement that, above all, organizations need to be able to learn, to innovate and to question existing ways of working. This thesis develops a model to take into account, firstly, what determines whether or not organizations endorse practices designed to facilitate learning. Secondly, the model evaluates the impact of such practices upon organizational outcomes, measured in terms of products and technological innovation. Researchers have noted that organizations that are committed to producing innovation show great resilience in dealing with adverse business conditions (e.g. Pavitt, 1991; Leonard Barton, 1998). In effect, such organizations bear many of the characteristics associated with the achievement of ‘learning organization’ status (Garvin, 1993; Pedler, Burgoyne & Boydell, 1999; Senge, 1990). Seven studies are presented to support this theoretical framework. The first empirical study explores the antecedents to effective learning. The three following studies present data to suggest that people management practices are highly significant in determining whether or not organizations are able to produce sustained innovation. The thesis goes on to explore the relationship between organizational-level job satisfaction, learning and innovation, and provides evidence to suggest that there is a strong, positive relationship between these variables. The final two chapters analyze learning and innovation within two similar manufacturing organizations. One manifests relatively low levels of innovation whilst the other is generally considered to be outstandingly innovative. I present the comparative framework for exploring the different approaches to learning manifested by the two organizations. The thesis concludes by assessing the extent to which the theoretical model presented in the second chapter is borne out by the findings of the study. Whilst this is a relatively new field of inquiry, findings reveal that organizations have a much stronger chance of producing sustained innovation where they manage people proactively where people process themselves to be satisfied at work. Few studies to date have presented empirical evidence to substantiate theoretical endorsements to engage in higher order learning, so this research makes an important contribution to existing literature in this field.

An exploration of the determinants of innovation:the top management team, organisational climate and organisational learning

Some researchers argue that the top team, rather than the CEO, is a better predictor of an organisation’s fate (Finkelstein & Hambrick, 1996; Knight et al., 1999). However, others suggest that the importance of the top management team (TMT) composition literature is exaggerated (West & Schwenk, 1996). This has stimulated a need for further research on TMTs. While the importance of TMT is well documented in the innovation literature, the organisational environment also plays a key role in determining organisational outcomes. Therefore, the inclusion of both TMT characteristics and organisational variables (climate and organisational learning) in this study provides a more holistic picture of innovation. The research methodologies employed includes (i) interviews with TMT members in 35 Irish software companies (ii) a survey completed by managerial respondents and core workers in these companies (iii) in-depth interviews with TMT members from five companies. Data were gathered in two phases, time 1 (1998-2000) and time 2 (2003). The TMT played an important part in fostering innovation. However, it was a group process, rather than team demography, that was most strongly associated with innovation. Task reflexivity was an important predictor of innovation time 1, time 2). Only one measure of TMT diversity was associated with innovation - tenure diversity -in time 2 only. Organisational context played an important role in determining innovation. This was positively associated with innovation - but with one dimension of organisational learning only. The ability to share information (access to information) was not associated with innovation but the motivation to share information was (perceiving the sharing of information to be valuable). Innovative climate was also associated with innovation. This study suggests that this will lead to innovative outcomes if employees perceive the organisation to support risk, experimentation and other innovative behaviours.

A study in Britain and France of the development of cross-cultural in-house sales training using distance learning.

The thesis is concerned with cross-cultural distance learning in two countries: Great Britain and France. Taking the example of in-house sales training, it argues that it is possible to develop courses for use in two or more countries of differing culture and language. Two courses were developed by the researcher. Both were essentially print-based distance-learning courses designed to help salespeople achieve a better understanding of their customers. One used a quantitative, the other qualitative approach. One considered the concept of the return on investment and the other, for which a video support was also developed, considered the analysis of a customer's needs. Part 1 of the thesis considers differences in the training context between France and Britain followed by a review of the learning process with reference to distance learning. Part 2 looks at the choice of training medium course design and evaluation and sets out the methodology adopted, including problems encountered in this type of fieldwork. Part 3 analyses the data and draws conclusions from the findings, before offering a series of guidelines for those concerned with the development of cross-cultural in-house training courses. The results of the field tests on the two courses were analysed in relation to the socio-cultural, educational and experiential background of the learners as well as their preferred learning styles. The thesis argues that it is possible to develop effective in-house sales training courses to be used in two cultures and identifies key considerations which need to be taken into account when carrying out this type of work.

ALEX®: a mobile Adult Literacy Experiential Learning application

An alarmingly high number of adults in the world's most developed countries are linguistically functionally illiterate. The research presented in this paper describes ALEX©, an ongoing attempt to successfully develop an innovative assistive, mobile, experiential language-learning application to support the daily literacy education and needs of such adults, anywhere, anytime. We introduce a set of guidelines we have collated to inform the design of mobile assistive technologies, introduce our application and describe the design activities to date that have led to the development of our current application. We present this overview in the hope that it is useful to others working in the fledgling domains of mobile assistive technology design and/or mobile experiential language-learning technologies.

Post-registration learning trends of community pharmacists

Background: Some Australian pharmacists use continuing education to maintain knowledge and acquire new information. There has been a progression from continuing education to continuing professional development (CPD) - a mandatory requirement for pharmacists in all jurisdictions of Australia. Aim: To identify post-registration learning trends of community pharmacists in Western Australia. Method: A questionnaire was developed and administered by face-to-face interviews with community pharmacists in metropolitan Perth. Pharmacists registered for less than 12 months and pharmacists working in hospitals were excluded. Results: 103 pharmacists were approached with a response rate of 95%. Journals (41%), reference books (23%) and the Internet (18%) were the most commonly used educational resources cited by pharmacists. Keeping scientific information up-to-date (39%) and gathering practical knowledge (22%) were the leading motivators for pharmacists to participate in continuing education. Factors that hindered participation in continuing education included lack of time (34%), family commitments (21%) and business commitments (21%). 79% of pharmacists agreed with the concept of mandatory CPD. 47% of pharmacists suggested that the primary sanction for not complying with mandatory CPD should be counselling to determine reasons for non-compliance. Conclusion: Community pharmacists preferred educational resources that were easily accessible at convenient times. Most pharmacists were able to fulfil the requirements of CPD, however, further educational support and promotion would ensure the successful uptake of CPD by community pharmacists in Western Australia.

An investigation into inductive parameter learning in complex hierarchical knowledge structures representing clinical expertise

This dissertation investigates the very important and current problem of modelling human expertise. This is an apparent issue in any computer system emulating human decision making. It is prominent in Clinical Decision Support Systems (CDSS) due to the complexity of the induction process and the vast number of parameters in most cases. Other issues such as human error and missing or incomplete data present further challenges. In this thesis, the Galatean Risk Screening Tool (GRiST) is used as an example of modelling clinical expertise and parameter elicitation. The tool is a mental health clinical record management system with a top layer of decision support capabilities. It is currently being deployed by several NHS mental health trusts across the UK. The aim of the research is to investigate the problem of parameter elicitation by inducing them from real clinical data rather than from the human experts who provided the decision model. The induced parameters provide an insight into both the data relationships and how experts make decisions themselves. The outcomes help further understand human decision making and, in particular, help GRiST provide more accurate emulations of risk judgements. Although the algorithms and methods presented in this dissertation are applied to GRiST, they can be adopted for other human knowledge engineering domains.

A bridge too far? Breaching the research/learning and teaching nexus in a previously research-led university

The relationship between research and learning and teaching represents what has been described as ‘amongst the most intellectually tangled, managerially complex and politically contentious issues in mass higher education’ (Scott, 2005, p 53). Despite this, arguments that in order to achieve high quality scholarly outcomes, university teachers need to adopt an approach to teaching similar to that of research (i.e. founded upon academic rigour and evidence), has long been discussed in the literature (see for example, Elton, 2005 & Healey, 2000). However, the practicalities of promoting an empirical and evidence-based approach to teaching within a research-led institution makes dealing with the research/learning and teaching nexus a somewhat challenging proposition. Drawing upon the findings of a mixed methodological study, this paper critically analyses the pedagogical, organisational and practical issues encountered by academics and support staff working within a newly established Centre for Learning Innovation and Professional Practice. Comprising an eclectic group of staff drawn from across the five Schools in the University, the Centre is dedicated to enhancing student learning through the development of evidence based teaching practice. Based upon the premise that the promotion of research-led teaching will act to bring teaching and research together, and in doing so enhance students learning experiences (Simmons & Elen 2007), the paper critically analyses the challenges encountered by staff responsible for developing and introducing a new learning & teaching focused organisational strategy (by reflecting on the previous 12 months work). In doing so it makes a significant contribution to current academic theory and debate in the areas of pedagogic practice and organisational management. Focusing specifically on the impact of the new policy on various aspects of university life including, pedagogic practice, student support, staff training, and organisational management, the paper critically addresses the cultural and attitudinal challenges of change management (Kotter, 1996) within a ‘grey-brick’ university. It concludes by arguing that the move towards becoming a more learning-focused university has started to develop an awareness of the positive impact the change initiative is having on the student experience and wider institution; whilst also drawing attention to the organisational challenges ahead.

Enhancing student learning experience through a novel electronic coursework assessment and feedback management system

Recent National Student Surveys revealed that many U.K. university students are dissatisfied with the timeliness and usefulness of the feedback received from their tutors. Ensuring timeliness in marking often results in a reduction in the quality of feedback. In Computer Science where learning relies on practising and learning from mistakes, feedback that pin-points errors and explains means of improvement is important to achieve a good student learning experience. Though suitable use of Information and Communication Technology should alleviate this problem, existing Virtual Learning Environments and e-Assessment applications such as Blackboard/WebCT, BOSS, MarkTool and GradeMark are inadequate to support a coursework assessment process that promotes timeliness and usefulness of feedback while maintaining consistency in marking involving multiple tutors. We have developed a novel Internet application, called eCAF, for facilitating an efficient and transparent coursework assessment and feedback process. The eCAF system supports detailed marking scheme editing and enables tutors to use such schemes to pin-point errors in students' work so as to provide helpful feedback efficiently. Tutors can also highlight areas in a submitted work and associate helpful feedback that clearly links to the identified mistakes and the respective marking criteria. In light of the results obtained from a recent trial of eCAF, we discuss how the key features of eCAF may facilitate an effective and efficient coursework assessment and feedback process.