Enhancing student learning experience through a novel electronic coursework assessment and feedback management system

Recent National Student Surveys revealed that many U.K. university students are dissatisfied with the timeliness and usefulness of the feedback received from their tutors. Ensuring timeliness in marking often results in a reduction in the quality of feedback. In Computer Science where learning relies on practising and learning from mistakes, feedback that pin-points errors and explains means of improvement is important to achieve a good student learning experience. Though suitable use of Information and Communication Technology should alleviate this problem, existing Virtual Learning Environments and e-Assessment applications such as Blackboard/WebCT, BOSS, MarkTool and GradeMark are inadequate to support a coursework assessment process that promotes timeliness and usefulness of feedback while maintaining consistency in marking involving multiple tutors. We have developed a novel Internet application, called eCAF, for facilitating an efficient and transparent coursework assessment and feedback process. The eCAF system supports detailed marking scheme editing and enables tutors to use such schemes to pin-point errors in students' work so as to provide helpful feedback efficiently. Tutors can also highlight areas in a submitted work and associate helpful feedback that clearly links to the identified mistakes and the respective marking criteria. In light of the results obtained from a recent trial of eCAF, we discuss how the key features of eCAF may facilitate an effective and efficient coursework assessment and feedback process.

Good practice guide in learning and teaching

Once again this publication is produced to celebrate and promote good teaching and learning support and to offer encouragement to those imaginative and innovative staff who continue to wish to challenge students to learn to maximum effect. It is hoped that others will pick up some good ideas from the articles contained in this volume. We have again changed our approach for this 2006/07 edition (our fourth) of the Aston Business School Good Practice Guide. As before, some contributions were selected from those identifying interesting best practice on their Annual Module reflection forms in 2005/2006. Other contributors received HELM (Research Centre in Higher Education Learning and Management) small research grants in 2005/2006. Part of the conditions were for them to write an article for this publication. We have also been less tight on the length of the articles this year. Some contributions are, therefore, on the way to being journal articles. HELM will be working with these authors to help develop these for publication. The themes covered in this year?s articles are all central to the issues faced by those providing HE teaching and learning opportunities in the 21st Century. Specifically this is providing support and feedback to students in large classes, embracing new uses of technology to encourage active learning and addressing cultural issues in a diverse student population. Michael Grojean and Yves Guillaume used Blackboard™ to give a more interactive learning experience and improve feedback to students. It would be easy for other staff to adopt this approach. Patrick Tissington and Qin Zhou (HELM small research grant holders) were keen to improve the efficiency of student support, as does Roger McDermott. Celine Chew shares her action learning project, completed as part of the Aston University PG Certificate in Teaching and Learning. Her use of Blackboard™ puts emphasis on the learner having to do something to help them meet the learning outcomes. This is what learning should be like, but many of our students seem used to a more passive learning experience, so much needs to be done on changing expectations and cultures about learning. Regina Herzfeldt also looks at cultures. She was awarded a HELM small research grant and carried out some significant new research on cultural diversity in ABS and what it means for developing teaching methods. Her results fit in with what many of us are experiencing in practice. Gina leaves us with some challenges for the future. Her paper certainly needs to be published. This volume finishes with Stuart Cooper and Matt Davies reflecting on how to keep students busy in lectures and Pavel Albores working with students on podcasting. Pavel?s work, which was the result of another HELM small research grant, will also be prepared for publication as a journal article. The students learnt more from this work that any formal lecture and Pavel will be using the approach again this year. Some staff have been awarded HELM small research grants in 2006/07 and these will be published in the next Good Practice Guide. In the second volume we mentioned the launch of the School?s Research Centre in Higher Education Learning and Management (HELM). Since then HELM has stimulated a lot of activity across the School (and University) particularly linking research and teaching. A list of the HELM seminars for 2006/2007 is listed as Appendix 1 of this publication. Further details can be obtained from Catherine Foster (c.s.foster@aston.ac.uk), who coordinates the HELM seminars. For 2006 and 2005 HELM listed, 20 refereed journal articles, 7 book chapters, 1 published conference papers, 20 conference presentations, two official reports, nine working papers and £71,535 of grant money produced in this research area across the School. I hope that this shows that reflection on learning is alive and well in ABS. We have also been working on a list of target journals to guide ABS staff who wish to publish in this area. These are included as Appendix 2 of this publication. May I thank the contributors for taking time out of their busy schedules to write the articles and to Julie Green, the Quality Manager, for putting the varying diverse approaches into a coherent and publishable form and for agreeing to fund the printing of this volume.

A visual interactive modelling system as a learning tool

This paper presents a case study of the use of a visual interactive modelling system to investigate issues involved in the management of a hospital ward. Visual Interactive Modelling systems are seen to offer the learner the opportunity to explore operational management issues from a varied perspective and to provide an interactive system in which the learner receives feedback on the consequences of their actions. However to maximise the potential learning experience for a student requires the recognition that they require task structure which helps them to understand the concepts involved. These factors can be incorporated into the visual interactive model by providing an interface customised to guide the student through the experimentation. Recent developments of VIM systems in terms of their connectivity with the programming language Visual Basic facilitates this customisation.

The development and evaluation of distance learning materials for administrative personnel in a multi-national company

There has been substantial research into the role of distance learning in education. Despite the rise in the popularity and practice of this form of learning in business, there has not been a parallel increase in the amount of research carried out in this field. An extensive investigation was conducted into the entire distance learning system of a multi-national company with particular emphasis on the design, implementation and evaluation of the materials. In addition, the performance and attitudes of trainees were examined. The results of a comparative study indicated that trainees using distance learning had significantly higher test scores than trainees using conventional face-to-face training. The influence of the previous distance learning experience, educational background and selected study environment of trainees was investigated. Trainees with previous experience of distance learning were more likely to complete the course and with significantly higher test scores than trainees with no previous experience. The more advanced the educational background of trainees, the greater the likelihood of their completing the course, although there was no significant difference in the test scores achieved. Trainees preferred to use the materials at home and those opting to study in this environment scored significantly higher than those studying in the office, the study room at work or in a combination of environments. The influence of learning styles (Kolb, 1976) was tested. The results indicated that the convergers had the greatest completion rates and scored significantly higher than trainees with the assimilator, accommodator and diverger learning styles. The attitudes of the trainees, supervisors and trainers were examined using questionnaire, interview and discussion techniques. The findings highlighted the potential problems of lack of awareness and low motivation which could prove to be major obstacles to the success of distance learning in business.

Perceptions of learning and teaching quality in Higher Education:developing a culture of co-creation of value

Perceptions about the quality of learning and teaching in Higher Education has for many years focused upon the application of market based principles. This includes the notion of students as “customers” of the Higher Education Institutions (HEI) service. We argue that the application of the customer analogy is unhelpful however, as students this approach is likely to affect student expectations about the service and their judgements about its quality. The purpose of this paper is to propose a study consisting of a series of interventions to develop a culture of value co-creation at a UK based HEI. By introducing CCV principles, it is hoped to steer students away from seeing themselves as “customers”, and passive recipients of in the learning and teaching process, to one where they take responsibility for their own learning experience, to be explored and acted upon in partnership with their lecturers and other stakeholders.

An assessment of web-based textbook supplementary material to support student learning

There is an increasing trend by publishers to provide supplementary learning materials with text books in order to improve the learning experience and thus ultimately improve text book sales. This study will aim to establish the use of these materials and their relevance to students in terms of supporting student learning. The materials include multiple choice test banks, animated demonstrations, simulations, quizzes and electronic versions of the text. The study will focus on the extensive library of web-based learning materials available on the ‘WileyPlus’ web platform which accompanies the textbook ‘Operations Management’, 2nd edition authored by A. Greasley and published by John Wiley and Sons Ltd.

Engaging employers as partners in work-based learning assessment:proposal for a quality enhancement framework

This paper seeks to advance research and practice related to the role of employers in all stages of the assessment process of work-based learning (WBL) within a tripartite relationship of higher education institution (HEI), student and employer. It proposes a research-informed quality enhancement framework to develop good practice in engaging employers as partners in assessment. The Enhancement Framework comprises three dimensions, each of which includes elements and questions generated by the experiences of WBL students, HEI staff and employers. The three dimensions of the Enhancement Framework are: 1. ‘premises of assessment’ encompassing issues of learning, inclusion, standards and value; 2. ‘practice’, encompassing stages of assessment made up of course design, assessment task, responsibilities, support, grading and feedback; 3. ‘communication of assessment’ with the emphasis on role clarity, language and pathways. With its prompt questions, the Enhancement Framework may be used as a capacity-building tool for promoting, sustaining, benchmarking and evaluating productive dialogue and critical reflection about assessment between WBL partners. The paper concludes by emphasising the need for professional development as well as policy and research development, so that assessment in WBL can more closely correspond to the potentially transformative nature of the learning experience.

Learning in friendship groups:developing students’ conceptual understanding through social interaction

The role that student friendship groups play in learning was investigated here. Employing a critical realist design, two focus groups on undergraduates were conducted to explore their experience of studying. Data from the "case-by-case" analysis suggested student-to-student friendships produced social contexts which facilitated conceptual understanding through discussion, explanation, and application to "real life" contemporary issues. However, the students did not conceive this as a learning experience or suggest the function of their friendships involved learning. These data therefore challenge the perspective that student groups in higher education are formed and regulated for the primary function of learning. Given these findings, further research is needed to assess the role student friendships play in developing disciplinary conceptual understanding.

Facilitating intuitive-guided learning in a serious game through integration with a learning content management system

Increased global uptake of entertainment gaming has the potential to lead to high expectations of engagement and interactivity from users of technology-enhanced learning environments. Blended approaches to implementing game-based learning as part of distance or technology-enhanced education have led to demonstrations of the benefits they might bring, allowing learners to interact with immersive technologies as part of a broader, structured learning experience. In this article, we explore how the integration of a serious game can be extended to a learning content management system (LCMS) to support a blended and holistic approach, described as an 'intuitive-guided' method. Through a case study within the EU-Funded Adaptive Learning via Intuitive/Interactive, Collaborative and Emotional Systems (ALICE) project, a technical integration of a gaming engine with a proprietary LCMS is demonstrated, building upon earlier work and demonstrating how this approach might be realized. In particular, how this method can support an intuitive-guided approach to learning is considered, whereby the learner is given the potential to explore a non-linear environment whilst scaffolding and blending provide guidance ensuring targeted learning objectives are met. Through an evaluation of the developed prototype with 32 students aged 14-16 across two Italian schools, a varied response from learners is observed, coupled with a positive reception from tutors. The study demonstrates that challenges remain in providing high-fidelity content in a classroom environment, particularly as an increasing gap in technology availability between leisure and school times emerges.

Practice based learning approaches in collaborative design and engineering education:a case study investigation into the benefits of a crossdisciplinary practice based learning strategy

This study explores the ongoing pedagogical development of a number of undergraduate design and engineering programmes in the United Kingdom. Observations and data have been collected over several cohorts to bring a valuable perspective to the approaches piloted across two similar university departments while trialling a number of innovative learning strategies. In addition to the concurrent institutional studies the work explores curriculum design that applies the principles of Co-Design, multidisciplinary and trans disciplinary learning, with both engineering and product design students working alongside each other through a practical problem solving learning approach known as the CDIO learning initiative (Conceive, Design Implement and Operate) [1]. The study builds on previous work presented at the 2010 EPDE conference: The Effect of Personality on the Design Team: Lessons from Industry for Design Education [2]. The subsequent work presented in this paper applies the findings to mixed design and engineering team based learning, building on the insight gained through a number of industrial process case studies carried out in current design practice. Developments in delivery also aligning the CDIO principles of learning through doing into a practice based, collaborative learning experience and include elements of the TRIZ creative problem solving technique [3]. The paper will outline case studies involving a number of mixed engineering and design student projects that highlight the CDIO principles, combined with an external industrial design brief. It will compare and contrast the learning experience with that of a KTP derived student project, to examine an industry based model for student projects. In addition key areas of best practice will be presented, and student work from each mode will be discussed at the conference.

Bringing engineering education to life – an empirical approach to learning and teaching

Learning and teaching approaches to engineering are generally perceived to be difficult and academically challenging. Such challenges are reflected in high levels of student attrition and failure. In addressing this issue, a unique approach to engineering education has been developed by the paper authors. This approach, which is suitable for undergraduate and postgraduate levels, brings together pedagogic and engineering epistemologies in an empirically grounded framework. It is underpinned by three distinctive concepts: Relationships, Variety & Synergy. Based upon research, the R + V + S approach to Engineering Education provides a learning and teaching strategy, which in enhancing the student experience, increases retention and positively impacts student success [S2]. Based on the study findings, this paper shows how, by designing engineering education around the concepts of Relationships, Variety and Synergy, the student learning experience becomes one that is academically challenging yet beneficial to both students and engineering educators. The challenge is to widen and test the approach in other areas of engineering education, before going on to investigate the value of the approach in other disciplines.

Creative thinking experimentations for entrepreneurship with a disruptive, personalised and mobile game-based learning ecosystem

Based on an unprecedented need of stimulating creative capacities towards entrepreneurship to university students and young researchers, this paper introduces and analyses a smart learning ecosystem for encouraging teaching and learning on creative thinking as a distinct feature to be taught and learnt in universities. The paper introduces a mashed-up authoring architecture for designing lesson-plans and games with visual learning mechanics for creativity learning. The design process is facilitated by creativity pathways discerned across components. Participatory learning, networking and capacity building is a key aspect of the architecture, extending the learning experience and context from the classroom to outdoor (co-authoring of creative pathways by students, teachers and real-world entrepreneurs) and personal spaces. We anticipate that the smart learning ecosystem will be empirically evaluated and validated in future iterations for exploring the benefits of using games for enhancing creative mindsets, unlocking the imagination that lies within, practiced and transferred to multiple academic tribes and territories.

Essential features of serious games design in higher education:linking learning attributes to game mechanics

This paper consolidates evidence and material from a range of specialist and disciplinary fields to provide an evidence-based review and synthesis on the design and use of serious games in higher education. Search terms identified 165 papers reporting conceptual and empirical evidence on how learning attributes and game mechanics may be planned, designed and implemented by university teachers interested in using games, which are integrated into lesson plans and orchestrated as part of a learning sequence at any scale. The findings outline the potential of classifying the links between learning attributes and game mechanics as a means to scaffold teachers’ understanding of how to perpetuate learning in optimal ways while enhancing the in-game learning experience. The findings of this paper provide a foundation for describing methods, frames and discourse around experiences of design and use of serious games, linked to methodological limitations and recommendations for further research in this area.