Enhancing student learning experience through a novel electronic coursework assessment and feedback management system

Recent National Student Surveys revealed that many U.K. university students are dissatisfied with the timeliness and usefulness of the feedback received from their tutors. Ensuring timeliness in marking often results in a reduction in the quality of feedback. In Computer Science where learning relies on practising and learning from mistakes, feedback that pin-points errors and explains means of improvement is important to achieve a good student learning experience. Though suitable use of Information and Communication Technology should alleviate this problem, existing Virtual Learning Environments and e-Assessment applications such as Blackboard/WebCT, BOSS, MarkTool and GradeMark are inadequate to support a coursework assessment process that promotes timeliness and usefulness of feedback while maintaining consistency in marking involving multiple tutors. We have developed a novel Internet application, called eCAF, for facilitating an efficient and transparent coursework assessment and feedback process. The eCAF system supports detailed marking scheme editing and enables tutors to use such schemes to pin-point errors in students' work so as to provide helpful feedback efficiently. Tutors can also highlight areas in a submitted work and associate helpful feedback that clearly links to the identified mistakes and the respective marking criteria. In light of the results obtained from a recent trial of eCAF, we discuss how the key features of eCAF may facilitate an effective and efficient coursework assessment and feedback process.

An assessment of web-based textbook supplementary material to support student learning

There is an increasing trend by publishers to provide supplementary learning materials with text books in order to improve the learning experience and thus ultimately improve text book sales. This study will aim to establish the use of these materials and their relevance to students in terms of supporting student learning. The materials include multiple choice test banks, animated demonstrations, simulations, quizzes and electronic versions of the text. The study will focus on the extensive library of web-based learning materials available on the ‘WileyPlus’ web platform which accompanies the textbook ‘Operations Management’, 2nd edition authored by A. Greasley and published by John Wiley and Sons Ltd.

Engaging employers as partners in work-based learning assessment:proposal for a quality enhancement framework

This paper seeks to advance research and practice related to the role of employers in all stages of the assessment process of work-based learning (WBL) within a tripartite relationship of higher education institution (HEI), student and employer. It proposes a research-informed quality enhancement framework to develop good practice in engaging employers as partners in assessment. The Enhancement Framework comprises three dimensions, each of which includes elements and questions generated by the experiences of WBL students, HEI staff and employers. The three dimensions of the Enhancement Framework are: 1. ‘premises of assessment’ encompassing issues of learning, inclusion, standards and value; 2. ‘practice’, encompassing stages of assessment made up of course design, assessment task, responsibilities, support, grading and feedback; 3. ‘communication of assessment’ with the emphasis on role clarity, language and pathways. With its prompt questions, the Enhancement Framework may be used as a capacity-building tool for promoting, sustaining, benchmarking and evaluating productive dialogue and critical reflection about assessment between WBL partners. The paper concludes by emphasising the need for professional development as well as policy and research development, so that assessment in WBL can more closely correspond to the potentially transformative nature of the learning experience.

New lecturers' beliefs about learning, teaching and assessment in higher education:the role of the PGCLTHE programme

This study was carried out with new lecturers on a two year Post Graduate Certificate in Learning and Teaching in Higher Education programme in a UK university. The aim was to establish their beliefs about how studying on the programme aligned with their teaching and learning philosophy and what, if anything, had changed or constrained those beliefs. Ten lecturers took part in an in-depth semi-structured interview. Content analysis of the transcripts suggested positive reactions to the programme but lecturers’ new insights were sometimes constrained by departments and university bureaucracy, particularly in the area of assessment. The conflicting roles of research and teaching were also a major issue facing these new professionals.

Complex skills and academic writing:a review of evidence about the types of learning required to meet core assessment criteria

Assessment criteria are increasingly incorporated into teaching, making it important to clarify the pedagogic status of the qualities to which they refer. We reviewed theory and evidence about the extent to which four core criteria for student writing-critical thinking, use of language, structuring, and argument-refer to the outcomes of three types of learning: generic skills learning, a deep approach to learning, and complex learning. The analysis showed that all four of the core criteria describe to some extent properties of text resulting from using skills, but none qualify fully as descriptions of the outcomes of applying generic skills. Most also describe certain aspects of the outcomes of taking a deep approach to learning. Critical thinking and argument correspond most closely to the outcomes of complex learning. At lower levels of performance, use of language and structuring describe the outcomes of applying transferable skills. At higher levels of performance, they describe the outcomes of taking a deep approach to learning. We propose that the type of learning required to meet the core criteria is most usefully and accurately conceptualized as the learning of complex skills, and that this provides a conceptual framework for maximizing the benefits of using assessment criteria as part of teaching. © 2006 Taylor & Francis.

Study of the Self-Assessment as а Component of the Model of Self-Regulated Learning for Engineering Students

Report published in the Proceedings of the National Conference on "Education and Research in the Information Society", Plovdiv, May, 2015

Collaborative Learning and Assessment in e-Learning

Report published in the Proceedings of the National Conference on "Education and Research in the Information Society", Plovdiv, May, 2016

Content Analysis of Outcome Assessment of Global Learning Foundations Courses: A Case Study

This study used content analysis to interpret and evaluate outcome evaluation matrices of undergraduate Global Learning foundations courses. The findings revealed a lack of uniformity in the faculty members’ interpretation and implementation of global learning components in the coursework. Successful teaching practices and challenges were identified and classified.

Exploring the mobile structural assessment tool: Concept maps for learning website: Concept Maps for Learning Website

In this paper, we describe how the pathfinder algorithm converts relatedness ratings of concept pairs to concept maps; we also present how this algorithm has been used to develop the Concept Maps for Learning website (www.conceptmapsforlearning.com) based on the principles of effective formative assessment. The pathfinder networks, one of the network representation tools, claim to help more students memorize and recall the relations between concepts than spatial representation tools (such as Multi- Dimensional Scaling). Therefore, the pathfinder networks have been used in various studies on knowledge structures, including identifying students’ misconceptions. To accomplish this, each student’s knowledge map and the expert knowledge map are compared via the pathfinder software, and the differences between these maps are highlighted. After misconceptions are identified, the pathfinder software fails to provide any feedback on these misconceptions. To overcome this weakness, we have been developing a mobile-based concept mapping tool providing visual, textual and remedial feedback (ex. videos, website links and applets) on the concept relations. This information is then placed on the expert concept map, but not on the student’s concept map. Additionally, students are asked to note what they understand from given feedback, and given the opportunity to revise their knowledge maps after receiving various types of feedback.

Is Our Students Learning - QuestionMark: Extending E-Assessment Systems for Adapative Marking and Feedback

Our key contribution is a flexible, automated marking system that adds desirable functionality to existing E-Assessment systems. In our approach, any given E-Assessment system is relegated to a data-collection mechanism, whereas marking and the generation and distribution of personalised per-student feedback is handled separately by our own system. This allows content-rich Microsoft Word feedback documents to be generated and distributed to every student simultaneously according to a per-assessment schedule.

The feedback is adaptive in that it corresponds to the answers given by the student and provides guidance on where they may have gone wrong. It is not limited to simple multiple choice which are the most prescriptive question type offered by most E-Assessment Systems and as such most straightforward to mark consistently and provide individual per-alternative feedback strings. It is also better equipped to handle the use of mathematical symbols and images within the feedback documents which is more flexible than existing E-Assessment systems, which can only handle simple text strings.

As well as MCQs the system reliably and robustly handles Multiple Response, Text Matching and Numeric style questions in a more flexible manner than Questionmark: Perception and other E-Assessment Systems. It can also reliably handle multi-part questions where the response to an earlier question influences the answer to a later one and can adjust both scoring and feedback appropriately.

New question formats can be added at any time provided a corresponding marking method conforming to certain templates can also be programmed. Indeed, any question type for which a programmatic method of marking can be devised may be supported by our system. Furthermore, since the student’s response to each is question is marked programmatically, our system can be set to allow for minor deviations from the correct answer, and if appropriate award partial marks.

The Hidden benefits of “poster presentation assessment”: Skill acquirement and learning; evaluated from the nursing students perspective

Introduction
This paper reports to an exercise in evaluating poster group work and poster presentation and the extra learning and skill acquisition that this can provide to nursing students, through a creative and stimulating assessment method. Much had been written about the benefits of using posters as an assessment method, yet there appears to be a lack of research that captures the student experience.
Aim
This evaluative study sought to evaluate the student experience by using a triangulation approach to evaluation:
Methodology
All students from the February 2015 nursing intake, were eligible to take part (80 students) of which 71 participated (n=71). The poster group presentations took place at the end of their first phase of year one teaching and the evaluation took place at the end of their first year as undergraduate. Evaluation involved;
1. Quantitative data by questionnaires
2. Qualitative data from focus group discussions
Results
A number of key themes emerged from analysis of the data which captured the “added value” of learning from the process of poster assessment including:
 Professionalism: developing time keeping skills, presenting skills.
 Academic skills: developing literature search, critic and reporting
 Team building and collaboration
Overall 88% agreed that the process furnished them with additional skills and benefits above the actual production of the poster, with 97% agreeing that these additional skills are important skills for a nurse.
Conclusion
These results would suggest that the process of poster development and presentation furnish student nurses with many additional skills that they may not acquire through other types of assessment and are therefore beneficial. The structure of the assessment encourages a self-directed approach so students take control of the goals and purposes of learning. The sequential organization of the assessment guides students in the transition from dependent to self-directed learners.