e-CAF: flexible marking schemes for electronic coursework assessment and feedback

Recent surveys reveal that many university students in the U.K. are not satisfied with the timeliness and usefulness of the feedback given by their tutors. Ensuring timeliness in marking can result in a reduction in the quality of feedback. Though suitable use of Information and Communication Technology should alleviate this problem, existing Virtual Learning Environments are inadequate to support detailed marking scheme creation and they provide little support for giving detailed feedback. This paper describes a unique new web-based tool called e-CAF for facilitating coursework assessment and feedback management directed by marking schemes. Using e-CAF, tutors can create or reuse detailed marking schemes efficiently without sacrificing the accuracy or thoroughness in marking. The flexibility in marking scheme design also makes it possible for tutors to modify a marking scheme during the marking process without having to reassess the students’ submissions. The resulting marking process will become more transparent to students.

A quest for helpful feedback to programming coursework

The 2011 National Student Survey (NSS) revealed that 40% of full-time students in England did not think that the feedback on their work has been helpful, even though 66% of these students agreed that the feedback was detailed and 62% of them agreed that the feedback has been prompt. Detailed feedback that is not considered helpful by students means a waste of tutors' time while students continue to struggle with their learning. What do students consider as helpful feedback? What are the qualities of helpful feedback? What are the preferred forms of feedback? How should tutors write feedback so that students will find it helpful? Can ICT help to improve the quality of feedback? In our ongoing search for answers to the above questions, we have trialled the use of a novel Internet application, called eCAF, to assess programming coursework from Engineering, Mathematics and Computing students and have collected their views on the feedback received through a survey. The survey reveals that most students prefer electronic feedback as given through eCAF, with verbal feedback ranked second and hand-written feedback ranked even lower. The survey also indicates that the feedback from some tutors is considered more helpful than others. We report on the detailed findings of the survey. By comparing the kinds of feedback given by each tutor who took part in the trial, we explore ways to improve the helpfulness of feedback on programming coursework in a bid to promote learning amongst engineering students.

Enhancing student learning experience through a novel electronic coursework assessment and feedback management system

Recent National Student Surveys revealed that many U.K. university students are dissatisfied with the timeliness and usefulness of the feedback received from their tutors. Ensuring timeliness in marking often results in a reduction in the quality of feedback. In Computer Science where learning relies on practising and learning from mistakes, feedback that pin-points errors and explains means of improvement is important to achieve a good student learning experience. Though suitable use of Information and Communication Technology should alleviate this problem, existing Virtual Learning Environments and e-Assessment applications such as Blackboard/WebCT, BOSS, MarkTool and GradeMark are inadequate to support a coursework assessment process that promotes timeliness and usefulness of feedback while maintaining consistency in marking involving multiple tutors. We have developed a novel Internet application, called eCAF, for facilitating an efficient and transparent coursework assessment and feedback process. The eCAF system supports detailed marking scheme editing and enables tutors to use such schemes to pin-point errors in students' work so as to provide helpful feedback efficiently. Tutors can also highlight areas in a submitted work and associate helpful feedback that clearly links to the identified mistakes and the respective marking criteria. In light of the results obtained from a recent trial of eCAF, we discuss how the key features of eCAF may facilitate an effective and efficient coursework assessment and feedback process.

A quest for helpful feedback to programming coursework

The 2011 National Student Survey (NSS) revealed that 40% of full-time students in England do not think that the feedback on their work has been helpful, even though 66% of these students agreed that the feedback was detailed and 62% of them agreed that the feedback has been prompt. Detailed feedback that is not considered helpful by students means a waste of tutors' time while students continue to struggle with their learning. What do students consider as helpful feedback? What are the qualities of helpful feedback? What are the preferred forms of feedback? How should tutors write feedback so that students will find it helpful? Can ICT help to improve the quality of feedback? In our ongoing search for answers to the above questions, we have trialled the use of a novel online application (eCAF) to assess programming coursework from engineering, mathematics and computing students and, through a survey, have collected their views on the feedback received. The survey reveals that most students prefer electronic feedback as given through eCAF, with verbal feedback ranked second and hand-written feedback ranked even lower. The survey also indicates that the feedback from some tutors is considered more helpful than others. We report on the detailed findings of the survey. By comparing the kinds of feedback given by each tutor who took part in the trial, we explore ways to improve the helpfulness of feedback on programming coursework in a bid to promote learning amongst engineering students.

Motivating students to learn through good and helpful coursework feedback

The 2008 National Student Survey revealed that: 44% of full-time students in England did not think that the feedback on their work had been prompt nor did they agree that the feedback on their work helped them clarify things that they did not understand (HEFCE, 2008). Computer Science and Engineering & Technology have been amongst the poorest performers in this aspect as they ranked in the lower quartile (Surridge, 2007, p.32). Five years since the first NSS survey, assessment and feedback remains the biggest concern. Dissatisfaction in any aspect of studies demotivates students and can lead to disengagement and attrition. As the student number grows, the situation can only get worse if nothing is done about it. We have conducted a survey to investigate views on assessment and feedback from Engineering, Mathematics and Computing students. The survey aims at investigating the core issues of dissatisfaction in assessment and feedback and ways in which UK Engineering students can learn better through helpful feedback. The study focuses on collecting students' experiences with feedback received in their coursework, assignments and quizzes in Computing Science modules. The survey reveals the role of feedback in their learning. The results of the survey help to identify the forms of feedback that are considered to be helpful in learning and the time frame for timely feedback. We report on the findings of the survey. We also explore ways to improve assessment and feedback in a bid to better engage engineering students in their studies.

How to write successful business and management essays

How to Write Successful Business and Management Essays is a systematic guide to successfully producing written work for business and management degrees. The authors address the all too common pitfalls of essay assignments, as well as providing students with a step-by-step programme to approach essay questions, both in coursework and exam contexts. Starting with the basics this book helps develop skills through the use of examples, exercises and checklists. Helpful features include: - Annotated essay examples, showing both good and bad points - Tips on time management and motivation, note taking and effective reading - Final checklists to use before you hand in - Explanation of what the markers are looking for – and how to give it to them Many students find referencing particularly confusing so the book provides detailed but easy-to-use information on what referencing is and how to do it properly.

Stepping Stones to Information Literacy: a PebblePad case study

Aston University has recently made PebblePad, an e-portfolio or personal learning system, available to all students within the University. The customisable Profiles within PebblePad allow students to self-declare their skills in particular areas, attaching evidence of their skills or an action plan for improvement to each statement. Formal Information Literacy (IL) teaching within Aston University is currently limited to Library & Information Services (LIS) Information Specialists delivering a maximum of one session to each student during each level of their degree. However, many of the skills are continually developed by students during the course of their academic studies. For this project, an IL skills profile was created within PebblePad, which was then promoted to groups of staff and students to complete during the academic session 2009-10. Functionality within PebblePad allowed students to share their IL skills profile, evidence, action plans or any other items they felt were appropriate with an LIS Information Specialist who was able to add comments and offer suggestions for activities to help the student to develop further. Activities were closely related to students’ coursework where possible: suggesting a student kept a short reflective log of their information searching and evaluating process for an upcoming essay, for example. Feedback on the usefulness of the IL Profile will be sought from students through focus groups and the communication tools in PebblePad. In this way, we hope to make students more aware of their IL skills and to offer IL skills support over a longer period of time than a single session can provide. We will present preliminary conclusions about the practicalities and benefits of a self-declaration approach to developing IL skills in students at Aston University.

The UK MPharm (2) - Do we over assess?

Introduction-The pace of structural change in the UK health economies, the new focus on regulation and the breaking down of professional boundaries means that the Royal Pharmaceutical Society of Great Britain (RPSGB) has to continually review the scope, range and outputs of education provided by schools of pharmacy (SOPs). In SOPs, the focus is on equipping students with the knowledge, skills and attitudes necessary to successfully engage with the pre-registration year. The aim of this study [1] was to map current programmes and undergraduate experiences to inform the RPSGB debate. The specific objectives of this paper are to describe elements of the survey of final year undergraduates, to explore student opinions and experiences of their workload, teaching, learning and assessment. Material and methods-The three main research techniques were: (1) quantitative course document review, (2) qualitative staff interview and (3) quantitative student self completion survey. The questions in the survey were based on findings from exploratory focus group work with BPSA (British Pharmaceutical Students’ Association) members and were designed to ascertain if views expressed in the focus groups on the volume and format of assessments were held by the general student cohort. The student self completion questionnaire consisting of 31 questions, was administered in 2005 to all (n=1847) final year undergraduates, using a pragmatic mixture of methods. The sample was 15 SOPs within the UK (1 SOP opted out). The total response rate was 50.62% (n=935): it varied by SOP from 14.42% to 84.62%. The survey data were analysed (n=741) using SPSS, excluding non-UK students who may have undertaken part of their studies within a non-UK university. Results and discussion • 76% (n=562) respondents considered that the amount of formal assessment was about right, 21% (n=158) thought it was too much. • There was agreement that the MPharm seems to have more assessment than other courses, with 63% (n=463) strongly agreeing or agreeing. • The majority considered the balance between examinations and coursework was about right (67%, n=498), with 27% (n=198) agreeing that the balance was too far weighted towards examinations. • 57% (n=421) agreed that the focus of MPharm assessment was too much towards memorised knowledge, 40% (n=290) that it was about right. • 78% (n= 575) agreed with the statement “Assessments don’t measure the skills for being a pharmacist they just measure your knowledge base”. Only 10% (n=77) disagreed. • Similarly 49% (n=358) disagreed with, and 35% (n=256) were not sure about the statement “I consider that the assessments used in the MPharm course adequately measure the skills necessary to be a pharmacist”. Only 17% (n=124) agreed. Experience from this study shows the difficulty of administering survey instruments through UK Schools of Pharmacy. It is heavily dependent on timing, goodwill and finding the right person. The variability of the response rate between SOPs precluded any detailed analysis by School. Nevertheless, there are some interesting results. Issues raised in the exploratory focus group work about amount of assessment and over reliance on knowledge have been confirmed. There is a real debate to be had about the extent to which the undergraduate course, which must instil scientific knowledge, can provide students with the requisite qualities, skills, attitudes and behaviour that are more easily acquired in the pre-registration year. References [1] Wilson K, Jesson J, Langley C, Clarke L, Hatfield K. MPharm Programmes: Where are we now? Report commissioned by the Pharmacy Practice Research Trust., 2005.

Learning to research - researching to learn

Learning to Research Researching to Learn explores the integration of research into teaching and learning at all levels of higher education. The chapters draw on the long and ongoing debate about the teaching research nexus in universities. Although the vast majority of academics believe that there is an important and valuable link between teaching and research, the precise nature of this relationship continues to be contested. The book includes chapters that showcase innovative ways of learning to research; how research is integrated into coursework teaching; how students learn the processes of research, and how universities are preparing students to engage with the world. The chapters also showcase innovative ways of researching to learn, exploring how students learn through doing research, how they conceptualise the knowledge of their fields of study through the processes of doing research, and how students experiment and reflect on the results produced. These are the key issues addressed by this anthology, as it brings together analyses of the ways in which university teachers are developing research skills in their students, creating enquiry-based approaches to teaching, and engaging in education research themselves. The studies here explore the links between teaching, learning and research in a range of contexts, from pre-enrolment through to academic staff development, in Australia, the UK, the US, Singapore and Denmark. Through a rich array of theoretical and methodological approaches, the collection seeks to further our understanding of how universities can play an effective role in educating graduates suited to the twenty-first century