Enhancing student learning experience through a novel electronic coursework assessment and feedback management system

Recent National Student Surveys revealed that many U.K. university students are dissatisfied with the timeliness and usefulness of the feedback received from their tutors. Ensuring timeliness in marking often results in a reduction in the quality of feedback. In Computer Science where learning relies on practising and learning from mistakes, feedback that pin-points errors and explains means of improvement is important to achieve a good student learning experience. Though suitable use of Information and Communication Technology should alleviate this problem, existing Virtual Learning Environments and e-Assessment applications such as Blackboard/WebCT, BOSS, MarkTool and GradeMark are inadequate to support a coursework assessment process that promotes timeliness and usefulness of feedback while maintaining consistency in marking involving multiple tutors. We have developed a novel Internet application, called eCAF, for facilitating an efficient and transparent coursework assessment and feedback process. The eCAF system supports detailed marking scheme editing and enables tutors to use such schemes to pin-point errors in students' work so as to provide helpful feedback efficiently. Tutors can also highlight areas in a submitted work and associate helpful feedback that clearly links to the identified mistakes and the respective marking criteria. In light of the results obtained from a recent trial of eCAF, we discuss how the key features of eCAF may facilitate an effective and efficient coursework assessment and feedback process.

Confirmatory feedback in teacher education:an instigator of student teacher learning

This book examines the intricacies of the discourse of post-observation feedback that student teachers receive following group teaching practice. In particular, the author explores confirmatory feedback as an instigator of student teacher learning, and examines the potential links between feedback and change. The book will be of specific interest to researchers, teacher educators and other professionals involved in feedback-giving settings.

Encouraging student to reflect on their employment experience

The purpose behind this case study is to share with a wider audience of placement officers, tutors and those who are involved in the management of placement students or employment of graduates, the approach taken to encourage reflective learning in undergraduate placement students at Aston Business School. Reflective learning forms an important foundation of the placement year at Aston Business School, where a professional placement is a mandatory element of the four year degree, for all Home/EU students (optional for International students) who are taking a Single Honours degree (i.e. a fully business programme). The placement year is not compulsory for those students taking a Combined Honours degree (i.e. a degree where two unrelated subjects are studied), although approximately 50% of those students taking an Aston Business School subject opt to take a placement year. Students spend their year out undertaking a ‘proper’ job within a company or public sector organisation. They are normally paid a reasonable salary for their work (in 2004/5 the average advertised salary was £13,700 per annum). The placement year is assessed, carrying credits which amount to a contribution of 10% towards the students’ final degree. The assessment methods used require the students to submit an academic essay relating theory to practice, a factual report about the company which can be of use to future students, and a log book, the latter being the reflective piece of work. Encouragement to reflect on the placement year has always been an important feature of Aston Business School’s approach to learning. More recently, however, feedback from employers indicated that, although our students have excellent employability skills, “they do not think about them” (Aston Business School Advisory Panel, 2001). We, therefore, began some activities which would encourage students to go beyond the mere acquisition of skills and knowledge. This work became the basis of a programme of introductions to reflective learning, mentoring and awareness of different learning styles written up in Higson and Jones (2002). The idea was to get students used to the idea of reflection on their experiences well before they entered the placement year.

Post-observation feedback as an instigator of teacher learning and change

This paper investigates an on-going study into the nature of the discourse teacher educators (TEds) and student-teachers (Ts) use during postobservation feedback, and explores the feedback discourse in terms of the impact it may have on teacher learning and change. Two types of feedback, confirmatory and corrective, are briefly discussed, and the former is then made the focus of the paper in its role as a potential instigator of teacher learning and change.

From postgraduate student to published writer:discourse variation and development in TESOL

This thesis is part of a project whose overall aim is to assist participants on an MSc TESOL course who wish to begin to publish articles in the field to do so. The project, which is undertaken within a naturalistic paradigm, has two intimately related and mutually constitutive strands: one descriptive, one interventionist. The descriptive strand consists of an analytical model of the TESOL article genre, and it is instantiated in this thesis. The interventionist strand consists of a series of pedagogic interactions and materials intended to assist project participants formulate a text suitable for publication within the target genre, and it is reported on in this thesis. I begin the thesis by looking in detail at the research approach which characterises the project. I then attempt to explain the situational context of the work and to position it within the context of other research in the areas of discourse community membership, academic genres, genre learning and academic enculturation. Having thus contextualised the work, I next attempt a detailed exploration of the problems of postgraduate students in TESOL when first attempting to write in the TESOL article genre: this exploration is undertaken from both a linguistic and a pedagogic perspective. Then in subsequent chapters, both a linguistic and a pedagogic response to these problems are proposed: the first consisting of an analytical model of the target genre, the second consisting of a series of pedagogic interactions and materials. The relationships between the two lines of response are also examined in some detail. Then in the final part of the thesis, I report feedback from the interventionist strand and attempt to conduct an evaluation of the whole project to date. Criteria for evaluation are proposed and examined in some detail in the context of the research approach of the project. The concluding chapter is a brief discussion of future directions for this work.

A quest for helpful feedback to programming coursework

The 2011 National Student Survey (NSS) revealed that 40% of full-time students in England did not think that the feedback on their work has been helpful, even though 66% of these students agreed that the feedback was detailed and 62% of them agreed that the feedback has been prompt. Detailed feedback that is not considered helpful by students means a waste of tutors' time while students continue to struggle with their learning. What do students consider as helpful feedback? What are the qualities of helpful feedback? What are the preferred forms of feedback? How should tutors write feedback so that students will find it helpful? Can ICT help to improve the quality of feedback? In our ongoing search for answers to the above questions, we have trialled the use of a novel Internet application, called eCAF, to assess programming coursework from Engineering, Mathematics and Computing students and have collected their views on the feedback received through a survey. The survey reveals that most students prefer electronic feedback as given through eCAF, with verbal feedback ranked second and hand-written feedback ranked even lower. The survey also indicates that the feedback from some tutors is considered more helpful than others. We report on the detailed findings of the survey. By comparing the kinds of feedback given by each tutor who took part in the trial, we explore ways to improve the helpfulness of feedback on programming coursework in a bid to promote learning amongst engineering students.

A quest for helpful feedback to programming coursework

The 2011 National Student Survey (NSS) revealed that 40% of full-time students in England do not think that the feedback on their work has been helpful, even though 66% of these students agreed that the feedback was detailed and 62% of them agreed that the feedback has been prompt. Detailed feedback that is not considered helpful by students means a waste of tutors' time while students continue to struggle with their learning. What do students consider as helpful feedback? What are the qualities of helpful feedback? What are the preferred forms of feedback? How should tutors write feedback so that students will find it helpful? Can ICT help to improve the quality of feedback? In our ongoing search for answers to the above questions, we have trialled the use of a novel online application (eCAF) to assess programming coursework from engineering, mathematics and computing students and, through a survey, have collected their views on the feedback received. The survey reveals that most students prefer electronic feedback as given through eCAF, with verbal feedback ranked second and hand-written feedback ranked even lower. The survey also indicates that the feedback from some tutors is considered more helpful than others. We report on the detailed findings of the survey. By comparing the kinds of feedback given by each tutor who took part in the trial, we explore ways to improve the helpfulness of feedback on programming coursework in a bid to promote learning amongst engineering students.

Student response to a pub quiz style first year psychology assessment

The deterioration in staff-student ratios in UK higher education has had a disproportionate impact on assessment and feedback, meaning that contemporary students may have fewer assessments and much less feedback than a generation ago (Gibbs, 2006). Early use of a quiz assessment may offer a blend of social benefits (social comparison, shared problem solving leading to engagement, belonging and continuation), academic benefits (early formative assessment, immediate feedback) and administrative benefits (on-the-spot verbal marking and feedback to 230 students simultaneously). This study sought student views on the acceptability and contribution to learning of the quiz. Social benefits were apparent but difficulties in creating questions to elicit deeper reasoning and problem solving are discussed and the quiz had limited pedagogic value in the eyes of participants. The use of assertion-reason questions are considered as a way of taking the table quiz to a higher level and extending its pedagogic value.

Motivating students to learn through good and helpful coursework feedback

The 2008 National Student Survey revealed that: 44% of full-time students in England did not think that the feedback on their work had been prompt nor did they agree that the feedback on their work helped them clarify things that they did not understand (HEFCE, 2008). Computer Science and Engineering & Technology have been amongst the poorest performers in this aspect as they ranked in the lower quartile (Surridge, 2007, p.32). Five years since the first NSS survey, assessment and feedback remains the biggest concern. Dissatisfaction in any aspect of studies demotivates students and can lead to disengagement and attrition. As the student number grows, the situation can only get worse if nothing is done about it. We have conducted a survey to investigate views on assessment and feedback from Engineering, Mathematics and Computing students. The survey aims at investigating the core issues of dissatisfaction in assessment and feedback and ways in which UK Engineering students can learn better through helpful feedback. The study focuses on collecting students' experiences with feedback received in their coursework, assignments and quizzes in Computing Science modules. The survey reveals the role of feedback in their learning. The results of the survey help to identify the forms of feedback that are considered to be helpful in learning and the time frame for timely feedback. We report on the findings of the survey. We also explore ways to improve assessment and feedback in a bid to better engage engineering students in their studies.

What do students want most from written feedback information? Distinguishing necessities from luxuries using a budgeting methodology

Feedback is a key concern for higher education practitioners, yet there is little evidence concerning the aspects of assessment feedback information that higher education students prioritise when their lecturers’ time and resources are stretched. One recent study found that in such circumstances, students actually perceive feedback information itself as a luxury rather than a necessity. We first re-examined that finding by asking undergraduates to ‘purchase’ characteristics to create the ideal lecturer, using budgets of differing sizes to distinguish necessities from luxuries. Contrary to the earlier research, students in fact considered good feedback information the single biggest necessity for lecturers to demonstrate. In a second study we used the same method to examine the characteristics of feedback information that students value most. Here, the most important perceived necessity was guidance on improvement of skills. In both studies, students’ priorities were influenced by their individual approaches to learning. These findings permit a more pragmatic approach to building student satisfaction in spite of growing expectations and demands.

From 'Plodder' to 'Creative':feedback in teacher education

This article discusses the case study of four student teachers, examining the ways in which a particular kind of feedback—namely, confirmatory feedback—can act as a catalyst for some of the learning and potential change student teachers in a teaching practice group may experience on an initial teacher education programme. It illustrates how one piece of confirmatory feedback given to the student teacher, Jake, during post-observation feedback sessions has been influential not just for him but also for his peers. The article shows how this kind of feedback can be particularly effective when it is specific and detailed. It also exemplifies confirmatory feedback and considers the implications of such feedback for the field of teacher education.

'It’d be useful, but I wouldn’t use it':barriers to university students’ feedback seeking and recipience

For feedback to be effective, it must be used by the receiver. Prior research has outlined numerous reasons why students’ use of feedback is sometimes limited, but there has been little systematic exploration of these barriers. In 11 activity-oriented focus groups, 31 undergraduate Psychology students discussed how they use assessment feedback. The data revealed many barriers that inhibit use of feedback, ranging from students’ difficulties with decoding terminology, to their unwillingness to expend effort. Thematic analysis identified four underlying psychological processes: awareness, cognisance, agency, and volition. We argue that these processes should be considered when designing interventions to encourage students’ engagement with feedback. Whereas the barriers identified could all in principle be removed, we propose that doing so would typically require – or would at least benefit from – a sharing of responsibility between teacher and student. The data highlight the importance of training students to be proactive receivers of feedback.

Collaborative design of assessment criteria to improve undergraduate student engagement and performance

Student engagement is vital in enhancing the student experience and encouraging deeper learning. Involving students in the design of assessment criteria is one way in which to increase student engagement. In 2011, a marking matrix was used at Aston University (UK) for logbook assessment (Group One) in a project-based learning module. The next cohort of students in 2012 (Group Two) were asked to collaboratively redesign the matrix and were given a questionnaire about the exercise. Group Two initially scored a lower average logbook mark than Group One. However, Group Two showed the greatest improvement between assessments, and the quality of, and commitment to, logbooks was noticeably improved. Student input resulted in a more defined, tougher mark scheme. However, this provided an improved feedback system that gave more scope for self-improvement. The majority of students found the exercise incorporated their ideas, enhanced their understanding, and was useful in itself.