Enhancing student learning experience through a novel electronic coursework assessment and feedback management system

Recent National Student Surveys revealed that many U.K. university students are dissatisfied with the timeliness and usefulness of the feedback received from their tutors. Ensuring timeliness in marking often results in a reduction in the quality of feedback. In Computer Science where learning relies on practising and learning from mistakes, feedback that pin-points errors and explains means of improvement is important to achieve a good student learning experience. Though suitable use of Information and Communication Technology should alleviate this problem, existing Virtual Learning Environments and e-Assessment applications such as Blackboard/WebCT, BOSS, MarkTool and GradeMark are inadequate to support a coursework assessment process that promotes timeliness and usefulness of feedback while maintaining consistency in marking involving multiple tutors. We have developed a novel Internet application, called eCAF, for facilitating an efficient and transparent coursework assessment and feedback process. The eCAF system supports detailed marking scheme editing and enables tutors to use such schemes to pin-point errors in students' work so as to provide helpful feedback efficiently. Tutors can also highlight areas in a submitted work and associate helpful feedback that clearly links to the identified mistakes and the respective marking criteria. In light of the results obtained from a recent trial of eCAF, we discuss how the key features of eCAF may facilitate an effective and efficient coursework assessment and feedback process.

A quest for helpful feedback to programming coursework

The 2011 National Student Survey (NSS) revealed that 40% of full-time students in England do not think that the feedback on their work has been helpful, even though 66% of these students agreed that the feedback was detailed and 62% of them agreed that the feedback has been prompt. Detailed feedback that is not considered helpful by students means a waste of tutors' time while students continue to struggle with their learning. What do students consider as helpful feedback? What are the qualities of helpful feedback? What are the preferred forms of feedback? How should tutors write feedback so that students will find it helpful? Can ICT help to improve the quality of feedback? In our ongoing search for answers to the above questions, we have trialled the use of a novel online application (eCAF) to assess programming coursework from engineering, mathematics and computing students and, through a survey, have collected their views on the feedback received. The survey reveals that most students prefer electronic feedback as given through eCAF, with verbal feedback ranked second and hand-written feedback ranked even lower. The survey also indicates that the feedback from some tutors is considered more helpful than others. We report on the detailed findings of the survey. By comparing the kinds of feedback given by each tutor who took part in the trial, we explore ways to improve the helpfulness of feedback on programming coursework in a bid to promote learning amongst engineering students.

'It’d be useful, but I wouldn’t use it':barriers to university students’ feedback seeking and recipience

For feedback to be effective, it must be used by the receiver. Prior research has outlined numerous reasons why students’ use of feedback is sometimes limited, but there has been little systematic exploration of these barriers. In 11 activity-oriented focus groups, 31 undergraduate Psychology students discussed how they use assessment feedback. The data revealed many barriers that inhibit use of feedback, ranging from students’ difficulties with decoding terminology, to their unwillingness to expend effort. Thematic analysis identified four underlying psychological processes: awareness, cognisance, agency, and volition. We argue that these processes should be considered when designing interventions to encourage students’ engagement with feedback. Whereas the barriers identified could all in principle be removed, we propose that doing so would typically require – or would at least benefit from – a sharing of responsibility between teacher and student. The data highlight the importance of training students to be proactive receivers of feedback.

Supporting learners’ agentic engagement with feedback:a systematic review and a taxonomy of recipience processes

Much has been written in the educational psychology literature about effective feedback and how to deliver it. However, it is equally important to understand how learners actively receive, engage with, and implement feedback. This article reports a systematic review of the research evidence pertaining to this issue. Through an analysis of 195 outputs published between 1985 and early 2014, we identified various factors that have been proposed to influence the likelihood of feedback being used. Furthermore, we identified diverse interventions with the common aim of supporting and promoting learners' agentic engagement with feedback processes. We outline the various components used in these interventions, and the reports of their successes and limitations. Moreover we propose a novel taxonomy of four recipience processes targeted by these interventions. This review and taxonomy provide a theoretical basis for conceptualizing learners' responsibility within feedback dialogues and for guiding the strategic design and evaluation of interventions. Receiving feedback on one's skills and understanding is an invaluable part of the learning process, benefiting learners far more than does simply receiving praise or punishment (Black & Wiliam, 1998 Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5, 7–74. doi:10.1080/0969595980050102[Taylor & Francis Online]; Hattie & Timperley, 2007 Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77, 81–112. doi:10.3102/003465430298487[CrossRef], [Web of Science ®]). Inevitably, the benefits of receiving feedback are not uniform across all circumstances, and so it is imperative to understand how these gains can be maximized. There is increasing consensus that a critical determinant of feedback effectiveness is the quality of learners' engagement with, and use of, the feedback they receive. However, studies investigating this engagement are underrepresented in academic research (Bounds et al., 2013 Bounds, R., Bush, C., Aghera, A., Rodriguez, N., Stansfield, R. B., & Santeen, S. A. (2013). Emergency medicine residents' self-assessments play a critical role when receiving feedback. Academic Emergency Medicine, 20, 1055–1061. doi:10.1111/acem.12231[CrossRef], [PubMed], [Web of Science ®]), which leaves a “blind spot” in our understanding (Burke, 2009 Burke, D. (2009). Strategies for using feedback students bring to higher education. Assessment & Evaluation in Higher Education, 34, 41–50. doi:10.1080/02602930801895711[Taylor & Francis Online], [Web of Science ®]). With this blind spot in mind, the present work sets out to systematically map the research literature concerning learners' proactive recipience of feedback. We use the term “proactive recipience” here to connote a state or activity of engaging actively with feedback processes, thus emphasizing the fundamental contribution and responsibility of the learner (Winstone, Nash, Rowntree, & Parker, in press Winstone, N. E., Nash, R. A., Rowntree, J., & Parker, M. (in press). ‘It'd be useful, but I wouldn't use it’: Barriers to university students' feedback seeking and recipience. Studies in Higher Education. doi: 10.1080/03075079.2015.1130032[Taylor & Francis Online]). In other words, just as Reeve and Tseng (2011 Reeve, J., & Tseng, M. (2011). Agency as a fourth aspect of student engagement during learning activities. Contemporary Educational Psychology, 36, 257–267. doi:10.1016/j.cedpsych.2011.05.002[CrossRef], [Web of Science ®]) defined “agentic engagement” as a “student's constructive contribution into the flow of the instruction they receive” (p. 258), likewise proactive recipience is a form of agentic engagement that involves the learner sharing responsibility for making feedback processes effective.

Confirmatory feedback in teacher education:an instigator of student teacher learning

This book examines the intricacies of the discourse of post-observation feedback that student teachers receive following group teaching practice. In particular, the author explores confirmatory feedback as an instigator of student teacher learning, and examines the potential links between feedback and change. The book will be of specific interest to researchers, teacher educators and other professionals involved in feedback-giving settings.

Encouraging student to reflect on their employment experience

The purpose behind this case study is to share with a wider audience of placement officers, tutors and those who are involved in the management of placement students or employment of graduates, the approach taken to encourage reflective learning in undergraduate placement students at Aston Business School. Reflective learning forms an important foundation of the placement year at Aston Business School, where a professional placement is a mandatory element of the four year degree, for all Home/EU students (optional for International students) who are taking a Single Honours degree (i.e. a fully business programme). The placement year is not compulsory for those students taking a Combined Honours degree (i.e. a degree where two unrelated subjects are studied), although approximately 50% of those students taking an Aston Business School subject opt to take a placement year. Students spend their year out undertaking a ‘proper’ job within a company or public sector organisation. They are normally paid a reasonable salary for their work (in 2004/5 the average advertised salary was £13,700 per annum). The placement year is assessed, carrying credits which amount to a contribution of 10% towards the students’ final degree. The assessment methods used require the students to submit an academic essay relating theory to practice, a factual report about the company which can be of use to future students, and a log book, the latter being the reflective piece of work. Encouragement to reflect on the placement year has always been an important feature of Aston Business School’s approach to learning. More recently, however, feedback from employers indicated that, although our students have excellent employability skills, “they do not think about them” (Aston Business School Advisory Panel, 2001). We, therefore, began some activities which would encourage students to go beyond the mere acquisition of skills and knowledge. This work became the basis of a programme of introductions to reflective learning, mentoring and awareness of different learning styles written up in Higson and Jones (2002). The idea was to get students used to the idea of reflection on their experiences well before they entered the placement year.

Post-observation feedback as an instigator of teacher learning and change

This paper investigates an on-going study into the nature of the discourse teacher educators (TEds) and student-teachers (Ts) use during postobservation feedback, and explores the feedback discourse in terms of the impact it may have on teacher learning and change. Two types of feedback, confirmatory and corrective, are briefly discussed, and the former is then made the focus of the paper in its role as a potential instigator of teacher learning and change.

From postgraduate student to published writer:discourse variation and development in TESOL

This thesis is part of a project whose overall aim is to assist participants on an MSc TESOL course who wish to begin to publish articles in the field to do so. The project, which is undertaken within a naturalistic paradigm, has two intimately related and mutually constitutive strands: one descriptive, one interventionist. The descriptive strand consists of an analytical model of the TESOL article genre, and it is instantiated in this thesis. The interventionist strand consists of a series of pedagogic interactions and materials intended to assist project participants formulate a text suitable for publication within the target genre, and it is reported on in this thesis. I begin the thesis by looking in detail at the research approach which characterises the project. I then attempt to explain the situational context of the work and to position it within the context of other research in the areas of discourse community membership, academic genres, genre learning and academic enculturation. Having thus contextualised the work, I next attempt a detailed exploration of the problems of postgraduate students in TESOL when first attempting to write in the TESOL article genre: this exploration is undertaken from both a linguistic and a pedagogic perspective. Then in subsequent chapters, both a linguistic and a pedagogic response to these problems are proposed: the first consisting of an analytical model of the target genre, the second consisting of a series of pedagogic interactions and materials. The relationships between the two lines of response are also examined in some detail. Then in the final part of the thesis, I report feedback from the interventionist strand and attempt to conduct an evaluation of the whole project to date. Criteria for evaluation are proposed and examined in some detail in the context of the research approach of the project. The concluding chapter is a brief discussion of future directions for this work.

A quest for helpful feedback to programming coursework

The 2011 National Student Survey (NSS) revealed that 40% of full-time students in England did not think that the feedback on their work has been helpful, even though 66% of these students agreed that the feedback was detailed and 62% of them agreed that the feedback has been prompt. Detailed feedback that is not considered helpful by students means a waste of tutors' time while students continue to struggle with their learning. What do students consider as helpful feedback? What are the qualities of helpful feedback? What are the preferred forms of feedback? How should tutors write feedback so that students will find it helpful? Can ICT help to improve the quality of feedback? In our ongoing search for answers to the above questions, we have trialled the use of a novel Internet application, called eCAF, to assess programming coursework from Engineering, Mathematics and Computing students and have collected their views on the feedback received through a survey. The survey reveals that most students prefer electronic feedback as given through eCAF, with verbal feedback ranked second and hand-written feedback ranked even lower. The survey also indicates that the feedback from some tutors is considered more helpful than others. We report on the detailed findings of the survey. By comparing the kinds of feedback given by each tutor who took part in the trial, we explore ways to improve the helpfulness of feedback on programming coursework in a bid to promote learning amongst engineering students.

The importance of power dynamics in the development of asynchronous online learning communities

This research explored how a more student-directed learning design can support the creation of togetherness and belonging in a community of distance learners in formal higher education. Postgraduate students in a New Zealand School of Education experienced two different learning tasks as part of their online distance learning studies. The tasks centered around two online asynchronous discussions each for the same period of time and with the same group of students, but following two different learning design principles. All messages were analyzed using a twostep analysis process, content analysis and social network analysis. Although the findings showed a balance of power between the tutor and the students in the first high e-moderated activity, a better pattern of group interaction and community feeling was found in the low e-moderated activity. The paper will discuss the findings in terms of the implications for learning design and the role of the tutor.

Textbook on contract law

Jill Poole's immensely popular Textbook on Contract Law has been guiding students through contract law for many years. The accessible writing style and focus on key principles and developments in contract law make this text a favourite with students and lecturers alike. The author places the law of contract clearly within its wider context before proceeding to provide detailed yet accessible treatment of all the key areas encountered when studying contract law. Key features: · Key points, illustrative examples and questions encourage a deeper understanding of the central facts and issues · Each chapter begins with a summary of key issues, providing an overview of key themes and points of law, and concludes with suggestions for further reading, guiding you towards the most relevant texts and articles · An attractive page design highlights headings, case summaries, case extracts and a variety of learning features, making navigation through the text easy Fully supported by an Online Resource Centre, which provides: Student Resources Regular updates on new legislation, cases, and other important developments Guidance on answering questions in contract law Self-test questions and answers linked with Casebook on Contract Law Lecturer Resources A test bank of 300 multiple choice questions with answers and feedback

Student response to a pub quiz style first year psychology assessment

The deterioration in staff-student ratios in UK higher education has had a disproportionate impact on assessment and feedback, meaning that contemporary students may have fewer assessments and much less feedback than a generation ago (Gibbs, 2006). Early use of a quiz assessment may offer a blend of social benefits (social comparison, shared problem solving leading to engagement, belonging and continuation), academic benefits (early formative assessment, immediate feedback) and administrative benefits (on-the-spot verbal marking and feedback to 230 students simultaneously). This study sought student views on the acceptability and contribution to learning of the quiz. Social benefits were apparent but difficulties in creating questions to elicit deeper reasoning and problem solving are discussed and the quiz had limited pedagogic value in the eyes of participants. The use of assertion-reason questions are considered as a way of taking the table quiz to a higher level and extending its pedagogic value.