Automated Feedback for 'Fill in the Gap' Programming Exercises

Timely feedback is a vital component in the learning process. It is especially important for beginner students in Information Technology since many have not yet formed an effective internal model of a computer that they can use to construct viable knowledge. Research has shown that learning efficiency is increased if immediate feedback is provided for students. Automatic analysis of student programs has the potential to provide immediate feedback for students and to assist teaching staff in the marking process. This paper describes a “fill in the gap” programming analysis framework which tests students’ solutions and gives feedback on their correctness, detects logic errors and provides hints on how to fix these errors. Currently, the framework is being used with the Environment for Learning to Programming (ELP) system at Queensland University of Technology (QUT); however, the framework can be integrated into any existing online learning environment or programming Integrated Development Environment (IDE)

Program Annotations: Feedback for Students Learning to Program

This paper presents a novel program annotation mechanism which enables students to obtain feedback from tutors on their programs in a far simpler and more efficient way than is possible with, for example, email. A common scenario with beginning students is to email tutors with copies of their malfunctioning programs. Unfortunately the emailed program often bears little resemblance to the program the student has been trying to make work; often it is incomplete, a different version and corrupted. We propose an annotation mechanism enabling students to simply and easily annotate their programs with comments asking for help. Similarly our mechanism enables tutors to view students’ programs and to reply to their comments in a simple and structured fashion. This means students can get frequent and timely feedback on their programs; tutors can provide such feedback efficiently, and hence students’ learning is greatly improved.

Teacher praise and feedback and students’ perceptions of the classroom environment

The relationships between teacher praise and feedback, and students’ perceptions of the classroom environment were investigated in six rural elementary schools (n 5 747). The Teacher Feedback Scale and My Classroom Scale were developed as part of this study and used to collect the data. Structural equation modelling was used to test a hypothesised model. The results indicated that negative teacher feedback and effort feedback were both related to students’ relationships with their teachers, while ability feedback was associated with perceptions of the classroom environment. Praise was not related to classroom environment or teacher–student relationships. Significant age and gender differences were found. Additionally, differences were found between students who were satisfied with their classroom and those who were dissatisfied. Satisfied students received more general praise, general ability feedback, effort feedback and less negative teacher feedback when compared to dissatisfied students. Research studies have emphasised the influence of signicicant adults (teachers and parents) on students’ personal development (Porlier et al., 1999) and the importance of significant others’ verbal statements when directed at children (Burnett, 1996a). The relationships between negative and positive statements made by teachers, parents, peers and siblings and children’s self-talk have been investigated (Burnett, 1996a) and positive statements (praise) have been found to be more beneficial than verbal criticism (Burnett, 1999). The quality of life in the classroom in recent times has been considered of great importance to students (Thorp et al., 1994) and this is recognised by Baker (1999) who reported a relationship between students’ satisfaction with the learning environment, and differential teacher feedback and praise. This study investigated the relationships between teacher praise and feedback, and how students perceived their classroom and their relationship with their teacher.

Performance measurement and feedback in a public sector program

Establishing a framework for measuring the performance of public sector programs is fraught with dangers. Many public sector organisations are satisfied with measuring activity in programs and fail to see the need for establishing a framework that will meet the needs of participants and measure outcomes as well as activities. This paper explores how a government department in Queensland went about establishing a performance management framework to measure the outcomes and activities in a program that was a public private partnership. Findings indicate that using an iterative consultative approach performance measure can be put in place that are meaningful and assist the participants to review the program.

Harnessing assessment and feedback in the first year to support learning success, engagement and retention

It has been argued that intentional first year curriculum design has a critical role to play in enhancing first year student engagement, success and retention (Kift, 2008). A fundamental first year curriculum objective should be to assist students to make the successful transition to assessment in higher education. Scott (2006) has identified that ‘relevant, consistent and integrated assessment … [with] prompt and constructive feedback’ are particularly relevant to student retention generally; while Nicol (2007) suggests that ‘lack of clarity regarding expectations in the first year, low levels of teacher feedback and poor motivation’ are key issues in the first year. At the very minimum, if we expect first year students to become independent and self-managing learners, they need to be supported in their early development and acquisition of tertiary assessment literacies (Orrell, 2005). Critical to this attainment is the necessity to alleviate early anxieties around assessment information, instructions, guidance, and performance. This includes, for example:  inducting students thoroughly into the academic languages and assessment genres they will encounter as the vehicles for evidencing learning success; and  making expectations about the quality of this evidence clear. Most importantly, students should receive regular formative feedback of their work early in their program of study to aid their learning and to provide information to both students and teachers on progress and achievement. Leveraging research conducted under an ALTC Senior Fellowship that has sought to articulate a research-based 'transition pedagogy' (Kift & Nelson, 2005) – a guiding philosophy for intentional first year curriculum design and support that carefully scaffolds and mediates the first year learning experience for contemporary heterogeneous cohorts – this paper will discuss theoretical and practical strategies and examples that should be of assistance in implementing good assessment and feedback practices across a range of disciplines in the first year.