Engineering education quality assurance within the school of engineering: a holistic approach

BACKGROUND Quality assurance is a key element of engineering education at Deakin University and is monitored through various mechanisms which also include the process of collecting students’ feedback within the Schools and faculties. The information received are then looked at holistically and action plan is developed to implement. This has proven to be very effective to ensure feedback received from the students has been properly addressed.
PURPOSE The School of Engineering at Deakin University, has initiated the formation of Engineering Educational Quality Working Group (QWG). The aim of QWG is to provide a focal point for learning and teaching quality and its assurance in undergraduate and postgraduate Engineering courses. The school approach complements Deakin University processes of collecting and analysing student feedback on unit curricula design, delivery and facilitator delivery performance; feedback regarding individual facilitator, unit evaluations and graduate course experiences.
DESIGN/METHOD The data are collected through face to face feedback from both on and off campus students. Feedback received from the end of trimester student evaluation process was also analysed.
RESULTS The motivation behind the practise is to close the loop for the feedback received from the students and take appropriate action against the feedback. This is to enhance overall delivery of engineering education at Deakin University.
CONCLUSIONS This paper outlines the activities planned by the QWG and elaborates on quality assurance approaches and key strategies to be implemented by the working group to achieve the desired quality as well as efficacy of those recommendations/actions undertaken at the school level.

INCORPORATING STIMULATING QUICK-WRITE PROMPTS WITHIN A SECONDARY SCIENCE CLASSROOM: A CASE STUDY IN LESOTHO

The use of intriguing open-ended quick-write prompts within the Basotho science classroom could potentially provide a way for secondary teachers in Lesotho to have a time-efficient alternative to stimulate student thinking and increase critical thinking or application of scientific principles. Writing can be used as a powerful means to improve the achievement of students across many subject areas, including the sciences (Moore, 1993; Rivard, 1994; Rillero, Zambo, Cleland, and Ryan, 1996; Greenstein, 2013). This study focuses on the use of a non-traditional nor extensively studied writing method that could potentially support learning in science. A quasi-experimental research design, with a control and experimental group, was applied. The study was conducted at two schools, with one experimental classroom in one school and a second control group classroom in the second school for a period of 4 weeks. 51 Form B (US Grade 9 equivalent) students participated as the experimental group and 43 Form B students as the control group. In an effort to assess learning achievement, a 1 hour (35 mark) pre-test evaluation was made by and given to students by Basotho teachers at the beginning of this study to have an idea of student’s previous knowledge. Topics covered were Static Electricity, Current Electricity, Electromagnetic Waves, and Chemistry of Water. After the experimental trial period, an almost completely identical post-test evaluation was given to students in the same fashion to observe and compare gains in achievement. Test data was analyzed using an inferential statistics procedure that compared means and gains in knowledge made by the experimental and control groups. Difference between the gains of mean pre-test and post-test scores were statistically significant within each group, but were not statistically significant when the control and experimental groups were compared. Therefore, there was no clear practical effect. Qualitative data from teachers’ journals and students’ written feedback provides insight on the assessments, incorporation of the teaching method, and the development of participating students. Both mid and post-study student feedback shows that students had an overall positive and beneficial experience participating in this activity. Assessments and teacher journals showed areas of strength and weaknesses in student learning and on differences in teaching styles. They also helped support some feedback claims made by students. Areas of further research and improvement of the incorporation of this teaching method in the Basotho secondary science classroom are explored.

The long game: five years of simulating the Middle East

Scholarly literature attesting to the benefits of role play in teaching international relations or political science subjects is abundant and universally positive. However, despite many case studies presenting snapshots of single examples, long term data concerning a role play exercise is difficult to find. This study presents student feedback data gathered from 10 iterations of the Middle East politics simulation carried out over 5 years from 2011-15. The data obtained from over 600 respondents establishes very clear trends in terms of satisfaction, engagement, and workload. The findings demonstrate that students can be significantly engaged in the subject matter through role plays and that they value these opportunities and the learning that ensues, even though it may represent more work than they are used to allotting to traditional assignments. The results show that year after year, successive student cohorts have made a clear judgement that extra work is worthwhile when it pays off against their perceived learning. The inference can also be drawn that they do not see this same pay off when completing essay type assignments.

Pedagogy of feedback on student academic writing : research supervisor practices for the end of the research degree candidature

All academic writing is advanced with the benefit of feedback about the writing. In the case of the academic writing genres of the research proposal and the dissertation, feedback is usually provided by the research supervisor. Given that academic writing development is a process, and in the case of the research proposal and dissertation, writing which develops over time, it seems likely that the nature of feedback on drafts written early in the candidature may be different from feedback provided by the research supervisor later in a student’s candidature. ----- ----- When a research supervisor has been reading a student’s writing over a period of time, their own familiarity with the writing generates a risk to their ability to provide critical and objective feedback. Particularly by the end of a student’s candidature, the research supervisor’s familiarity with the work may cause them to miss elements of writing improvement. ----- ----- The author, as a research supervisor, has developed a feedback grid to facilitate feedback on the final drafts of a dissertation. This feedback grid is generated by the embedded promises in the early sections of the dissertation, which are then used to audit the content of the final sections of the dissertation to ascertain whether promises made have been fulfilled. This provides a strategy for the research supervisor to step back from the work and read the dissertation with the agenda of a dissertation examiner. ----- ----- The grid is one strategy within a broader pedagogy of providing feedback on writing samples.

The role of radiotherapy patients in provision of student interpersonal skills feedback

Background At Queensland University of Technology, student radiation therapists receive regular feedback from clinical staff relating to clinical interpersonal skills. Although this is of great value, there is anecdotal evidence that students communicate differently with patients when under observation. Purpose The aim of this pilot was to counter this perceived observer effect by allowing patients to provide students with additional feedback. Materials and methods Radiotherapy patients from two departments were provided with anonymous feedback forms relating to aspects of student interpersonal skills. Clinical assessors, mentors and students were also provided with feedback forms, including questions about the role of patient feedback. Patient perceptions of student performance were correlated with staff feedback and assessment scores. Results Results indicated that the feedback was valued by both students and patients. Students reported that the additional dimension focused them on communication, set goals for development and increased motivation. These changes derived from both feedback and study participation, suggesting that the questionnaires could be a useful teaching tool. Patients scored more generously than mentors, although there was agreement in relative grading. Conclusions The anonymous questionnaire is a convenient and valuable method of gathering patient feedback on students. Future iterations will determine the optimum timing for this method of feedback.

Improving criteria and feedback in student assessment in law

Spurred on by both the 1987 Pearce Report1 and the general changes to higher education spawned by the “Dawkins revolution” from 1988, there has been much critical self-evaluation leading to profound improvements to the quality of teaching in Australian law schools.2 Despite the changes there are still areas of general law teaching practice which have lagged behind recent developments in our understanding of what constitutes high quality teaching. One such area is assessment criteria and feedback. The project Improving Feedback in Student Assessment in Law is an attempt to remedy this. It aims to produce a manual containing key principles for the design of assessment and the provision of feedback, with practical yet flexible ideas and illustrations which law teachers may adopt or modify. Most of the examples have been developed by teachers at the University of Melbourne Law School. The project was supported in 1996 by a Committee for the Advancement of University Teaching grant and the manual will be published late in 1997.3 This note summarises the core principles which are elaborated further in the manual.

Enhanced student learning in accounting utilising web-based technology, peer-review feedback and reflective practices: A learning community approach to assessment

Higher education is becoming a major driver of economic competitiveness in an increasingly knowledge-driven global economy. Maintaining the competitive edge has seen an increase in public accountability of higher education institutions through the mechanism of ranking universities based on the quality of their teaching and learning outcomes. As a result, assessment processes are under scrutiny, creating tensions between standardisation and measurability and the development of creative and reflective learners. These tensions are further highlighted in the context of large undergraduate subjects, learner diversity and time-poor academics and students. Research suggests that high level and complex learning is best developed when assessment, combined with effective feedback practices, involves students as partners in these processes. This article reports on a four-phase, cross-institution and cross-discipline project designed to embed peer-review processes as part of the assessment in two large, undergraduate accounting classes. Using a social constructivist view of learning, which emphasises the role of both teacher and learner in the development of complex cognitive understandings, we undertook an iterative process of peer review. Successive phases built upon students’ feedback and achievements and input from language/learning and curriculum experts to improve the teaching and learning outcomes.

Feedback on student performance in the workplace: The role of workplace supervisors

This chapter highlights the im portance of feedback in work - integrated learning (WIL) , the key role of workplace supervisors, and the importance of continuous improvement in systems to support feedback processes. The paper proposes a definition of feedback and formative feedback, as well as approaches for providing industry feedback in W I L . It further reports on a case analysis based on workplace supervisors providing feedback to students in engineering and urban development , yielding certain insights into student pe rformance in the workplace, and m ore importantly, hi ghlighting the need to enhance the use of feedback processes. This is requir ed in a context where delivering feedback in WIL is generally acknowledge d to be complex, and where the role of the industry supervisor in appraising the performance of the student in the workplace needs to be very c learly defined in order for supervisor s ’ feedback to have optimal impact. F eedback in WIL i s set against the bac kdrop of recognizing the importance and complexity of stakeholder engagement in WIL in general, and the intricacy associated with the provision of feedback from industry supervisors in particular. Student self - assessment is briefly considered as a fu rther dimension of their participation in providing feedback on their own performance in the workplace . ( Asia - Pacific Journal of Cooperative Education, Special Issue, 2014, 15 (3 ), 241 - 25 2

'Take away from the dry sixties style marking': Lecturer and student perceptions and experiences of audio feedback

Providing audio feedback to assessment is relatively uncommon in higher education. However, published research suggests that it is preferred over written feedback by students but lecturers were less convinced. The aim of this paper is to examine further these findings in the context of a third year business ethics unit. Data was collected from two sources. The first is a series of in-depth, semi-structured interviews conducted with three lecturers providing audio feeback for the first time in Semester One 2011. The second source of data was drawn from the university student evaluation system. A total of 363 responses were used providing 'before' and 'after' perspectives about the effectiveness of audio feedback versus written feedback. Between 2005 and 2009 the survey data provided information about student attitudes to written assessment feedback (n=261). From 2010 onwards the data relates to audio (mp3) feedback (n=102). The analysis of he interview data indicated that introducing audio feedback should be done with care. The perception of the participating lecturers was mixed, ranging from sceptism to outright enthusiasm, but over time the overall approach became positive. It was found that particular attention needs to be paid to small (but important) technical details, and lecturers need to be convinced of its effectieness, especially that it is not necessarily more time consuming than providing written feedback. For students, the analysis revealed a clear preference for audio feedback. It is concluded that there is cause for concern and reason for optimism. It is a cause for concern because there is a possibility that scepticism on the part of academic staff seems to be based on assumptions about what students prefer and a concern about using the technology. There is reason for optimism because the evidence points towards students preferring audio feedback and as academic staff become more familiar with the technology the scepticism tends to evaporate. While this study is limited in scope, questions are raised about tackling negative staff perceptions of audio feedback that are worthy of further research.

Marking and providing feedback face-to-face: staff and student perspectives.

The setting, marking and providing feedback on assessments forms an important part of a tutor’s role. Studies into the use of feedback and how it is interpreted by students indicate a mismatch between what students are looking for and what tutors think they are giving. Tutors comment that students are more interested in the mark than the feedback, and yet students indicate that they do not get enough feedback, or that it is not useful. This study investigates student and staff perceptions of the linking of marking and feedback in face-to-face sessions. A cohort of year one university students were given the option of receiving either written feedback or a 15 minute meeting with one of their tutors to have their essay marked with them. Forty nine students chose face-to-face marking, the remaining 35 students received written feedback. Focus groups were used to investigate the student experience. Staff members were also asked to reflect on the process. Students and staff found the experience of face-to-face marking beneficial and positive. Both felt that the time spent together allowed for a feedback dialogue about the piece of work, and that staff could explain and justify why marks were given.

The feedback we give: university student perceptions and preferences

This paper reports the results of a study on higher education student perceptions of and preferences for feedback on their performance. The issue of feedback to students is becoming increasingly important in higher education, not only because it is an important element of learning, but also as a significant component of the student experience and its evaluation. Within a mass education context, written feedback on coursework may be an important opportunity available to students for individualised attention. The current research explored perceptions of feedback by participants who were studying in undergraduate business degrees in a UK university (N=175). The survey instrument asked participants to evaluate the feedback they receive at university in terms of its impact and influence, as well as their understanding of feedback received and preferences. Analysis of the data indicates that students generally find feedback provided to them helpful and encouraging in improving their work but they also indicate that they would prefer to discuss their work directly with their tutor instead of receiving written feedback. They comment on the illegibility of some hand written feedback received. They also report that, generally, they act on the feedback received in order to improve their work and say that it helps them to reflect on their learning. Students comment that negative feedback received does not make them angry or demotivate them. The survey found considerable variability in the students' understanding of 'typical' feedback comments. The majority of students (79%) also reported that they prefer a structured feedback matrix to general comments because they consider it more specific and easier to understand. The implications of these findings for feedback and assessment practices are discussed and suggestions for improvements developed.

Understanding Student and Staff Perceptions of Feedback in Architecture: Summary Report

This report presents the results of a collaborative project between Queens University, Belfast and the Robert Gordon University, Aberdeen, and builds on a dialogue initiated during Session 2009-10 through which course guidance and feedback received by students was identified as an area requiring deeper understanding in order to enhance current practice