The systematic influences on student evaluation of teaching in engineering education

BACKGROUND Student evaluation of teaching (SET) has a long history, has grown in prevalence and importance over a period of decades, and is now common-place in many universities internationally. SET data are collected for a range of purposes, including: as diagnostic feedback to improve the quality of teaching and learning; as an input to staff performance management processes and personnel decisions such as promotion for staff; to provide information to prospective students in their selection of courses and programs; and as a source of data for research on teaching. Rovai et al. (2006) report that while SET research provides mixed results, there is evidence that, for course-related factors, smaller classes are rated more favourably than large classes, upper-year-level classes are rated more favourably than lower-year classes, and that there are rating differences between discipline areas. While additional course-related factors are also noted, other reviews of the literature on SET also identify these three factors as commonly reported systematic influences on SET ratings. The School of Engineering at Deakin University in Australia offers undergraduate and postgraduate engineering programs, and these programs are delivered in both on-campus and off-campus modes.PURPOSEThe paper presents a quantitative investigation of SET data for the School of Engineering at Deakin University to identify whether the commonly reported systematic influences on SET ratings of class size and year level are also observed here. The influence of online mode of offer is also explored.DESIGN/METHOD Deakin University’s Student Evaluation of Teaching and Units (SETU) questionnaire is administered to students enrolled in every unit of study every time that unit is offered, unless it is specially exempted. Following data collation, summary results are reported via a public website. The publicly available SETU data for all School of Engineering units of study were collected for a two year period. The collected data were subjected to analysis of variance (ANOVA) analysis to identify any significant systematic influences on mean student SETU ratings.RESULTS SETU data from 100 separate units of study over the two year period were collected, representing 3375 sets of SETU ratings, and covering unit enrolment sizes from 12 to 462 students. Although this was a modest sized investigation, significantly higher mean ratings for some SETU items were observed for units with small enrolments, for postgraduate level units compared to undergraduate level units, and for units offered in conventional mode compared to online mode of offer. The presence of the commonly observed systematic influences on SET ratings was confirmed.CONCLUSIONS While the use of SET data may have originally been primarily for formative purposes to improve teaching and learning, they are also increasingly used for summative judgements of teaching quality and teaching staff performance that have implications for personnel decision making. There may be an acceptance of the need for SET, however there remains no universal consensus as to what constitutes quality in university teaching and learning, and the increasing use of SET for high-stakes decision making puts pressure on institutions to ensure that their SET practices are sound, equitable and defensible.

Interethnic understanding and the teaching of local languages in Sri Lanka

 In precolonial times, equal socioeducational recognition accorded to local languages played a key role in promoting inter-ethnic harmony, co-existence and 'connectedness' between linguistically and ethnically .diverse people of Sri Lanka. This history should motivate policy considerations in postcolonial situations in the country. This chapter has its focus on educational issues surrounding the promotion of local languages for interethnic harmony in Sri Lanka, where the promotion of Sinhala among minority Tamils, and Tamil among the majority Sinhalese has been the subject of many current political, policy and popular discourses. Proficiency in the local languages was encouraged actively through policies and practices during precolonial times. However, despite popular thinking that there is an acute need to promote Tamil, its manifestation as a classroom subject in school education curricula for the majority Sinhalese and minority Tamils in post-war Sri Lanka has been lost in the public and policy discourses. Using archival records and opinions expressed in newspapers as data, this chapter explores these ambiguities in attitudes, policies and practices from precolonial times to the present day.

'A chart for further exploration and a kind of rallying call': James Moffett and english curriculum history in Victoria

Both James Britton and James Moffett were keynote speakers at the Sydney International Federation for the Teaching of English conference in 1980 - a fact reflective of the wide recognition and acceptance of their work and influence throughout Australia by that time. In Victoria, Moffett's writings became known initially through teacher education, in particular at the University of Melbourne and the State College of Victoria, Rusden, then through the visits and writing of figures from the London Institute and others, and through the State and national English teaching association, the Australian Association for the Teaching of English. In the 1970s, Moffett's influence in Victoria came rather through the mix of his vision and writing, both theoretical and practical, in conjunction with others in Australia and elsewhere. This paper takes two separate but related sites or moments in English education in the 1970s in the Australian city of Melbourne, Victoria, as instances of the permeating influence of Moffett's work - in conjunction with leading figures from the London School associated with the 'New' English' - on education discourses and practice in that State's English curriculum history. It concludes with a consideration of the ways in which Moffett's work might still act as a 'rallying call' today.

Teaching an old game new tricks : long-term feedback on a re-designed online role play

Despite an extensive history of use in teaching Political Science subjects, long-term scholarly studies of online role plays are uncommon. This paper redresses that balance by presenting five years of data on the Middle East Politics Simulation. This online role play has been run since the 1990s and underwent significant technical upgrade in 2013-14. The data presented here covers student feedback to this upgrade process and the factors that can influence their response. Key indications are that students tend to recognise when something is fit (or not) for its purpose and will forgo attractive and well-appointed online environments if the underlying learning exercise is valued. However, there are limits to this minimalism and whilst designers do not need to replicate every Internet trend, attention needs to be paid to broader changes in technology, such as access platform and changing avenues of political communication. The study demonstrates that long-term monitoring of online role play exercises is important to allow informed changes to be implemented and their impacts properly assessed.

Student perspectives on the value of experiential learning in history

This paper is a reflective study of experiential learning as an American history teaching-tool. It is based on a survey of students who took a University of Melbourne study tour to the United States in the years from 2001–2011. This survey asked students to identify the tour’s long-term outcomes. The responses showed that students believed the study tour was beneficial academically, and that it also opened up employment opportunities. However, the most significant benefit identified by the students was positive social outcomes—in other words, the friends they made on the tour and the professional networks they formed. The conclusion we drew from these results was that students believe that experiential learning has a legitimate place in history curriculums, and that it is an antidote to the loneliness they feel in traditional classroom settings.