Investigating sample bias in student evaluations of teaching

Student evaluations of teaching have increased in importance to universities in Australia over recent years due to changes in government policy. There has been significant debate in the literature as to the validity and usefulness of such evaluations and as to whether students who respond to the evaluations are indeed representative of the student population. A potential invalidating issue is self selection in the evaluation process. In this paper, we consider student evaluations of a large first year business statistics subject that had 1073 eligible students enrolled across four campuses at the time of the evaluation. The study is based on the 373 students (34.8%) who responded to the survey, and their final results. The evaluations were open for a period of six weeks leading up to and just after the final exam. The study looks in detail at the student population identifying such attributes as gender; home campus; course of study; domestic/international; Commonwealth Supported Place/full fee paying, etc. and then mapping these results to those of the students who responded to the survey.

Exploring the impact of faculty reflection on weekly student evaluations of teaching

This exploratory study considered Larrivee’s assessment of teachers’ reflective practice levels by using a formative, weekly, online student evaluation of teaching (SET) tool through a virtual learning environment (VLE) as a means to encourage reflective practice. In-depth interviews were conducted with six faculty members in three departments at a university college in the UK. The study found that: (a) faculty who experienced surface-level reflection were more likely to have a reactive reflection style; and (b) faculty who experienced higher levels of reflection were more likely to have a proactive reflection style. Overall, the tool was found to be an efficient means of encouraging reflection by all participants and demonstrated that reflective practice could come about as a result of these weekly formative SETs. The study concludes with suggestions for academic development and future research on reflection that could be conducted using SETs via a VLE.

If you build it will they come? Exploring the student perspective of weekly student evaluations of teaching

This exploratory study investigated the students’ use of formative, weekly, online evaluations of teaching through a virtual learning environment. Results were based on in-depth interviews of seven students at a rural university college in the UK. Students from different genders, education levels and backgrounds volunteered for the study. The students thought it was a good tool and useful for providing anonymous feedback. However, their motivation to fill in the evaluations every week varied throughout the period of study, and the weekly feedback soon became routine and too onerous a task, and thus had a tendency towards being superficially conducted. Students were more inclined to comment on negative issues, rather than critically analyse positive ones. They also tended to be more positive towards conducting the evaluation if the lecturer discussed them and/or made changes to their future lectures.

Communicating outcomes of students' evaluations of teaching and learning: one-size-fits-all?

Student evaluations of teaching are increasingly used to measure the teaching of individual academics in Australian higher education. The outcomes of these evaluations are variably made available to the individual academics themselves, to university management and to the public. However, communicating evaluation outcomes to each of these audiences assumes a different purpose and necessitates different objectives, foci and methodology. The need for these differences is sometimes forgotten with a ‘one-size-fits-all’ approach in Australian higher education. This paper examines these differences and discusses some of the issues surrounding the communication of the outcomes of student evaluations of teaching.

Framing student evaluations of university learning and teaching : discursive strategies and textual outcomes

Evaluation in higher education is an evolving social practice, that is, it involves what people, institutions and broader systems do and say, how they do and say it, what they value, the effects of these practices and values, and how meanings are ascribed. The textual products (verbal, written, visual, gestural) that inform and are produced by, for and through evaluative practices are important as they promulgate particular kinds of meanings and values in specific contexts. This paper reports on an exploratory study that sought to investigate, using discourse analysis, the types of evaluative practices that were ascribed value, and the student responses that ensued, in different evaluative instruments. Findings indicate that when a reflective approach is taken to evaluation, students’ responses are more considered, they interrogate their own engagement in the learning context and they are more likely to demonstrate reconstructive thought. These findings have implications for reframing evaluation as reflective learning.

Longitudinal Student Evaluations of a Postgraduate Unit Using Importance-Performance Analysis

The Australian tourism tertiary education sector operates in a competitive and dynamic environment, which necessitates a market orientation to be successful. Academic staff and management in the sector must regularly assess the perceptions of prospective and current students, and monitor the satisfaction levels of current students. This study is concerned with the setting and monitoring of satisfaction levels of current students, reporting the results of three longitudinal investigations of student satisfaction in a postgraduate unit. The study also addresses a limitation of a university’s generic teaching evaluation instrument. Importance-performance analysis (IPA) has been recommended as a simple but effective tool for overcoming the deficiencies of many student evaluation studies, which have generally measured only attribute importance or importance at the end of a semester. IPA was used to compare student expectations of the unit at the beginning of semester with their perceptions of performance ten weeks later. The first stage documented key benchmarks for which amendments to the unit based on student feedback could be evaluated during subsequent teaching periods.

A comparison of student evaluation of teaching with student performance

This study measures the evaluation of teaching given by students against their final outcomes in a subject. The subject in question had an enrolment across four campuses of 1073 students at the time of the evaluation and is a statistics subject that is core (i.e. compulsory) to several undergraduate business degrees. This study is based on the 373 students (34.8%) who responded to the survey, and their final results. The evaluations were open for a period of six weeks leading up to and just after the final exam. The study matches the responses to the question “This unit was well taught” to final outcomes, in an attempt to ascertain whether there is a link between student evaluation of teaching and performance. The analysis showed that for the students who self -selected to complete the survey:

· Students who perform well in the subject generally give higher scores than lower performing students.

· The same general pattern prevailed when other secondary factors were taken into account, such as, when the evaluation was completed, campus and gender.

· The timing of when a student completes the evaluation seems the most important of these secondary variables.

· In general, students who submitted their evaluations after the exam gave higher ratings if they eventually obtained a pass grade or better, and lower grades if they failed.

Students' evaluations of teaching quality and their unit online activity : an empirical investigation

This paper reports on an investigation of the relationship between students’ level of online activity in units in a business faculty and their evaluations of teaching quality in these units. The analysis was conducted using student evaluation data from 2004 to 2007 together with data for student online activity for one semester. We compare on-campus and off-campus students and undergraduate and postgraduate students. The results indicate that students’ evaluations of units have improved on all surveyed criteria during the five years. We also show that for some cohorts student online activity is associated with greater satisfaction with teaching. The paper concludes by considering the implications of these findings for further research and teaching practice.

Responding to student evaluation of teaching : closing the loop

Our undergraduate curriculum focuses on preparing students to be critical thinkers, problem solvers, and knowledgeable, responsible information technology (IT) professionals. Students often question the relevance of core subjects which are designed to introduce and develop these attributes; such units regularly perform poorly in student evaluation of teaching. Although these subjects are strongly grounded in meeting industry expectations regarding employability skills, students do not value the learning as the curriculum is deemed non-technical and not worthy of inclusion in an IT qualification. As these are core subjects, improving student perceptions and learning outcomes is of critical importance. Simply responding to student feedback received via student evaluation of teaching had not resulted in any improvement; so a holistic approach was adopted. A workshop was organised to explore the issues and develop a strategy to improve outcomes and perceptions of these subjects. Rather than addressing student feedback specifically, the underlying issues that led to students’ negative perceptions were identified and addressed. Recommendations were implemented in 2014 resulting in improvements in student evaluation for relevant subjects. In this paper, we will discuss the process that was adopted to respond effectively to student evaluations, and explore the impact that this had on them.

Improved questionnaire for gathering student perceptions of teaching and learning

An instrument used to gather university students’ perceptions of their learning environments, the Perceptions of Learning Environments Questionnaire (PLEQ) has been used recently in higher education research. The current paper examines the strengths and limitations of the PLEQ, particularly in relation to uncovering student perceptions about responsibility for their own learning. A study trialling a modified questionnaire, which
builds on the advances and addresses the limitations of the PLEQ, is reported.

Student expectations of teaching and learning

Higher education aims to develop students as life-long learners. Facilitative, learning-centred approaches are more likely to develop independent learners. However, these learning methods may challenge students’ conceptions of “good teaching” developed from their previous learning experiences. Student beliefs and expectations about teaching were examined through interviews of a small number of students as part of a wider study looking at developing techniques to assist students to become more aware, engaged and appreciative of their learning experience. The analysis of the interviews offer some useful suggestions for lecturers engaged in teaching professional disciplines wishing to use facilitative, student-centred teaching approaches.

Learning approaches and student perceptions of teaching quality

This research investigated the links between students' personal characteristics, their approaches to learning and their perceptions of teaching quality in a first-year accounting unit. Significant learning differences were found between Australian and Chinese students, and strong inter-relationships between contextual factors, such as teaching quality, and learning approaches were identified.