Student feedback systems in higher education: a focused literature review and environmental scan

In recent times, higher education institutions have paid increasing attention to the views of students to obtain feedback on their experience of learning and teaching through internal surveys. This article reviews research in the field and reports on practices in other Australian universities. Findings demonstrate that while student feedback is valued and used by all Australian universities, survey practices are idiosyncratic and in the majority of cases, questionnaires lack validity and reliability; data are used inadequately or inappropriately; and they offer limited potential for cross-sector benchmarking. The study confirms the need for institutions to develop an overarching framework for evaluation in which a valid, reliable, multidimensional and useful student feedback survey constitutes just one part. Given external expectations and internal requirements to collect feedback from students on their experience of learning and teaching, the pursuit of sound evaluation practices will continue to be of interest at local, national and international levels.

Faculty mentoring, evidence-based assessment, and student learning : an Australian exploration of American initiatives

There have been many improvements in Australian engineering education since the 1990s. However, given the recent drive for assuring the achievement of identified academic standards, more progress needs to be made, particularly in the area of evidence-based assessment. This paper reports on initiatives gathered from the literature and engineering academics in the USA, through an Australian National Teaching Fellowship program. The program aims to establish a process to help academics in designing and implementing evidence-based assessments that meet the needs of not only students and the staff that teach them, but also industry as well as accreditation bodies. The paper also examines the kinds and levels of support necessary for engineering academics, especially early career ones, to help meet the expectations of the current drive for assured quality and standards of both research and teaching. Academics are experiencing competing demands on their time and energy with very high expectations in research performance and increased teaching responsibilities, although many are researchers who have not had much pedagogic training. Based on the literature and investigation of relevant initiatives in the USA, we conducted interviews with several identified experts and change agents who have wrought effective academic cultural change within their institutions and beyond. These reveal that assuring the standards and quality of student learning outcomes through evidence-based assessments cannot be appropriately addressed without also addressing the issue of pedagogic training for academic staff. To be sustainable, such training needs to be complemented by a culture of on-going mentoring support from senior academics, formalised through the university administration, so that mentors are afforded resources, time, and appropriate recognition.

Successful outcomes in vocational education and training courses : how pedagogy and expectations influence achievement

This paper reports on a four year Australian Research Council funded Linkage Project titled Skilling Indigenous Queensland, conducted in regional areas of Queensland, Australia from 2009 to 2013. The project sought to investigate vocational education, training (VET) and teaching, Indigenous learners’ needs, employer cultural and expectations and community culture and expectations to identify best practice in numeracy teaching for Indigenous VET learners. Specifically it focused on ways to enhance the teaching and learning of courses and the associated mathematics in such courses to benefit learners and increase their future opportunities of employment. To date thirty-nine teachers/trainers/teacher aides and two hundred and thirty-one students consented to participate in the project. Nine VET courses were nominated to be the focus on the study. This paper focuses on questionnaire and interview responses from four trainers, two teacher aides and six students. In recent years a considerable amount of funding has been allocated to increasing Indigenous Peoples’ participation in education and employment. This increased funding is predicated on the assumption that it will make a difference and contribute to closing the education gap between Indigenous and non-Indigenous Australians (Council of Australia Governments, 2009). The central tenet is that access to education for Indigenous People will create substantial social and economic benefits for regional and remote Indigenous People. The project’s aim is to address some of the issues associated with the gap. To achieve the aims, the project adopted a mixed methods design aimed at benefitting research participants and included: participatory collaborative action research (Kemmis & McTaggart, 1988) and, community research (Smith, 1999). Participatory collaborative action research refers to a is a “collective, self-reflective enquiry undertaken by participants in social situations in order to improve the rationality and justice of their own social and educational practices” (Kemmis et al., 1988, p. 5). Community research is described as an approach that “conveys a much more intimate, human and self-defined space” (p. 127). Community research relies on and validates the community’s own definitions. As the project is informed by the social at a community level, it is described as “community action research or emancipatory research” (Smith, 1999, p. 127). It seeks to demonstrate benefit to the community, making positive differences in the lives of Indigenous People and communities. The data collection techniques included survey questionnaires, video recording of teaching and learning processes, teacher reflective video analysis of teaching, observations, semi-structured interviews and student numeracy testing. As a result of these processes, the findings indicate that VET course teachers work hard to adopt contextualising strategies to their teaching, however this process is not always straight forward because of the perceptions of how mathematics has been taught and learned historically. Further teachers, trainers and students have high expectations of one another with the view to successful outcomes from the courses.

Making the implicit explicit : successful student skills for commencing cohorts

Making institutional expectations explicit using clear and common language engages commencing students and promotes help-seeking behaviour. When first year students enter university they cross the threshold into an unfamiliar environment (Devlin, Kift, Nelson, Smith & McKay, 2012). Universities endeavour to provide appropriate learning support services and resources; however research suggests that there is limited up take of these services, particularly in high risk students (Nelson-Field & Goodman, 2005). The Successful Student Skills Checklist is a tool which will be trialled during the 2013 Orientation period at the QUT Caboolture campus. The new tool is a response to the university’s commitment to provide “an environment where [students] are supported to take responsibility for their own learning, and to embrace an active role in succeeding to their full potential” (QUT, 2012, 6.2.1). This paper will outline the design of the support tool implemented during Orientation, as well as discuss the anticipated outcomes of the trial.

How to meet stakeholders' expectations, not manage them?

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

Work integrated learning: Exposure to professional practice : expectations and challenges

Prior to graduation engineering students are expected to provide evidence of relevant experience in the workplace. This experience is expected to provide opportunities for exposure to the profession and to help students develop confidence, skills and capabilities as emerging professionals. This investigation considers the expectations and challenges in implementing WIL programs in different contexts. While this will inform the next iteration of engineering course development at QUT the issues and interventions described provide useful insights into options available and engineering curriculum design more broadly. This comparative analysis across three phases highlights expectations and challenges including stakeholder responsibilities, expectations, and assessment. The study draws on the findings of a 2005 investigation into the purpose and provision of WIL and findings of a 2012 Faculty review of the current WIL model. The enhancement of WIL through a series of developmental phases highlights strengths and weaknesses of various models. It is anticipated that this investigation will inform course development decisions on a whole-of-course approach to WIL that improves student engagement and learning experience. The importance of WIL is not disputed. However with industry expectations, increasing student numbers and cohort diversity the ways in which students and industry currently engage in WIL are not sustainable and more creative, flexible and engaging approaches are needed.

Australian journalism students' motivations and job expectations : evidence from a survey across six universities

The value of tertiary journalism education is an often hotly-debated topic among journalism educators and in the industry. Yet, the voices of students are often not heard in these debates. For example, we know relatively little about why young people actually decide to study journalism, what area of journalism they want to work in and what they are looking for in a job. To shed more light on the student perspective, this paper reports on a survey of 320 undergraduate journalism students at six Australian universities. The results show that only a minority actually want to work in news journalism, while most prefer entertainment-focussed areas. Students are motivated mainly by a love for writing and because they like journalism as a profession. In terms of job characteristics, they are particularly interested in their own career progression, but also in the extent to which they can provide a public service.

Successful outcomes in vocational education and training courses and mathematics: how pedagogy and expectations influence achievement

This paper reports on a four year Australian Research Council funded Linkage Project titled Skilling Indigenous Queensland, conducted in regional areas of Queensland, Australia from 2009 to 2013. The project sought to investigate Vocational Education and Training (VET) and teaching, Indigenous learners’ needs, employer culture and expectations and community culture and expectations to identify best practice in numeracy teaching for Indigenous VET learners. Specifically it focused on ways to enhance the teaching and learning of courses and the associated mathematics in such courses to benefit learners and increase their future opportunities of employment. To date thirty - nine teachers/trainers/teacher aides and two hundred and thirty - one students consented to participate in the project. Nine VET courses offered in schools and Technical and Further Education Institutes (TAFE) were nominated to be the focus on the study. This paper focuses on student questionnaire responses and interview responses from teachers/trainers one high school principal and five students as a result of these processes, the findings indicated that VET course teachers work hard to adopt contextualising strategies to their teaching; however this process is not always straight forward because of the perceptions of how mathematics has been taught and learned by trainers and teachers. Further teachers, trainers and students have high expectations of one another with the view to successful outcomes from the courses.

The influence of teachers’ expectations

As teachers and educators understand, just because you want a student to learn something or perform well doesn’t mean that they always will! Often we focus on what the student is doing or not doing correctly – “Why can’t they just…?”. However, if we only focus on reasons that are external to us, we may miss important opportunities to reflect on how our own behaviour might influence our students’ performance.

Case Study 4: Education Doctoral Student - "An Exploratory Study of Online Social Networking within a Doctorate of Education Program"

Introduction The professional doctorate is specifically designed for professionals investigating real-world problems and relevant issues for a profession, industry, and/or the community. The focus is scholarly research into professional practices. The research programme bridges academia and the professions, and offers doctoral candidates the opportunity to investigate issues relevant to their own practices and to apply these understandings to their professional contexts. The study on which this article is based sought to track the scholarly skill development of a cohort of professional doctoral students who commenced the course in January 2008 at an Australian university. Because they hold positions of responsibility and are time-poor, many doctoral students have difficulty transitioning from professional practitioner to researcher and scholar. The struggle many experience is in the development of a theoretical or conceptual standpoint for argumentation (Lesham, 2007; Weese et al., 1999). It was thought that the use of a scaffolded learning environment that drew upon a blended learning approach incorporating face to face intensive blocks and collaborative knowledge-building tools such as wikis would provide a data source for understanding the development of scholarly skills. Wikis, weblogs and similar social networking software have the potential to support communities to share, learn, create and collaborate. The development of a wiki page by each candidate in the 2008 cohort was encouraged to provide the participants and the teaching team members with textual indicators of progress. Learning tasks were scaffolded with the expectation that the candidates would complete these tasks via the wikis. The expectation was that cohort members would comment on each other’s work, together with the supervisor and/or teaching team member who was allocated to each candidate. The supervisor is responsible for supervising the candidate’s work through to submission of the thesis for examination and the teaching team member provides support to both the supervisor and the candidate through to confirmation. This paper reports on the learning journey of a cohort of doctoral students during the first seven months of their professional doctoral programme to determine if there had been any qualitative shifts in understandings, expectations and perceptions regarding their developing knowledge and skills. The paper is grounded in the literature pertaining to doctoral studies and examines the structure of the professional doctoral programme. Following this is a discussion of the qualitative study that helped to unearth key themes regarding the participants’ learning journey.

Journalism students' motivations and expectations of their work in comparative perspective

Based on a survey of 4,393 journalism students in Australia, Brazil, Chile, Mexico, South Africa, Spain, Switzerland, and the United States, this study provides much-needed comparative evidence about students’ motivations for becoming journalists, their future job plans, and expectations. Findings show not only an almost universal decline in students’ desire to work in journalism by the end of their program but also important national differences in terms of the journalistic fields in which they want to work, as well as their job expectations. The results reinforce the need to take into account national contexts when examining journalism education across the globe.

Acting, accidents and performativity: Challenging the hegemonic good student in secondary schools

Current educational practice tends to ascribe a limiting vision of the good student as one who is well behaved, performs well in assessments and demonstrates values in keeping with dominant expectations. This paper argues that this vision of the good student is antithetical to the lived experience of students as they negotiate their positionality within complex power games in secondary schools. Student voices in focus group research nominate six rationales of the good student that inform their ‘performances’ of the good student. Understanding the multiplicity and dynamism of the good student is an educational imperative as schools seek to meet the changing needs of society in the new millennium.

The good student: Subjectivities, power and schooling

Schools are places where student subjectivities are negotiated and contested in a variety of spaces. This paper argues that schools organise the possibilities for student subjectivities through a set of discourses that construct idealised notions of the good student. Whilst some discourses occur across educational sites, in practice these sets of discourses construct a unique vision of the good student in each specific school site. This vision is articulated in a variety of ways in each school, however, the result is that each student is enmeshed within a complex nexus of power relations that they can contest, negotiate or accept. Most of the time, students engage in a swirling set of subjectivities that encompasses these possibilities in various ways at various times. This paper problematises commonsense notions of the good student at one school site. One intent is to give voice to the lived experience of students who find themselves the site of these technologies of power. These technologies construct a set of commonsense expectations of schools - amongst which is the desire to produce the good student. Another is to use a Foucaultean analysis that rejects the good/bad binary that underpins many commonsense understandings of what students should be.

Who is the good high school student?

Schooling is one of the core experiences of most young people in the Western world. This study examines the ways that students inhabit subjectivities defined in their relationship to some normalised good student. The idea that schools exist to produce students who become good citizens is one of the basic tenets of modernist educational philosophies that dominate the contemporary education world. The school has become a political site where policy, curriculum orientations, expectations and philosophies of education contest for the ‘right’ way to school and be schooled. For many people, schools and schooling only make sense if they resonate with past experiences. The good student is framed within these aspects of cultural understanding. However, this commonsense attitude is based on a hegemonic understanding of the good, rather than the good student as a contingent multiplicity that is produced by an infinite set of discourses and experiences. In this book, author Greg Thompson argues that this understanding of subjectivities and power is crucial if schools are to meet the needs of a rapidly changing and challenging world. As a high school teacher for many years, Thompson often wondered how students responded to complex articulations on how to be a good student. How a student can be considered good is itself an articulation of powerful discourses that compete within the school. Rather than assuming a moral or ethical citizen, this study turns that logic on it on its head to ask students in what ways they can be good within the school. Visions of the good student deployed in various ways in schools act to produce various ways of knowing the self as certain types of subjects. Developing the postmodern theories of Foucault and Deleuze, this study argues that schools act to teach students to know themselves in certain idealised ways through which they are located, and locate themselves, in hierarchical rationales of the good student. Problematising the good student in high schools engages those institutional discourses with the philosophy, history and sociology of education. Asking students how they negotiate or perform their selves within schools challenges the narrow and limiting ways that the good is often understood. By pushing the ontological understandings of the self beyond the modernist philosophies that currently dominate schools and schooling, this study problematises the tendency to see students as fixed, measurable identities (beings) rather than dynamic, evolving performances (becomings). Who is the Good High School Student? is an important book for scholars conducting research on high school education, as well as student-teachers, teacher educators and practicing teachers alike.