Longitudinal evaluations of student satisfaction with a postgraduate unit using importance-performance analysis

The Australian tourism tertiary education sector operates in a competitive and dynamic environment, which necessitates a market orientation to be successful. Academic staff and management in the sector must regularly assess the perceptions of prospective and current students and monitor the satisfaction levels of current students. This study is concerned with the setting and monitoring of satisfaction levels of current students, reporting the results of three longitudinal investigations of student satisfaction in a postgraduate unit. The study also addresses a limitation of a university’s generic teaching evaluation instrument. Importance-Performance Analysis (IPA) has been recommended as a simple but effective tool for overcoming the deficiencies of many student evaluation studies, which have generally measured only attribute performance at the end of a semester. IPA was used to compare student expectations of the unit at the beginning of a semester with their perceptions of performance 10 weeks later. The first stage documented key benchmarks for which amendments to the unit based on student feedback could be evaluated during subsequent teaching periods.

Student evaluations and the impact on curriculum, teaching and assessment

This presentation discusses some of the major pressures on universities to frame curriculum around employability skills and professional requirements. Recent evaluation of Australian university courses by graduates suggests that many institutions remain perplexed as to how to do this. The presentation suggests that the student evaluations do not necessarily indicate poor curriculum development but possibly a lack of making skill development more overt through teaching and assessment. The main objective of this presentation is to outline and describe a project on how curriculum needs to and can respond to professional needs and what this may entail for the way in which traditional professional courses are taught and assessed. The presentation seeks to involve participants in identifying and discussing options for the teaching and assessment of skills and possible options for how these skills can be progressively developed throughout a course of study.

Learner strategy instruction and student uptake of strategies in a Japanese as a foreign language context

The Japanese language is recognised as being more difficult than European languages, needing three times more tuition time to reach comparable levels of proficiency. Encouraging Japanese as a Foreign Language (JFL) students to become aware of, and effectively use, learner strategies is one way to assist them become more controlled, effective learners leading to enhanced language learning. This thesis investigates the development and implementation of a JFL curriculum implemented in a university course for students learning JFL. The curriculum was developed specifically to assist beginner university students with the development of learner strategies appropriate for a JFL reading context. The theoretical underpinning of the study was informed by Educational Criticism (Eisner, 1998), which aims to describe, interpret and evaluate the processes of interaction between the teacher, the learner and the curriculum and the students' learning processes in a tertiary JFL classroom. The study investigated the effect on student learning processes of a JFL reading program that incorporated explicit learner strategy instruction and identified factors that enhanced or impeded the development of learner strategy knowledge. The participants in the study were 29 students enrolled in the course, 10 of whom volunteered to undertake additional tasks, and the two teachers who implemented the curriculum. Data collection involved a number of different strategies to observe the students' participation in the classroom and learning experiences. Learning processes were investigated through TOL protocols, classroom observations, course evaluations, interviews, and learner strategy use measurement instruments (SILL, SILK and SORS) to document student uptake of learner strategies. The design of the study and its applied focus recognised my expertise as a JFL teacher, curriculum writer and researcher, an approach that aligns with the purpose of a Professional Doctorate. Four general thematics, or principles, were identified in this study: „h Explicit learner strategy instruction provides the context for students to develop awareness of learner strategies and take control of their learning; „h Collaborative learning and interaction with teachers offers students the opportunity for shared knowledge construction; „h Reflection offers teachers and students the opportunity to reflect on their own learning style and strategy knowledge, and raises awareness of other available strategies; and „h Diverse cultural and linguistic backgrounds have an impact on curriculum implementation and student uptake of learner strategies. The study¡¦s methodological contribution is that it is one of the first in Australia to use Educational Criticism (Eisner, 1998) as a research methodology. The findings contribute to theoretical knowledge in the fields of Applied Linguistics, Second Language Teaching and Learning, Second Language Acquisition and JFL Teaching and Learning by offering new knowledge on the importance of learner strategies in the beginner JFL classroom, the potential of explicit strategy instruction, the value of reflection for both teachers and students, and the important role of the teacher in the process of curriculum implementation. The general principles identified and the findings of this in-depth study of a JFL classroom can be drawn upon to inform other teaching practice situations, and invite practitioners from not just Japanese, but from other language areas and other disciplines, to examine and improve their own practices, and suggest further research questions to pursue this line of enquiry.

Transforming teaching practice through virtual classrooms: A study of staff and student views of synchronous learning

Australia is a vast land and access to quality higher education is challenging for many Australians that live outside the larger metropolitan areas. In 2010, the School of Education at an Australian university (Curtin University in Western Australia) moved to flexible delivery of a fully online Bachelor of Education degree for their rural students. The new model of delivery allows access for students from any location provided they have a computer and an internet connection.A number of teaching staff had previously used an asynchronous environment to deliver learning modules housed within a learning management system (LMS) but had not used synchronous software with their students. To enhance the learning environment and to provide high quality learning experiences to students learning at a distance, the adoption of synchronous software (Elluminate Live) was introduced. This software is a real-time virtual classroom environment that allows for communication through Voice over Internet Protocol (VoIP) and video conferencing, alongside a large number of collaboration tools to engage learners.This research paper reports on the integration of a live e-learning solution into the current Learning Management System (LMS) environment. Staff were interviewed about their perceptions and a questionnaire was administered to a sample of students to identify their experience with the synchronous software in order to inform future practice.

Web based content and hybrid teaching: student perceptions of the effectiveness of using web based content and hyper-linked teaching units in teaching hybrid business and marketing post secondary classes /

This exploratory, descriptive action research study is based on a survey of a sample of convenience consisting of 172 college and university marketing students, and 5 professors who were experienced in teaching in an internet based environment. The students that were surveyed were studying e-commerce and international business in 3^^ and 4*'' year classes at a leading imiversity in Ontario and e-commerce in 5^ semester classes at a leading college. These classes were taught using a hybrid teaching style with the contribution of a large website that contained pertinent text and audio material. Hybrid teaching employs web based course materials (some in the form of Learning Objects) to deliver curriculimi material both during the attended lectures and also for students accessing the course web page outside of class hours. The survey was in the form on an online questionnaire. The research questions explored in this study were: 1. What factors influence the students' ability to access and learn from web based course content? 2. How likely are the students to use selected elements of internet based curriculum for learning academic content? 3. What is the preferred physical environment to facilitate learning in a hybrid environment? 4. How effective are selected teaching/learning strategies in a hybrid environment? The findings of this study suggest that students are very interested in being part of the learning process by contributing to a course web site. Specifically, students are interested in audio content being one of the formats of online course material, and have an interest in being part of the creation of small audio clips to be used in class.

The impact of teaching models, group structures and assessment modes on cooperative learning in the student design studio

As a result of ever diminishing teaching resources, an increasing number of architectural educators are setting group design projects, rather then spreading their time thinly over a large number of individual projects. This allows them to co-ordinate longer and more in-depth review sessions on a smaller number of assignment submissions. However, while the group
model may offer an authentic learning model by reflecting design in practice, the approach is not without its obvious shortcomings as a teaching archetype for the assessment of the knowledge and skill competencies of individual students. Hence, what is clear is the need for a readily adoptable andragogy for the teaching and assessment of group design projects.
The following paper describes the background, methodology and findings of a Strategic Teaching and Learning Grant funded research project carried out in the year 2005 at the School of Architecture and Building at Deakin University. The project aimed to inform a change of classroom/studio practice governing the assemblage, teaching and assessment of student design teams. The development through these changes of cooperative and student centred learning principles focused on effective design collaboration and fair assessment should, it will be argued, lead to an enhanced group-learning experience in studio, which will subsequently and ultimately enhance professional practice.

20 years on - have student evaluations made a difference?

This paper poses the question, what impact have student evaluations (SE’s) of teaching had on the improvement in teaching in Australian tertiary education. The paper proposes to assess the effectiveness of SE’s through an investigations of the ways in which have been used in Australian tertiary education over the last 20 years or so. Three approaches are discussed: a) quality assurance - student evaluations used to ensure the quality of the learning environment in which learning takes place; b) quality improvement - student evaluations used as a diagnostic tool for individual teaching staff; and c) student feedback – student evaluations used to provide prospective and current students with information to help inform their choices and expectations. The discussions reviews some of the research and known practise in Australian universities. It concludes that SE’s have had a profound impact on pedagological understandings of tertiary education by placing the student at centre stage of teaching and learning. However it suggests that we do not know how SE’s have impacted on teaching effectiveness and improvement. The paper concludes by recommending further research to define critical success factors, a better understanding of how to make the student feedback and evaluation tools and mechanisms more approachable and meaningful for students, and an assessment of the ‘survey industry’ as a sustainable enterprise.

Closing the loop on student evaluations

It is generally agreed that good teaching is dependent on the nature of the learning goals and the quality of the environment in which learning takes place1,2. If this is the case, then planned as opposed to unplanned variations in learning experiences are the hallmark of good teaching. This raises a complex set of relations between assuring and improving teaching within an institution. The essential question for a University is: how do we assure that learning is maximised in all given contexts?

Benchmarking the use of student feedback was identified as a priority project at the ATN annual conference in February 2002. This paper presents a number of issues arising from a study of practices across the ATN in relation to collecting, analysing and using student feedback. The project involved working with those responsible for teaching and learning improvements at the operational level to identify strategies for a systematic approach to the use of student feedback for improving communication of actions arising from results.

The framework for the inquiry involved an exploration of student feedback systems as they operate for different cohorts of students, differing measures (or constructs), and at different levels within institutional structures. The framework also explored the various tracking and reporting systems by which results generated from student feedback systems at each level were utilised to develop strategies for improving teaching and learning. Findings from the study were used to inform recommendations in relation to internal practices within each University, as well as initiatives for benchmarking student evaluation results across universities within the ATN network.

Where shall the future student learn? Student expectations of university facilities for teaching and learning

This paper examines some of the issues surrounding educational facilities - their design and impact upon student learning now and into the future. It details some of the recent literature in this area with particular emphasis upon teaching and learning trends that match the needs of modern students. The responses of a group of first year university students in the School of Property, Construction and Project Management at RMIT University are also matched against these trends. The conclusions from these responses drawn indicate that the future university student will want flexible learning spaces that can adapt to both individual and collaborative work with a strong emphasis on social learning and advanced technology. The responses also indicate a mismatch between existing lecture theatres and tutorial rooms and the third space learning that these graduates of 2011 want. The results have implications for all higher education institutions as we enter the new millennium.

An analysis of student engagement when taught in classes of different sizes in rural, regional and metropolitan campuses of an Australian university

This study investigates the impact of class size on student engagement and student performance. It is based on an analysis of student university enter scores, student grades and student evaluations in metropolitan, regional and rural campuses of an Australian universityduring trimester 1 of years 2008, 9 & 10. Past literature appears to support the predominant influence of the class size effect on learning, though some findings are mixed and inconclusive. Contrary to the accepted view that higher entry level scores result in higher grades and, conversely, lower entry level scores result in lower grades, the findings suggest that factorsother than entry level scores, contribute to student outcomes and student engagement. The study reveals that student satisfaction of teaching quality is higher in the rural and regional campuses where the cohorts are smaller than at the metropolitan campus. This may be an indication that class size seems to have a predominant influence on student engagement and learning outcomes.

The best of all worlds: Immersive interfaces for art education in virtual and real world teaching and learning environments

A narrative interpretative research methodology was used to investigate collaboration between higher education students and an art educator with the aim of establishing a community of learners. Located, Cloud based and graphically built 3D virtual, socially networked, e-learning environments were used to encourage synchronous and asynchronous student participation in authentic learning and collaborative art practice. Discussion focuses on art educator observations, student visual journal entries, their virtual exhibition of artworks on Deakin Art Education Island in Second Life and student evaluations of the unit Navigating the Visual World. It was concluded that immersion in an e-technology rich blended learning environment resulted in the establishment of an effective e-learning community of art.

Lecturing and other face-to-face teaching – too much or too little? An assessment based on student feedback and fail rates

Institutes of higher learning are tending to reduce the amount of face-to-face teaching that they offer, and particularly through the traditional pedagogical method of lecturing. There is ongoing debate about the educational value of lectures as a teaching approach, in terms of both whether they facilitate understanding of subject material and whether they augment the student educational experience. In this study, student evaluation of teaching scores plus academic outcome (percentage of students who fail) was assessed for 236 course units offered by a science faculty at an Australian university over the course of one year. These measures were related to the degree to which lectures and other face-to-face teaching were used in these units, controlling for factors such as class size, school and year level. An information-theoretic model selection approach was employed to identify the best models and predictors of student assessments and fail rates. All the top models of student feedback included a measure reflecting amount of face-to-face teaching, with the evaluation of quality of teaching being higher in units with higher proportions of lectures. However, these models explained only 12–20% of the variation in student evaluation scores, suggesting that many other factors come into play. By contrast, units with fewer lectures have lower failure rates. These results suggest that moving away from lectures and face-to-face teaching may not harm, and indeed may improve the number of students who pass the subject, but that this may be incurred at the expense of greater dissatisfaction in students' learning experience.