Understanding VET teachers’challenges in providing quality education to international students

In the past fifteen years, increasing attention has been given to the role of Vocational Education and Training (VET) in attracting large numbers of international students and its contribution to the economic development of Australia. This trend has given rise to many challenges in vocational education, especially with regard to providing quality education that ensures international students stay in Australia is a satisfactory experience. Teaching and learning are continuously scrutinised, and teaching quality and student assessment are subject to regular audit (Takerei, 2010). VET teachers are key stakeholders in international education and share responsibility for ensuring international students gain quality learning experiences and positive outcomes; however, their experiences are generally not well understood. Therefore, this paper reports on a study which responded to this research gap and investigated particular challenges that VET teachers experience when teaching international students. The research participants were 15 teachers from several public and private VET institutions in Brisbane, Australia. The method involved responsive interviewing and inductive data analysis to identify and categorize teachers’ challenges and dilemmas. After briefly outlining the background of the research approach, this paper presents findings about challenges that VET teachers’ experienced while teaching international students. The aim of the paper is to explore VET teachers’ perspectives in order to contribute essential understandings that contribute to a holistic approach to vocational education of international students. It reveals that the teachers experienced challenges of three main types: professional, personal and educational.

From policy borrowing to implementation : an illuminative evaluation of learning and teaching in higher education in Australia (2002 to 2008)

This study documents and theorises the consequences of the 2003 Australian Government Reform Package focussed on learning and teaching in Higher Education during the period 2002 to 2008. This is achieved through the perspective of program evaluation and the methodology of illuminative evaluation. The findings suggest that the three national initiatives of that time, Learning and Teaching Performance Fund (LTPF), Australian Learning and Teaching Council (ALTC), and Australian Universities Quality Agency (AUQA), were successful in repositioning learning and teaching as a core activity in universities. However, there were unintended consequences brought about by international policy borrowing, when the short-lived nature of LTPF suggests a legacy of quality compliance rather than one of quality enrichment.

(How) Do research and administrative duties affect university professors’ teaching?

We analyze the interaction between university professors’ teaching quality and their research and administrative activities. Our sample is a high-quality individual panel data set from a medium size public Spanish university that allows us to avoid several types of biases frequently encountered in the literature. Although researchers teach roughly 20% more than non-researchers, their teaching quality is also 20% higher. Instructors with no research are 5 times more likely than the rest to be among the worst teachers. Over much of the relevant range, we find a nonlinear and positive relationship between research output and teaching quantity on teaching quality. Our conclusions may be useful for decision makers in universities and governments.

The Masters in Teaching and Learning (MTL): a retrospective, intrinsic case study of the process of policy into practice and its impact on teacher participants

The research reported here is a retrospective case study of the recent (2010) introduction of the Masters in Teaching and Learning (MTL) as a post-graduate level programme of professional development for teachers. It contributes to the debate and research over the past two decades about the impact of post-graduate professional development and appropriate ways of delivering it. The study is located within an extensive body of literature dealing with the importance of the teaching profession with regard to the success of schools and pupils and the impact of professional development on teaching quality and of teaching quality on attainment. A further relevant context is the ongoing tension between the teaching profession and academics on the one hand and government and political actors on the other, in respect of the approaches to professional development and to the control of educational processes. The research questions which inform the study deal with the perspectives of various participants – policy makers, programme directors, coaches and teachers studying for the MTL – on the extent to which the MTL is likely to have an ameliorative effect on teaching and pupil attainment, their experiences of the process of policy development and their experiences as course participants. The study adopts a case study approach which involves elite interviews with those responsible for the development and implementation of the MTL, questionnaires completed by MTL course participants and a comparison group taking a conventional MA and in depth interviews with participants and coaches. The results revealed tensions and difficulties associated with the development of the MTL including uneasy relationships between HE institutions and government agencies, ideas about ‘producer capture’, the relevance of the MBA model and concern over the role of coaches. However, while acknowledging various difficulties and some misconceived expectations they viewed its potential to meet its expressed aims positively, given time. Course participants were positive about their experience of the MTL and felt that it had contributed to many aspects of their professional development. Most saw it as a positive experience despite the variable quality of support from their schools, particularly in the form of the school-based coach the concept of which had been heralded as the bellwether of the MTL. It was striking that the responses of the MTL participants were very similar to those of teachers taking a conventional MA. A finding which would repay further investigation is that while the great majority of course participants felt that the MTL (and the MA) had contributed to their becoming more effective teachers they were much less confident that it had contributed to increased pupil attainment.

E-commerce and graduate education: is educational quality taking a nose dive?

Purpose: Online education has been growing rapidly, but has not had the benefit of the extensive teaching pedagogy development of traditional face-to-face teaching. This paper aims to provide a review of the current literature and present the results of a survey, conducted to determine the effectiveness of a graduate online subject. Design/methodology/approach: The literature was reviewed to identify measures of success and quality in online education delivery. These measures were then considered in relation to their application in practice via a case study based around a survey conducted at Deakin University in Australia. Findings: A total of 16 relevant measures of teaching quality were identified in the literature. Most measures had elements of bias and some were more generally applicable to online learning. The case study suggested that the value of computer mediated learning in an online environment was limited and that a combination of print and computer mediated conferencing performed better in more of the identified quality matrices. Practice implications: Online learning does not save teaching resources if standards of quality are maintained. It can be used to provide a remote teaching facility, provided it is backed up by resources such as printed study guides. For the subject evaluated, online mediated learning did not the provide the same quality of education. Originality/value: Whilst some research has been conducted in this area, no substantive grounded theory has been applied to postgraduate or fee-paying online education regimes. As a result, case studies of such applications can be very helpful in the design of future teaching systems.

Effective teaching in universities: are students' basic needs being satisfied in large classes?

In a quest for a more efficient education system, many organizations have opted to increase class size. It is a common perception that large subjects are economical to run and small subjects are not. Many in the tertiary  education system have had concerns with issues involved in the teaching of large classes, including teaching quality and whether there are effective learning outcomes for students. As with any complex issue, there are several approaches that could be utilized to assess whether the needs of  stakeholders are being met. Stakeholders include the institution, the  teaching staff the community and the students. This study aims to assess whether universities are satisfying the needs of students as class size is increased The study focuses on satisfaction with large classes and includes an assessment of the satisfaction of students' psychological needs. These constructs are measured in small, medium and large classes to identify the change in the level of satisfaction. The study used a multi-method approach consisting of a literature review, a qualitative phase involving in depth  interviews, focus groups, and a quantitative survey The results show that while customer satisfaction is being met, the satisfaction of students' psychological needs are not being fully realised. It was also found that there were notable variations between individual students, the subjects being studied and degree streams of students taking the same subject. The implications of these findings and suggestions for further investigation are discussed in this paper.

An investigation of issues in the teaching and management of large classes

In a quest for a more efficient education system, many organizations have opted to increase class size. It is a common perception that large subjects are economical to run and small subjects are not. Many in the tertiary education system have had concerns with issues involved in the teaching of large classes, including teaching quality and whether there are effective learning outcomes for students. As with any complex issue, there are several approaches that could be utilized to assess whether the needs of stakeholders are being met. Stakeholders include the institution, the teaching staff, the community and the students. This study aims to assess whether universities are satisfying the needs of students as class size is increased. The study focuses on satisfaction with large classes and includes an assessment of the satisfaction of students' psychological needs. These constructs are measured in small, medium and large classes to identify the change in the level of satisfaction. The study used a multi-method approach consisting of a literature review, a qualitative phase involving in-depth interviews, focus groups, and a quantitative survey. The results show that while customer satisfaction is being met, the satisfaction of students' psychological needs are not being fully realised. It was also found that there were notable variations between individual students, the subjects being studied and degree streams of students taking the same subject. The implications of these findings and suggestions for further investigation are discussed in this paper.

An institutional study of the influence of ‘onlineness’ on student evaluation of teaching in a dual mode Australian university

Student evaluation of teaching (SET) is now commonplace in many universities internationally. The most common criticism of SET practices is that they are influenced by a number of non-teaching-related factors. More recently, there has been dramatic growth in online education internationally, but only limited research on the use of SET to evaluate online teaching. This paper presents a large-scale and detailed investigation, using the institutional SET data from an Australian university with a significant offering of wholly online units, and whose institutional SET instrument contains items relating to student perceptions of online technologies in teaching and learning. The relationship between educational technology and SET is not neutral. The mean ratings for the ‗online‘ aspects of SET are influenced by factors in the wider teaching and learning environment, and the overall perception of teaching quality is influenced by whether a unit is offered in wholly online mode or not.

Student evaluation of teaching data 2009-2010

This dataset consists of a summary of publicly available student evaluation of teaching (SET) data for the annual period of trimester 2 2009, trimester 3 2009/2010 and trimester 1 2010, from the Student Evaluation of Teaching and Units (SETU) portal.

The data was analysed to include mean rating sets for 1432 units of study, and represented 74498 sets of SETU ratings, 188391 individual student enrolements and 58.5 percent of all units listed in the Deakin University handbook for the period under consideration, to identify any systematic influences on SET results at Deakin University.

The data reported for a unit included:
• total enrolment;
• total number of responses; and
• computed response rate for the enrolment location(s) selected

And, the data reported for each of the ten core SETU items included:
• number of responses;
• mean rating;
• standard deviation of the mean rating;
• percentage agreement;
• percentage disagreement; and
• percentage difference.

Student evaluation of teaching : keeping in touch with reality

Student evaluation of teaching is commonplace in many universities and may be the predominant input into the performance evaluation of staff and organisational units. This article used publicly available student evaluation of teaching data to present examples of where institutional responses to evaluation processes appeared to be educationally ineffective and where the pursuit of the ‘right’ student evaluation results appears to have been mistakenly equated with the aim of improved teaching and learning. If the vast resources devoted to student evaluation of teaching are to be effective, then the data produced by student evaluation systems must lead to real and sustainable improvements in teaching quality and student learning, rather than becoming an end in itself.

Authentically assessing graduate teaching: outside and beyond neo-liberal constructs

In this paper, we challenge the current focus on ‘best practice’, graduate teacher tests, and student test scores as the panacea for ensuring teaching quality and argue for ways of thinking about evidence of quality beginning teaching outside and beyond the current neoliberal accountability discourses circulating in Australia and other countries. We suggest that teacher educators need to reinsert themselves as key players in the debates around quality beginning teaching, rather than being viewed as a source of the problem. To enable teacher educators to assume accountability for quality beginning teachers, we propose the framework of a capstone teacher performance assessment—a structured portfolio called the Authentic Teacher Assessment (ATA)— and examine examples of these assessments through the lens of critical discourse analysis. As a measure of ‘readiness to teach’, the ATA is compared with supervising teachers’ assessments of preservice teachers. We argue that structured portfolios that include artefacts derived from preservice teachers’ practice in classrooms along with graduate teacher self assessments provide a stronger accountability measure of effec- tive beginning teaching and demonstrably address the current anxiety regarding ‘evi- dence’. We suggest that such an approach should be reliable enough to be ‘read’ by external assessors (and moderated across other teacher education institutions). Rigor- ous research on a national basis is called for in order to develop and implement a structured portfolio as rich evidence of graduates’ quality and readiness to teach.

The systematic influences on student evaluation of teaching in engineering education

BACKGROUND Student evaluation of teaching (SET) has a long history, has grown in prevalence and importance over a period of decades, and is now common-place in many universities internationally. SET data are collected for a range of purposes, including: as diagnostic feedback to improve the quality of teaching and learning; as an input to staff performance management processes and personnel decisions such as promotion for staff; to provide information to prospective students in their selection of courses and programs; and as a source of data for research on teaching. Rovai et al. (2006) report that while SET research provides mixed results, there is evidence that, for course-related factors, smaller classes are rated more favourably than large classes, upper-year-level classes are rated more favourably than lower-year classes, and that there are rating differences between discipline areas. While additional course-related factors are also noted, other reviews of the literature on SET also identify these three factors as commonly reported systematic influences on SET ratings. The School of Engineering at Deakin University in Australia offers undergraduate and postgraduate engineering programs, and these programs are delivered in both on-campus and off-campus modes.PURPOSEThe paper presents a quantitative investigation of SET data for the School of Engineering at Deakin University to identify whether the commonly reported systematic influences on SET ratings of class size and year level are also observed here. The influence of online mode of offer is also explored.DESIGN/METHOD Deakin University’s Student Evaluation of Teaching and Units (SETU) questionnaire is administered to students enrolled in every unit of study every time that unit is offered, unless it is specially exempted. Following data collation, summary results are reported via a public website. The publicly available SETU data for all School of Engineering units of study were collected for a two year period. The collected data were subjected to analysis of variance (ANOVA) analysis to identify any significant systematic influences on mean student SETU ratings.RESULTS SETU data from 100 separate units of study over the two year period were collected, representing 3375 sets of SETU ratings, and covering unit enrolment sizes from 12 to 462 students. Although this was a modest sized investigation, significantly higher mean ratings for some SETU items were observed for units with small enrolments, for postgraduate level units compared to undergraduate level units, and for units offered in conventional mode compared to online mode of offer. The presence of the commonly observed systematic influences on SET ratings was confirmed.CONCLUSIONS While the use of SET data may have originally been primarily for formative purposes to improve teaching and learning, they are also increasingly used for summative judgements of teaching quality and teaching staff performance that have implications for personnel decision making. There may be an acceptance of the need for SET, however there remains no universal consensus as to what constitutes quality in university teaching and learning, and the increasing use of SET for high-stakes decision making puts pressure on institutions to ensure that their SET practices are sound, equitable and defensible.

From a Vicious Circle of Anxiety to a Virtuous Circle of Learning: Experience of Teaching to a Heterogenous Clientele

A considerable body of literature suggests that significant psychological barrier and anxiety characterize the teaching and learning process in statistics. This study investigates the incidence of statistics anxiety, the extent to which it can be overcome and the factors that contribute to the process of overcoming it. Self-study and overall teaching quality, amongst others, significantly contributed to this outcome. This study identifies factors contributing to overall teaching quality. The teaching and learning process typified a highly effective communication mechanism based on an appropriate diagnosis of individual needs. This cumulative change resulted from circular causation. It is argued that given appropriate conditions the vicious circle of anxiety can be transformed into a virtuous circle of learning.

Good practice guide in learning and teaching

This is the second edition of our Aston Business School (ABS) Good Practice Guide and the enthusiasm of the contributors appears undiminished. I am again reminded that I work with a group of very committed, dedicated and professional colleagues. Once again this publication is produced to celebrate and promote good teaching across the School and to offer encouragement to those imaginative and innovative staff who continue to wish to challenge students to learn to maximum effect. It is hoped that others will pick up some good ideas from the articles contained in this volume. Contributors to this Guide were not chosen because they are the best teachers in the School, although they are undoubtedly all amongst my colleagues who are exponents of enthusiastic and inspiring approaches to learning. The Quality Unit approached these individuals because they declared on their Annual Module Reflection Forms that they were doing something interesting and worthwhile which they thought others might find useful. Amongst those reading the Guide I am sure that there are many other individuals who are trying to operate similar examples of good practice in their teaching, learning and assessment methods. I hope that this publication will provoke these people into providing comments and articles of their own and that these will form the basis of next year’s Guide. It may also provoke some people to try these methods in their own teaching. The themes of the articles this year can be divided into two groups. The first theme is the quest to help students to help themselves to learn via student-run tutorials, surprise tests and mock examinations linked with individual tutorials. The second theme is making learning come to life in exciting practical ways by, for example, hands-on workshops and simulations, story telling, rhetorical questioning and discussion groups. A common theme is one of enthusiasm, reflection and commitment on behalf of the lecturers concerned. None of the approaches discussed in this publication are low effort activities on the part of the facilitator, but this effort is regarded as worthwhile as a means of creating greater student engagement. As Biggs (2003)[1] says, in his similarly inspiring way, students learn more the less passive they are in their learning. (Ref). The articles in this publication bear witness of this and much more. Since last year Aston Business School has launched its Research Centre in Higher Education Learning and Management (HELM) which is another initiative to promote excellent learning and teaching. Even before this institution has become fully operational, at least one of the articles in this publication has seen the light of day in the research arena and at least two others are ripe for dissemination to a wider audience via journal publication. More news of our successes in this activity will appear in next year’s edition. May I thank the contributors for taking time out of their busy schedules to write the articles this summer, and to Julie Green who runs the ABS Quality Unit, for putting our diverse approaches into a coherent and publishable form and for chasing us when we have needed it! I would also like to thank Ann Morton and her colleagues in the Centre for Staff Development who have supported this publication. During the last year the Centre has further stimulated the learning and teaching life of the School (and the wider University) via their Learning and Teaching Week and sponsorship of Teaching Quality Enhancement Fund (TQEF) projects. Pedagogic excellence is in better health at Aston than ever before – long may this be because this is what life in HE should be about.

A study into the effectiveness of quality management training:a focus on tools and critical success factors

Purpose – The purpose of this paper is to investigate the effectiveness of quality management training by reviewing commonly used critical success factors and tools rather than the overall methodological approach. Design/methodology/approach – The methodology used a web-based questionnaire. It consisted of 238 questions covering 77 tools and 30 critical success factors selected from leading academic and practitioner sources. The survey had 79 usable responses and the data were analysed using relevant statistical quality management tools. The results were validated in a series of structured workshops with quality management experts. Findings – Findings show that in general most of the critical success factor statements for quality management are agreed with, although not all are implemented well. The findings also show that many quality tools are not known or understood well; and that training has an important role in raising their awareness and making sure they are used correctly. Research limitations/implications – Generalisations are limited by the UK-centric nature of the sample. Practical implications – The practical implications are discussed for organisations implementing quality management initiatives, training organisations revising their quality management syllabi and academic institutions teaching quality management. Originality/value – Most recent surveys have been aimed at methodological levels (i.e. “lean”, “Six Sigma”, “total quality management” etc.); this research proposes that this has limited value as many of the tools and critical success factors are common to most of the methodologies. Therefore, quite uniquely, this research focuses on the tools and critical success factors. Additionally, other recent comparable surveys have been less comprehensive and not focused on training issues.