Student feedback systems in higher education: a focused literature review and environmental scan

In recent times, higher education institutions have paid increasing attention to the views of students to obtain feedback on their experience of learning and teaching through internal surveys. This article reviews research in the field and reports on practices in other Australian universities. Findings demonstrate that while student feedback is valued and used by all Australian universities, survey practices are idiosyncratic and in the majority of cases, questionnaires lack validity and reliability; data are used inadequately or inappropriately; and they offer limited potential for cross-sector benchmarking. The study confirms the need for institutions to develop an overarching framework for evaluation in which a valid, reliable, multidimensional and useful student feedback survey constitutes just one part. Given external expectations and internal requirements to collect feedback from students on their experience of learning and teaching, the pursuit of sound evaluation practices will continue to be of interest at local, national and international levels.

Finding your research voice : the application of bibliometrics as an analytic literature tool on the pedagogic field of higher education

This paper documents the use of bibliometrics as a methodology to bring forth a structured, systematic and rigorous way to analyse and evaluate a range of literature. When starting out and reading broadly for my doctoral studies, one article by Trigwell and Prosser (1996b) led me to reflect about my level of comprehension as the content, concepts and methodology did not resonate with my epistemology. A disconnection between our paradigms emerged. Further reading unveiled the work by Doyle (1987) who categorised research in teaching and teacher education by three main areas: teacher characteristics, methods research and teacher behaviour. My growing concerns that there were gaps in the knowledge also exposed the difficulties in documenting said gaps. As an early researcher who required support to locate myself in the field and to find my research voice, I identified bibliometrics (Budd, 1988; Yeoh & Kaur, 2007) as an appropriate methodology to add value and rigour in three ways. Firstly, the application of bibliometrics to analyse articles is systematic, builds a picture from the characteristics of the literature, and offers a way to elicit themes within the categories. Secondly, by systematic analysis there is occasion to identify gaps within the body of work, limitations in methodology or areas in need of further research. Finally, extension and adaptation of the bibliometrics methodology, beyond citation or content analysis, to investigate the merit of methodology, participants and instruments as a determinant for research worth allowed the researcher to build confidence and contribute new knowledge to the field. Therefore, this paper frames research in the pedagogic field of Higher Education through teacher characteristics, methods research and teacher behaviour, visually represents the literature analysis and locates my research self within methods research. Through my research voice I will present the bibliometrics methodology, the outcomes and document the landscape of pedagogy in the field of Higher Education.

Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

The pedagogical balancing act : teaching reflection in higher education

Despite the common use of the term reflection in higher education assessment tasks, learners are not often taught how to communicate their disciplinary knowledge through reflection. This paper argues that students can and should be taught how to reflect in deep and transformative ways. It highlights the reflexive pedagogical balancing act of attending to different levels of reflection as a way to stimulate focused, thoughtful and reasoned reflections that show evidence of new ways of thinking and doing. The paper uses data from a current project to illustrate the effects of focusing on particular levels of reflection in the pedagogical strategies used, and argues that while the goal of academic or professional reflection is generally to move students to the highest level of reflection to transform their learning/practice, unless higher education teachers attend to every level of reflection, there are specific, observable gaps in the reflections that students produce.

Factors affecting the motivation of TEFL academics in higher education in China

This study investigates the motivation of English language lecturers in a Chinese university. Recent studies have shown that low morale and job dissatisfaction are significant problems identified in lecturers who teach English in universities in China. Given the importance of teaching English as a second language in China, this problem has potentially significant ramifications for the nation’s future. Low staff morale is likely to be associated with less effective teaching and poor student learning outcomes. Although the problem is acknowledged, there has been limited research to understand the underlying contributing factors. To address this, a sequential explanatory mixed methods approach was adopted and implemented in two phases at a large regional university in Northern China. The participants in the main study were 100 lecturers from two colleges at this university. All of the lecturers were responsible for teaching English as a foreign language (TEFL); 50 were teaching English majors and 50 were teaching university students whose majors were not English. The research was informed by a synthesis of self determination theory and theories of organisational culture. The study found: 1) in contrast to previously reported studies, lecturers in this institution were in general autonomously motivated in teaching. 2) However, their level of motivation was influenced by their personal experiences and varied sense of competence, relatedness and autonomy. 3) In particular, personal experiences and contextual factors such as the influence of Chinese culture, societal context, and organisational climate were significant in regulating lecturers’ motivation to teach. The findings are significant for leaders in higher education who need to implement policies that foster effective work environments. The study has also provided insights into the capacity of self determination theory to explain motivation in a Chinese culture.

Success factors for ICT shared services in the higher education sector

Shared services is a prominent organizational arrangement for organizations, in particular for support functions. The success (or failure) of shared services is a critical concern as the move to shared services can entail large scale investment and involve fundamental organizational change. The Higher Education (HE) sector is particularly well poised to benefit from shared services as there is a need to improve organizational performance and strong potential from sharing. Through a multiple case study of shared services experiences in HE, this study identifies ten important antecedents of shared services success: (1) Understanding of shared services; (2) Organizational environment; (3) Top management support; (4) IT environment; (5) Governance; (6) Process centric view; (7) Implementation strategy; (8) Project management; (9) Change management; and (10) Communication. The study then develops a preliminary model of shared services success that addresses the interdependencies between the success factors. As the first empirical success model for shared services, it provides valuable guidance to practice and future research.

Building sustainable and effective assurance of learning process in a changing higher education environment

In a study of assuring learning in Australian Business Schools, 25 Teaching and Learning Associate Deans were interviewed to identify current issues in developing and measuring the quality of teaching and learning outcomes. Results indicate that for most institutions developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program required knowledge creation and the building of new inclusive processes. Common elements of effective practice, namely those which offered consistently superior outcomes, included: inclusive processes; embedded graduate attributes throughout a program; alongside consistent and appropriate assessment. Results indicate that assurance of learning processes are proliferating nationally while quality of teaching and learning outcomes and in the processes for assuring it is increasing as a result.

Towards success in higher education in engineering and technology : a coaching approach to develop holistic graduates

There is a growing gap between engineering practice and engineering education that may be contributing to less engineers practicing in industry. Coaching approach to learning and teaching has been proven to be an effective way to develop people in the workplace. A pilot coaching program is offered to Engineering and Technology students in Queensland University of Technology to enable holistic growth in order to better integrate them to the work force and society at large. The results and findings of this program will be published once the program has been completed

The relationship between entertainment producers and higher education providers

Cameron, Verhoeven and Court have noted that many screen producers do not see their tertiary education as being beneficial to their careers. We hypothesise that Universities have traditionally not trained students in producing skills because of the division of labour between Faculties of Art and Faculties of Business; and because their focus on art rather than entertainment has downplayed the importance of producing. This article presents a SOTL (Scholarship of Teaching and Learning) whole-of-program evaluation of a new cross-Faculty Bachelor of Entertainment Industries at QUT, devoted to providing students with graduate attributes for producing including creative skills (understanding story, the aesthetics of entertainment, etc), business skills (business models, finance, marketing, etc) and legal skills (contracts, copyright, etc). Stakeholder evaluations suggest that entertainment producers are highly supportive of this new course.

Transnational higher education programs for facilitating inter-university knowledge transfer : University of Indonesia’s experience

This paper explores the impacts and extent of knowledge transfer (KT) in an undergraduate engineering transnational program with an Australian university partner at the University of Indonesia (UI) using an inter-university KT conceptual framework (Sutrisno, Lisana, & Pillay 2012). For the purpose of this paper, the opportunity for KT in curriculum design is examined. Given the explicit nature of curriculum knowledge, assessing each partner’s curriculum was pivotal in allowing UI to enrich its own curriculum. The KT mechanism of face-to-face contact between Indonesian and Australian academics led to not only transfer of knowledge related to the curriculum of the undergraduate program but also to other cooperation beyond the transnational program in the form of joint research and joint supervision of post-graduate theses. Positive inter-university dynamics, such as trust and willingness to work together between the partners were underpinned by the presence of key actors from both sides at the earlier stages of the partnership. Retrospectively exploring the KT process in the UI’s transnational programs with its Australian partner suggests that there have been both structured and unstructured mechanisms, highlighting the ubiquitous and unbounded nature of KT between universities. While initially successful in facilitating KT, due to rapid succession of persons in charge of the program and the increasing focus on revenue generation, the useful lessons and practices unfortunately are being lost. Although the intention to use the transnational program for KT was always implied, it gradually was overlooked by newer staff members. Based on UI’s experience as the first provider of transnational program in Indonesia and other similar cases in China, seemingly transnational programs driven by short-term immediate financial return are unsuccessful in facilitating KT due to sensitivities to unfavourable economic situation. Those that remain operational and contribute to knowledge exchange between the partners apparently have genuine long-term engagement objective.

Higher education for capacity development or revenue maximisation? Lessons from transnational higher education programs at two Indonesian universities

HE has been changing rapidly due to globalisation that has increased the interconnectedness between nations and people throughout the world (Mok, 2012). As HE has manifested into different forms and governed by competing rationales in recent years, this paper focuses on transnational HE, which is an example of the interconnectedness of universities beyond the national borders. Indonesia is also influenced by the above changes. It took part in free-trade agreements that include HE as a sector to be liberated and accessed by international providers (Nizam, 2006). Indonesian universities found themselves bracing for the global competition for students and simultaneously having to improve their quality in order to survive amidst the growing competition. This competition gave birth to joint transnational HE programs with overseas partners among many Indonesian universities (Macaranas, 2010).

Satisfiers and dissatisfiers for international students of higher education : an exploratory study in Australia

This paper explores the main satisfiers and dissatisfiers for international students in Australia’s higher educational sector. Using a critical incident technique, this study is conducted with international students of higher education in Australia. Four categories of satisfiers and dissatisfiers emerge from the data which are related to individual performance, quality of the educational service, socialisation, and living conditions.

Consumer guarantees and the supply of educational services by higher education providers

The higher education sector is undergoing a number of significant changes, the implications of which have yet to emerge. One such change is the increasing reliance by higher education providers on the revenue generated by full fee paying international students to fund their operating expenses. The report by the Victorian Ombudsman, Investigation into how Universities Deal with International Students ('Victorian Ombudsman's Report') tabled in the Victorian Parliament on 27 October 2011, provides evidence that Australian higher education providers may be failing to meet their legal obligations to international students. The Victorian Ombudsman's Report is the result of an investigation into four Victorian universities teaching international students with a focus on accounting and nursing schools. The report contains evidence that the universities were admitting students with scores below, or at the lower end of, the International English Language Testing System ('IELTS') score considered acceptable. Alternatively, they were relying upon their own language testing admission standards and not on an independent test like the IELTS test. While the universities provided English language support services for their international students after they had been admitted, the Ombudsman was concerned that the universities 'have not dedicated sufficient resources to meet the level of need amongst international students'.

Towards a typology of structural arrangements for shared services : evidence from the higher education sector

Shared services are increasingly prevalent in practice, their introduction potentially entailing substantive and highly consequential organizational redesign. Yet, attention to the structural arrangements of shared services has been limited. This study explores types of structural arrangements for shared services that are observed in practice, and the salient dimensions along which those types can be usefully differentiated. Through inductive attention to the shared services literature, and content analysis of 36 secondary case studies of shared services in the higher education sector, three salient dimensions emerged: (1) the existence or not of a separate organizational entity, (2) an intra- or inter-organizational sharing boundary, and (3) involvement or not of a third party. Each dimension being dichotomous yields 23 combinations, or eight shared services structural arrangement types. Each of the eight structural arrangement types is defined and demonstrated through case examples. The typology offers clarity around shared services structural arrangements. It can serve as a useful analytical tool for researchers investigating the phenomenon further, and for practitioners considering the introduction or further development of shared services arrangements. Important follow on research is suggested too.

Action research and unit improvement in higher education : a case study approach

Student satisfaction data has been collected on a national basis in Australia since 1972. In recent years this data has been used by federal government agencies to allocate funding, and by students in selecting their universities of choice. The purpose of this paper is to present the findings of an action research project designed to identify and implement unit improvement initiatives over a three year period for an underperforming unit. This research utilises student survey data and teacher reflections to identify areas of unit improvement, with a view to aligning learning experiences, teaching and assessment to learning outcomes and improved student satisfaction. This research concludes that whilst a voluntary student survey system may be imperfect, it nevertheless provides important data that can be utilised to the benefit of the unit, learning outcomes and student satisfaction ratings, as well as wider course related outcomes. Extrapolation of these findings is recommended to other underperforming units.