Australian higher education evaluation through assurance of learning

A collaborative research project conducted by five Australian universities inquired into the philosophy and motivation for Assurance of Learning (AoL) as a process of education evaluation. Associate Deans Teaching and Learning representing Business schools from twenty-five universities across Australia participated in telephone interviews. Data was analysed using NVIVO9. Results indicated that articulated rationale for AoL was both ensuring that students had acquired the attributes and skills the universities claimed they had, and the philosophy of continuous improvement. AoL was motivated both by ritualistic objectives to satisfy accreditation requirements and virtuous agendas for quality improvement. Closing-the-loop was emphasised, but was mostly wishful thinking for next steps beyond data collection and reporting. AoL was conceptualised as one element within the larger context of quality review, but there was no evidence of comprehensive frameworks or strategic plans.

Using cases in a mixed learning environment : meeting the challenges of higher education reform

This paper explains the context for pedagogy in a specific undergraduate course; the comparative benefits of using cases in a mixed learning environment (simultaneous large and small groups); and illustrates one significant way for universities to respond to increasing demand for delivery efficiency while maintaining high quality learning outcomes. Thus, to achieve objectives of the subject, tutorial classes expand on what is taught in lectures and provide the necessary context to analyse cases in more detail. A small, qualitative study explored experiences of market research tutors with the use of case method teaching reported. Implications of the study for case teaching in higher education are identified.

Student feedback systems in higher education: a focused literature review and environmental scan

In recent times, higher education institutions have paid increasing attention to the views of students to obtain feedback on their experience of learning and teaching through internal surveys. This article reviews research in the field and reports on practices in other Australian universities. Findings demonstrate that while student feedback is valued and used by all Australian universities, survey practices are idiosyncratic and in the majority of cases, questionnaires lack validity and reliability; data are used inadequately or inappropriately; and they offer limited potential for cross-sector benchmarking. The study confirms the need for institutions to develop an overarching framework for evaluation in which a valid, reliable, multidimensional and useful student feedback survey constitutes just one part. Given external expectations and internal requirements to collect feedback from students on their experience of learning and teaching, the pursuit of sound evaluation practices will continue to be of interest at local, national and international levels.

Building sustainable and effective assurance of learning process in a changing higher education environment

In a study of assuring learning in Australian Business Schools, 25 Teaching and Learning Associate Deans were interviewed to identify current issues in developing and measuring the quality of teaching and learning outcomes. Results indicate that for most institutions developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program required knowledge creation and the building of new inclusive processes. Common elements of effective practice, namely those which offered consistently superior outcomes, included: inclusive processes; embedded graduate attributes throughout a program; alongside consistent and appropriate assessment. Results indicate that assurance of learning processes are proliferating nationally while quality of teaching and learning outcomes and in the processes for assuring it is increasing as a result.

Higher education for capacity development or revenue maximisation? Lessons from transnational higher education programs at two Indonesian universities

HE has been changing rapidly due to globalisation that has increased the interconnectedness between nations and people throughout the world (Mok, 2012). As HE has manifested into different forms and governed by competing rationales in recent years, this paper focuses on transnational HE, which is an example of the interconnectedness of universities beyond the national borders. Indonesia is also influenced by the above changes. It took part in free-trade agreements that include HE as a sector to be liberated and accessed by international providers (Nizam, 2006). Indonesian universities found themselves bracing for the global competition for students and simultaneously having to improve their quality in order to survive amidst the growing competition. This competition gave birth to joint transnational HE programs with overseas partners among many Indonesian universities (Macaranas, 2010).

Satisfiers and dissatisfiers for international students of higher education : an exploratory study in Australia

This paper explores the main satisfiers and dissatisfiers for international students in Australia’s higher educational sector. Using a critical incident technique, this study is conducted with international students of higher education in Australia. Four categories of satisfiers and dissatisfiers emerge from the data which are related to individual performance, quality of the educational service, socialisation, and living conditions.

ICT shared services in the higher education sector : foundations, benefits, success factors and issues

Universities are more and more challenged by the emerging global higher education market, facilitated by advances in Information and Communication Technologies (ICT). This requires them to reconsider their mission and direction in order to function effectively and efficiently, and to be responsive to changes in their environment. In the face of increasing demands and competitive pressures, Universities like other companies, seek to continuously innovate and improve their performance. Universities are considering co-operating or sharing, both internally and externally, in a wide range of areas to achieve cost effectiveness and improvements in performance. Shared services are an effective model for re-organizing to reduce costs, increase quality and create new capabilities. Shared services are not limited to the Higher Education (HE) sector. Organizations across different sectors are adopting shared services, in particular for support functions such as Finance, Accounting, Human Resources and Information Technology. While shared services has been around for more than three decades, commencing in the 1970’s in the banking sector and then been adopted by other sectors, it is an under researched domain, with little consensus on the most fundamental issues even as basic as defining what shared services is. Moreover, the interest in shared services within Higher Education is a global phenomenon. This study on shared services is situated within the Higher Education Sector of Malaysia, and originated as an outcome resulting from a national project (2005 – 2007) conducted by the Ministry of Higher Education (MOHE) entitled "Knowledge, Information Communication Technology Strategic Plan (KICTSP) for Malaysian Public Higher Education"- where progress towards more collaborations via shared services was a key recommendation. The study’s primary objective was to understand the nature and potential for ICT shared services, in particular in the Malaysian HE sector; by laying a foundation in terms of definition, typologies and research agenda and deriving theoretically based conceptualisations of the potential benefits of shared services, success factors and issues of pursuing shared services. The study embarked on this objective with a literature review and pilot case study as a means to further define the context of the study, given the current under-researched status of ICT shared services and of shared services in Higher Education. This context definition phase illustrated a range of unaddressed issues; including a lack of common understanding of what shared services are, how they are formed, what objectives they full fill, who is involved etc. The study thus embarked on a further investigation of a more foundational nature with an exploratory phase that aimed to address these gaps, where a detailed archival analysis of shared services literature within the IS context was conducted to better understand shared services from an IS perspective. The IS literature on shared services was analysed in depth to report on the current status of shared services research in the IS domain; in particular definitions, objectives, stakeholders, the notion of sharing, theories used, and research methods applied were analysed, which provided a firmer base to this study’s design. The study also conducted a detailed content analysis of 36 cases (globally) of shared services implementations in the HE sector to better understand how shared services are structured within the HE sector and what is been shared. The results of the context definition phase and exploratory phase formed a firm basis in the multiple case studies phase which was designed to address the primary goals of this study (as presented above). Three case sites within the Malaysian HE sector was included in this analysis, resulting in empirically supported theoretical conceptualizations of shared services success factors, issues and benefits. A range of contributions are made through this study. First, the detailed archival analysis of shared services in Information Systems (IS) demonstrated the dearth of research on shared services within Information Systems. While the existing literature was synthesised to contribute towards an improved understanding of shared services in the IS domain, the areas that are yet under-developed and requires further exploration is identified and presented as a proposed research agenda for the field. This study also provides theoretical considerations and methodological guidelines to support the research agenda; to conduct better empirical research in this domain. A number of literatures based a priori frameworks (i.e. on the forms of sharing and shared services stakeholders etc) are derived in this phase, contributing to practice and research with early conceptualisations of critical aspects of shared services. Furthermore, the comprehensive archival analysis design presented and executed here is an exemplary approach of a systematic, pre-defined and tool-supported method to extract, analyse and report literature, and is documented as guidelines that can be applied for other similar literature analysis, with particular attention to supporting novice researchers. Second, the content analysis of 36 shared services initiatives in the Higher Education sector presented eight different types of structural arrangements for shared services, as observed in practice, and the salient dimensions along which those types can be usefully differentiated. Each of the eight structural arrangement types are defined and demonstrated through case examples, with further descriptive details and insights to what is shared and how the sharing occurs. This typology, grounded on secondary empirical evidence, can serve as a useful analytical tool for researchers investigating the shared services phenomenon further, and for practitioners considering the introduction or further development of shared services. Finally, the multiple case studies conducted in the Malaysian Higher Education sector, provided further empirical basis to instantiate the conceptual frameworks and typology derived from the prior phases and develops an empirically supported: (i) framework of issues and challenges, (ii) a preliminary theory of shared services success, and (iii) a benefits framework, for shared services in the Higher Education sector.

Information literacy : a theoretical framework for higher education

Information literacy has been a significant issue in the library community for many years. It is now being recognised as an important issue by the higher education community. This theoretical framework draws together important elements of the information literacy agenda specifically for tertiary educators and administrators. The frame-work examines three areas of primary concern: the possible outcomes of information literacy education (through outlining the characteristics of information literate people); the nature of information literacy education; and the potential role of stake-holders (including information services, faculty, staff developers and learning counsellors) in helping staff and students to be information literate. This theoretical framework forms part of the Griffith University Information Literacy Blueprint. The Blueprint was designed between June and August of 1994. The project, a quality initiative of the Division of Information Services, was led by Janice Rickards, University Librarian.

New media and the transformation of higher education

One set of public institutions that has seen growing discussion about the transformative impact of new media technologies has been universities. The higher education sector, historically one of the more venerable and stable areas of public life, is now the subject of almost continuous speculation about whether it can continue in its current form during the 21st century. Digital media technologies are often seen as being at the forefront of such changes. It has been widely noted that moves towards a knowledge economy generates ‘skills-biased technological change’, that places a premium upon higher education qualifications, and that this earnings gap remains despite the continuing increase in the number of university graduates. As the demand for higher education continues to grow worldwide, there are new discussions about whether technologically-mediated education through new forms such as Massively Open Online Courses (MOOCs) are broadening access to quality learning, or severing the vital connection between teacher and student seen as integral to the learning process. This paper critically appraises such debates in the context of early 21st century higher education. It will discuss ten drivers of change in higher education, many of which are related to themes discussed elsewhere in this book, such as the impact of social media, globalization, and a knowledge economy. It will also consider the issues raised in navigating such developments from the perspective of the ‘Five P’s’: practical issues; personal issues; pedagogical issues; policy issues; and philosophical issues. It also includes a critical evaluation of MOOCs from the point of view of their educational qualities. It will conclude with the observation that while universities will continue to play a significant – and perhaps growing – role in the economy, society and culture, the issues raised about what Clayton Christensen and Henry Eyring term the ‘disruptive university’ (Christensen and Eyring 2011) are nonetheless pressing ones, and that cost and policy pressures in particular are likely to generate significant institutional transformations in higher education worldwide.

Establishing a framework for transforming student engagement, success and retention in higher education institutions [Final Report]

The perennial issues of student engagement, success and retention (SESR) in higher education continue to attract attention as key indicators of learning and teaching quality. This project aimed to establish and provide a holistic framework that would allow higher education institutions (HEIs) manage and improve their student engagement and retention strategies and programs. The framework and main project deliverable is a Maturity Model (MM) for Student Engagement, Success and Retention (SESR-MM). The project involved three Australian universities with experience and reputations in SESR activities: Queensland University of Technology (lead institution), the University of Queensland and Griffith University, working cooperatively to develop and trial the project deliverables. Project findings suggest that the SESR-MM has the potential to positively transform the holistic—academic, social and personal—engagement experiences of students in Australian universities, and that the SESR-MM is a useful mechanism for sharing good practice and improving programs designed to enhance the student experience.

From policy borrowing to implementation : an illuminative evaluation of learning and teaching in higher education in Australia (2002 to 2008)

This study documents and theorises the consequences of the 2003 Australian Government Reform Package focussed on learning and teaching in Higher Education during the period 2002 to 2008. This is achieved through the perspective of program evaluation and the methodology of illuminative evaluation. The findings suggest that the three national initiatives of that time, Learning and Teaching Performance Fund (LTPF), Australian Learning and Teaching Council (ALTC), and Australian Universities Quality Agency (AUQA), were successful in repositioning learning and teaching as a core activity in universities. However, there were unintended consequences brought about by international policy borrowing, when the short-lived nature of LTPF suggests a legacy of quality compliance rather than one of quality enrichment.

Leadership Enabling Effective Pedagogic Change in Higher Education

This chapter will consider pedagogic change in Higher Education from the perspective of an Assistant Dean (Teaching and Learning) and one member of their leadership team with particular focus on reflective writing in their courses. The discussion will focus on leadership for the development of teaching capability for reflective writing development and implications for quality assurance of teaching and learning across faculties of a leading comprehensive University. The authors will present and contrast the experiences and challenges of developing teaching approaches for reflective writing across the discipline of teacher education. The chapter will argue a position for the establishment of a framework of distributed leadership that supports effective pedagogical change management generally and with specific reference to reflective writing.

Moderation in higher education: Four discourses

Across the globe, higher education institutions are working in environments of increasing accountability with little sign of this trend abating. This heightened focus on accountability has placed greater demands on institutions to provide evidence of quality and the achievement of standards that assure that quality. Moderation is one quality assurance process that plays a central role in the teaching, learning and assessment cycle in higher education institutions. While there is a growing body of research globally on teaching, learning and , to a lesser degree, assessment in higher education, the process of moderation has received even less attention (Watty, Freeman, Howieson, Hancock, O'Connell, et al. 2013). Until recently, moderation processes in Australian universities have been typically located within individual institutions, with universities given the responsibility for developing their own specific policies and practices. However, in 2009 the Australian Government announced that an independent national quality and regulatory body for higher education institutions would be established. With the introduction of the Tertiary Education Quality Standards Authority (TEQSA), more formalised requirements for moderation of assessment are being mandated. In light of these reforms, the purpose of this qualitative study was to identify and investigate current moderation practices operating within one faculty, the Faculty of Education, in a large urban university in eastern Australia. The findings of this study revealed four discourses of moderation: equity, justification, community building and accountability. These discourses provide a starting point for academics to engage in substantive conversations around assessment and to further critique the processes of moderation.

An investigation into students' motivation to learn English in higher education in Vietnam

This mixed-methods research explored students' motivation to learn English in an attempt to enhance the quality of teaching and learning English in Vietnamese higher education. An intricate picture of students' motivation was revealed: motivation to learn English to gain pragmatic benefits, to satisfy internal aspirations, and in response to external pressures. Students expressed that feeling connected with significant people (lecturers, peers and parents) enhanced their motivation to learn English. This research has significance at both practical and theoretical levels as it provides important insights into the teaching and learning English in Vietnamese higher education and the literature of second language learning motivation.

“There’s nothing standard about standards”: Exploring tensions between two standards documents in higher education

Quality in education at the tertiary level is constantly questioned, and increasingly “professional standards” are offered as the solution to the perceived decline in quality. Foucauldian archaeological analysis of teacher graduate and geography graduate standards in Australia is conducted, revealing tensions between the different document sets. Teacher graduate standards reflect two discourses (one of knowledge and understanding, and one of skills) that are anti-intellectual and based on jargon and formulaic prescriptions. In contrast, disciplinary standards give primacy to geography as an intellectual inquiry such that its knowledge and understanding, skills, and concepts lead to progressively higher order thinking in graduates.