The place of higher education institutions in assessing student engagement, success and retention : a maturity model to guide practice

The perennial issues of student engagement, success and retention in higher education continue to attract attention as the salience of teaching and learning funding and performance measures has increased. This paper addresses the question of the responsibility or place of higher education institutions (HEIs) for initiating, planning, managing and evaluating their student engagement, success and retention programs and strategies. An evaluation of the current situation indicates the need for a sophisticated approach to assessing the ability of HEIs to proactively design programs and practices that enhance student engagement. An approach—the Student Engagement Success and Retention Maturity Model (SESR-MM)—is proposed and its development, current status, and relationship with and possible use in benchmarking are discussed.

REFRAME : a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

ICT shared services in the higher education sector : foundations, benefits, success factors and issues

Universities are more and more challenged by the emerging global higher education market, facilitated by advances in Information and Communication Technologies (ICT). This requires them to reconsider their mission and direction in order to function effectively and efficiently, and to be responsive to changes in their environment. In the face of increasing demands and competitive pressures, Universities like other companies, seek to continuously innovate and improve their performance. Universities are considering co-operating or sharing, both internally and externally, in a wide range of areas to achieve cost effectiveness and improvements in performance. Shared services are an effective model for re-organizing to reduce costs, increase quality and create new capabilities. Shared services are not limited to the Higher Education (HE) sector. Organizations across different sectors are adopting shared services, in particular for support functions such as Finance, Accounting, Human Resources and Information Technology. While shared services has been around for more than three decades, commencing in the 1970’s in the banking sector and then been adopted by other sectors, it is an under researched domain, with little consensus on the most fundamental issues even as basic as defining what shared services is. Moreover, the interest in shared services within Higher Education is a global phenomenon. This study on shared services is situated within the Higher Education Sector of Malaysia, and originated as an outcome resulting from a national project (2005 – 2007) conducted by the Ministry of Higher Education (MOHE) entitled "Knowledge, Information Communication Technology Strategic Plan (KICTSP) for Malaysian Public Higher Education"- where progress towards more collaborations via shared services was a key recommendation. The study’s primary objective was to understand the nature and potential for ICT shared services, in particular in the Malaysian HE sector; by laying a foundation in terms of definition, typologies and research agenda and deriving theoretically based conceptualisations of the potential benefits of shared services, success factors and issues of pursuing shared services. The study embarked on this objective with a literature review and pilot case study as a means to further define the context of the study, given the current under-researched status of ICT shared services and of shared services in Higher Education. This context definition phase illustrated a range of unaddressed issues; including a lack of common understanding of what shared services are, how they are formed, what objectives they full fill, who is involved etc. The study thus embarked on a further investigation of a more foundational nature with an exploratory phase that aimed to address these gaps, where a detailed archival analysis of shared services literature within the IS context was conducted to better understand shared services from an IS perspective. The IS literature on shared services was analysed in depth to report on the current status of shared services research in the IS domain; in particular definitions, objectives, stakeholders, the notion of sharing, theories used, and research methods applied were analysed, which provided a firmer base to this study’s design. The study also conducted a detailed content analysis of 36 cases (globally) of shared services implementations in the HE sector to better understand how shared services are structured within the HE sector and what is been shared. The results of the context definition phase and exploratory phase formed a firm basis in the multiple case studies phase which was designed to address the primary goals of this study (as presented above). Three case sites within the Malaysian HE sector was included in this analysis, resulting in empirically supported theoretical conceptualizations of shared services success factors, issues and benefits. A range of contributions are made through this study. First, the detailed archival analysis of shared services in Information Systems (IS) demonstrated the dearth of research on shared services within Information Systems. While the existing literature was synthesised to contribute towards an improved understanding of shared services in the IS domain, the areas that are yet under-developed and requires further exploration is identified and presented as a proposed research agenda for the field. This study also provides theoretical considerations and methodological guidelines to support the research agenda; to conduct better empirical research in this domain. A number of literatures based a priori frameworks (i.e. on the forms of sharing and shared services stakeholders etc) are derived in this phase, contributing to practice and research with early conceptualisations of critical aspects of shared services. Furthermore, the comprehensive archival analysis design presented and executed here is an exemplary approach of a systematic, pre-defined and tool-supported method to extract, analyse and report literature, and is documented as guidelines that can be applied for other similar literature analysis, with particular attention to supporting novice researchers. Second, the content analysis of 36 shared services initiatives in the Higher Education sector presented eight different types of structural arrangements for shared services, as observed in practice, and the salient dimensions along which those types can be usefully differentiated. Each of the eight structural arrangement types are defined and demonstrated through case examples, with further descriptive details and insights to what is shared and how the sharing occurs. This typology, grounded on secondary empirical evidence, can serve as a useful analytical tool for researchers investigating the shared services phenomenon further, and for practitioners considering the introduction or further development of shared services. Finally, the multiple case studies conducted in the Malaysian Higher Education sector, provided further empirical basis to instantiate the conceptual frameworks and typology derived from the prior phases and develops an empirically supported: (i) framework of issues and challenges, (ii) a preliminary theory of shared services success, and (iii) a benefits framework, for shared services in the Higher Education sector.

New media and the transformation of higher education

One set of public institutions that has seen growing discussion about the transformative impact of new media technologies has been universities. The higher education sector, historically one of the more venerable and stable areas of public life, is now the subject of almost continuous speculation about whether it can continue in its current form during the 21st century. Digital media technologies are often seen as being at the forefront of such changes. It has been widely noted that moves towards a knowledge economy generates ‘skills-biased technological change’, that places a premium upon higher education qualifications, and that this earnings gap remains despite the continuing increase in the number of university graduates. As the demand for higher education continues to grow worldwide, there are new discussions about whether technologically-mediated education through new forms such as Massively Open Online Courses (MOOCs) are broadening access to quality learning, or severing the vital connection between teacher and student seen as integral to the learning process. This paper critically appraises such debates in the context of early 21st century higher education. It will discuss ten drivers of change in higher education, many of which are related to themes discussed elsewhere in this book, such as the impact of social media, globalization, and a knowledge economy. It will also consider the issues raised in navigating such developments from the perspective of the ‘Five P’s’: practical issues; personal issues; pedagogical issues; policy issues; and philosophical issues. It also includes a critical evaluation of MOOCs from the point of view of their educational qualities. It will conclude with the observation that while universities will continue to play a significant – and perhaps growing – role in the economy, society and culture, the issues raised about what Clayton Christensen and Henry Eyring term the ‘disruptive university’ (Christensen and Eyring 2011) are nonetheless pressing ones, and that cost and policy pressures in particular are likely to generate significant institutional transformations in higher education worldwide.

Mixing higher education teaching and learning with mobile devices and social media

The use of mobile devices and social media technologies are becoming all-pervasive in society: they are both transformative and constant. The high levels of mobile device ownership and increased access to social media technologies enables the potential for ‘anytime, anywhere’ cooperation and collaboration in education. While recent reports into emerging technologies in higher education predict an increase in the use of mobile devices and social media technologies (Horizon Report, 2013), there is a lack of theory-based research to indicate how these technologies can be most effectively harnessed to support and enhance student learning and what the impacts of these technologies are on both students and educators. In response to the need to understand how these technologies can be better embraced within higher education, this study investigated how first year education students used mobile devices and social media technologies. More specifically, the study identified how students spent most of their time when connected online with mobile devices and social media technologies and whether the online connected time engaged them in their learning or whether it was a distraction.

Virtual worlds in Australian and New Zealand higher education : remembering the past, understanding the present and imagining the future

3D virtual reality, including the current generation of multi-user virtual worlds, has had a long history of use in education and training, and it experienced a surge of renewed interest with the advent of Second Life in 2003. What followed shortly after were several years marked by considerable hype around the use of virtual worlds for teaching, learning and research in higher education. For the moment, uptake of the technology seems to have plateaued, with academics either maintaining the status quo and continuing to use virtual worlds as they have previously done or choosing to opt out altogether. This paper presents a brief review of the use of virtual worlds in the Australian and New Zealand higher education sector in the past and reports on its use in the sector at the present time, based on input from members of the Australian and New Zealand Virtual Worlds Working Group. It then adopts a forward-looking perspective amid the current climate of uncertainty, musing on future directions and offering suggestions for potential new applications in light of recent technological developments and innovations in the area.

REFRAME: a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

A higher education quality assurance model for small states : the Maldives case study

Increasing globalisation and local expansion of Higher Education presents challenges to manage quality of the education services. This study investigated key stakeholders' perspectives on what constitutes key elements and attributes of an effective Quality Assurance (QA) system in Higher Education. The findings highlighted the need for: i) legislation to support a strong QA regulatory framework, ii) independence of the QA agency, iii) development of minimum quality standards through broad stakeholder involvement, and iv) a cyclical approach. The findings of this study proposed a QA model which has implications for strengthening of HE QA systems of Small State.

The potential of combining phenomenography, variation theory and threshold concepts to inform curriculum design in higher education

This chapter describes an innovative method of curriculum design that is based on combining phenomenographic research, and the associated variation theory of learning, with the notion of disciplinary threshold concepts to focus specialised design attention on the most significant and difficult parts of the curriculum. The method involves three primary stages: (i) identification of disciplinary concepts worthy of intensive curriculum design attention, using the criteria for threshold concepts; (ii) action research into variation in students’ understandings/misunderstandings of those concepts, using phenomenography as the research approach; (iii) design of learning activities to address the poorer understandings identified in the second stage, using variation theory as a guiding framework. The curriculum design method is inherently theory and evidence based. It was developed and trialed during a two-year project funded by the Australian Learning and Teaching Council, using physics and law disciplines as case studies. Disciplinary teachers’ perceptions of the impact of the method on their teaching and understanding of student learning were profound. Attempts to measure the impact on student learning were less conclusive; teachers often unintentionally deviated from the design when putting it into practice for the first time. Suggestions for improved implementation of the method are discussed.

University Students Depression Inventory : measurement model and psychometric properties

Depression is a serious condition that impacts the academic success and emotional well-being of the university students globally. Keeping in view the debilitating nature of this condition, the present study examined the stability of the factor structure and psychometric properties of the University Student Depression Inventory (USDI; Khawaja and Bryden, 2006). There is a need to translate and validate the scale for Persian speaking students, who live in Iran, its neighboring countries and in many other Western countries. The scale was translated into the Persian language and was used as part of a battery consisting of the scales measuring suicide, depression, stress, happiness and academic achievement. The battery was administered to 359 undergraduate students, and an additional 150 students who had been referred to the mental health center of the University of Tehran as clinical sample. Confirmatory factor analysis upheld the original three-factor structure. The results exhibited internal consistency, test-retest reliability, convergent, and divergent validity, and discriminant validity. There were gender differences and male had higher mean scores on Lethargy, Cognitive\emotion, and Academic motivation subscales than female students. Findings supported the Persian version of the USDI for cross-cultural use as a valid and reliable measure in the diagnosis of depression.

Desert harmony : stories of collaboration between Indigenous musicians and university students

This article will discuss the ways in which community service learning programs in music can foster meaningful collaborations between universities and Indigenous communities. Drawing on recent pedagogical literature on service learning and insights from a four-year partnership between Australian Indigenous musicians at the Winanjjikari Music Centre in Tennant Creek and music students from Queensland Conservatorium Griffith University, it will describe how such programs can facilitate significant cross-cultural exchanges between students and Indigenous communities. By drawing on observations and interview data from those involved in the project, this paper argues that these partnerships can both assist communities with activities such as cultural maintenance, and provide students with intercultural experiences that have the potential to transform their understandings of Indigenous culture.

Developing a culture to support peer review of teaching in higher education

This presentation addresses issues related to leadership, academic development and scholarship of teaching and learning, and highlights research funded by the Australian Office of Learning and Teaching (OLT) designed to embed and sustain peer review of teaching within the culture of 5 Australian universities: Queensland University of Technology, University of Technology, Sydney, University of Adelaide, Curtin University, and Charles Darwin University. Peer review of teaching in higher education will be emphasised as a professional process for providing feedback on teaching and learning practice, which if sustained, can become an effective ongoing strategy for academic development (Barnard et al, 2011; Bell, 2005; Bolt and Atkinson, 2010; McGill & Beaty 2001, 1992; Kemmis & McTaggart, 2000). The research affirms that using developmental peer review models (Barnard et al, 2011; D'Andrea, 2002; Hammersley-Fletcher & Orsmond, 2004) can bring about successful implementation, especially when implemented within a distributive leadership framework (Spillane & Healey, 2010). The project’s aims and objectives were to develop leadership capacity and integrate peer review as a cultural practice in higher education. The research design was a two stage inquiry process over 2 years. The project began in July 2011 and encompassed a development and pilot phase followed by a cascade phase with questionnaire and focus group evaluation processes to support ongoing improvement and measures of outcome. Leadership development activities included locally delivered workshops complemented by the identification and support of champions. To optimise long term sustainability, the project was implemented through existing learning and teaching structures and processes within the respective partner universities. Research outcomes highlight the fundamentals of peer review of teaching and the broader contextual elements of integration, leadership and development, expressed as a conceptual model for embedding peer review of teaching within higher education. The research opens a communicative space about introduction of peer review that goes further than simply espousing its worth and introduction. The conceptual model highlights the importance of development of distributive leadership capacity, integration of policies and processes, and understanding the values, beliefs, assumptions and behaviors embedded in an organizational culture. The presentation overviews empirical findings that demonstrate progress to advance peer review requires an ‘across-the-board’ commitment to embed change, and inherently demands a process that co-creates connection across colleagues, discipline groups, and the university sector. Progress toward peer review of teaching as a cultural phenomenon can be achieved and has advantages for academic staff, scholarship, teaching evaluation and an organisation, if attention is given to strategies that influence the contexts and cultures of teaching practice. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment and has a focus on scholarship of teaching. The work is ongoing and has implication for policy, research, teaching development and student outcomes, and has potential application world-wide.

Higher Education and Sustainable Development : A Model for Curriculum Renewal

Responding to the global and unprecedented challenge of capacity building for twenty-first century life, this book is a practical guide for tertiary education institutions to quickly and effectively renew the curriculum towards education for sustainable development. The book begins by exploring why curriculum change has been so slow. It then describes a model for rapid curriculum renewal, highlighting the important roles of setting timeframes, formal and informal leadership, and key components and action strategies. The second part of the book provides detailed coverage of six core elements that have been trialled and peer reviewed by institutions around the world: - raising awareness among staff and students - mapping graduate attributes - auditing the curriculum - developing niche degrees, flagship courses and fully integrated programs - engaging and catalysing community and student markets - integrating curriculum with green campus operations. With input from more than seventy academics and grounded in engineering education experiences, this book will provide academic staff with tools and insights to rapidly align program offerings with the needs of present and future generations of students.

Career mentoring : a career development-enhancing strategy for university students in transition to employment

In 1992 the Queensland University of Technology (QUT) Convocation initiated the Mentor Scheme to assist students to better prepare for the transition to employment. The scheme has developed over the past six years and in 1998 more than 130 pairs of employers and students from 12 different disciplines participated in it. Evaluations indicate the positive impact the scheme has made on both mentors and mentees, particularly in enhancing mentees' career development.

Shaping lecturers’ beliefs about teaching and learning in higher education in the Pacific

The aim of this study was to describe the educational experiences shaping the teaching and learning beliefs held by a group of beginning lecturers in higher education at various tertiary institutions in the Pacific Island Countries (PICs). A total of sixty three essays written by participants in an online course on teaching in higher education comprised the data for the study. A modified version of narrative analysis was used. This is a powerful methodology in qualitative research that can provide remarkable insights into individuals’ beliefs. The critical experiences that were thought to shape their beliefs in teaching and learning were identified and discussed in the light of relevant literature. The participants described a range of influences that shaped their beliefs about teaching and learning including realisation about the need to work harder and know more, the importance of independence, support systems, curriculum, qualities of a teacher, teaching and learning process, teaching and learning strategies, and learning environments. This information was useful in teaching these students and for further courses.