REFRAME: a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

Purposes of transnational higher education programs : lessons from two Indonesian universities

While intended to facilitate knowledge transfer from international universities and develop Indonesian universities’ capacity, transnational higher education programs (TEPs) in Indonesia have been criticised for operating merely as an international trade in education – implying discrepancy between the rhetoric and reality surrounding the key purposes for establishing TEPs among Indonesian universities. This case study seeks to ascertain what actually drives Indonesian universities to operate the TEPs. Interview and document data from two private Indonesian universities were thematically analysed to identify the key purposes for establishing TEPs in light of the conflicting global–national–local agendas and unequal power relations between TEP partners. The findings suggest the Indonesian universities actively advanced their particular institutional purposes within the Indonesian national agenda and negotiate mutually beneficial outcomes with their global partners. This study informs other universities to devise clear purposes and expectations in managing TEPs to avoid functioning merely as student recruitment pathways for international partners.

Educating for digital futures : what the learning strategies of digital content professionals can teach higher education

Beginning in the second half of the 20th century, ICTs transformed many societies from industrial societies in which manufacturing was the central focus, into knowledge societies in which dealing effectively with data and information has become a central element of work (Anderson, 2008). To meet the needs of the knowledge society, universities must reinvent their structures and processes, their curricula and pedagogic practices. In addition to this, of course higher education is itself subject to the sweeping influence of ICTs. But what might effective higher education look like in the 21st century? In designing higher education systems and learning experiences which are responsive to the learning needs of the future and exploit the possibilities offered by ICTs, we can learn much from the existing professional development strategies of people who are already successful in 21st century fields, such as digital media. In this study, I ask: (1) what are the learning challenges faced by digital media professionals in the 21st century? (2) what are the various roles of formal and informal education in their professional learning strategies at present? (3) how do they prefer to acquire needed capabilities? In-depth interviews were undertaken with successful Australian digital media professionals working in micro businesses and SMEs to answer these questions. The strongest thematic grouping that emerged from the interviews related to the need for continual learning and relearning because of the sheer rate of change in the digital media industries. Four dialectical relationships became apparent from the interviewees’ commentaries around the learning imperatives arising out of the immense and continual changes occurring in the digital content industries: (1) currency vs best practice (2) diversification vs specialisation of products and services (3) creative outputs vs commercial outcomes (4) more learning opportunities vs less opportunity to learn. These findings point to the importance of ‘learning how to learn’ as a 21st century capability. The interviewees were ambivalent about university courses as preparation for professional life in their fields. Higher education was described by several interviewees as having relatively little value-add beyond what one described as “really expensive credentialling services.” For all interviewees in this study, informal learning strategies were the preferred methods of acquiring the majority of knowledge and skills, both for ongoing and initial professional development. Informal learning has no ‘curriculum’ per se, and tends to be opportunistic, unstructured, pedagogically agile and far more self-directed than formal learning (Eraut, 2004). In an industry impacted by constant change, informal learning is clearly both essential and ubiquitous. Inspired by the professional development strategies of the digital media professionals in this study, I propose a 21st century model of the university as a broad, open learning ecology, which also includes industry, professionals, users, and university researchers. If created and managed appropriately, the university learning network becomes the conduit and knowledge integrator for the latest research and industry trends, which students and professionals alike can access as needed.

A higher education quality assurance model for small states : the Maldives case study

Increasing globalisation and local expansion of Higher Education presents challenges to manage quality of the education services. This study investigated key stakeholders' perspectives on what constitutes key elements and attributes of an effective Quality Assurance (QA) system in Higher Education. The findings highlighted the need for: i) legislation to support a strong QA regulatory framework, ii) independence of the QA agency, iii) development of minimum quality standards through broad stakeholder involvement, and iv) a cyclical approach. The findings of this study proposed a QA model which has implications for strengthening of HE QA systems of Small State.

The potential of combining phenomenography, variation theory and threshold concepts to inform curriculum design in higher education

This chapter describes an innovative method of curriculum design that is based on combining phenomenographic research, and the associated variation theory of learning, with the notion of disciplinary threshold concepts to focus specialised design attention on the most significant and difficult parts of the curriculum. The method involves three primary stages: (i) identification of disciplinary concepts worthy of intensive curriculum design attention, using the criteria for threshold concepts; (ii) action research into variation in students’ understandings/misunderstandings of those concepts, using phenomenography as the research approach; (iii) design of learning activities to address the poorer understandings identified in the second stage, using variation theory as a guiding framework. The curriculum design method is inherently theory and evidence based. It was developed and trialed during a two-year project funded by the Australian Learning and Teaching Council, using physics and law disciplines as case studies. Disciplinary teachers’ perceptions of the impact of the method on their teaching and understanding of student learning were profound. Attempts to measure the impact on student learning were less conclusive; teachers often unintentionally deviated from the design when putting it into practice for the first time. Suggestions for improved implementation of the method are discussed.

Realigning capital portfolios : international students' educational experiences in higher education

This paper reports on first year experiences of international students who use English as an additional language (EAL) in higher education in Australia. It examines how valued resources can foster a positive educational experience of these students from sociological perspectives. It draws data from an interview study, exploring narrative accounts of 17 EAL international students from nine countries about their educational relations and strategies across their first year of study. Their narratives were analysed through Bourdieu's concepts of field, habitus, capital and legitimation, as well as tools of narrative inquiry. The paper finds that the students took up strategies to realign their capital portfolios with new rules of the game. Their decisions were dependent on their personal trajectories and conditions on offer. This paper suggests that more effort needs to be made to understand international students' differentiated access to valued resources in higher education.

Possible, inevitable or fait accompli? An analysis of streaming video acquisition, acceptance and use in higher education

This paper explores the potential for online video as a mechanism to transform the ways students learn, as measured by research, user experience and usage following surveys and trials of patron-driven acquisition collaboratively undertaken by Queensland University of Technology, La Trobe University and Kanopy.

A little learning is a dangerous thing? The ethics of teaching accidental tourists in higher education

This paper raises questions about the ethical issues that arise for academics and universities when under-graduate students enrol in classes outside of their discipline - classes that are not designed to be multi-disciplinary or introductory. We term these students ‘accidental tourists'. Differences between disciplines in terms of pedagogy, norms, language and understanding may pose challenges for accidental tourists in achieving desired learning outcomes. This paper begins a discussion about whether lecturers and universities have any ethical obligations towards supporting the learning of these students. Recognising that engaging with only one ethical theory leads to a fragmented moral vision, this paper employs a variety of ethical theories to examine any possible moral obligations that may fall upon lecturers and/or universities. In regards to lecturers, the paper critically engages with the ethical theories of utilitarianism, Kantianism and virtue ethics (Aristotle) to determine the extent of any academic duty to accidental tourists. In relation to universities, this paper employs the emerging ethical theory of organisational ethics as a lens through which to critically examine any possible obligations. Organisational ethics stems from the recognition that moral demands also exist for organisations so organisations must be reconceptualised as ethical actors and their policies and practices subject to ethical scrutiny. The analysis in this paper illustrates the challenges faced by lecturers some of whom, we theorise, may experience a form of moral distress facing a conflict between personal beliefs and organisational requirements. It also critically examines the role and responsibilities of universities towards students and towards their staff and the inherent moral tensions between a market model and demands for ‘good' learning experiences. This paper highlights the tensions for academics, between academics and universities and within university policy and indicates the need for greater reflection about this issue, especially given the many constraints facing lecturers and universities.

Establishing a framework for transforming student engagement, success and retention in higher education institutions [Final Report]

The perennial issues of student engagement, success and retention (SESR) in higher education continue to attract attention as key indicators of learning and teaching quality. This project aimed to establish and provide a holistic framework that would allow higher education institutions (HEIs) manage and improve their student engagement and retention strategies and programs. The framework and main project deliverable is a Maturity Model (MM) for Student Engagement, Success and Retention (SESR-MM). The project involved three Australian universities with experience and reputations in SESR activities: Queensland University of Technology (lead institution), the University of Queensland and Griffith University, working cooperatively to develop and trial the project deliverables. Project findings suggest that the SESR-MM has the potential to positively transform the holistic—academic, social and personal—engagement experiences of students in Australian universities, and that the SESR-MM is a useful mechanism for sharing good practice and improving programs designed to enhance the student experience.

Developing a culture to support peer review of teaching in higher education

This presentation addresses issues related to leadership, academic development and scholarship of teaching and learning, and highlights research funded by the Australian Office of Learning and Teaching (OLT) designed to embed and sustain peer review of teaching within the culture of 5 Australian universities: Queensland University of Technology, University of Technology, Sydney, University of Adelaide, Curtin University, and Charles Darwin University. Peer review of teaching in higher education will be emphasised as a professional process for providing feedback on teaching and learning practice, which if sustained, can become an effective ongoing strategy for academic development (Barnard et al, 2011; Bell, 2005; Bolt and Atkinson, 2010; McGill & Beaty 2001, 1992; Kemmis & McTaggart, 2000). The research affirms that using developmental peer review models (Barnard et al, 2011; D'Andrea, 2002; Hammersley-Fletcher & Orsmond, 2004) can bring about successful implementation, especially when implemented within a distributive leadership framework (Spillane & Healey, 2010). The project’s aims and objectives were to develop leadership capacity and integrate peer review as a cultural practice in higher education. The research design was a two stage inquiry process over 2 years. The project began in July 2011 and encompassed a development and pilot phase followed by a cascade phase with questionnaire and focus group evaluation processes to support ongoing improvement and measures of outcome. Leadership development activities included locally delivered workshops complemented by the identification and support of champions. To optimise long term sustainability, the project was implemented through existing learning and teaching structures and processes within the respective partner universities. Research outcomes highlight the fundamentals of peer review of teaching and the broader contextual elements of integration, leadership and development, expressed as a conceptual model for embedding peer review of teaching within higher education. The research opens a communicative space about introduction of peer review that goes further than simply espousing its worth and introduction. The conceptual model highlights the importance of development of distributive leadership capacity, integration of policies and processes, and understanding the values, beliefs, assumptions and behaviors embedded in an organizational culture. The presentation overviews empirical findings that demonstrate progress to advance peer review requires an ‘across-the-board’ commitment to embed change, and inherently demands a process that co-creates connection across colleagues, discipline groups, and the university sector. Progress toward peer review of teaching as a cultural phenomenon can be achieved and has advantages for academic staff, scholarship, teaching evaluation and an organisation, if attention is given to strategies that influence the contexts and cultures of teaching practice. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment and has a focus on scholarship of teaching. The work is ongoing and has implication for policy, research, teaching development and student outcomes, and has potential application world-wide.

Higher Education and Sustainable Development : A Model for Curriculum Renewal

Responding to the global and unprecedented challenge of capacity building for twenty-first century life, this book is a practical guide for tertiary education institutions to quickly and effectively renew the curriculum towards education for sustainable development. The book begins by exploring why curriculum change has been so slow. It then describes a model for rapid curriculum renewal, highlighting the important roles of setting timeframes, formal and informal leadership, and key components and action strategies. The second part of the book provides detailed coverage of six core elements that have been trialled and peer reviewed by institutions around the world: - raising awareness among staff and students - mapping graduate attributes - auditing the curriculum - developing niche degrees, flagship courses and fully integrated programs - engaging and catalysing community and student markets - integrating curriculum with green campus operations. With input from more than seventy academics and grounded in engineering education experiences, this book will provide academic staff with tools and insights to rapidly align program offerings with the needs of present and future generations of students.

Educating for digital futures : what the learning strategies of digital media professionals can teach higher education

This article explores how universities might engage more effectively with the imperative to develop students’ 21st century skills for the information society, by examining learning challenges and professional learning strategies of successful digital media professionals. The findings of qualitative interviews with professionals from Australian games, online publishing, apps and software development companies reinforce an increasing body of literature that suggests that legacy university structures and pedagogical approaches are not conducive to learning for professional capability in the digital age. Study participants were ambivalent about the value of higher education to digital careers, in general preferring a range of situated online and face-to-face social learning strategies for professional currency. This article draws upon the learning preferences of the professionals in this study to present a model of 21st century learning, as linked with extant theory relating to informal, self-determined learning and communities of practice.

Shaping lecturers’ beliefs about teaching and learning in higher education in the Pacific

The aim of this study was to describe the educational experiences shaping the teaching and learning beliefs held by a group of beginning lecturers in higher education at various tertiary institutions in the Pacific Island Countries (PICs). A total of sixty three essays written by participants in an online course on teaching in higher education comprised the data for the study. A modified version of narrative analysis was used. This is a powerful methodology in qualitative research that can provide remarkable insights into individuals’ beliefs. The critical experiences that were thought to shape their beliefs in teaching and learning were identified and discussed in the light of relevant literature. The participants described a range of influences that shaped their beliefs about teaching and learning including realisation about the need to work harder and know more, the importance of independence, support systems, curriculum, qualities of a teacher, teaching and learning process, teaching and learning strategies, and learning environments. This information was useful in teaching these students and for further courses.

‘I now know I can do this now’: Indigenous women and writing in the Australian higher education sector

This paper explores the challenges of writing and publishing faced by Indigenous women who work in the Australian higher education sector. It demonstrates that Indigenous women are under-represented in the academy and argues that Indigenous styles of writing are typically not valued for broader publication. The authors describe a writing mentoring and support program specifically developed for Indigenous academic women in Australia. The Tiddas Writin’ Up Workshop provided a safe and culturally-appropriate space for women to learn about academic writing and develop their writing skills. The workshop led to the publication of a special issue of the Journal of Australian Indigenous Issues – known as the Tiddas Collection. The authors highlight the power and strength of well-developed support programs to address skills development, confidence, inequities and under-representation of Indigenous women within the higher education workforce.