REFRAME : a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

ICT shared services in the higher education sector : foundations, benefits, success factors and issues

Universities are more and more challenged by the emerging global higher education market, facilitated by advances in Information and Communication Technologies (ICT). This requires them to reconsider their mission and direction in order to function effectively and efficiently, and to be responsive to changes in their environment. In the face of increasing demands and competitive pressures, Universities like other companies, seek to continuously innovate and improve their performance. Universities are considering co-operating or sharing, both internally and externally, in a wide range of areas to achieve cost effectiveness and improvements in performance. Shared services are an effective model for re-organizing to reduce costs, increase quality and create new capabilities. Shared services are not limited to the Higher Education (HE) sector. Organizations across different sectors are adopting shared services, in particular for support functions such as Finance, Accounting, Human Resources and Information Technology. While shared services has been around for more than three decades, commencing in the 1970’s in the banking sector and then been adopted by other sectors, it is an under researched domain, with little consensus on the most fundamental issues even as basic as defining what shared services is. Moreover, the interest in shared services within Higher Education is a global phenomenon. This study on shared services is situated within the Higher Education Sector of Malaysia, and originated as an outcome resulting from a national project (2005 – 2007) conducted by the Ministry of Higher Education (MOHE) entitled "Knowledge, Information Communication Technology Strategic Plan (KICTSP) for Malaysian Public Higher Education"- where progress towards more collaborations via shared services was a key recommendation. The study’s primary objective was to understand the nature and potential for ICT shared services, in particular in the Malaysian HE sector; by laying a foundation in terms of definition, typologies and research agenda and deriving theoretically based conceptualisations of the potential benefits of shared services, success factors and issues of pursuing shared services. The study embarked on this objective with a literature review and pilot case study as a means to further define the context of the study, given the current under-researched status of ICT shared services and of shared services in Higher Education. This context definition phase illustrated a range of unaddressed issues; including a lack of common understanding of what shared services are, how they are formed, what objectives they full fill, who is involved etc. The study thus embarked on a further investigation of a more foundational nature with an exploratory phase that aimed to address these gaps, where a detailed archival analysis of shared services literature within the IS context was conducted to better understand shared services from an IS perspective. The IS literature on shared services was analysed in depth to report on the current status of shared services research in the IS domain; in particular definitions, objectives, stakeholders, the notion of sharing, theories used, and research methods applied were analysed, which provided a firmer base to this study’s design. The study also conducted a detailed content analysis of 36 cases (globally) of shared services implementations in the HE sector to better understand how shared services are structured within the HE sector and what is been shared. The results of the context definition phase and exploratory phase formed a firm basis in the multiple case studies phase which was designed to address the primary goals of this study (as presented above). Three case sites within the Malaysian HE sector was included in this analysis, resulting in empirically supported theoretical conceptualizations of shared services success factors, issues and benefits. A range of contributions are made through this study. First, the detailed archival analysis of shared services in Information Systems (IS) demonstrated the dearth of research on shared services within Information Systems. While the existing literature was synthesised to contribute towards an improved understanding of shared services in the IS domain, the areas that are yet under-developed and requires further exploration is identified and presented as a proposed research agenda for the field. This study also provides theoretical considerations and methodological guidelines to support the research agenda; to conduct better empirical research in this domain. A number of literatures based a priori frameworks (i.e. on the forms of sharing and shared services stakeholders etc) are derived in this phase, contributing to practice and research with early conceptualisations of critical aspects of shared services. Furthermore, the comprehensive archival analysis design presented and executed here is an exemplary approach of a systematic, pre-defined and tool-supported method to extract, analyse and report literature, and is documented as guidelines that can be applied for other similar literature analysis, with particular attention to supporting novice researchers. Second, the content analysis of 36 shared services initiatives in the Higher Education sector presented eight different types of structural arrangements for shared services, as observed in practice, and the salient dimensions along which those types can be usefully differentiated. Each of the eight structural arrangement types are defined and demonstrated through case examples, with further descriptive details and insights to what is shared and how the sharing occurs. This typology, grounded on secondary empirical evidence, can serve as a useful analytical tool for researchers investigating the shared services phenomenon further, and for practitioners considering the introduction or further development of shared services. Finally, the multiple case studies conducted in the Malaysian Higher Education sector, provided further empirical basis to instantiate the conceptual frameworks and typology derived from the prior phases and develops an empirically supported: (i) framework of issues and challenges, (ii) a preliminary theory of shared services success, and (iii) a benefits framework, for shared services in the Higher Education sector.

The practice of quality assuring learning in higher education

There remains a lack of published empirical data on the substantive outcomes of higher learning and the establishment of quality processes for determining them. Studies that do exist are nationally focused with available rankings of institutions reflecting neither the quality of teaching and learning nor the diversity of institutions. This paper describes two studies in which Associate Deans from Australian higher education institutions and focus groups of management and academics identify current issues and practices in the design, development and implementation of processes for assuring the quality of learning and teaching. Results indicate that developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program necessitates knowledge creation and new inclusive processes. Common elements supporting consistently superior outcomes included: inclusivity; embedded graduate attributes; consistent and appropriate assessment; digital collection mechanisms; and systematic analysis of outcomes used in program review. Quality measures for assuring learning are proliferating nationally and changing the processes, systems and culture of higher education as a result.

Educating for digital futures : what the learning strategies of digital content professionals can teach higher education

Beginning in the second half of the 20th century, ICTs transformed many societies from industrial societies in which manufacturing was the central focus, into knowledge societies in which dealing effectively with data and information has become a central element of work (Anderson, 2008). To meet the needs of the knowledge society, universities must reinvent their structures and processes, their curricula and pedagogic practices. In addition to this, of course higher education is itself subject to the sweeping influence of ICTs. But what might effective higher education look like in the 21st century? In designing higher education systems and learning experiences which are responsive to the learning needs of the future and exploit the possibilities offered by ICTs, we can learn much from the existing professional development strategies of people who are already successful in 21st century fields, such as digital media. In this study, I ask: (1) what are the learning challenges faced by digital media professionals in the 21st century? (2) what are the various roles of formal and informal education in their professional learning strategies at present? (3) how do they prefer to acquire needed capabilities? In-depth interviews were undertaken with successful Australian digital media professionals working in micro businesses and SMEs to answer these questions. The strongest thematic grouping that emerged from the interviews related to the need for continual learning and relearning because of the sheer rate of change in the digital media industries. Four dialectical relationships became apparent from the interviewees’ commentaries around the learning imperatives arising out of the immense and continual changes occurring in the digital content industries: (1) currency vs best practice (2) diversification vs specialisation of products and services (3) creative outputs vs commercial outcomes (4) more learning opportunities vs less opportunity to learn. These findings point to the importance of ‘learning how to learn’ as a 21st century capability. The interviewees were ambivalent about university courses as preparation for professional life in their fields. Higher education was described by several interviewees as having relatively little value-add beyond what one described as “really expensive credentialling services.” For all interviewees in this study, informal learning strategies were the preferred methods of acquiring the majority of knowledge and skills, both for ongoing and initial professional development. Informal learning has no ‘curriculum’ per se, and tends to be opportunistic, unstructured, pedagogically agile and far more self-directed than formal learning (Eraut, 2004). In an industry impacted by constant change, informal learning is clearly both essential and ubiquitous. Inspired by the professional development strategies of the digital media professionals in this study, I propose a 21st century model of the university as a broad, open learning ecology, which also includes industry, professionals, users, and university researchers. If created and managed appropriately, the university learning network becomes the conduit and knowledge integrator for the latest research and industry trends, which students and professionals alike can access as needed.

A higher education quality assurance model for small states : the Maldives case study

Increasing globalisation and local expansion of Higher Education presents challenges to manage quality of the education services. This study investigated key stakeholders' perspectives on what constitutes key elements and attributes of an effective Quality Assurance (QA) system in Higher Education. The findings highlighted the need for: i) legislation to support a strong QA regulatory framework, ii) independence of the QA agency, iii) development of minimum quality standards through broad stakeholder involvement, and iv) a cyclical approach. The findings of this study proposed a QA model which has implications for strengthening of HE QA systems of Small State.

A little learning is a dangerous thing? The ethics of teaching accidental tourists in higher education

This paper raises questions about the ethical issues that arise for academics and universities when under-graduate students enrol in classes outside of their discipline - classes that are not designed to be multi-disciplinary or introductory. We term these students ‘accidental tourists'. Differences between disciplines in terms of pedagogy, norms, language and understanding may pose challenges for accidental tourists in achieving desired learning outcomes. This paper begins a discussion about whether lecturers and universities have any ethical obligations towards supporting the learning of these students. Recognising that engaging with only one ethical theory leads to a fragmented moral vision, this paper employs a variety of ethical theories to examine any possible moral obligations that may fall upon lecturers and/or universities. In regards to lecturers, the paper critically engages with the ethical theories of utilitarianism, Kantianism and virtue ethics (Aristotle) to determine the extent of any academic duty to accidental tourists. In relation to universities, this paper employs the emerging ethical theory of organisational ethics as a lens through which to critically examine any possible obligations. Organisational ethics stems from the recognition that moral demands also exist for organisations so organisations must be reconceptualised as ethical actors and their policies and practices subject to ethical scrutiny. The analysis in this paper illustrates the challenges faced by lecturers some of whom, we theorise, may experience a form of moral distress facing a conflict between personal beliefs and organisational requirements. It also critically examines the role and responsibilities of universities towards students and towards their staff and the inherent moral tensions between a market model and demands for ‘good' learning experiences. This paper highlights the tensions for academics, between academics and universities and within university policy and indicates the need for greater reflection about this issue, especially given the many constraints facing lecturers and universities.

Sustainable development as a meta-context for engineering education

At the end of the first decade of the twenty-first century, there is unprecedented awareness of the need for a transformation in development, to meet the needs of the present while also preserving the ability of future generations to meet their own needs. However, within engineering, educators still tend to regard such development as an ‘aspect’ of engineering rather than an overarching meta-context, with ad hoc and highly variable references to topics. Furthermore, within a milieu of interpretations there can appear to be conflicting needs for achieving sustainable development, which can be confusing for students and educators alike. Different articulations of sustainable development can create dilemmas around conflicting needs for designers and researchers, at the level of specific designs and (sub-) disciplinary analysis. Hence sustainability issues need to be addressed at a meta-level using a whole of system approach, so that decisions regarding these dilemmas can be made. With this appreciation, and in light of curriculum renewal challenges that also exist in engineering education, this paper considers how educators might take the next step to move from sustainable development being an interesting ‘aspect’ of the curriculum, to sustainable development as a meta-context for curriculum renewal. It is concluded that capacity building for such strategic considerations is critical in engineering education.

Fostering rapid transitions to education for sustainable development through a whole-system approach to curriculum and organizational change

Despite decades of attempts to embed sustainability within higher education, literature clearly suggests that highly regulated disciplines such as engineering have been relatively slow to incorporate sustainability knowledge and skill areas, and are generally poorly prepared to do so. With current efforts, it is plausible that sustainability could take another two decades to be embedded within the curriculum. Within this context, this paper presents a whole system approach to implement systematic, intentional and timely curriculum renewal that is responsive to emerging challenges and opportunities, encompassing curriculum and organizational change. The paper begins by considering the evolution of curriculum renewal processes, documenting a number of whole system considerations that have been empirically distilled from literature, case studies, pilot trials, and a series of workshops with built environment educators from around the world over the last decade. The paper outlines a whole-of-institution curriculum renewal approach to embedding sustainability knowledge and skills within the DNA of the institutional offerings. The paper concludes with a discussion of research and practice implications for the field of education research, within and beyond higher education.

Educating for digital futures : what the learning strategies of digital media professionals can teach higher education

This article explores how universities might engage more effectively with the imperative to develop students’ 21st century skills for the information society, by examining learning challenges and professional learning strategies of successful digital media professionals. The findings of qualitative interviews with professionals from Australian games, online publishing, apps and software development companies reinforce an increasing body of literature that suggests that legacy university structures and pedagogical approaches are not conducive to learning for professional capability in the digital age. Study participants were ambivalent about the value of higher education to digital careers, in general preferring a range of situated online and face-to-face social learning strategies for professional currency. This article draws upon the learning preferences of the professionals in this study to present a model of 21st century learning, as linked with extant theory relating to informal, self-determined learning and communities of practice.

‘I now know I can do this now’: Indigenous women and writing in the Australian higher education sector

This paper explores the challenges of writing and publishing faced by Indigenous women who work in the Australian higher education sector. It demonstrates that Indigenous women are under-represented in the academy and argues that Indigenous styles of writing are typically not valued for broader publication. The authors describe a writing mentoring and support program specifically developed for Indigenous academic women in Australia. The Tiddas Writin’ Up Workshop provided a safe and culturally-appropriate space for women to learn about academic writing and develop their writing skills. The workshop led to the publication of a special issue of the Journal of Australian Indigenous Issues – known as the Tiddas Collection. The authors highlight the power and strength of well-developed support programs to address skills development, confidence, inequities and under-representation of Indigenous women within the higher education workforce.

Benchmarking potential factors leading to education quality : a study of Cambodian higher education

Purpose To study the quality in higher education in Cambodia and explore the potential factors leading to quality in Cambodian higher education. Design/methodology/approach Five main factors that were deemed relevant in providing quality in Cambodian higher education were proposed: academic curriculum and extra-curricular activities, teachers' qualification and methods, funding and tuition, school facilities, and interactive network. These five propositions were used to compare Shu-Te University, Taiwan with the top five universities in Cambodia. The data came in the forms of questionnaire and desk research. Descriptive analytical approach is then carried out to describe these five factors. Findings Only 6 per cent of lecturers hold PhD degree and about 85 per cent never published any papers; some private universities charge as low as USD200 per academic year, there is almost no donation from international organizations, and annual government funding on higher education sector nationwide in 2005 was only about USD3.67 million; even though there is a library at each university, books, study materials etc. are not up-to-date and inadequate; 90 per cent of the lecturers never have technical discussion or meeting and about 60 per cent of students felt that their teachers did not have time for them to consult with. Originality/value A useful insight was gained into the perceived importance of quality in higher education that can stimulate debate and discussion on the role of government in building the standard quality in higher education. Also, the findings from this research can assist in the development of a framework of developing human resource.

Celebrating and sustaining Indigenous knowledges through higher education

In its intervention at the 10th session of the United Nations Permanent Forum on Indigenous Issues 2010, the World Indigenous Network Higher Education Consortium (WINHEC) acknowledged that despite a history of protracted but limited attempts by Governments globally to address the low participation and graduation rates of Indigenous peoples from higher education at post graduate level, this continues to be an area of considerable concern. This paper speaks to the development of an innovative academic process that profiles the ground breaking work of WINHEC and a cohort of Indigenous academics in developing academic programs designed to address this systemic failure. The concept of these programs was endorsed in 2006 at a WINHEC conference where Indigenous representatives from across the world met to discuss in part, historical and contempory impediments to Indigenous success within higher education. The goal of WINHEC has been to develop a nested suite of inventive postgraduate awards founded within the scholarship of Indigenous Knowledge which encapsulates an epistemological approach. This has been a ground breaking process that has included collaborative and intellectual contributions of Indigenous academics from diverse cultural nations across the globe and, in particular, Australia. In 2012 the culmination of this dream and the suite of courses developed, honours and embrace the uniqueness of Indigenous Knowledge and the cultural integrity of Indigenous Leadership.

Indigenous epistemology : creating an international Indigenous higher education space in the wake of the western “university of excellence”

Interest in the participation of Indigenous peoples in higher education has, in recent times, gained momentum with an increasing number of advocates challenging the global history of culturally inept policies and practices imposed within the western higher education system. To address the challenges being presented by Indigenous communities and other groups (often relegated under the banner of disadvantaged or equity) Western Universities are promoting a shift toward inclusive policies and practices. Frustrated with the offerings of the Western Higher Education system, a global movement of Indigenous academics, Elders and knowledge holders are developing strategies to meet the educational needs of their own communities, in order to find a way forward. The mobilization of Elders and Indigenous academics has resulted in the development of a global higher education network which is proving to be a significant force in changing the position of Indigenous participation in higher education. The World Indigenous Network Higher Education Consortium (WINHEC) has presented a significant challenge to those barriers within the western higher education system that has historically demonstrated an inability to develop culturally inclusive practices within their institutions. This paper examines the development of a world Indigenous higher education movement and its contribution to the history of the “university” within the context of western higher education institutions. Outlined in this examination will be a synopsis of the development of the “University of Excellence” and the creation of an international Indigenous space within higher education.

On the operationalisation of conceptions of learning in higher education and their association with students’ knowledge and experiences of their learning

Conceptions of learning, as well as other associated aspects of prior knowledge, are theoretically important factors in influencing the manner in which the content and context of learning are engaged. The present study reports on: (a) the operationalisation of some of these factors aimed at isolating sources of explanatory variation that can be used for modelling purposes; and (b) a conservative exploration of the discriminatory power of, and exhibited patterns of association between, such sources of variation as have been isolated. Based on a conservative analytical approach, the results of the present study do not support a single clearly defined empirical model of conceptions of learning and associated constructs. Instead, there is consistent evidence that underlying empirical structures appear to be sensitive to the response context and other factors.

The SOLO Taxonomy as a means of shaping and assessing learning in higher education

This paper is a discussion of the use of the SOLO (Structure of Observed Learning Outcomes) Taxonomy (Biggs & Collis, 1982, 1989; Biggs, 1991, 1992a, 1992b; Boulton‐Lewis, 1992, 1994) as a means of developing and assessing higher order thinking in Higher Education. It includes a summary of the research into its use to date as an instrument to find out what students know and believe about their own learning, to assess entering knowledge in a discipline, to present examples of structural organization of knowledge in a discipline, to provide models of levels of desired learning outcomes, and in particular to assess learning outcomes. A proposal is made for further research.