Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

Trends in policies, programs and practices in the Australasian First Year Experience literature 2000-2010. The First Year in Higher Education Research Series on Evidence-based Practice. Number 1

This publication is the first in a series of scholarly reports on research-based practice related to the First Year Experience in Higher Education. This report synthesises evidence about practice-based initiatives and pragmatic approaches in Aotearoa (New Zealand) and Australia that aim to enhance the experience of commencing students in the higher education sector. Trends in policies, programs and practices ... examines the first year experience literature from 2000-2010. It acknowledges the uniqueness of the Australasian socio-political context and its influence on the interests and output of researchers. The review surveyed almost 400 empirical reports and conceptual discussions produced over the decade that dealt with the stakeholders, institutions and the higher education sector in Australasia. The literature is examined through two theoretical constructs or “lenses”: first, a set of first year curriculum design principles and second, the generational approach to describing the maturation of initiatives. These outcomes and suggested directions for further research provide the challenges and the opportunities for FYE adherents, both scholars and practitioners, to grapple with in the next decade.

The judicious utilization of new technologies through authentic learning in higher education : a case study

Though technology holds significant promise for enhanced teaching and learning it is unlikely to meet this promise without a principled approach to course design. There is burgeoning discourse about the use of technological tools and models in higher education, but much of the discussion is fixed upon distance learning or technology based courses. This paper will develop and propose a balanced model for effective teaching and learning for “on campus” higher education, with particular emphasis on the opportunities for revitalisation available through the judicious utilisation of new technologies. It will explore the opportunities available for the creation of more authentic learning environments through the principled design. Finally it will demonstrate with a case study how these have come together enabling the creation of an effective and authentic learning environment for one pre-service teacher education course at the University of Queensland.

Theorising a model for teaching and assessing reflective learning in higher education

The importance of reflection in higher education, and across disciplinary fields is widely recognised; it is generally included in university graduate attributes, professional standards and program objectives. Furthermore, reflection is commonly embedded into assessment requirements in higher education subjects, often without necessary scaffolding or clear expectations for students. Despite the rhetoric around the importance of reflection for ongoing learning, there is scant literature on any systematic, developmental approach to teaching reflective learning across higher education programs/courses. Given that professional or academic reflection is not intuitive, and requires specific pedagogic intervention to do well, a program/course-wide approach is essential. This paper draws on current literature to theorise a new, transferable and customisable model for teaching and assessing reflective learning across higher education, which foregrounds and explains the pedagogic field of higher education as a multi-dimensional space. We argue that explicit and strategic pedagogic intervention, supported by dynamic resources, is necessary for successful, broad-scale approaches to reflection in higher education.

‘It's the end of the university as we know it (and I feel fine)’: the Generation Y student in higher education discourse

This paper examines discussions of Generation Y within higher education discourse, arguing the sector’s use of the term to describe students is misguided for three reasons. First, portraying students as belonging to Generation Y homogenises people undertaking higher education as young, middle-class and technologically literate. Second, speaking of Generation Y students allows constructivism to be reinvented as a ‘new’ learning and teaching philosophy. Third, the Generation Y university student has become a central figure in concerns about technology’s role in learning and teaching. While the notion of the ‘Generation Y student’ creates the illusion that higher education institutions understand their constituents, ultimately, it is of little value in explaining young adults’ educational experiences.

Multimodal approaches to reflective teaching and assessment in higher education

Reflection is not a new concept in the teaching of higher education and is often an important component of many disciplinary courses. Despite this, past research shows that whilst there are examples of rich reflective strategies used in some areas of higher education, most approaches to and conceptualisations of reflective learning and assessment have been perfunctory and inconsistent. In many disciplinary areas reflection is often assessed as a written activity ‘tagged onto’ assessment practices. In creative disciplines however, reflective practice is an integral and cumulative form of learning and is often expressed in ways other than in the written form. This paper will present three case studies of reflective practice in the area of Creative Industries in higher education – Dance, Fashion and Music. It will discuss the ways in which higher education teachers and students use multi-modal approaches to expressing knowledge and reflective practice in context. The paper will argue that unless students are encouraged to participate in deep reflective disciplinary discourse via multi-modes then reflection will remain superficial in the higher education context.

The place of higher education institutions in assessing student engagement, success and retention : a maturity model to guide practice

The perennial issues of student engagement, success and retention in higher education continue to attract attention as the salience of teaching and learning funding and performance measures has increased. This paper addresses the question of the responsibility or place of higher education institutions (HEIs) for initiating, planning, managing and evaluating their student engagement, success and retention programs and strategies. An evaluation of the current situation indicates the need for a sophisticated approach to assessing the ability of HEIs to proactively design programs and practices that enhance student engagement. An approach—the Student Engagement Success and Retention Maturity Model (SESR-MM)—is proposed and its development, current status, and relationship with and possible use in benchmarking are discussed.

The potential of combining phenomenography, variation theory and threshold concepts to inform curriculum design in higher education

This chapter describes an innovative method of curriculum design that is based on combining phenomenographic research, and the associated variation theory of learning, with the notion of disciplinary threshold concepts to focus specialised design attention on the most significant and difficult parts of the curriculum. The method involves three primary stages: (i) identification of disciplinary concepts worthy of intensive curriculum design attention, using the criteria for threshold concepts; (ii) action research into variation in students’ understandings/misunderstandings of those concepts, using phenomenography as the research approach; (iii) design of learning activities to address the poorer understandings identified in the second stage, using variation theory as a guiding framework. The curriculum design method is inherently theory and evidence based. It was developed and trialed during a two-year project funded by the Australian Learning and Teaching Council, using physics and law disciplines as case studies. Disciplinary teachers’ perceptions of the impact of the method on their teaching and understanding of student learning were profound. Attempts to measure the impact on student learning were less conclusive; teachers often unintentionally deviated from the design when putting it into practice for the first time. Suggestions for improved implementation of the method are discussed.

On the operationalisation of conceptions of learning in higher education and their association with students’ knowledge and experiences of their learning

Conceptions of learning, as well as other associated aspects of prior knowledge, are theoretically important factors in influencing the manner in which the content and context of learning are engaged. The present study reports on: (a) the operationalisation of some of these factors aimed at isolating sources of explanatory variation that can be used for modelling purposes; and (b) a conservative exploration of the discriminatory power of, and exhibited patterns of association between, such sources of variation as have been isolated. Based on a conservative analytical approach, the results of the present study do not support a single clearly defined empirical model of conceptions of learning and associated constructs. Instead, there is consistent evidence that underlying empirical structures appear to be sensitive to the response context and other factors.

The SOLO Taxonomy as a means of shaping and assessing learning in higher education

This paper is a discussion of the use of the SOLO (Structure of Observed Learning Outcomes) Taxonomy (Biggs & Collis, 1982, 1989; Biggs, 1991, 1992a, 1992b; Boulton‐Lewis, 1992, 1994) as a means of developing and assessing higher order thinking in Higher Education. It includes a summary of the research into its use to date as an instrument to find out what students know and believe about their own learning, to assess entering knowledge in a discipline, to present examples of structural organization of knowledge in a discipline, to provide models of levels of desired learning outcomes, and in particular to assess learning outcomes. A proposal is made for further research.

LeaD-In : a cultural change model for peer review of teaching in higher education

Peer review of teaching is recognized increasingly as one strategy for academic development even though historically peer review of teaching is often unsupported by policy, action and culture in many Australian universities. Higher education leaders report that academics generally do not engage with peer review of teaching in a systematic or constructive manner, and this paper advances and analyses a conceptual model to highlight conditions and strategies necessary for the implementation of sustainable peer review in higher education institutions. The model highlights leadership, development and implementation, which are critical to the success and formation of a culture of peer review of teaching. The work arises from collaborative research funded by the Office for Learning and Teaching to foster and advance a culture of peer review of teaching across several universities in Australia.

Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.

Moderation in higher education: Four discourses

Across the globe, higher education institutions are working in environments of increasing accountability with little sign of this trend abating. This heightened focus on accountability has placed greater demands on institutions to provide evidence of quality and the achievement of standards that assure that quality. Moderation is one quality assurance process that plays a central role in the teaching, learning and assessment cycle in higher education institutions. While there is a growing body of research globally on teaching, learning and , to a lesser degree, assessment in higher education, the process of moderation has received even less attention (Watty, Freeman, Howieson, Hancock, O'Connell, et al. 2013). Until recently, moderation processes in Australian universities have been typically located within individual institutions, with universities given the responsibility for developing their own specific policies and practices. However, in 2009 the Australian Government announced that an independent national quality and regulatory body for higher education institutions would be established. With the introduction of the Tertiary Education Quality Standards Authority (TEQSA), more formalised requirements for moderation of assessment are being mandated. In light of these reforms, the purpose of this qualitative study was to identify and investigate current moderation practices operating within one faculty, the Faculty of Education, in a large urban university in eastern Australia. The findings of this study revealed four discourses of moderation: equity, justification, community building and accountability. These discourses provide a starting point for academics to engage in substantive conversations around assessment and to further critique the processes of moderation.

Speaking of supervision: A dialogic approach to building higher degree research supervision capacity in the creative arts

In the emergent field of creative practice higher degrees by research, first generation supervisors have developed new models of supervision for an unprecedented form of research that combines creative practice and written thesis. In a national research project, entitled 'Effective supervision of creative practice higher research degrees', we set out to capture and share early supervisors' insights, strategies and approaches to supporting their creative practice PhD students. From the insights we gained during the early interview process, we expanded our research methods in line with a distributed leadership model and developed a dialogic framework. This led us to unanticipated conclusions and unexpected recommendations. In this study, we primarily draw on philosopher and literary theorist Mikhail Bakhtin's dialogics to explain how giving precedence to the voices of supervisors not only facilitated the articulation of dispersed tacit knowledge, but also led to other 20 discoveries. These include the nature of supervisors' resistance to prescribed models, policies and central academic development programmes; the importance of polyvocality and responsive dialogue in enabling continued innovation in the field; the benefits to supervisors of reflecting, discussing and sharing practices with colleagues; and the value of distributed leadership and dialogue to academic development and supervision capacity building in research education.