From policy borrowing to implementation : an illuminative evaluation of learning and teaching in higher education in Australia (2002 to 2008)

This study documents and theorises the consequences of the 2003 Australian Government Reform Package focussed on learning and teaching in Higher Education during the period 2002 to 2008. This is achieved through the perspective of program evaluation and the methodology of illuminative evaluation. The findings suggest that the three national initiatives of that time, Learning and Teaching Performance Fund (LTPF), Australian Learning and Teaching Council (ALTC), and Australian Universities Quality Agency (AUQA), were successful in repositioning learning and teaching as a core activity in universities. However, there were unintended consequences brought about by international policy borrowing, when the short-lived nature of LTPF suggests a legacy of quality compliance rather than one of quality enrichment.

Australian higher education evaluation through assurance of learning

A collaborative research project conducted by five Australian universities inquired into the philosophy and motivation for Assurance of Learning (AoL) as a process of education evaluation. Associate Deans Teaching and Learning representing Business schools from twenty-five universities across Australia participated in telephone interviews. Data was analysed using NVIVO9. Results indicated that articulated rationale for AoL was both ensuring that students had acquired the attributes and skills the universities claimed they had, and the philosophy of continuous improvement. AoL was motivated both by ritualistic objectives to satisfy accreditation requirements and virtuous agendas for quality improvement. Closing-the-loop was emphasised, but was mostly wishful thinking for next steps beyond data collection and reporting. AoL was conceptualised as one element within the larger context of quality review, but there was no evidence of comprehensive frameworks or strategic plans.

Building sustainable and effective assurance of learning process in a changing higher education environment

In a study of assuring learning in Australian Business Schools, 25 Teaching and Learning Associate Deans were interviewed to identify current issues in developing and measuring the quality of teaching and learning outcomes. Results indicate that for most institutions developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program required knowledge creation and the building of new inclusive processes. Common elements of effective practice, namely those which offered consistently superior outcomes, included: inclusive processes; embedded graduate attributes throughout a program; alongside consistent and appropriate assessment. Results indicate that assurance of learning processes are proliferating nationally while quality of teaching and learning outcomes and in the processes for assuring it is increasing as a result.

A risk-based approach to course quality assurance

A decade ago, Queensland University of Technology (QUT) developed an innovative annual Courses Performance Report, but through incremental change, this report became quite labour-intensive. A new risk-based approach to course quality assurance, that consolidates voluminous data in a simple dashboard, responds to the changing context of the higher education sector. This paper will briefly describe QUT’s context and outline the second phase of implementation of this new approach to course quality assurance. The main components are: Individual Course Reports (ICRs), the Consolidated Courses Performance Report (CCPR), Underperforming Courses Status Update and the Strategic Faculty Courses Update (SFCU). These components together form a parsimonious and strategic annual cycle of reporting and place QUT in a positive position to respond to future sector change

Transition pedagogy : a third generation approach to FYE : a case study of policy and practice for the higher education sector

Current research and practice related to the first year experience (FYE) of commencing higher education students are still mainly piecemeal rather than institution-wide with institutions struggling to achieve cross-institutional integration, coordination and coherence of FYE policy and practice. Drawing on a decade of FYE-related research including an ALTC Senior Fellowship and evidence at a large Australian metropolitan university, this paper explores how one institution has addressed that issue by tracing the evolution and maturation of strategies that ultimately conceptualize FYE as “everybody's business.” It is argued that, when first generation co-curricular and second generation curricular approaches are integrated and implemented through an intentionally designed curriculum by seamless partnerships of academic and professional staff in a whole-of-institution transformation, we have a third generation approach labelled here as transition pedagogy. It is suggested that transition pedagogy provides the optimal vehicle for dealing with the increasingly diverse commencing student cohorts by facilitating a sense of engagement, support and belonging. What is presented here is an example of transition pedagogy in action.

Why teaching about Asia matters in higher education

I commence this opinion piece with specific reference to the Gillard Government's decision to cut funding for the Australian Learning and Teaching Council (ALTC)in 2011. I then consider impact of this decision on quality teaching in higher education with specific reference to Studies of Asia. In particular, I reflect on the teaching of Asian languages and cultures in Australia since the 1970 Auchmuty report, and conclude that despite the efforts of policy makers, not much has really changed. In doing so, I emphasise the importance of quality teaching in higher education for inspiring students to challenge their cultural assumptions and to prompt them to develop new views of the world.

Gender equity policies in higher education in Japan

In a similar fashion to many western countries, the political context of Japan has been transformed since the 1975 UN World Conference on Women, which eventually led to the establishment of the Basic Law for a Gender-equal Society in Japan in 1999. The Basic Law sets out a series of general guidelines across every field of society, including education. This trajectory policy research study targets gender issues in Japanese higher education and follows the development of the Basic Law and, in particular, how it has been interpreted by bureaucrats and implemented within the field of higher education. This feminist policy research study examines Japanese power relationships within the field of gender and identifies gender discourses embedded within Japanese gender equity policy documents. The study documents the experiences of, and strategies used by, Japanese feminists in relation to gender equity policies in education. Drawing on critical feminist theory and feminist critical discourse theory, the study explores the relationship between gender discourses and social practices and analyses how unequal gender relations have been sustained through the implementation of Japanese gender equity policy. Feminist critical policy analysis and feminist critical discourse analysis have been used to examine data collected through interviews with key players, including policy makers and policy administrators from the national government and higher education institutions offering teacher education courses. The study also scrutinises the minutes of government meetings, and other relevant policy documents. The study highlights the struggles between policy makers in the government and bureaucracy, and feminist educators working for change. Following an anti-feminist backlash, feminist discourses in the original policy documents were weakened or marginalised in revisions, ultimately weakening the impact of the Basic Law in the higher education institutions. The following four key findings are presented within the research: 1) tracking of the original feminist teachers’ movement that existed just prior to the development of the Basic Law in 1999; 2) the formation of the Basic Law, and how the policy resulted in a weakening of the main tenets of women’s policy from a feminist perspective; 3) the problematic manner in which the Basic Law was interpreted at the bureaucratic level; and 4) the limited impact of the Basic Law on higher education and the strategies and struggles of feminist scholars in reaction to this law.

Redefining excellence : a strategic policy framework for community engagement and higher education

This report provides a current overview and analysis of the role of universities in local community development in the State of Victoria. Drawing on successful programs of community engagement in Victoria, Australia, Europe, Africa, and North America, the report proposes policy strategies for fostering community development for Victorian Higher Education through effective community engagement programs.

Responding to rapid change in higher education : enabling university departments responsible for work related programs through boundary spanning

Boundary spanning links organisations to one another in order to create mutually beneficial relationships; it is a concept developed and used in organisational theory but rarely used to understand organisational structures in higher education (Pruitt & Schwartz, 1999). Yet understanding boundary spanning activity has the capacity to help universities respond to demands for continuous quality improvement, and to increase capacity to react to environmental uncertainty. At a time of rapid change characterised by a fluctuating economic environment, globalisation, increased mobility, and ecological issues, boundary spanning could be viewed as a key element in assisting institutions in effectively understanding and responding to such change. The literature suggests that effective boundary spanning could help universities improve organisational performance, use of infrastructure and resources, intergroup relations, leadership styles, performance and levels of job satisfaction, technology transfer, knowledge creation, and feedback processes, amongst other things. Our research aims to put a face on boundary spanning (Miller, 2008) by contextualising it within organisational systems and structures in university departments responsible for work related programs i.e. Work Integrated Learning (WIL) and Co-operative Education (Co-op). In this paper these approaches are referred to collectively as work related programs. The authors formed a research team in Victoria, British Columbia in 2009 at a sponsored international research forum, Two Days in June. The purpose of the invitation-only forum was to investigate commonalities and differences across programs and to formulate an international research agenda for work related programs over the next five to ten years. Researchers from Queensland University of Technology, University of Cincinnati, Baden-Wuerttemberg Cooperative State University, University of Ottawa,and Dublin City University agreed that further research was needed into the impact stakeholders, organisational systems, structures, policies, and practices have on departments delivering work related programs. This paper illustrates how policy and practice across the five institutions can be better understood through the lens of boundary spanning. It is argued that boundary spanning is an area of theory and practice with great applicability to a better understanding of the activity of these departments. The paper concludes by proposing topics for future research to examine how boundary spanning can be used to better understand practice and change in work related programs.

Future directions in course quality assurance

The Course Quality Assurance System at Queensland University of Technology (QUT) has as its centrepiece an exemplar of data visualisation known as the Individual Course Report (ICR). This report provides every course coordinator with an annual snapshot of their performance data evaluated against QUT and national benchmarks. In this article, the impact of the ICR is explored through the case study of one undergraduate course identified as underperforming. The case study features an innovative, ethnographic approach to working with course teams and highlights the importance of context, collaboration and appropriate support in creating evidence-based action plans for course improvement.

Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

Information literacy : a theoretical framework for higher education

Information literacy has been a significant issue in the library community for many years. It is now being recognised as an important issue by the higher education community. This theoretical framework draws together important elements of the information literacy agenda specifically for tertiary educators and administrators. The frame-work examines three areas of primary concern: the possible outcomes of information literacy education (through outlining the characteristics of information literate people); the nature of information literacy education; and the potential role of stake-holders (including information services, faculty, staff developers and learning counsellors) in helping staff and students to be information literate. This theoretical framework forms part of the Griffith University Information Literacy Blueprint. The Blueprint was designed between June and August of 1994. The project, a quality initiative of the Division of Information Services, was led by Janice Rickards, University Librarian.

Course quality assurance at a glance

From 2014, QUT will be adopting a life-cycle approach to Course Quality Assurance informed by a wider and richer range of historic, ‘live’ and ‘predictive’ course data. Key data elements continue to be grouped according to the three broad categories – Viability, Quality of Learning Environment and Outcomes – and are further supported with analytic data presented within tables and charts. Course Quality Assurance and this Consolidated Courses Performance Report illuminate aspects of courses from a data evidence base highlighting the strengths and weaknesses of our courses. It provides the framework and tools to achieve QUT's commitment to excellent graduate outcomes by drawing attention and focus to the quality of our courses and providing a structured approach for bringing about change. Our portfolio of courses forms a vital part of QUT, generating almost $600 million in 2013 alone. Real world courses are fundamental to the strength of the Institution; they are what our many thousands of current and future students are drawn to and invest their time and aspirations in. As we move through a period of some regulatory and deregulatory uncertainty, there is a greater need for QUT to monitor and respond to the needs and expectations of our students. The life-cycle approach, with its rich and predicative data, provides the best source of evidence we have had, to date, to assure the quality of our courses and their relevance in a rapidly changing higher education context.

Leadership Enabling Effective Pedagogic Change in Higher Education

This chapter will consider pedagogic change in Higher Education from the perspective of an Assistant Dean (Teaching and Learning) and one member of their leadership team with particular focus on reflective writing in their courses. The discussion will focus on leadership for the development of teaching capability for reflective writing development and implications for quality assurance of teaching and learning across faculties of a leading comprehensive University. The authors will present and contrast the experiences and challenges of developing teaching approaches for reflective writing across the discipline of teacher education. The chapter will argue a position for the establishment of a framework of distributed leadership that supports effective pedagogical change management generally and with specific reference to reflective writing.

Moderation in higher education: Four discourses

Across the globe, higher education institutions are working in environments of increasing accountability with little sign of this trend abating. This heightened focus on accountability has placed greater demands on institutions to provide evidence of quality and the achievement of standards that assure that quality. Moderation is one quality assurance process that plays a central role in the teaching, learning and assessment cycle in higher education institutions. While there is a growing body of research globally on teaching, learning and , to a lesser degree, assessment in higher education, the process of moderation has received even less attention (Watty, Freeman, Howieson, Hancock, O'Connell, et al. 2013). Until recently, moderation processes in Australian universities have been typically located within individual institutions, with universities given the responsibility for developing their own specific policies and practices. However, in 2009 the Australian Government announced that an independent national quality and regulatory body for higher education institutions would be established. With the introduction of the Tertiary Education Quality Standards Authority (TEQSA), more formalised requirements for moderation of assessment are being mandated. In light of these reforms, the purpose of this qualitative study was to identify and investigate current moderation practices operating within one faculty, the Faculty of Education, in a large urban university in eastern Australia. The findings of this study revealed four discourses of moderation: equity, justification, community building and accountability. These discourses provide a starting point for academics to engage in substantive conversations around assessment and to further critique the processes of moderation.