The influences and implications of PISA: An Australian perspective

This article is a commentary on Australia’s involvement in the Programme for International Student Assessment (PISA) tests. It provides a rationale for Australia’s participation in the PISA programme, the influences of PISA involvement on education policies and practices, and considerations and implications for school leaders and education researchers. It provides commentary on the positive and negative aspects of PISA involvement and concludes that there are many more disadvantages than benefits, each of which is explained. The article has applicability across the many standardized testing programmes to which Australian students are subjected. Furthermore, the Australian experience and this perspective may hold resonance for colleagues in countries with similar education systems, policies, and standardized testing regimes.

Closing the emergency facility: Moving schools from literacy triage to better literacy outcomes

This article focuses on the tensions between national and international testing, educational policy and professionalism for middle school English teachers. I argue that state and federal government(s) are responding to the impact of Australia's falling results on the international testing in PISA (Programme for International Student Assessment) through the usage of their own testing program, the National Assessment Program for Literacy and Numeracy (NAPLAN). The publication of NAPLAN results on the MySchool website in a searchable and comparable form has been detrimental to many schools and has pushed these schools into "emergency mode", as they struggle to improve their scores. At the same time, the results from recent PISA examinations reveal extensive inequities in educational outcomes across Australia, as well as some consistent general trends in the Australian data. I use the metaphor of the hospital emergency department to explore this situation. Drawing on Sahlberg's (2011) notion of the Global Educational Reform Movement (GERM), I explore this metaphor becoming a pandemic. I draw on Gillborn and Youdell's (2000) usage of educational triage and cast different and multiple educational professionals playing the role of the triage nurse-the alternate federal and state government education ministers responding to international and state test results in triage; and principals of poor performing schools operating their school as though it is an emergency department; poor literacy results triaged Code Red receiving immediate focus and attention, but "treated" in terms of immediate survival and a focus on basic skills. I argue that the international testing provides better markers for how we are doing as a nation, and what might be done to improve our international standing with respect to our literacy scores. I argue that true gains in literacy and the development of more complex literacy skills are not made through triaging literacy through an emergency department, but through a long-term focus on school redesign.

PISA – Shocks, after shocks and misconceptions

The Program for International Student Assessment (PISA) is as a triennial event of ranking compulsory education performance of students in participating countries. The results are published as a leagues table, which attracts much attention from politicians, media, employer groups, academics and other interest groups. Many of the responses and much of interpretation of PISA results are arguably misguided, for they mistake quality of education within performance of education systems. In this paper we are attempting to demystify PISA results by focusing on issues OECD-PISA education concept, test results and its limitations from a quality of education perspective.

A transcultural dance: enriching work-based learning facilitation

In this chapter you will learn:
• To question what it might mean to be an ‘international student’, and position students as bringing a vibrant array of different perspectives which can be rich learning assets.
• A pedagogic model of facilitation that moves towards mutual adaptivity in learning contexts where both you and your learners learn new ways of thinking and acting as well as different professional practices across cultures.
• Strategies for learner adaptivity including integrating diverse examples and cases, connecting to and validating diverse experiences and prior knowledge, accommodating diverse needs, and reciprocating learning about different ways of thinking, acting and feeling across cultures.
• Strategies to enable and sustain a learning environment for work-based learning study success.

Leaning too far? PISA, policy and Australia's ‘top five’ ambitions

 Australia has declared its ambition to be within the ‘top five’ in the Programme for International Student Assessment (PISA) by 2025. So serious is it about this ambition, that the Australian Government has incorporated it into the Australian Education Act, 2013. Given this focus on PISA results and rankings, we go beyond average scores to take a close look at Australia’s performance in PISA, examining rankings by different geographical units, by item content and by test completion. Based on this analysis and using data from interviews with measurement and policy experts, we show how uninformative and even misleading the ‘average performance scores’, on which the rankings are based, can be. We explore how a more nuanced understanding would point to quite different policy actions. After considering the PISA data and Australia’s ‘top five’ ambition closely, we argue that neither the rankings nor such ambitions should be given much credence.

Towards a sociology of measurement in education policy

The Organisation for Economic Cooperation and Development (OECD) has developed impressive machinery to produce international comparative data across more than 70 systems of education and these data have come to be used extensively in policy circles around the world. In many countries, national and international comparative data are used as the bases for significant, high-stakes policy and reform decisions. This article traces how international comparability is produced, using the example of equity measurement in OECD's Programme for International Student Assessment (PISA). It focuses on the construction of the objects of comparison and traces the struggles to produce equivalence and commensurability across diverse and complex worlds. Based on conversations with a number of measurement experts who are familiar with the OECD and PISA, the article details how comparability is achieved and how it falters and fails. In performing such an analysis, this research is not concerned with ‘exposing’ the limitations of comparison or challenging their validity. Rather, based on the work of Steve Woolgar and other scholars, it attempts to mobilise a ‘sociology of measurement’ that explores the instrumentalism and performativity of the technologies of international comparisons.

ANT on the PISA trail: following the statistical pursuit of certainty

The OECD’s Programme for International Student Assessment (PISA) is increasingly depended upon by education policy makers to provide reliable measures of their country’s education system against international benchmarks. PISA attempts to provide efficient, scientific and technical means to develop educational policies which achieve optimal outcomes (Berg &Timmermans, 2000, p. 31). This kind of scientific evidence is seen by policy makers as being free of prejudice and ideology. Science is expected to represent the truth, state universal facts and make predictions.Thus PISA seeks to rank countries’ performances, work out future scenarios and offer policy direction. By what means does PISA gain knowledge and speak with confidence about diverse cultures and distant nations? How does it acquire a ‘voice from nowhere’ (Haraway, 1988; Suchman, 2000), and become a modern-day Oracle that countries might consult for policy advice? Modelled on early actor-network accounts of laboratory life, this ethnography traces how PISA knowledge comes to be made, guided by interview data with two ‘insiders’ in the ‘PISA laboratory’. It traces the translations and the circulating reference that turn PISA into a ‘centre of calculation’. It highlights how human and non-human entities are imbricated in the assembling of scientific facts and argues for a suspension of the divide between ‘science’ and ‘politics’. In the process, the paper offers an empirical instantiation of how some concepts from actor-network theory may be applied in the field of education policy, and ponders the implications of such an understanding for evidence based policy making.

Policy as assemblage

In this article, the author tells the story of her search for appropriate tools to conceptualise policy work. She had set out to explore the relationship between the Programme for International Student Assessment (PISA) of the Organisation for Economic Co-operation and Development (OECD) and Australia’s education policy, but early interview data forced her to reconsider her research question. The plethora of available models of policy did not satisfactorily accommodate her growing understanding of the messiness and complexity of policy work. On the basis of interviews with 18 policy actors, including former OECD officials, PISA analysts and bureaucrats, as well as documentary analysis of government reports and ministerial media releases, she suggests that the concept of ‘assemblage’ provides the tools to better understand the messy processes of policy work. The relationship between PISA and national policy is of interest to many scholars in Europe, making this study widely relevant. An article that argues for the unsettling of tidy accounts of knowledge making in policy can hardly afford to obscure the untidiness of its own assemblage. Accordingly, this article is somewhat unconventional in its presentation, and attempts to take the reader into the messiness of the research world as well as the policy world. Implicit in this presentation is the suggestion that both policy work and research work are ongoing attempts to find order and coherence through the cobbling together of a variety of resources.

Investigating the use of IELTS in determining employment, migration and professional registration outcomes in healthcare and early chidlhood education in Australia

Focusing on two professional fields that are critical to Australia’s future – health and early childhood education – the study provides key insights into the many challenges facing overseas-trained professionals and international graduates transitioning into the Australian labour market.The study highlights the complex language requirements in the professions of medicine, nursing and early childhood education and explores the implications for stakeholders. Employers require graduates to have high-level English language skills, and universities are increasingly expected to ensure international students graduate with the required English language proficiency.Finally, the study highlights the many challenges facing overseas-trained/international graduates transitioning into the labour market. For participants in this study, the challenges of working in their profession in Australia are many and varied. These challenges include workplace discrimination, isolation and extreme frustration when unable to work in their area of qualification.

A model of student satisfaction : international postgraduate students from Asia

The internationalisation of higher education remains one of the major challenges faced by universities with the increasing mobility and rising expectations of a highly diversified student community worldwide. With the competitiveness of the industry, universities will need to focus on factors influencing student satisfaction to improve service quality where required. This paper draws on the theory of cognitive dissonance dealining with disconformation of expectations that results in customer satisfaction and using structural equation modelling, investigates factors that influence satisfaction of international postgraduate students from Asian countries studying in Australia and concludes with strategic implications for universities.

Policy responses to address student “brain drain”: An assessment of measures intended to reduce the emigration of singaporean international students

For several decades,Singapore has experienced a high rate of outbound degree mobility with around 1 in 10 higher education students currently studying outside the country according to UNESCO figures. Singapore’s successful economic development strategy, which has seen it become a key Asian hub for knowledge-intensive industries for internationalized services, has benefited from the presence of large numbers of graduates who have been educated abroad. However, significant numbers of Singaporean students do not return home after their studies, and since the late 1990s, the government has expressed concern about the resulting “brain drain.” This article examines four strategies that have been used by the Singapore government to address this concern: reducing the number of outbound students through improvements to domestic study options, promoting the return of graduates after their studies, engagement with the Singaporean diaspora, and recruitment of incoming international students into the workforce. While data are limited, the measures adopted to support each of these approaches appear to have had some success over the past decade. While the circumstances of each sending country vary, the case of Singapore is illustrative of the types of practical measures that are effectively adopted by governments to moderate the negative impacts of student emigration.

Student satisfaction : impact of age and gender on satisfaction among international postgraduate students from Asia

Customer satisfaction is a core-marketing concept. It is considered as a major outcome of marketing activity and serves to link processes, culminating in purchase and consumption with post-purchase phenomena such as attitudinal change, customer retention, repeat purchase, brand loyalty, positive word-of-mouth communication. Student satisfaction is a strategic factor in developing a competitive advantage in the highly attractive and globally competitive international education market. Market forecasts indicate a seven-fold increase in the number of students seeking higher education overseas by 2025 and given the competitiveness of the industry, universities will need to focus on variables influencing student satisfaction in order to address areas where improvements in service quality are required.

A sample of 371 postgraduate students from China, India, Indonesia and Thailand, is investigated. The study highlights the development of a scale to measure international postgraduate student satisfaction. The scale demonstrates the importance of four predominant factors influencing university choices - Education Resources; Communication and Guidance; Customer Value and Study Outcomes; and Image, Prestige and Recognition. Using logistic regression and chi square testing, this paper investigates the impact of age and gender on satisfaction among international postgraduate students from four Asian countries studying in universities in Victoria, Australia, on theses factors. The results indicate that age has a positive relationship with satisfaction among postgraduate students while the influence of gender has no effect on influencing satisfaction among postgraduate students from Asia.

Comparative analysis of student perceptions : impact on satisfaction among international postgraduate students from China, India, Indonesia and Thailand

The paper undertakes a comparative analysis of the gap in student expectations and perceptions on key service quality factors influencing the choice of Australia as a study destination by international postgraduate students of Asian origin and their relationship with student satisfaction. Based on the theoretical framework of expectancy-disconfirmation paradigm, the paper examines the differences in student perceptions of the level of service quality related to the key factors of choice among four groups of students from China, India, Indonesia and Thailand using structural equation modelling, ANOV A and MANOV A. It concludes with strategic implications for universities.