Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.

Do instructional attributes pose multicollinearity problems? An empirical exploration

It is commonly perceived that variables ‘measuring’ different dimensions of teaching (construed as instructional attributes) used in student evaluation of teaching (SET) questionnaires are so highly correlated that they pose a serious multicollinearity problem for quantitative analysis including regression analysis. Using nearly 12000 individual student responses to SET questionnaires and ten key dimensions of teaching and 25 courses at various undergraduate and postgraduate levels for multiple years at a large Australian university, this paper investigates whether this is indeed the case and if so under what circumstances. This paper tests this proposition first by examining variance inflation factors (VIFs), across courses, levels and over time using individual responses; and secondly by using class averages. In the first instance, the paper finds no sustainable evidence of multicollinearity. While, there were one or two isolated cases of VIFs marginally exceeding the conservative threshold of 5, in no cases did the VIFs for any of the instructional attributes come anywhere close to the high threshold value of 10. In the second instance, however, the paper finds that the attributes are highly correlated as all the VIFs exceed 10. These findings have two implications: (a) given the ordinal nature of the data ordered probit analysis using individual student responses can be employed to quantify the impact of instructional attributes on TEVAL score; (b) Data based on class averages cannot be used for probit analysis. An illustrative exercise using level 2 undergraduate courses data suggests higher TEVAL scores depend first and foremost on improving explanation, presentation, and organization of lecture materials.

Rediscovering law students as citizens: Critical thinking and the public value of legal education

In a series of publications over the last decade, Australian National University Professor Margaret Thornton has documented a disturbing change in the nature of legal education. This body of work culminates in a recently published book based on interviews with 145 legal academics in Australia, the United Kingdom, New Zealand and Canada. In it, Thornton describes a feeling of widespread unease among legal academics that society, government, university administrators and students themselves are moving away from viewing legal education as a public good which benefits both students and society. Instead, legal education is increasingly being viewed as a purely private good, for consumption by the student in the quest for individual career enhancement.

Cross cultural similarities in using mobile technologies to engage and connect with students

The access to mobile technologies is growing at an exponential rate in developed and developing countries, with some developing countries surpassing developed countries in terms of device ownership. It is both the demand for, and high usage of mobile technologies that have driven new and emerging pedagogical practices in higher education. These technologies have also exponentially increased access to information in a knowledge economy. While differences are often drawn between developing and developed countries in terms of the access and use of information and communication technologies (ICT), this paper will report on a study detailing how higher education students use mobile technologies and social media in their studies and in their personal lives. It will contrast the similarities in how students from an Australian and Vietnamese university access and use mobile and social media technologies while also highlighting ways in which these technologies can be embraced by academics to connect and engage with students.

Democratic and participatory citizenship: Youth action for sustainability in Australia

Purpose – The purpose of this paper is to provide a critical analysis of recent examples of action competence among young people engaged in democratic participatory action in sustainability programs in Australia. It explores examples of priorities identified for citizen action, the forms this action takes and the ways that democratic participation can achieve positive outcomes for future sustainability. It suggests multiple ways for developing action competence that provides further opportunities for authentic and engaging citizen action for youth connected to school- and community-based learning, in new and powerful ways. Design/methodology/approach – This conceptual paper examines international literature on the theory of “action competence,” its significance for education for sustainability (EfS) and the ways it can inform education for young people’s democratic participatory citizenship and civic engagement. It analyses examples of the development of action competency among young people in Australia, including the problems and priorities identified for citizen action, the forms this action takes and how it can achieve positive outcomes for sustainability. Following this analysis, the paper suggests multiple ways for developing action competence in EfS in schools and communities in new and powerful ways. Findings – Developing EfS to increase democratic and participatory action among young citizens is now widely regarded as an urgent education priority. There are growing exemplars of school and community organizations’ involvement in developing EfS learning and teaching to increase participatory citizenship. Young people are being empowered to develop a greater sense of agency through involvement in programs that develop action competence with a focus on sustainability in and out of school. New forms of participation include student action teams and peer collaboration among youth who are marshaling social media and direction action to achieve change. Originality/value – It contributes to the literature on multiple ways for developing action competence in EfS.

Engaging a multiple-track approach to building capacity for 21st Century engineering, opportunities and challenges for rapid curriculum renewal

‘Complexity’ is a term that is increasingly prevalent in conversations about building capacity for 21st Century professional engineers. Society is grappling with the urgent and challenging reality of accommodating seven billion people, meeting needs and innovating lifestyle improvements in ways that do not destroy atmospheric, biological and oceanic systems critical to life. Over the last two decades in particular, engineering educators have been active in attempting to build capacity amongst professionals to deliver ‘sustainable development’ in this rapidly changing global context. However curriculum literature clearly points to a lack of significant progress, with efforts best described as ad hoc and highly varied. Given the limited timeframes for action to curb environmental degradation proposed by scientists and intergovernmental agencies, the authors of this paper propose it is imperative that curriculum renewal towards education for sustainable development proceeds rapidly, systemically, and in a transformational manner. Within this context, the paper discusses the need to consider a multiple track approach to building capacity for 21st Century engineering, including priorities and timeframes for undergraduate and postgraduate curriculum renewal. The paper begins with a contextual discussion of the term complexity and how it relates to life in the 21st Century. The authors then present a whole of system approach for planning and implementing rapid curriculum renewal that addresses the critical roles of several generations of engineering professionals over the next three decades. The paper concludes with observations regarding engaging with this approach in the context of emerging accreditation requirements and existing curriculum renewal frameworks.

Education policy-making and time

This paper examines the global policy convergence toward high-stakes testing in schools and the use of test results to ‘steer at a distance’, particularly as it applies to policy-makers’ promise to improve teacher quality. Using Deleuze’s three syntheses of time in the context of the Australian policy blueprint Quality Education, this paper argues that using test scores to discipline teaching repeats the past habit of policy-making as continuing the problem of the unaccountable teacher. This results in local policy-making enfolding test scores in a pure past where the teacher-as-problem is resolved through the use of data from testing to deliver accountability and transparency. This use of the database returns a digitised form of inspection that is a repetition of the habit of teacher-as-problem. While dystopian possibilities are available through the database, in what Deleuze refers to as a control society, for us the challenge is to consider policy-making as a step into an unknown future, to engage with producing policy that is not grounded on the unconscious interiority of solving the teacher problem, but of imagining new ways of conceiving the relationship between policy-making and teaching.

A comparison of motivation to learn English between English major and non-English major students in a Vietnamese university

Despite the plethora of literature examining higher education students’ motivation to learn a second language, it is not known if students who choose to study English as their major differ from those who are required to study English as the minor component of their wider degree. Drawing on self-determination theory, this paper reports on the findings of a quantitative study designed to investigate the types of motivation demonstrated by English major (n=180) and non-English major students (n=242), and their levels of effort expended in learning English in a Vietnamese university. The findings revealed that both groups demonstrated high levels of motivation to learn English to prepare for their future profession. English major students felt more intrinsically motivated and less obligated to learn English. In addition, for both groups, intrinsically motivated students invested the highest levels of effort in learning English. This paper argues that it is imperative for lecturers to foster students’ intrinsic aspirations to learn English to improve the quality of the teaching and learning of English in Vietnamese higher education.

Beyond social justice agendas: Indigenous knowledges in pre-service teacher education and practice in Australia

The space and positioning of Indigenous knowledges (IK) within Australian curricula and pedagogy are often contentious, informed by the broader Australian socio-cultural, political and economic landscape. Against changing educational policy, historically based on the myth of terra nullius, we discuss the shifting priorities for embedding Indigenous knowledges in educational practice in university and school curricula and pedagogy. In this chapter, we argue that personal and professional commitment to social justice is an important starting point for embedding Indigenous knowledges in the Australian school curricula and pedagogy. Developing teacher knowledge around embedding IK is required to enable teachers’ preparedness to navigate a contested historical/colonising space in curriculum decision-making, teaching and learning. We draw one mpirical data from a recent research project on supporting pre-service teachers as future curriculum leaders; the project was funded by the Office of Learning and Teaching (OLT). This project aimed to support future curriculum leaders to develop their knowledge of embedding IK at one Australian university. We propose supporting the embedding of IK in situ with pre-service teachers and their supervising teachers on practicum in real, sustained and affirming ways that shifts the recognition of IK from personal commitment to social justice in education, to one that values Indigenous knowledges as content to educate (Connell, 1993). We argue that sustained engagement with and appreciation of IKhas the potential to decolonise Australian curricula, shift policy directions and enhance race relations between Indigenous and non-Indigenous Australians .

A holistic, institution-wide approach to building sessional staff capacity

Sessional Academics enhance students’ learning experience by bringing a diverse range of perspectives and expertise into the classroom. As industry specialists, research students, and recent graduates who have excelled in their courses, they complement the discipline expertise of career academics. With increasing casualization of the academic workforce, Sessional Academics now deliver the majority of face-to-face undergraduate teaching in Australian Universities. To enable them to realize their full potential as effective contributors to student learning and course quality, universities need to offer effective training and access to advice and support and facilitate engagement in university life. However, in the face of complex and diverse contexts, overwhelming numbers, and the transitory nature of sessional cohorts, few universities have developed a comprehensive, systematic approach. During the past three years at QUT, we have set out to develop a multifaceted approach to Sessional Academic support and development. In this paper I will explain why and how we have done so, and describe the range of strategies and programs we have developed. They include a central academic development program, which is structured and scaffolded with learning objectives and outcomes, and aligned with a graduate certificate in Academic Practice; a Sessional Academic Success program, which deploys experienced, school-based sessional academic success advisors to provide local support, build a sense of community, and offer discipline focused academic development; an online, dialogic communication strategy; and opportunities to present and be acknowledged for good learning and teaching practices. Together, these strategies have impacted on sessional academics’ confidence, learning and teaching capacity, reflection and engagement.

Benefits of blended learning for the first year medical imaging students in preparation for clinical placement

Although there is a plethora of definitions of blended learning, the underlying distinguishing feature is the combination of traditional content delivery and the utilisation of technology. Within Medical Imaging undergraduate education there is evidence of advantages and increased student engagement when utilising a blended learning approach. Although the embedding of technology has been proven to be a useful teaching tool, “Educators should tailor their teaching media to learner’s needs rather than assume that web based learning is intrinsically superior”. This study aims to determine which clinical learning tools are perceived to be the most useful to the student in preparing them for placements.

The Google Online Marketing Challenge: A Transnational Comparison of Classroom Learning with Real Clients, Real Money, and Real Advertising Campaigns

In 2008, a collaborative partnership between Google and academia launched the Google Online Marketing Challenge (hereinafter Google Challenge), perhaps the world’s largest in-class competition for higher education students. In just two years, almost 20,000 students from 58 countries participated in the Google Challenge. The Challenge gives undergraduate and graduate students hands-on experience with the world’s fastest growing advertising mechanism, search engine advertising. Funded by Google, students develop an advertising campaign for a small to medium sized enterprise and manage the campaign over three consecutive weeks using the Google AdWords platform. This article explores the Challenge as an innovative pedagogical tool for marketing educators. Based on the experiences of three instructors in Australia, Canada and the United States, this case study discusses the opportunities and challenges of integrating this dynamic problem-based learning approach into the classroom.

Integrating ePsychology into practice and research: A guide for early career psychologists

The ever expanding availability of technology-based mental health services and resources has opened up new areas of psychological practice and research. There are many reasons to embrace this technology movement, whether specialising in providing e-mental health services, conducting research on e-mental health or using technology to assist you in your work in other fields of psychology. e-mental health services not only offer more treatment choices for clients but they provide health professionals with an array of free and comprehensive resources that can help streamline their face-to-face work. This growth in ePsychology (the application of e-mental health by psychologists) also opens up an exciting range of research and teaching possibilities. In this article we cover what ePsychology can offer the early career psychologist.

Book Review: "Deviance Conformity and Social Control (4th Edn)" Sharyn L. Roach Anleu Sydney: Pearson, 2006

If the sociology of deviance ‘died’ a few years back, as some have claimed, the continuing significance of deviance for sociologists, in both research and teaching, might be explained in terms of a ‘resurrection’. Sharyn Roach Anleu has been spreading both the good and bad news about deviance for some years now, this being not merely the second coming of her text, but its fourth. In terms of Australian tertiary publishing, this is no small accomplishment and gives further weight to the durability of sociological concern with the sub-field of deviance...

Why the Constraints-Led Approach is not teaching games for understanding: A clarification

Background There is some apparent confusion regarding similarities and differences between two popular physical education (PE) pedagogical frameworks, that is, the Constraints-Led Approach (CLA) and Teaching Games for Understanding (TGfU). Purpose Our aim in this commentary is to detail important theoretical and pedagogical concepts that distinguish these approaches, as well as to recognise where commonalities exist. Findings In particular, we note that TGfU had its roots in the 1960s in the absence of a substantial theoretical framework, although several attempts to retrospectively scaffold theories around TGfU have subsequently emerged in the literature. TGfU is a learner-centred approach to PE in which teachers are encouraged to design modified games to develop the learner's understanding of tactical concepts. In contrast, the CLA has arisen more recently from the umbrella of Nonlinear Pedagogy (NLP), emerging from the empirically rich theoretical framework of ecological dynamics. The CLA adopts a ‘learner–environment’ scale of analysis in which practitioners are encouraged to identify and modify interacting constraints (of task, environment and learner) to facilitate the coupling of each learner's perceptual and action systems during learning. The CLA is a broader framework which has been adapted for the design of (re)learning environments in PE, sport and movement therapy. Other key distinctions between the approaches include: the overall goals; the way in which the learner and the learning process are modelled; the use of questioning as a pedagogical tool; the focus on individual differences vs. generic concepts; and how progressions and skill interjections are planned and implemented. Conclusions Despite such distinctions, the two approaches are somewhat harmonious and key similarities include: their holistic perspective of the learner; the proposed role of the teacher and the design characteristics of learning tasks in each. Both TGfU and the CLA have a powerful central focus on the nature of learning activities undertaken by each individual learner. This clarification of TGFU and the CLA is intended to act as a catalyst for more empirical work into the complementarity of these juxtaposed pedagogical approaches to learning design.