Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.

Context-sensitive evaluation: Determining the context surrounding the implementation of a government policy

This article explains the essence of the context-sensitive parameters and dimensions in play at the time of an intervention, through the application of Rog’s (2012) model of contextual parameters. Rog’s model offers evaluators a structured approach to examine an intervention. The initial study provided a systematic way to clarify the scope, variables, timing, and appropriate evaluation methodology to evaluate the implementation of a government policy. Given that the government implementation of an educational intervention under study did not follow the experimental research approach, nor the double cycle of action research approach, the application of Rog’s model provided an in-depth understanding of the context-sensitive environment; it is from this clear purpose that the broader evaluation was conducted. Overall, when governments or institutions implement policy to invoke educational change (and this intervention is not guided by an appropriate evaluation approach), then program evaluation is achievable post-implementation. In this situation, Rog’s (2012) model of contextual parameters is a useful way to achieve clarity of purpose to guide the program evaluation.

Realistic yet humanitarian? The comprehensive plan of action and refugee policy in Southeast Asia

The 1989 Comprehensive Plan of Action (CPA) has recently been described as a successful example of how to manage large protracted refugee flows. However, this article revisits the circumstances surrounding the CPA used to resolve the prolonged Indo-Chinese refugee crisis to highlight that part of its development was linked to the fact that Southeast Asian states refused to engage with proposed solutions, which did not include repatriation for the majority of the Indo-Chinese asylum seekers who were deemed to be ‘non-genuine’1 ( UNGA, 1989a) refugees. This resulted in the CPA often forcibly repatriating ‘non-genuine’ refugees, particularly near the end of its program. This article reviews the CPA in order to assess whether its practices and results should be repeated.

The development of strategies to drive government and academic policy to underpin e-portfolio practice

The impact of government policy can become a strong enabler for the use of e-portfolios to support learning and employability. E-portfolio policy and practice seeks to draw together the different elements of integrated education and learning, graduate attributes, employability skills, professional competencies and lifelong learning, ultimately to support an engaged and productive workforce. Drawing on and updating the research findings from a nationwide research study conducted as part of the Australian ePortfolio Project, the present chapter discusses two important areas of the e-portfolio environment, government policy and academic policy. The focus is on those jurisdictions where government and academic policy issues have had a significant impact on e-portfolio practice, such as the European Union, the Netherlands, Scandinavian countries and the United Kingdom, as well as in Australia and New Zealand. These jurisdictions are of interest as government policy discussions are currently focusing on the need for closer integration between the different education and employment sectors. Finally, issues to be considered as well as strategies for driving policy decision making are presented.

New and young firms Entrepreneurship policy and the role of government – evidence from the Federation of Small Businesses survey

Purpose – The purpose of this paper is to investigate whether new and young firms are different from older firms. This analysis is undertaken to explore general characteristics, use of external resources and growth orientation. Design/methodology/approach – Data from the 2008 UK Federation of Small Businesses survey provided 8,000 responses. Quantitative analysis identified significantly different characteristics of firms from 0-4, 4-9, 9-19 and 20+ years. Factor analysis was utilised to identify the advice sets, finance and public procurement customers of greatest interest, with ANOVA used to statistically compare firms in the identified age groups with different growth aspirations. Findings – The findings reveal key differences between new, young and older firms in terms of characteristics including business sector, owner/manager age, education/business experience, legal status, intellectual property and trading performance. New and young firms were more able to access beneficial resources in terms of finance and advice from several sources. New and young firms were also able to more easily access government and external finance, as well as government advice, but less able to access public procurement. Research limitations/implications – New and young firms are utilising external networks to access several resources for development purposes, and this differs for older firms. This suggests that a more explicit age-differentiated focus is required for government policies aimed at supporting firm growth. Originality/value – The study provides important baseline data for future quantitative and qualitative studies focused on the impact of firm age and government policy.

Searching for value : the influence of policy and reform on nurses’ sense of value in long-term aged care in Australia.

Contemporary literature on long-term aged care focuses heavily on issues associated with the recruitment and retention of nursing staff, such as job satisfaction and attitudes towards caring for older people. This paper aims to highlight one aspect of a larger study of registered nurses' experiences in long-term aged care in Australia and the influence that government policy and reform has in shaping that experience. This insight into aspects of nurses' everyday experience also contributes to a broader understanding of job satisfaction in long-term care. Findings from this study suggest that registered nurses experience tension in their search for value in their practice, which incorporates professional, political and social mediators of value and worth. These issues are discussed in relation to the impact of policy and reform on nurses' sense of value in long-term aged care and highlight the need for sensitive policy initiatives that support issues of value in nursing practice.

Monitoring and benchmarking government policies and actions to improve the healthiness of food environments : a proposed Government Healthy Food Environment Policy Index

Government action is essential to increase the healthiness of food environments and reduce obesity, diet-related non-communicable diseases (NCDs), and their related inequalities. This paper proposes a monitoring framework to assess government policies and actions for creating healthy food environments. Recommendations from relevant authoritative organizations and expert advisory groups for reducing obesity and NCDs were examined, and pertinent components were incorporated into a comprehensive framework for monitoring government policies and actions. A Government Healthy Food Environment Policy Index (Food-EPI) was developed, which comprises a ‘policy’ component with seven domains on specific aspects of food environments, and an ‘infrastructure support’ component with seven domains to strengthen systems to prevent obesity and NCDs. These were revised through a week-long consultation process with international experts. Examples of good practice statements are proposed within each domain, and these will evolve into benchmarks established by governments at the forefront of creating and implementing food policies for good health. A rating process is proposed to assess a government's level of policy implementation towards good practice. The Food-EPI will be pre-tested and piloted in countries of varying size and income levels. The benchmarking of government policy implementation has the potential to catalyse greater action to reduce obesity and NCDs.

Imaginging the good Indigenous citizen : race war and the pathology of partiarchal white sovereignty

In June 2007, the Australian federal government sent military and policy into Indigenous communities in the Northern Territory on the premise that sexual abuse of children was rampant and a national crisis. This article draws on Foucault’s work on sovereignty and rights to argue that patriarchal white sovereignty as a regime of power deploys a discourse of pathology in the exercising of sovereign right to subjugate and discipline Indigenous people as good citizens.

Conceptualising value creation for social change management

Australian and international governments are increasingly adopting social marketing as a social change management tool to deal with complex social problems. Government decision makers typically need to balance the use of business models and management theories whilst maintaining the integrity of government policy. In taking this approach, decision makers experience management tensions between a social mission to equitably deliver social services and the accountability and affordability of providing quality social and health services to citizens. This is a significant challenge as the nature of the ‘social product’ in government is often more service-oriented than goods-based. In this paper the authors examine value creation in government social marketing services. The contribution of this paper is a value creation process model, which considers the nature of governments to create social good. This is particularly important for governments where consumers still expect value and quality in the service delivered, despite that offering being ‘free’.

Learning to be literate : issues of pedagogy for recently arrived refugee youth in Australia

This paper focuses on issues of access to productive literacy learning as part of socially just schooling for recently arrived refugee youth within Australia. It argues that a sole reliance on traditional ESL pedagogy is failing this vulnerable group of students, who differ significantly from past refugees who have settled in Australia. Many have been ‘placeless’ for some time, are likely to have received at best an interrupted education before arriving in Australia, and may have experienced signification trauma (Christie & Sidhu, 2006; Cottone, 2004; Miller, Mitchell, & Brown, 2005). Australian Government policy has resulted in spacialized settlement, leaving particular schools dealing with a large influx of refugee students who may be attending school for the first time (Centre for Multicultural Youth Issues, 2004; Sidhu & Christie, 2002). While this has implications generally, it has particular consequences for secondary school students attempting to learn English literacy in short periods of time, without basic foundations in either English or print-based literacy in any first language (Centre for Multicultural Youth Issues, 2006). Many of these students leave schools without the most basic early literacy practices, having endured several years of pedagogy pitched well beyond their needs. This paper suggests that schools must take up three key roles: to educate, to provide a site for the development of civic responsibility, and to act as a site for welfare with responsibility. As a system, our department needs to work out what can we do for 17-18 year olds that are coming into our school system in year 10 without more than 1-2 years of education. I don't think there is a policy about what to do. – (T2-ESL teacher)

ePortfolio use by university students in Australia: Informing excellence in policy and practice

In mid 2007, the Australian Learning and Teaching Council (ALTC), formerly the Carrick Institute for Learning and Teaching in Higher Education, commissioned an intensive research project to examine the use of ePortfolios by university students in Australia. The project was awarded to a consortium of four universities: Queensland University of Technology as lead institution, The University of Melbourne, University of New England and University of Wollongong.---------- The overarching aim of the research project, which was given the working title of the Australian ePortfolio Project, was to examine the current levels of ePortfolio practice in Australian higher education. The principal project goals sought to provide an overview and analysis of the national and international ePortfolio contexts, document the types of ePortfolios used in Australian higher education, examine the relationship with the National Diploma Supplement project funded by the Federal government, identify any significant issues relating to ePortfolio implementation, and offer guidance about future opportunities for ePortfolio development. The research findings revealed that there was a high level of interest in the use of ePortfolios in the context of higher education, particularly in terms of the potential to help students become reflective learners who are conscious of their personal and professional strengths and weaknesses, as well as to make their existing and developing skills more explicit. There were some good examples of early adoption in different institutions, although this tended to be distributed across the sector. The greatest use of ePortfolios was recorded in coursework programs, rather than in research programs, with implementation generally reflecting subject-specific or program-based activity, as opposed to faculty- or university-wide activity. Accordingly, responsibility for implementation frequently rested with the individual teaching unit, although an alternative centralised model of coordination by ICT services, careers and employment or teaching and learning support was beginning to emerge. The project report concludes with a series of recommendations to guide the process, drawing on the need for open dialogue and effective collaboration between the stakeholders across the range of contexts: government policy, international technical standards, academic policy, and learning and teaching research and practice.

Teachers reporting child sexual abuse : towards evidence-based reform of law, policy and practice

This report presents the results of the largest study ever conducted into the law, policy and practice of primary school teachers’ reporting of child sexual abuse in New South Wales, Queensland and Western Australia. The study included the largest Australian survey of teachers about reporting sexual abuse, in both government and non-government schools (n=470). Our research has produced evidence-based findings to enhance law, policy and practice about teachers’ reporting of child sexual abuse. The major benefits of our findings and recommendations are to: • Show how the legislation in each State can be improved; • Show how the policies in government and non-government school sectors can be improved; and • Show how teacher training can be improved. These improvements can enhance the already valuable contribution that teachers are making to identify cases of child sexual abuse. Based on the findings of our research, this report proposes solutions to issues in seven key areas of law, policy and practice. These solutions are relevant for State Parliaments, government and non-government educational authorities, and child protection departments. The solutions in each State are practicable, low-cost, and align with current government policy approaches. Implementing these solutions will: • protect more children from sexual abuse; • save cost to governments and society; • develop a professional teacher workforce better equipped for their child protection role; and • protect government and school authorities from legal liability.

Access to public sector information : law, technology and policy

On the back of the growing capacity of networked digital information technologies to process and visualise large amounts of information in a timely, efficient and user-driven manner we have seen an increasing demand for better access to and re-use of public sector information (PSI). The story is not a new one. Share knowledge and together we can do great things; limit access and we reduce the potential for opportunity. The two volumes of this book seek to explain and analyse this global shift in the way we manage public sector information. In doing so they collect and present papers, reports and submissions on the topic by leading authors and institutions from across the world. These in turn provide people tasked with mapping out and implementing information policy with reference material and practical guidance. Volume 1 draws together papers on the topic by policymakers, academics and practitioners while Volume 2 presents a selection of the key reports and submissions that have been published over the last few years.