Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.

Context-sensitive evaluation: Determining the context surrounding the implementation of a government policy

This article explains the essence of the context-sensitive parameters and dimensions in play at the time of an intervention, through the application of Rog’s (2012) model of contextual parameters. Rog’s model offers evaluators a structured approach to examine an intervention. The initial study provided a systematic way to clarify the scope, variables, timing, and appropriate evaluation methodology to evaluate the implementation of a government policy. Given that the government implementation of an educational intervention under study did not follow the experimental research approach, nor the double cycle of action research approach, the application of Rog’s model provided an in-depth understanding of the context-sensitive environment; it is from this clear purpose that the broader evaluation was conducted. Overall, when governments or institutions implement policy to invoke educational change (and this intervention is not guided by an appropriate evaluation approach), then program evaluation is achievable post-implementation. In this situation, Rog’s (2012) model of contextual parameters is a useful way to achieve clarity of purpose to guide the program evaluation.

Learning to be literate : issues of pedagogy for recently arrived refugee youth in Australia

This paper focuses on issues of access to productive literacy learning as part of socially just schooling for recently arrived refugee youth within Australia. It argues that a sole reliance on traditional ESL pedagogy is failing this vulnerable group of students, who differ significantly from past refugees who have settled in Australia. Many have been ‘placeless’ for some time, are likely to have received at best an interrupted education before arriving in Australia, and may have experienced signification trauma (Christie & Sidhu, 2006; Cottone, 2004; Miller, Mitchell, & Brown, 2005). Australian Government policy has resulted in spacialized settlement, leaving particular schools dealing with a large influx of refugee students who may be attending school for the first time (Centre for Multicultural Youth Issues, 2004; Sidhu & Christie, 2002). While this has implications generally, it has particular consequences for secondary school students attempting to learn English literacy in short periods of time, without basic foundations in either English or print-based literacy in any first language (Centre for Multicultural Youth Issues, 2006). Many of these students leave schools without the most basic early literacy practices, having endured several years of pedagogy pitched well beyond their needs. This paper suggests that schools must take up three key roles: to educate, to provide a site for the development of civic responsibility, and to act as a site for welfare with responsibility. As a system, our department needs to work out what can we do for 17-18 year olds that are coming into our school system in year 10 without more than 1-2 years of education. I don't think there is a policy about what to do. – (T2-ESL teacher)

The development of strategies to drive government and academic policy to underpin e-portfolio practice

The impact of government policy can become a strong enabler for the use of e-portfolios to support learning and employability. E-portfolio policy and practice seeks to draw together the different elements of integrated education and learning, graduate attributes, employability skills, professional competencies and lifelong learning, ultimately to support an engaged and productive workforce. Drawing on and updating the research findings from a nationwide research study conducted as part of the Australian ePortfolio Project, the present chapter discusses two important areas of the e-portfolio environment, government policy and academic policy. The focus is on those jurisdictions where government and academic policy issues have had a significant impact on e-portfolio practice, such as the European Union, the Netherlands, Scandinavian countries and the United Kingdom, as well as in Australia and New Zealand. These jurisdictions are of interest as government policy discussions are currently focusing on the need for closer integration between the different education and employment sectors. Finally, issues to be considered as well as strategies for driving policy decision making are presented.

New and young firms Entrepreneurship policy and the role of government – evidence from the Federation of Small Businesses survey

Purpose – The purpose of this paper is to investigate whether new and young firms are different from older firms. This analysis is undertaken to explore general characteristics, use of external resources and growth orientation. Design/methodology/approach – Data from the 2008 UK Federation of Small Businesses survey provided 8,000 responses. Quantitative analysis identified significantly different characteristics of firms from 0-4, 4-9, 9-19 and 20+ years. Factor analysis was utilised to identify the advice sets, finance and public procurement customers of greatest interest, with ANOVA used to statistically compare firms in the identified age groups with different growth aspirations. Findings – The findings reveal key differences between new, young and older firms in terms of characteristics including business sector, owner/manager age, education/business experience, legal status, intellectual property and trading performance. New and young firms were more able to access beneficial resources in terms of finance and advice from several sources. New and young firms were also able to more easily access government and external finance, as well as government advice, but less able to access public procurement. Research limitations/implications – New and young firms are utilising external networks to access several resources for development purposes, and this differs for older firms. This suggests that a more explicit age-differentiated focus is required for government policies aimed at supporting firm growth. Originality/value – The study provides important baseline data for future quantitative and qualitative studies focused on the impact of firm age and government policy.

Monitoring and benchmarking government policies and actions to improve the healthiness of food environments : a proposed Government Healthy Food Environment Policy Index

Government action is essential to increase the healthiness of food environments and reduce obesity, diet-related non-communicable diseases (NCDs), and their related inequalities. This paper proposes a monitoring framework to assess government policies and actions for creating healthy food environments. Recommendations from relevant authoritative organizations and expert advisory groups for reducing obesity and NCDs were examined, and pertinent components were incorporated into a comprehensive framework for monitoring government policies and actions. A Government Healthy Food Environment Policy Index (Food-EPI) was developed, which comprises a ‘policy’ component with seven domains on specific aspects of food environments, and an ‘infrastructure support’ component with seven domains to strengthen systems to prevent obesity and NCDs. These were revised through a week-long consultation process with international experts. Examples of good practice statements are proposed within each domain, and these will evolve into benchmarks established by governments at the forefront of creating and implementing food policies for good health. A rating process is proposed to assess a government's level of policy implementation towards good practice. The Food-EPI will be pre-tested and piloted in countries of varying size and income levels. The benchmarking of government policy implementation has the potential to catalyse greater action to reduce obesity and NCDs.

Providing youth with skills, training and employment opportunities through ICT Initiatives

Youth population is increasing explosively particularly in developing countries as a result of rapid urbanization. This increase is bringing large number of social and economic problems. For instance the impacts of job and training availability, and the physical, social and cultural quality of urban environment on young people are enormous, and affect their health, lifestyles, and well-being (Gleeson and Sipe 2006). Besides this, globalization and technological developments are affecting youth in urban areas in all parts of the world, both positively and negatively (Robertson 1995). The rapidly advancing information and communications technologies (ICTs) helps in addressing social and economic problems caused by the rapid growth of urban youth populations in developing countries. ICTs offer opportunities to young people for learning, skill development and employment. But there are downsides: young people in many developing countries lack of having broad access to these new technologies, they are vulnerable to global market changes, and ICTs link them into global cultures which promote consumer goods, potentially eroding local cultures and community values (Manacorda and Petrongolo 1999). However we believe that the positives outweigh such negatives. At the beginning of the twenty-first century, the world’s young population number more than they ever have. There are over a billion young people between the ages of 15 and 24, which 85 per cent of them live in developing countries and mainly in urban environments. Many of these young people are in the process of making, or have already made, the transition from school to work. During the last two decades all around the world, these young people, as new workers, have faced a number of challenges associated with globalization and technological advances on labour markets (United Nations 2004). The continuous decrease in the manufacturing employment is made many of the young people facing three options: getting jobs in the informal economy with insecurity and poor wages and working conditions, or getting jobs in the low-tier service industries, or developing their vocational skills to benefit from new opportunities in the professional and advanced technical/knowledge sectors. Moreover in developing countries a large portion of young people are not even lucky enough to choose among any of these options, and consequently facing long-term unemployment, which makes them highly vulnerable. The United Nations’ World Youth Employment report (2004) indicates that in almost all countries, females tend to be far more vulnerable than males in terms of long-term unemployment, and young people who have advanced qualifications are far less likely to experience long-term unemployment than others. In the limited opportunities of the formal labour market, those with limited vocational skills resort to forced entrepreneurship and selfemployment in the informal economy, often working for low pay under hazardous conditions, with only few prospects for the future (United Nations 2005a). The International Labour Organization’s research (2004) revealed that the labour force participation rates for young people decreased by almost four per cent (which is equivalent of 88 million young people) between 1993 and 2003. This is largely as a result of the increased number of young people attending school, high overall unemployment rates, and the fact that some young people gave up any hope of finding work and dropped out of the labour market. At the regional level, youth unemployment was highest in Middle East and North Africa (MENA) (25.6%) and sub-Saharan Africa (21%) and lowest in East Asia (7%) and the industrialized economies(13.4%) (International Labour Organization 2004). The youth in economically disadvantaged regions (e.g. the MENA region) face many challenges in education and training that delivers them the right set of skills and knowledge demanded by the labour market. As a consequence, the transition from school to work is mostly unsuccessful and young population end up either unemployed or underemployed in the informal sectors (United Nations 2005b). Unemployment and lack of economic prospects of the urban youth are pushing many of them into criminal acts, excessive alcohol use, substance addiction, and also in many cases resulting in processes of social or political violence (Fernandez-Maldonado 2004; United Nations 2005a). Long-term unemployment leads young people in a process of marginalisation and social exclusion (United Nations 2004). The sustained high rates of long-term youth unemployment have a number of negative effects on societies. First, it results in countries failing to take advantage of the human resources to increase their productive potential, at a time of transition to a globalized world that inexorably demands such leaps in productive capacity. Second, it reinforces the intergenerational transmission of poverty. Third, owing to the discrepancy between more education and exposure to the mass media and fewer employment opportunities, it may encourage the spread of disruptive behaviours, recourse to illegal alternatives for generating income and the loss of basic societal values, all of which erode public safety and social capital. Fourth, it may trigger violent and intractable political conflicts. And lastly, it may exacerbate intergenerational conflicts when young people perceive a lack of opportunity and meritocracy in a system that favours adults who have less formal education and training but more wealth, power and job stability (Hopenhayn 2002). To assist in addressing youth’s skill training and employment problems this paper scrutinises useful international practices, policies, initiatives and programs targeting youth skill training, particularly in ICTs. The MENA national governments and local authorities could consider implementing similar initiative and strategies to address some of the youth employment issues. The broader aim of this paper is to investigate the successful practice and strategies for the information and communication related income generation opportunities for young people to: promote youth entrepreneurship; promote public-private partnerships; target vulnerable groups of young people; narrow digital divide; and put young people in charge. The rest of this paper is organised in five parts. First, the paper provides an overview of the literature on the knowledge economy, skill, education and training issues. Secondly, it reviews the role of ICTs for vocational skill development and employability. Thirdly, it discusses the issues surrounding the development of the digital divide. Fourthly, the paper underlines types and the importance of developing ICT initiatives targeting young people, and reviews some of the successful policy implementations on ICT-based initiatives from both developed and developing countries that offer opportunities to young people for learning, skill development and employment. Then the paper concludes by providing useful generalised recommendations for the MENA region countries and cities in: advocating possible opportunities for ICT generated employment for young people; and discussing how ICT policies could be modified and adopted to meet young people’s needs.

ePortfolio use by university students in Australia: Informing excellence in policy and practice

In mid 2007, the Australian Learning and Teaching Council (ALTC), formerly the Carrick Institute for Learning and Teaching in Higher Education, commissioned an intensive research project to examine the use of ePortfolios by university students in Australia. The project was awarded to a consortium of four universities: Queensland University of Technology as lead institution, The University of Melbourne, University of New England and University of Wollongong.---------- The overarching aim of the research project, which was given the working title of the Australian ePortfolio Project, was to examine the current levels of ePortfolio practice in Australian higher education. The principal project goals sought to provide an overview and analysis of the national and international ePortfolio contexts, document the types of ePortfolios used in Australian higher education, examine the relationship with the National Diploma Supplement project funded by the Federal government, identify any significant issues relating to ePortfolio implementation, and offer guidance about future opportunities for ePortfolio development. The research findings revealed that there was a high level of interest in the use of ePortfolios in the context of higher education, particularly in terms of the potential to help students become reflective learners who are conscious of their personal and professional strengths and weaknesses, as well as to make their existing and developing skills more explicit. There were some good examples of early adoption in different institutions, although this tended to be distributed across the sector. The greatest use of ePortfolios was recorded in coursework programs, rather than in research programs, with implementation generally reflecting subject-specific or program-based activity, as opposed to faculty- or university-wide activity. Accordingly, responsibility for implementation frequently rested with the individual teaching unit, although an alternative centralised model of coordination by ICT services, careers and employment or teaching and learning support was beginning to emerge. The project report concludes with a series of recommendations to guide the process, drawing on the need for open dialogue and effective collaboration between the stakeholders across the range of contexts: government policy, international technical standards, academic policy, and learning and teaching research and practice.

Teachers reporting child sexual abuse : towards evidence-based reform of law, policy and practice

This report presents the results of the largest study ever conducted into the law, policy and practice of primary school teachers’ reporting of child sexual abuse in New South Wales, Queensland and Western Australia. The study included the largest Australian survey of teachers about reporting sexual abuse, in both government and non-government schools (n=470). Our research has produced evidence-based findings to enhance law, policy and practice about teachers’ reporting of child sexual abuse. The major benefits of our findings and recommendations are to: • Show how the legislation in each State can be improved; • Show how the policies in government and non-government school sectors can be improved; and • Show how teacher training can be improved. These improvements can enhance the already valuable contribution that teachers are making to identify cases of child sexual abuse. Based on the findings of our research, this report proposes solutions to issues in seven key areas of law, policy and practice. These solutions are relevant for State Parliaments, government and non-government educational authorities, and child protection departments. The solutions in each State are practicable, low-cost, and align with current government policy approaches. Implementing these solutions will: • protect more children from sexual abuse; • save cost to governments and society; • develop a professional teacher workforce better equipped for their child protection role; and • protect government and school authorities from legal liability.

Access to public sector information : law, technology and policy

On the back of the growing capacity of networked digital information technologies to process and visualise large amounts of information in a timely, efficient and user-driven manner we have seen an increasing demand for better access to and re-use of public sector information (PSI). The story is not a new one. Share knowledge and together we can do great things; limit access and we reduce the potential for opportunity. The two volumes of this book seek to explain and analyse this global shift in the way we manage public sector information. In doing so they collect and present papers, reports and submissions on the topic by leading authors and institutions from across the world. These in turn provide people tasked with mapping out and implementing information policy with reference material and practical guidance. Volume 1 draws together papers on the topic by policymakers, academics and practitioners while Volume 2 presents a selection of the key reports and submissions that have been published over the last few years.