Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.

Promoting creativity in education : from policy to practice : an Australian perspective

In the 21st century, our global community is changing to increasingly value creativity and innovation as driving forces in our lives. This paper will investigate how educators need to move beyond the rhetoric to effective practices for teaching and fostering creativity. First, it will describe the nature of creativity at different levels, with a focus on personal and everyday creativity. It will then provide a brief snapshot of creativity in education through the lens of new policies and initiatives in Queensland, Australia. Next it will review two significant areas related to enriching and enhancing students’ creative engagement and production: 1) influential social and environmental factors; and 2) creative self-efficacy. Finally, this paper will propose that to effectively promote student creativity in schools, we need to not only emphasise policy, but also focus on establishing a shared discourse about the nature of creativity, and researching and implementing effective practices for supporting and fostering creativity. This paper has implications for educational policy, practice and teacher training that are applicable internationally.

The development of strategies to drive government and academic policy to underpin e-portfolio practice

The impact of government policy can become a strong enabler for the use of e-portfolios to support learning and employability. E-portfolio policy and practice seeks to draw together the different elements of integrated education and learning, graduate attributes, employability skills, professional competencies and lifelong learning, ultimately to support an engaged and productive workforce. Drawing on and updating the research findings from a nationwide research study conducted as part of the Australian ePortfolio Project, the present chapter discusses two important areas of the e-portfolio environment, government policy and academic policy. The focus is on those jurisdictions where government and academic policy issues have had a significant impact on e-portfolio practice, such as the European Union, the Netherlands, Scandinavian countries and the United Kingdom, as well as in Australia and New Zealand. These jurisdictions are of interest as government policy discussions are currently focusing on the need for closer integration between the different education and employment sectors. Finally, issues to be considered as well as strategies for driving policy decision making are presented.

How to plan and implement an environmental education program for a conservation area : lessons from Australia and Borneo

The Augo Wetland Forest Park, along with other conservation areas around the world, provides an opportunity for a personal connection with the natural world - an opportunity for creating ways to convince people to reverse the degradation of the planet. In this presentation I use the settings approach, as used by the World Health Organisation in health promotion, as a framework. The WHO’s 1986 Ottawa Charter states that "Health is created and lived by people within the settings of their everyday life; where they learn, work, play, and love." I argue that, similarly, a conservation area provides a setting for people to connect with environmental issues and can be the place where positive behaviours and actions for the environment are created and enacted. In a wired and virtual world, such settings may be the only opportunity some people, especially children, get to connect with the environment. An evidence-based, intentionally designed and implemented environmental education program enhances the opportunities for the personal connection and subsequent action. Planning and implementing an Environmental education program for a conservation area requires an understanding of the principles of three domains: • Environmental Communication • Environmental Education • Environmental Interpretation In this presentation I define these domains and demonstrate how they become interdependent within the context of a particular setting such as a conservation area. I outline the principles of each domain and demonstrate how they can be enacted with reference to environmental education program case studies from settings in Australia and Borneo. The first case study is based around a proposal for a planned residential community at Eden’s Crossing, in Brisbane’s high growth Western corridor. The setting featured a number of important natural and heritage conservation characteristics and the developer wanted to be pro-active in informing the market what this development aims to achieve in terms of innovative community and environmental objectives. By designing an education and interpretation program in line with best practice education and interpretation principles the developers would be assisted in their efforts to build community, preserve heritage, and facilitate environmentally sensitive lifestyles for the future residents of Eden’s Crossing. Above all, the strategy focused on advancing sustainability in a way that made the Eden’s Crossing greenfield development significantly greener. It did this by interacting with prospective purchasers, and building knowledge about sustainability with a view to shaping the future community of Eden’s Crossing in terms of attitudes and behaviours. The second case study is based around the development of the Rainforest Interpretation Centre (RIC), now renamed the Rainforest Discovery Centre, an environmental education facility managed by the Sabah Forestry Department (SFD) and located at the edge of the Kabili-Sepilok Forest Reserve in the East Malaysian state of Sabah (Borneo). This setting is of paramount importance for biodiversity conservation and research and a vital habitat for orang utan. As an Environmental Education Consultant I was tasked with developing an environmental education program for this setting as part of the SFD’s long- term strategy towards sustainable forest management. By employing the principles of Environmental Education and Environmental Interpretation I designed and implemented a program with three major components: • an environmental education component for visiting primary and secondary school groups. • an environmental education component for in-service and pre-service teachers and teacher educators. • a public awareness and environmental interpretation component which caters for the general public and tourists. From these modest beginnings the program has expanded and new facilities have been developed to meet the demands of visitors, teachers and students. The effectiveness of the program can be traced back to the grounding in the principles of best practice environmental education, communication and interpretation.

Inclusive Education Statement - policy analysis

This study analyses the Inclusive Education Statement – 2005, Education Queensland. (Appendix 1). The Statement was a product of the Queensland State Government response to Federal Legislation. The Federal Disability Discrimination Act (DDA), 1992 and the subsequent Standards for Education 2005, sought to eliminate discrimination against people with disabilities. Under Section 22 of the Act, it became unlawful for an educational authority to discriminate against a person on the grounds of the person’s disability.

ePortfolio use by university students in Australia: A review of the Australian ePortfolio Project

In October 2008, the Australian Learning and Teaching Council (ALTC) released the final report for the commissioned project ePortfolio use by university students in Australia: Informing excellence in policy and practice. The Australian ePortfolio Project represented the first attempt to examine the breadth and depth of ePortfolio practice in the Australian higher education sector. The research activities included surveys of stakeholder groups in learning and teaching, academic management and human resource management, with respondents representing all Australian universities; a series of focus groups and semi-structured interviews which sought to explore key issues in greater depth; and surveys designed to capture students’ pre-course expectations and their post-course experiences of ePortfolio learning. Further qualitative data was collected through interviews with ‘mature users’ of ePortfolios. Project findings revealed that, while there was a high level of interest in the use of ePortfolios in terms of the potential to help students become reflective learners who were conscious of their personal and professional strengths and weaknesses, the state of play in Australian universities was very fragmented. The project investigation identified four individual, yet interrelated, contexts where strategies may be employed to support and foster effective ePortfolio practice in higher education: government policy, technical standards, academic policy, and learning and teaching. Four scenarios for the future were also presented with the goal of stimulating discussion about opportunities for stakeholder engagement. It is argued that the effective use of ePortfolios requires open dialogue and collaboration between the different stakeholders across this range of contexts.

Mentoring experiences as professional development for leaders in environmental education : the cascade of influence

Environmental education is a field which has only come of age since the late nineteen sixties. While its content and practice have been widely debated and researched, its leadership has been minimally studied and, therefore, is only partially understood. The role of mentoring in the development of leaders has been alluded to, but has attracted scant research. Therefore, this study explores the importance of mentoring during the personal and professional development of leaders in environmental education. Four major research questions were investigated. Firstly, have leaders been men to red during their involvement with environmental education? Secondly, when and how has that mentoring taken place? Thirdly, what was the personal and professional effectiveness of the mentoring relationship? Fourthly, is there any continuation of the mentoring process which might be appropriate for professional development within the field of environmental education? Leaders were solicited from a broad field of environmental educators including teachers, administrators, academics, natural resource personnel, business and community persons. They had to be recognized as active leaders across several environmental education networks. The research elicited qualitative and quantitative survey data from fifty seven persons in Queensland, Australia and Colorado, USA. Seventeen semi-structured interviews were subsequently conducted with selected leaders who had nominated their mentors. This led to a further thirteen 'linked interviews' with some of the mentors' mentors and new mentorees. The interview data is presented as four cases reflecting pairs, triads, chains and webs of relationships- a major finding of the research process. The analysis of the data from the interviews and the surveys was conducted according to a grounded theory approach and was facilitated by NUD.IST, a computer program for non-numerical text analysis. The findings of the study revealed many variations on the classical mentoring patterns found in the literature. Gender and age were not seen as mportant factors, as there were examples of contemporaries in age, older men to younger women, older women to younger men, and women to women. Personal compatibility, professional respect and philosophical congruence were critical. Mentoring was initiated from early, mid and late career stages with the average length of the relationship being fourteen years. There was seldom an example of the mentoree using the mentor for hierarchical career climbing, although frequent career changes were made. However, leadership actions were found to increase after the intervention of a mentoring relationship. Three major categories of informal mentoring were revealed - perceived,acknowledged and deliberate. Further analysis led to the evolution of the core concept, a 'cascade of influence'. The major finding of this study was that this sample of leaders, mentors and new mentorees moved from the perception of having been mentored to the acknowledgment of these relationships and an affirmation of their efficacy for both personal and professional growth. Hence, the participants were more likely to continue future mentoring, not as a serendipitous happening, but through a deliberate choice. Heightened awareness and more frequent 'cascading' of mentoring have positive implications for the professional development of future leaders in environmental education in both formal and informal settings. Effective mentoring in environmental education does not seek to create 'clones' of the mentors, but rather to foster the development of autonomous mentorees who share a philosophical grounding. It is a deliberate invitation to 'join the clan'.

Detaining the usual suspects : charting the use of segregated settings in New South Wales government schools, Australia

In this paper, we examine the increase in segregated placements in the New South Wales government school sector. Using disaggregated enrolment data, we point to the growing over-representation of boys in special schools and classes; particularly those of a certain age in certain support categories. In the discussion that follows, we question the role of special education in the development of new and additional forms of being “at risk.” In effect, we invert the traditional concept by asking: Who is at risk of what? In focusing on the containment of risk, are modern practices of diagnosis and segregation perpetuating risks that already disproportionately affect certain groups of individuals? Do these perceptions of and responses to risk in local schools now place these students at greater personal risk of school failure and a future marked by social exclusion? And, finally, is that risk worth the cost?

Context-sensitive evaluation: Determining the context surrounding the implementation of a government policy

This article explains the essence of the context-sensitive parameters and dimensions in play at the time of an intervention, through the application of Rog’s (2012) model of contextual parameters. Rog’s model offers evaluators a structured approach to examine an intervention. The initial study provided a systematic way to clarify the scope, variables, timing, and appropriate evaluation methodology to evaluate the implementation of a government policy. Given that the government implementation of an educational intervention under study did not follow the experimental research approach, nor the double cycle of action research approach, the application of Rog’s model provided an in-depth understanding of the context-sensitive environment; it is from this clear purpose that the broader evaluation was conducted. Overall, when governments or institutions implement policy to invoke educational change (and this intervention is not guided by an appropriate evaluation approach), then program evaluation is achievable post-implementation. In this situation, Rog’s (2012) model of contextual parameters is a useful way to achieve clarity of purpose to guide the program evaluation.

Assessment in education : principles, policy and practice

The English examination system provides a market in which a limited number of providers are accredited to offer curriculum-based examinations in many subject areas and at several levels. The most significant are the General Certificate of Secondary Education (GCSE) and the General Certificate of Education, Advanced (A level). Because these examinations are used for high-stakes purposes, including higher education and employment selection for individuals and programme evaluation for institutions, it is desired that scores from various exams be ‘comparable’ in several respects: across syllabuses and examination boards within a subject area, across years, and even across subject areas. Just how to accomplish this goal has been a topic of continual research and debate for over 50 years, through many changes of examination and institutional structures. But ever year, tens of thousands of scores must be reported, and every year, users expect them to ‘be comparable’ and use them as if they are.