Developing a culture to support peer review of teaching in higher education

This presentation addresses issues related to leadership, academic development and scholarship of teaching and learning, and highlights research funded by the Australian Office of Learning and Teaching (OLT) designed to embed and sustain peer review of teaching within the culture of 5 Australian universities: Queensland University of Technology, University of Technology, Sydney, University of Adelaide, Curtin University, and Charles Darwin University. Peer review of teaching in higher education will be emphasised as a professional process for providing feedback on teaching and learning practice, which if sustained, can become an effective ongoing strategy for academic development (Barnard et al, 2011; Bell, 2005; Bolt and Atkinson, 2010; McGill & Beaty 2001, 1992; Kemmis & McTaggart, 2000). The research affirms that using developmental peer review models (Barnard et al, 2011; D'Andrea, 2002; Hammersley-Fletcher & Orsmond, 2004) can bring about successful implementation, especially when implemented within a distributive leadership framework (Spillane & Healey, 2010). The project’s aims and objectives were to develop leadership capacity and integrate peer review as a cultural practice in higher education. The research design was a two stage inquiry process over 2 years. The project began in July 2011 and encompassed a development and pilot phase followed by a cascade phase with questionnaire and focus group evaluation processes to support ongoing improvement and measures of outcome. Leadership development activities included locally delivered workshops complemented by the identification and support of champions. To optimise long term sustainability, the project was implemented through existing learning and teaching structures and processes within the respective partner universities. Research outcomes highlight the fundamentals of peer review of teaching and the broader contextual elements of integration, leadership and development, expressed as a conceptual model for embedding peer review of teaching within higher education. The research opens a communicative space about introduction of peer review that goes further than simply espousing its worth and introduction. The conceptual model highlights the importance of development of distributive leadership capacity, integration of policies and processes, and understanding the values, beliefs, assumptions and behaviors embedded in an organizational culture. The presentation overviews empirical findings that demonstrate progress to advance peer review requires an ‘across-the-board’ commitment to embed change, and inherently demands a process that co-creates connection across colleagues, discipline groups, and the university sector. Progress toward peer review of teaching as a cultural phenomenon can be achieved and has advantages for academic staff, scholarship, teaching evaluation and an organisation, if attention is given to strategies that influence the contexts and cultures of teaching practice. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment and has a focus on scholarship of teaching. The work is ongoing and has implication for policy, research, teaching development and student outcomes, and has potential application world-wide.

The QUT innovation space : a trans-disciplinary learning environment for entrepreneurship education : final report

In the current climate of global economic volatility, there are increasing calls for training in enterprising skills and entrepreneurship to underpin the systemic innovation required for even medium-term business sustainability. The skills long-recognised as the essential for entrepreneurship now appear on the list of employability skills demanded by industry. The QUT Innovation Space (QIS) was an experiment aimed at delivering entrepreneurship education (EE), as an extra-curricular platform across the university, to the undergraduate students of an Australian higher education institute. It was an ambitious project that built on overseas models of EE studied during an Australian Learning and Teaching Council (ALTC) Teaching Fellowship (Collet, 2011) and implemented those approaches across an institute. Such EE approaches have not been attempted in an Australian university. The project tested resonance not only with the student population, from the perspective of what worked and what didn’t work, but also with every level of university operations. Such information is needed to inform the development of EE in the Australian university landscape. The QIS comprised a physical co-working space, virtual sites (web, Twitter and Facebook) and a network of entrepreneurial mentors, colleagues, and students. All facets of the QIS enabled connection between like-minded individuals that underpins the momentum needed for a project of this nature. The QIS became an innovation community within QUT. This report serves two purposes. First, as an account of the QIS project and its evolution, the report serves to identify the student demand for skills and training as well as barriers and facilitators of the activities that promote EE in an Australian university context. Second, the report serves as a how-to manual, in the tradition of many tomes on EE, outlining the QIS activities that worked as well as those that failed. The activities represent one measure of QIS outcomes and are described herein to facilitate implementation in other institutes. The QIS initially aimed to adopt an incubation model for training in EE. The ‘learning by doing’ model for new venture creation is a highly successful and high profile training approach commonly found in overseas contexts. However, the greatest demand of the QUT student population was not for incubation and progression of a developed entrepreneurial intent, but rather for training that instilled enterprising skills in the individual. These two scenarios require different training approaches (Fayolle and Gailly, 2008). The activities of the QIS evolved to meet that student demand. In addressing enterprising skills, the QIS developed the antecedents of entrepreneurialism (i.e., entrepreneurial attitudes, motivation and behaviours) including high-level skills around risk-taking, effective communication, opportunity recognition and action-orientation. In focusing on the would-be entrepreneur and not on the (initial) idea per se, the QIS also fostered entrepreneurial outcomes that would never have gained entry to the rigid stage-gated incubation model proposed for the original QIS framework. Important lessons learned from the project for development of an innovation community include the need to: 1. Evaluate the context of the type of EE program to be delivered and the student demand for the skills training (as noted above). 2. Create a community that builds on three dimensions: a physical space, a virtual environment and a network of mentors and partners. 3. Supplement the community with external partnerships that aid in delivery of skills training materials. 4. Ensure discovery of the community through the use of external IT services to deliver advertising and networking outlets. 5. Manage unrealistic student expectations of billion dollar products. 6. Continuously renew and rebuild simple activities to maintain student engagement. 7. Accommodate the non-university end-user group within the community. 8. Recognise and address the skills bottlenecks that serve as barriers to concept progression; in this case, externally provided IT and programming skills. 9. Use available on-line and published resources rather than engage in constructing project-specific resources that quickly become obsolete. 10. Avoid perceptions of faculty ownership and operate in an increasingly competitive environment. 11. Recognise that the continuum between creativity/innovation and entrepreneurship is complex, non-linear and requires different training regimes during the different phases of the pipeline. One small entity, such as the QIS, cannot address them all. The QIS successfully designed, implemented and delivered activities that included events, workshops, seminars and services to QUT students in the extra-curricular space. That the QIS project can be considered successful derives directly from the outcomes. First, the QIS project changed the lives of emerging QUT student entrepreneurs. Also, the QIS activities developed enterprising skills in students who did not necessarily have a business proposition, at the time. Second, successful outcomes of the QIS project are evidenced as the embedding of most, perhaps all, of the QIS activities in a new Chancellery-sponsored initiative: the Leadership Development and Innovation Program hosted by QUT Student Support Services. During the course of the QIS project, the Brisbane-based innovation ecosystem underwent substantial change. From a dearth of opportunities for the entrepreneurially inclined, there is now a plethora of entities that cater for a diversity of innovation-related activities. While the QIS evolved with the landscape, the demand endpoint of the QIS activities still highlights a gap in the local and national innovation ecosystems. The freedom to experiment and to fail is not catered for by the many new entities seeking to build viable businesses on the back of the innovation push. The onus of teaching the enterprising skills, which are the employability skills now demanded by industry, remains the domain of the higher education sector.

Conceptualising the learning organisation : creating a maturity framework to develop a shared understanding of the library's role in literacy and learning

Although they sit outside the formal education sector, libraries are intrinsically centres of learning where people can engage with knowledge and ideas and acquire the literacy skills that are essential for active participation in an increasingly digital society. In Australia, National and State Libraries Australasia (NSLA) has acknowledged the need to not only better understand the general concept of the library as a learning institution, but also to help the individual NSLA libraries specifically identify their capabilities in this arena. The NSLA Literacy and Learning project aimed to improve the members' organisational comprehension and practice as learning institutions and to help them conceptualise their ability to deliver literacy and learning programmes that will benefit their staff and their communities. The NSLA concept of learning institution encompassed two discrete lenses: the internal lens of the library's own organisational understanding and practice, and the external lens of the clients who engage in the literacy and learning programmes delivered by the library. The ultimate goal was to develop a matrix which could enable libraries to assess their perceived levels of maturity as learning institutions along a continuum of emerging to active capabilities. The matrix should also serve as a tool for shared understanding about the NSLA's own strategic directions in the literacy and learning space. This case study documents the evolving process of developing a learning institution maturity framework for libraries that considers individual, team and organisational learning, as well as clients' interactions with the organisation, with the goal of producing a framework that has the potential to measure the value of learning and growth in both the library's staff and the library's communities

Teacher education targeting high-poverty schools : the National Exceptional Teachers for Disadvantaged Schools program

This paper examines the Exceptional Teachers for Disadvantaged Schools (ETDS) program and demonstrates how the outcomes from this teacher education model targeting high-poverty schools have been used to expand the model across other Australian universities. The paper outlines the parameters of ETDS and stresses the importance to the program of academic excellence, a modified teacher education curriculum, targeted practicums and a network of jurisdictional and school-based partnerships. The paper presents data from ETDS that demonstrates 90% of graduates have secured employed as teachers within high-poverty Australian schools. The paper concludes by outlining the impact of philanthropic funding (2 million dollars AUD) that will allow the expansion of the ETDS model into other teacher education universities across Australia.

'Means to ends': Integration for stakeholder engagement.

In project management today, sustainability considerations are becoming increasingly necessary as an inclusion into project discovery, design and delivery phase methodologies. However, sustainability cannot always be tacked on to traditional project management approaches and still achieve the best project outcomes. Throw in the particular considerations for a culturally specific project, as for Aboriginal and Torres Strait Islander people, and the traditional project management approach is at risk of not meeting the needs of stakeholders or their engagement. In this presentation, we will briefly demonstrate how from beginning with sustainability considerations and integrating both project management principles and Aboriginal and Torres Strait Islander va lu es that QUT's Oodgeroo Unit is actioning a 'means to ends' integration approach for stakeholder engagement in two national Aboriginal and Torres Strait Islander projects. The iterative discovery and design of the federally Higher Education Participation and Partnerships Program (HEPPP) funded Aboriginal and Torres Strait Islander Higher Education Social Marketing Strategy (Strategy) and the Aboriginal and Torres Strait Islander Higher Education Portal (Portal) projects is being informed through a 'means' to 'ends' user- and design -led project management approach for inclusivity, visioning, and participation informing these projects for susta inable national deliverables. This approach draws upon the integration of Sustain ability Development Pillars and Project Management Pillars with the contextual lens of our proposed Aboriginal and Torres Strait Islander Pillars as the underpinning methodology of the Strategy and Portal Project's Communication and Collaboration Plan and approach with stakeholders. These th ree Pillars are integrated further through participatory consideration and inclu sion of comparative models: Daly's Sustainability Triangle, Walker's Object Design, Maslow's Hierarchy of Human Needs, Olsen's Four Layers of Communication,Project Management In stitute's (PMI's) Integrated Framework for Organisational Project Management, with the Aborig inal and Torres Strait Islander six core research ethics values. This presentation invites participants to join us in envisioning the 'ultimate means' of Environment, Del ivery and Sovereignty, through Economy, Design and Self-determination to the 'ultimate ends' of Social, Discove ry and Cultural Safety principles through stakeholder engagement.

Visions and values : the Children’s Book Council of Australia’s prizing of picture books in the twenty-first century

The Children’s Book Council of Australia (CBCA) administers the oldest national prize for children’s literature in Australia. Each year, the CBCA confers “Book of the Year” awards to literature for young people in five categories. In 2001, the establishment of an “Early Childhood” category opened up the venerable “Picture Book” category (first awarded in 1955) to books with an implied readership up to 18 years of age. As a result, this category has emerged in recent years as a highly visible space within which the CBCA can contest discourses of cultural marginalisation insofar as Australian (“colonial”) literature is constructed as inferior or adjunct to the major Anglophone literary traditions, and the consistent identification of children’s literature (and, indeed, of children) as lesser than its ‘adult’ counterparts. The CBCA is engaged in defining, evaluating, and legitimising a tradition of Australian children’s literature which is underpinned by a canonical impulse, and is a reflexive practice of self-definition, self-evaluation and self-legitimisation for the CBCA itself. While it is obviously problematic to identify award winners as a canon, it is equally obvious that literary prizing is a cultural practice derived from the logic of canonicity. In his discussion of the United States’s Newbery Medal, Kenneth Kidd notes that “Medal books are instant classics, the selection process an ostensible simulation of the test of time” (169) and that “the Medal is part of the canonical architecture of children's literature” (169). Thus, it is instructive to consider the visions and values of the national, of the social, and of the literary-aesthetic, in the picture books chosen by the Children’s Book Council of Australia (CBCA) as the “best” of the early twenty-first century. These books not only constitute a kind of canon for contemporary Australian children’s literature, but may well come to define what contemporary Australian children’s literature means in the wider literary field. The Book of the Year: Picture Book awards given by the CBCA since 2001 demonstrate that it is not only true of the Booker Prize that, “The choices of winning books reflect not only on the books themselves, then, but also back on the Prize, affecting its reputation and creating journalistic capital which is vital for the Prize to achieve its prominence and impact.” (81). Many of the twenty-first century CBCA award-winning picture books complicate traditional or comfortable understanding of Australianness, children’s literature, or “appropriate” modes of form and content, reminding us that “moments when texts resist or complicate recuperation into national discourses offer fruitful points for exploring the relationships between text and celebratory context” (Roberts 6). The CBCA has taken the opportunities offered by the liberation of the Picture Book category from an implied readership to challenge dominant constructions of children’s literature in Australia, and in so doing, are engaged in overt practices of canonicity with potentially long-lasting effects. Works Cited: Kidd, Kenneth. “Prizing Children’s Literature: The Case of Newbery Gold.” Children's Literature 35 (2007): 166-190. Roberts, Gillian. Prizing Literature: The Celebration and Circulation of National Culture. Toronto: U Toronto P, 2011. Squires, Claire. “Book Marketing and the Booker Prize.” Judging a Book by Its Cover: Fans, Publishers, Designers, and the Marketing of Fiction. Eds. Nicole Matthews and Nickianne Moody. Aldershot: Ashgate, 2007. 71-82.

The impact of transformative learning in a critical service-learning program on teacher development: Building a foundation for inclusive teaching

With international and national policies requiring teachers to adopt inclusive practices worldwide, this paper examines the impact of transformational learning in a critical service-learning program on final-year pre-service teachers’ approaches to inclusive teaching. Data from emailed questionnaires and focus group interviews are analysed through a social, critical framework. The results indicate that the critical service-learning program provided the students with an opportunity to consider diversity and inclusion in selecting teaching strategies, and to enact values suitable to inclusive practices and appreciation of diversity in schools. In this paper we argue that transformative learning experiences about inclusivity and diversity are needed if pre-service teachers are to be challenged to adopt inclusive values and practice in schools. A critical service-learning program for pre-service teachers provides a solid foundation on which to develop or build on the ability to think and teach inclusively.

Teacher education for high poverty schools : the National Exceptional Teachers for Disadvantaged Schools program

A vital element to improve outcomes for disadvantaged students is outstanding teachers. A reality, however, is that teacher graduates in the top quartile of academic scores are far less likely to accept positions in tough urban, regional, rural and remote schools. Further, because high poverty schools can be challenging environments, these teachers are retained for much shorter periods of time. In response to this challenge, the National Exceptional Teachers for Disadvantaged Schools program (NETDS) creates a pathway for the highest quality pre-service teachers to be fully prepared, professionally and personally, for roles within high poverty schools. The program identifies the highest-achieving mainstream preservice teachers in university programs across the country and offers them a specialised curriculum and supported practicum experience in a network of disadvantaged partner schools. By working closely with government, philanthropy and partner schools, the program also works to channel these exceptional pre-service teachers into employment in schools where they will have the greatest impact. Its initial results have been exceptional: over 90% of graduates are now employed as teachers in high poverty schools. This paper will discuss their research on how they are working to build the infrastructure and capacity for research on innovations that prepare teachers for 21st century schools in the Australian context.

Beyond competencies : using a capability framework in developing practice standards for advanced practice nursing

AIM This paper presents a discussion on the application of a capability framework for advanced practice nursing standards/competencies. BACKGROUND There is acceptance that competencies are useful and necessary for definition and education of practice-based professions. Competencies have been described as appropriate for practice in stable environments with familiar problems. Increasingly competencies are being designed for use in the health sector for advanced practice such as the nurse practitioner role. Nurse practitioners work in environments and roles that are dynamic and unpredictable necessitating attributes and skills to practice at advanced and extended levels in both familiar and unfamiliar clinical situations. Capability has been described as the combination of skills, knowledge, values and self-esteem which enables individuals to manage change, be flexible and move beyond competency. DESIGN A discussion paper exploring 'capability' as a framework for advanced nursing practice standards. DATA SOURCES Data were sourced from electronic databases as described in the background section. IMPLICATIONS FOR NURSING As advanced practice nursing becomes more established and formalized, novel ways of teaching and assessing the practice of experienced clinicians beyond competency are imperative for the changing context of health services. CONCLUSION Leading researchers into capability in health care state that traditional education and training in health disciplines concentrates mainly on developing competence. To ensure that healthcare delivery keeps pace with increasing demand and a continuously changing context there is a need to embrace capability as a framework for advanced practice and education.

Linking pedagogical knowledge practices and student outcomes in STEM education for primary schools

STEM education is a new frontier in Australia, particularly for primary schools. However, the E in STEM needs to have a stronger focus with science and mathematics concepts aligned to the presiding curricula. In addition, pedagogical knowledge practices such as planning, preparation, teaching strategies, assessment and so forth need to be connected to key concepts for developing a STEM education. One of the aims of this study was to understand how a pedagogical knowledge practice framework could be linked to student outcomes in STEM education. Specifically, this qualitative research investigated Year 4 students’ involvement in an integrated STEM education program that focused on science concepts (e.g., states of matter, testing properties of materials) and mathematics concepts (such as 3D shapes and metric measurements: millilitres, temperature, grams, centimetres) for designing, making and testing a strong and safe medical kit to insulate medicines at desirable temperatures. Eleven pedagogical knowledge practices (e.g., planning, preparation, teaching strategies, classroom management, and assessment) were used as a framework for understanding how teaching may be linked to student outcomes in STEM education. For instance, “planning” involved devising a student booklet as a resource for students to understand the tasks required of them, which also provided space for them to record ideas, results and information. Planning involved linking national and state curriculum documents to the STEM education activities. More studies are required around pedagogical knowledge frameworks to understand what students learn when involved in STEM education, particularly with the inclusion of engineering education.

An Investigation into the Options for Increasing the Extent of Energy Efficiency Knowledge and Skills in Engineering Education

Society is increasingly calling for professionals across government, industry, business and civil society to be able to problem-solve issues related to climate change and sustainable development as part of their work. In particular there is an emerging realisation of the fundamental need to swiftly reduce the growing demand for energy across society, and to then meet the demand with low emissions options. A key ingredient to addressing such issues is equipping professionals with emerging knowledge and skills to address energy challenges in all aspects of their work. The Council of Australian Governments has recognised this need, signing the National Partnership Agreement on Energy Efficiency in July 2009, which included a commitment to assist business and industry obtain the knowledge, skills and capacity to pursue cost-effective energy efficiency opportunities.2 Engineering will play a critical part among the professions, with Engineers Australia acknowledging that, ‘The need to make changes in the way energy is used and supplied throughout the world represents the greatest challenge to engineers in moving toward sustainability.’

Creating a legal framework for copyright management of open access within the Australian academic and research sector

This chapter analyses the copyright law framework needed to ensure open access to outputs of the Australian academic and research sector such as journal articles and theses. It overviews the new knowledge landscape, the principles of copyright law, the concept of open access to knowledge, the recently developed open content models of copyright licensing and the challenges faced in providing greater access to knowledge and research outputs.

The whole world shook : shifts in ethnic, national and heroic identities in children's fiction about 9/11

Like many other cataclysmic events September 11, a day now popularly believed to have 'changed the world', has become a topic taken up by children's writers. This thesis, titled The Whole World Shook: Ethnic, National and Heroic Identities in Children's Fiction About 9/11, examines how cultural identities are constructed within fictional texts for young people written about the attacks on the Twin Towers. It identifies three significant identity categories encoded in 9/11 books for children: ethnic identities, national identities, and heroic identities. The thesis argues that the identities formed within the selected children's texts are in flux, privileging performances of identities that are contingent on post-9/11 politics. This study is located within the field of children's literature criticism, which supports the understanding that children's books, like all texts, play a role in the production of identities. Children's literature is highly significant both in its pedagogical intent (to instruct and induct children into cultural practices and beliefs) and in its obscurity (in making the complex simple enough for children, and from sometimes intentionally shying away from difficult things). This literary criticism informed the study that the texts, if they were to be written at all, would be complex, varied and most likely as ambiguous and contradictory as the responses to the attacks on New York themselves. The theoretical framework for this thesis draws on a range of critical theories including literary theory, cultural studies, studies of performativity and postmodernism. This critical framework informs the approach by providing ways for: (i) understanding how political and ideological work is performed in children's literature; (ii) interrogating the constructed nature of cultural identities; (iii) developing a nuanced methodology for carrying out a close textual analysis. The textual analysis examines a representative sample of children's texts about 9/11, including picture books, young adult fiction, and a selection of DC Comics. Each chapter focuses on a different though related identity category. Chapter Four examines the performance of ethnic identities and race politics within a sample of picture books and young adult fiction; Chapter Five analyses the construction of collective, national identities in another set of texts; and Chapter Six does analytic work on a third set of texts, demonstrating the strategic performance of particular kinds of heroic identities. I argue that performances of cultural identities constructed in these texts draw on familiar versions of identities as well as contribute to new ones. These textual constructions can be seen as offering some certainties in increasingly uncertain times. The study finds, in its sample of books a co-mingling of xenophobia and tolerance; a binaried competition between good and evil and global harmony and national insularity; and a lauding of both the commonplace hero and the super-human. Being a recent corpus of texts about 9/11, these texts provide information on the kinds of 'selves' that appear to be privileged in the West since 2001. The thesis concludes that the shifting identities evident in texts that are being produced for children about 9/11 offer implicit and explicit accounts of what constitute good citizenship, loyalty to nation and community, and desirable attributes in a Western post-9/11 context. This thesis makes an original contribution to the field of children's literature by providing a focussed and sustained analysis of how texts for children about 9/11 contribute to formations of identity in these complex times of cultural unease and global unrest.

Shared values : diverse perspectives – engaging engineering educators in integrating Indigenous engineering knowledge into current curricula

BACKGROUND Engineering is a problem-based practically oriented discipline, whose practitioners aim to find effective solutions to engineering challenges, technically and economically. Engineering educators operate within a mandate to ensure that graduate engineers understand the practicalities and realities of good engineering practice. While this is a vital goal for the discipline, emerging influences are challenging the focus on ‘hard practicalities’ and requiring recognition of the cultural and social aspects of engineering. Expecting graduate engineers to possess communication skills essential for negotiating satisfactory outcomes in contexts of complex social beliefs about the impact of their work can be an unsettling and challenging prospect for engineering educators. This project identifies and addresses Indigenous engineering practices and principles, and their relevance to future engineering practices. PURPOSE This Office of Learning and Teaching (OLT) project proposes that what is known/discoverable about indigenous engineering knowledge and practices must be integrated into engineering curricula. This is an important aspect of ensuring that engineering as a profession responds competently to increasing demands for socially and environmentally responsible activity across all aspects of engineering activity. DESIGN/METHOD The project addresses i) means for appropriate inclusion of Indigenous students into usual teaching activities ii) assuring engineering educators have access to knowledge of Indigenous practices and skills relevant to particular engineering courses and topics iii) means for preparing all students to negotiate their way through issues of indigenous relationships with the land where engineering projects are planned. The project is undertaking wide-ranging research to collate knowledge about indigenous engineering principles and practices and develop relevant resource materials. RESULTS It is common to hear that such social issues as ‘Indigenous concerns’ are only of concern to environmental engineers. We challenge that perspective, and make the case that Indigenous knowledge is an important issue for all engineering educators in relation to effective integration of indigenous students and preparation of all engineering graduates to engage with indigenous communities. At the time of first contact, a rich and varied, technically literate, Indigenous social framework possessed knowledge of the environment that is not yet fully acknowledged in Australian society. A core outcome of the work will be development of resources relating to Indigenous engineering practices for inclusion in engineering core curricula. CONCLUSIONS A large body of technical knowledge was needed to survive and sustain human society in the complex environment that was Australia before 1788. This project is developing resource materials, and supporting documentation, about that knowledge to enable engineering educators to more easily integrate it into current curricula. The project also aims to demonstrate the importance for graduating engineers to appreciate the existence of diverse perspectives on engineering tasks and learn how to value - and employ - multiple paths to possible solutions.

Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.