Curriculum evaluation : approaches and methodologies

Curriculum evaluation, as a field of study, is dynamic. For over the years it has been responsive to the developments in the conceptualization of curriculum and the associated processes of curriculum change. The concept of curriculum is integral to curriculum evaluation and can be defined in terms of what can and shall be taught to whom, when, where, how, and why. Much of the decision making relates to what knowledge is to be selected for inclusion in the curriculum.

An ecological footprint for an early learning centre : identifying opportunities for early childhood sustainability education through interdisciplinary research

In this study, engineers and educators worked together to adapt and apply the ecological footprint (EF) methodology to an early learning centre in Brisbane, Australia. Results were analysed to determine how environmental impact can be reduced at the study site and more generally across early childhood settings. It was found that food, transport and energy consumption had the largest impact on the centre’s overall footprint. In transport and energy, early childhood centres can reduce their impact through infrastructure and cultural change, in association with changed curriculum strategies. Building design, the type of energy purchased and appliance usage can all be modified to reduce the energy footprint. The transport footprint can be reduced through more families using active and public transport, which can be encouraged by providing information, support and facilities and appropriate siting of new centres. Introducing the concept of ecological footprint in early childhood education may be an effective way to educate children, staff and parents on the links between the food they eat, land usage and environmental impact. This study responds directly to the call in this journal for research focused on early childhood education and for more to be made of interdisciplinary research opportunities.

Re-conceptualising and re-positioning Australian library and information science education for the 21st century [Final Report 2011]

How can Australian library and information science (LIS) education produce, in a sustainable manner, the diverse supply of graduates with the appropriate attributes to develop and maintain high quality professional practice in the rapidly changing 21st century? This report presents the key findings of a project that has examined this question through research into future directions for LIS education in Australia. Titled Re-conceptualising and re-positioning Australian library and information science education for the twenty-first century, the purpose of the project was to establish a consolidated and holistic picture of the Australian LIS profession, and identify how its future education and training can be mediated in a cohesive and sustainable manner. The project was undertaken with a team of 12 university and vocational LIS educators from 11 institutions around Australia between November 2009 and December 2010. Collectively, these eleven institutions represented the broad spectrum and diversity of LIS education in Australia, and enabled the project to examine education for the information profession in a holistic and synergistic manner. Participating institutions in the project included Queensland University of Technology (Project Leader), Charles Sturt University, Curtin University of Technology, Edith Cowan University, Monash University, RMIT University, University of Canberra, University of South Australia, University of Tasmania, University of Technology Sydney and Victoria University. The inception and need for the project was motivated by a range of factors. From a broad perspective several of these factors relate to concerns raised at national and international levels regarding problems with education for LIS. In addition, the motivation and need for the project also related to some unique challenges that LIS education faces in the Australian tertiary education landscape. Over recent years a range of responses to explore the various issues confronting LIS education in Australia have emerged at local and national levels however this project represented the first significant investment of funding for national research in this area. In this way, the inception of the project offered a unique opportunity and powerful mechanism through which to bring together key stakeholders and inspire discourse concerning future education for the profession. Therefore as the first national project of its kind, its intent has been to provide foundation research that will inform and guide future directions for LIS education and training in Australia. The primary objective of the project was to develop a Framework for the Education of the Information Professions in Australia. The purpose of this framework was to provide evidence based strategic recommendations that would guide Australia’s future education for the information professions. Recognising the three major and equal players in the education process the project was framed around three areas of consideration: LIS students, the LIS workforce and LIS educators. Each area of consideration aligned to a research substudy in the project. The three research substudies were titled Student Considerations, Workforce Planning Considerations and Tertiary Education Considerations. The Students substudy provided a profile of LIS students and an analysis of their choices, experiences and expectations in regard to LIS education and their graduate destinations. The Workforce substudy provided an overview and analysis of the nature of the current LIS workforce, including a focus on employer expectations and employment opportunities and comment on the core and elective skill, knowledge and attitudes of current and future LIS professionals. Finally the Tertiary Education substudy provided a profile of LIS educators and an analysis of their characteristics and experiences including the key issues and challenges. In addition it also explored current national and international trends and priorities impacting on LIS education. The project utilised a Community Based Participatory Research (CBPR) approach. This approach involves all members of the community in all aspects of the project. It recognised the unique strengths and perspectives that community members bring to the process. For this project ‘community’ comprised of all individuals who have a role in, or a vested interest in, LIS education and included LIS educators, professionals, employers, students and professional associations. Individuals from these sub-groups were invited to participate in a range of aspects of the project from design through to implementation and evaluation. A range of research methodologies were used to consider the many different perspectives of LIS education, including employers and recruiters, professional associations, students, graduates and LIS teaching staff. Data collection involved a mixed method approach of questionnaires, focus groups, semi-structured interviews and environmental scans. An array of approaches was selected to ensure that broadest possible access to different facets of the information profession would be achieved. The main findings and observations from each substudy have highlighted a range of challenges for LIS education that need to be addressed. These findings and observations have grounded the development of the Framework for the Education of the Information Professions in Australia. The framework presents eleven recommendations to progress the national approach to LIS education and guide Australia’s future education for the information professions. The framework will be used by the LIS profession, most notably its educators, as strategic directions for the future of LIS education in Australia. Framework for the Education of the Information Professions in Australia: Recommendation 1: It is recommended that a broader and more inclusive vocabulary be adopted that both recognises and celebrates the expanding landscape of the field, for example ‘information profession’, ‘information sector’, ‘information discipline’ and ‘information education’. Recommendation 2: It is recommended that a self-directed body composed of information educators be established to promote, support and lead excellence in teaching and research within the information discipline. Recommendation 3: It is recommended that Australia’s information discipline continue to develop excellence in information research that will raise the discipline’s profile and contribute to its prominence within the national and international arena. Recommendation 4: It is recommended that further research examining the nature and context of Australia’s information education programs be undertaken to ensure a sustainable and relevant future for the discipline. Recommendation 5: It is recommended that further research examining the pathways and qualifications available for entry into the Australian information sector be undertaken to ensure relevance, attractiveness, accessibility and transparency. Recommendation 6: It is recommended that strategies are developed and implemented to ensure the sustainability of the workforce of information educators. Recommendation 7: It is recommended that a national approach to promoting and marketing the information profession and thereby attracting more students to the field is developed. Recommendation 8: It is recommended that Australia’s information discipline continues to support a culture of quality teaching and learning, especially given the need to accommodate a focus on the broader information landscape and more flexible delivery options. Recommendation 9: It is recommended that strategies are developed that will support and encourage collaboration between information education within the higher education and VET sectors. Recommendation 10: It is recommended that strategies and forums are developed that will support the information sector working together to conceptualise and articulate their professional identity and educational needs. Recommendation 11: It is recommended that a research agenda be established that will identify and prioritise areas in which further development or work is needed to continue advancing information education in Australia. The key findings from this project confirm that a number of pressing issues are confronting LIS education in Australia. Left unaddressed these issues will have significant implications for the future of LIS education as well as the broader LIS profession. Consequently creating a sustainable and cohesive future can only be realised through cooperation and collaboration among all stakeholders including those with the capacity to enact radical change in university and vocational institutions. Indeed the impending adoption and implementation of the project’s recommendations will fundamentally determine whether Australian LIS education is assured both for the present day and into the future.

A highway for research in science education that no longer leads to the frontier

A review of "Progressing science education: constructing the scientific research programme into the contingent nature of learning science", by Keith S. Taber, Dordrecht, Springer, 2009.

A Fair Go Beyond the School Gate? Systemic factors affecting participation and attainment in tertiary education by Queensland students from LSES backgrounds

The purpose of this project was to conduct an empirical study that would result in findings that inform systemic policy development aimed at improving tertiary participation and attainment by students from low socioeconomic status (LSES) backgrounds in Queensland. The project focuses on systemic policy, initiatives and programs that encourage tertiary education participation and attainment by individuals from LSES backgrounds, rather than on institution-specific initiatives or programs. While the broad remit was to consider tertiary education participation, the study particularly highlights issues pertaining to LSES student participation and attainment in the higher education sector, given the notable under representation of this demographic subgroup in Australian universities. This study supports the strategic priority of addressing professional skills shortages and innovations aiming to improve human and social capital in the state of Queensland. The ultimate goal is to contribute to the enhancement of Queensland’s education and training system by maximising participation and attainment by people from LSES backgrounds in higher education, thereby improving their quality of life and future life choices and opportunities. The study addressed the following five research questions: 1. What are the major factors that promote or inhibit participation and attainment in tertiary education by LSES students in Queensland? 2. To what extent do systemic policies or practices(systemic factors) of Queensland’s tertiary education system promote or inhibit participation and attainment by LSES students? That is, what features of Queensland’s tertiary education system have a significant effect on participation and attainment by LSES students? 3. What system policies or practices are found to boost participation and attainment by LSES students in other jurisdictions? 4. What evidence is there to suggest that policies or practices that have boosted participation and attainment by LSES students in other jurisdictions would be successful if implemented in Queensland? 5. What are the implications of the research findings for Queensland’s tertiary education system to improve participation and attainment by LSES students? The project adopted a mixed methods approach to data collection. A comprehensive review of the literature was conducted to identify relevant state, national and international literature. Both qualitative and quantitative methodologies were used to collect data from a range of key stakeholders.

Cultural factors affecting tertiary education access for Bundjalung men

Despite documented changes to mainstream educational systems, Indigenous educational achievements are still at critically low levels across all phases of formal education. According to the Australian Bureau of Statistics (2011) Indigenous students are still less likely than non-Indigenous students to complete their final years of schooling (45% compared with 77% in 2009); tertiary level entry and outcomes are also significantly lower than non-Indigenous entry and outcomes. Although significant research has focused on the area of Indigenous education, in particular, identifying and making recommendations on how to close educational gaps between Indigenous and non-Indigenous people, these studies have failed to bring about the change needed and to engage successfully with Indigenous communities and draw on Indigenous communities’ insights for best practice. This thesis focuses on Indigenous perspectives and takes a closer look at the cultural factors that impact on tertiary education access for Indigenous young men who come from a Bundjalung community on the far north coast of northern New South Wales. To date, this community has not been the focus of serious postgraduate study. Their experiences and the values and ideas of their community have not been investigated. To do this, the study uses an Indigenous methodological framework. It draws on Indigenous Standpoint Theory to analyse data through concepts of the cultural interface and tensions (Nakata, 2007, pp. 195-217). The study’s framing also draws on decolonising methods (Porsanger, 2004; Smith, 1999) and Indigenist research methods (Rigney, 1997). Such methodologies are intended to benefit both the research participants (community members) and the researcher. In doing so, the study draws on Creswell’s (2008) methods of restorying and retelling to analyse the participants’ interviews and yarns about their lives and experiences relating to tertiary educational access. The research process occurred in multiple stages: (1) selection of research sites, (2) granting of access which was requested through consultation with local Aboriginal Elders and through the local Aboriginal Lands Council, (3) conducting of interviews with participants/ data collection, (4) analysis of data, (5) documentation of findings, (6) theory development, and (7) reporting back to the nominated Indigenous community on the progress and findings of the research. The benefits of this research are numerous. First, this study addresses an issue that has been identified from within the local Aboriginal community as an issue of high precedence, looking at the cultural factors surrounding the underrepresentation of Indigenous people accessing tertiary education. This is not only of local significance but has been identified in the literature as a local, national and international area of concern amongst Indigenous peoples (Department of Economic and Social Affairs, 2009; Herbert, 2010; King, 2011). Secondly, the study draws on local Indigenous knowledges and learning processes from within a Bundjalung community to gain inside perspectives, namely the cultural factors that are being expressed from a range of Indigenous community members – young men, community Elders and community members – and finding out what they perceive inhibit and/or promote tertiary education participation within their community. Such perspectives are rarely heard. Finally, recommendations made from this study are aimed at revealing investigative styles that may be utilised by Western institutions to improve access for Indigenous young men living in the Narlumdarlum1 region in the tertiary context.

Content analysis of international research in geographical and environmental education : eighteen years of academic publishing

This paper examines the history of the IRGEE Journal in terms of its sustainable future. The development of geographical and environmental education is evaluated, as reflected from the articles published in the Journal “International Research in Geographical and Environmental Education” (IRGEE). A content analysis of all papers and forum sections which have appeared in the journal since Volume 1 Number 1 was published in 1992 has been conducted, examining the content of as many as 526 articles. The method was a content analysis, and revealed themes which have experienced an increasing or declining interest over the 18 years of publication of IRGEE (1992-2009), while other themes have remained current during this period. The main findings of this analysis are: a) the total number of articles has increased more than threefold, b) articles related to geographical education (sensu stricto) outweighed those related to environmental education, c) the themes “syllabi, textbooks, curricula” and “values, attitudes” attract the attention of researchers with increasing strength and d) emerging subjects, such as GIS and sustainability have appeared dynamically in the last years.

Statistical and scientometric analysis of international research in geographical and environmental education

Certain statistic and scientometric features of articles published in the journal “International Research in Geographical and Environmental Education” are examined in this paper, for the period 1992-2009, by applying nonparametric statistics and Shannon’s entropy (diversity) formula. The main findings of this analysis are: a) after 2004 the research priorities of researchers in geographical and environmental education seem to have changed, b) “teacher education” has been the most recurrent theme throughout these 18 years, followed by “values & attitudes” and “inquiry & problem solving” c) the themes “GIS” and “Sustainability” were the most “stable” throughout the 18 years, meaning that they maintained their ranks as publication priorities more than other themes, d) citations of IRGEE increase annually, e) the average thematic diversity of articles published during the period 1992-2009 is 82.7% of the maximum thematic diversity (very high), meaning that the Journal has the capacity to attract a wide readership for the 10 themes it has successfully covered throughout the 18 years of its publication.

Tech-Savvy Youth and Participatory Research in “iScapes”

This chapter provides a theoretically and empirically grounded discussion of participatory research methodologies with respect to investigating the dynamic and evolving phenomenon of young people constructing identities and social relations in “iScapes”. We coin the term iScapes to refer to the online/offline interconnectedness of spaces in the fabric of everyday life. Specifically, we offer a critical analysis of the participatory research methods we used in our own research project to understand the ways in which high school students use new media and information communication technologies (ICTs) to construct identities, form social relations, and engage in creative practices as part of their everyday lives. The chapter concludes with reflexive deliberations on our approach to participatory research that may benefit other researchers who share a similar interest in youth and new media.

Education higher degree research students writing for publication

Higher Degree Research (HDR) student publications are increasingly valued by students, by professional communities and by research institutions. Peer-reviewed publications form the HDR student writer's publication track record and increase competitiveness in employment and research funding opportunities. These publications also make the results of HDR student research available to the community in accessible formats. HDR student publications are also valued by universities because they provide evidence of institutional research activity within a field and attract a return on research performance. However, although publications are important to multiple stakeholders, many Education HDR students do not publish the results of their research. Hence, an investigation of Education HDR graduates who submitted work for publication during their candidacy was undertaken. This multiple, explanatory case study investigated six recent Education HDR graduates who had submitted work to peer-reviewed outlets during their candidacy. The conceptual framework supported an analysis of the development of Education HDR student writing using Alexander's (2003, 2004) Model of Domain Learning which focuses on expertise, and Lave and Wenger's (1991) situated learning within a community of practice. Within this framework, the study investigated how these graduates were able to submit or publish their research despite their relative lack of writing expertise. Case data were gathered through interviews and from graduate publication records. Contextual data were collected through graduate interviews, from Faculty and university documents, and through interviews with two Education HDR supervisors. Directed content analysis was applied to all data to ascertain the support available in the research training environment. Thematic analysis of graduate and supervisor interviews was then undertaken to reveal further information on training opportunities accessed by the HDR graduates. Pattern matching of all interview transcripts provided information on how the HDR graduates developed writing expertise. Finally, explanation building was used to determine causal links between the training accessed by the graduates and their writing expertise. The results demonstrated that Education HDR graduates developed publications and some level of expertise simultaneously within communities of practice. Students were largely supported by supervisors who played a critical role. They facilitated communities of practice and largely mediated HDR engagement in other training opportunities. However, supervisor support alone did not ensure that the HDR graduates developed writing expertise. Graduates who appeared to develop the most expertise, and produce a number of publications reported experiencing both a sustained period of engagement within one community of practice, and participation in multiple communities of practice. The implications for the MDL theory, as applied to academic writing, suggests that communities of practice can assist learners to progress from initial contact with a new domain of interest through to competence. The implications for research training include the suggestion that supervisors as potentially crucial supporters of HDR student writing for publication should themselves be active publishers. Also, Faculty or university sponsorship of communities of practice focussed on HDR student writing for publication could provide effective support for the development of HDR student writing expertise and potentially increase the number of their peer-reviewed publications.

Innovation through action research in environmental education : from project to praxis

This thesis is a work-in-progress that articulates my research journey based on the development of a curriculum innovation in environmental education. This journey had two distinct, but intertwined phases: action research based fieldwork, conducted collaboratively, to create a whole school approach to environmental education curriculum planning; and a phase of analysis and reflection based on the emerging findings, as I sought to create personal "living educational theory" about change and innovation. A key stimulus for the study was the perceived theory-practice gap in environmental education, which is often presented in the literature as a criticism of teachers for failing to achieve the values and action objectives of critical environmental education. Hence, many programs and projects are considered to be superficial and inconsequential in terms of their ability to seriously address environmental issues. The intention of this study was to work with teachers in a project that would be an exemplar of critical environmental education. This would be in the form of a whole school "learnscaping" curriculum in a primary school whereby the schoolgrounds would be utilised for interdisciplinary critical environment education. Parallel with the three cycles of action research in this project, my research objectives were to identify and comment upon the factors that influence the generation of successful educational innovation. It was anticipated that the project would be a collaboration involving me, as researcher-facilitator, and many of the teachers in the school as active participants. As the project proceeded through its action cycles, however, it became obvious that the goal of developing a critical environmental education curriculum, and the use of highly participatory processes, were unrealistic. Institutional and organisational rigidities in education generally, teachers' day-to-day work demands, and the constant juggle of work, family and other responsibilities for all participants acted as significant constraints. Consequently, it became apparent that the learnscaping curriculum would not be the hoped-for exemplar. Progress was slow and, at times, the project was in danger of stalling permanently. While the curriculum had some elements of critical environmental education, these were minor and not well spread throughout the school. Overall, the outcome seemed best described as a "small win"; perhaps just another example of the theory-practice gap that I had hoped this project would bridge. Towards the project's end, however, my continuing reflection led to an exploration of chaos/complexity theory which gave new meaning to the concept of a "small win". According to this theory, change is not the product of linear processes applied methodically in purposeful and diligent ways, but emerges from serendipitous events that cannot be planned for, or forecast in advance. When this perspective of change is applied to human organisations - in this study, a busy school - the context for change is recognised not as a stable, predictable environment, but as a highly complex system where change happens all the time, cannot be controlled, and no one can be really sure where the impacts might lead. This so-called "butterfly effect" is a central idea of this theory where small changes or modifications are created - the effects of which are difficult to know, let alone determine - and which can have large-scale impacts. Allied with this effect is the belief that long term developments in an organisation that takes complexity into account, emerge by spontaneous self-organising evolution, requiring political interaction and learning in groups, rather than systematic progress towards predetermined goals or "visions". Hence, because change itself and the contexts of change are recognised as complex, chaos/complexity theory suggests that change is more likely to be slow and evolutionary - cultural change - rather than fast and revolutionary where the old is quickly ushered out by radical reforms and replaced by new structures and processes. Slow, small-scale changes are "normal", from a complexity viewpoint, while rapid, wholesale change is both unlikely and unrealistic. Therefore, the frustratingly slow, small-scale, imperfect educational changes that teachers create - including environmental education initiatives - should be seen for what they really are. They should be recognised as successful changes, the impacts of which cannot be known, but which have the potential to magnify into large-scale changes into the future. Rather than being regarded as failures for not meeting critical education criteria, "small wins" should be cause for celebration and support. The intertwined phases of collaborative action research and individual researcher reflection are mirrored in the thesis structure. The first three chapters, respectively, provide the thesis overview, the literature underpinning the study's central concern, and the research methodology. Chapters 4, 5, and 6 report on each of the three action research cycles of the study, namely Laying the Groundwork, Down to Work!, and The Never-ending Story. Each of these chapters presents a narrative of events, a literature review specific to developments in the cycle, and analysis and critique of the events, processes and outcomes of each cycle. Chapter 7 provides a synthesis of the whole of the study, outlining my interim propositions about facilitating curriculum change in schools through action research, and the implications of these for environmental education.

Standards and Research in Geographical Education: Current Trends and International Issues

What is the state of geographical education in the second decade of the 21st century? This volume presents a selection of peer reviewed papers presented at the 2012 Cologne Congress of the International Geographical Union (IGU) sessions on Geographical Education as representative of current thinking in the area. It then presents (perhaps for the first time) a cross-case analysis of the common factors of all these papers as a current summary of the “state of the art” of geographical education today. The primary aim of the individual authors as well as the editors is not only to record the current state of the art of geographical education but also to promote ongoing discussions of the longer term health and future prospects of international geographical education. We wish to encourage ongoing debate and discussion amongst local, national, regional and international education journals, conferences and discussion groups as part of the international mission of the Commission on Geographical Eduction. While the currency of these chapters in terms of their foci, breadth and recency of the theoretical literature on which they are based and the new research findings they present justifies considerable confidence in the current health of geographical education as an educational and research endeavour, each new publication should only be the start of new scholarly inquiry. Where should we, as a scholarly community, place our energies for the future? If readers are left with a new sense of direction, then the aims of the authors and editors will have been amply met.

Ghost hunting with lollies, chess and Lego : appreciating the ‘messy’ complexity (and costs) of doing difficult research in education

This paper contributes to conversations about the funding and quality of education research. The paper proceeds in two parts. Part I sets the context by presenting an historical analysis of funding allocations made to Education research through the ARC’s Discovery projects scheme between the years 2002 and 2014, and compares these trends to allocations made to another field within the Social, Behavioural and Economic Sciences assessment panel: Psychology and Cognitive Science. Part II highlights the consequences of underfunding education research by presenting evidence from an Australian Research Council Discovery project that is tracking the experiences of disaffected students who are referred to behaviour schools. The re-scoping decisions that became necessary and the incidental costs that accrue from complications that occur in the field are illustrated and discussed through vignettes of research with “ghosts” who don’t like school but who do like lollies, chess and Lego.

Research in Early Childhood Education for Sustainability : International Perspectives and Provocations

Sustainability is a global issue that urgently needs addressing, the most serious consequences of which concern children and future generations. This insightful research text tackles one of the most significant contemporary issues of our times – the nexus between society and environment – and how early childhood education can contribute to sustainable living. By offering international and multidisciplinary research perspectives on Early Childhood Education for Sustainability, each chapter explores and investigates the complex topic of sustainability and its relationship to early childhood education. A particular emphasis that runs through this text is young children as empowered citizens, capable of both contributing to and creating change for sustainability. The chapter authors work from, or are aligned with, a transformative education paradigm that suggests the socio-constructivist frameworks currently underpinning Early Childhood Education require reframing in light of the social transformations necessary to address humanity’s unsustainable, unjust and unhealthy living patterns. This research text is designed to be provocative and challenging; in so doing it seeks to encourage exploration of current understandings about Early Childhood Education for Sustainability, offers new dimensions for more deeply informed practice, and proposes avenues for further research in this field.