Australian higher education evaluation through assurance of learning

A collaborative research project conducted by five Australian universities inquired into the philosophy and motivation for Assurance of Learning (AoL) as a process of education evaluation. Associate Deans Teaching and Learning representing Business schools from twenty-five universities across Australia participated in telephone interviews. Data was analysed using NVIVO9. Results indicated that articulated rationale for AoL was both ensuring that students had acquired the attributes and skills the universities claimed they had, and the philosophy of continuous improvement. AoL was motivated both by ritualistic objectives to satisfy accreditation requirements and virtuous agendas for quality improvement. Closing-the-loop was emphasised, but was mostly wishful thinking for next steps beyond data collection and reporting. AoL was conceptualised as one element within the larger context of quality review, but there was no evidence of comprehensive frameworks or strategic plans.

Assurance of learning – are academics and senior management singing from the same hymn sheet?

Assurance of learning (AoL) is an important process in quality education, designed to measure the accomplishment of educational aims at the core of an institution’s programs, whilst encouraging faculty to continuously develop and improve the programs and courses. This paper reports on a study of Australian business schools to investigate current AoL practices through semi structured interviews with senior faculty leaders followed by focus group interviews with groups of senior program leaders and groups of academic teaching staff. Initial findings indicate there are significant challenges in encouraging academic staff to commit to the process and recognise the benefits of assuring learning. The differences in understanding between the various leaders and the academics were highlighted through the different focus groups. Leaders’ stressed strategic issues such as staff engagement and change, while academics focussed on process issues such as teaching graduate attributes and external accreditation. Understanding the differences in the perspectives of leaders and faculty is important, as without a shared understanding between the two groups, there is likely to be limited engagement, which creates difficulties in developing effective assurance of learning processes. Findings indicate that successful strategies developed to foster shared values on assurance of learning include: strong senior leaders’ commitment; developing champions among program and unit level staff; providing professional development opportunities; promoting and celebrating success and effectiveness; and ensuring an inclusive process with academics of all levels collaborating in the development and implementation of the process.

Enabling innovation and facilitating learning in kifs: the role of HRM practices

The aim of this paper is to contribute to our understanding of the link between HR practices, learning orientation and types of innovation in knowledge-intensive firms (KIFs). To this end, we first compiled a comprehensive overview of the existing literature on HR practices aimed at supporting innovation. On the basis of this literature, we then collected and analyzed data from a qualitative study of 19 Danish KIFs recognized for their innovation performance, focusing on links between the HR practices they use to support exploratory and exploitive learning behaviors to enhance incremental and/or radical innovation. The findings from this study demonstrate that KIFs utilize a range of HR practices that enable different learning orientations, based on the type of innovation compatible with their organizational goals.

Learning communities learning series

In 2008 the introduction of the National Assessment Program – Literacy and Numeracy (NAPLAN), combined with the publication of the international comparative analyses of student achievement data (such as the Programme of International Student Assessment (PISA) developed by the Organisation for Economic Co-operation and Development (OECD) and the Trends in International Mathematics and Science Study (TIMSS) of the International Association for the Evaluation of Educational Achievement (IEA)) highlighted a significant priority for Australian education by identifying low levels of equity.

The impact of English as a Foreign Language (EFL) listening comprehension through first language (L1) listening strategy training

Listening is the basic and complementary skill in second language learning. The term listening is used in language teaching to refer to a complex process that allows us to understand spoken language. Listening, the most widely used language skill, is often used in conjunction with the other skills of speaking, reading and writing. Listening is not only a skill area in primary language performance (L1), but is also a critical means of acquiring a second language (L2). Listening is the channel in which we process language in real time – employing pacing, units of encoding and decoding (the 2 processes are central to interpretation and meaning making) and pausing (allows for reflection) that are unique to spoken language. Despite the wide range of areas investigated in listening strategies during training, there is a lack of research looking specifically at how effectively L1 listening strategy training may transfer to L2. To investigate the development of any such transfer patterns the instructional design and implementation of listening strategy of L1 will be critical.

Meaningful musical engagement : the potential impact of generative music systems on learning experiences

In order to create music, the student must establish a relationship with the musical materials. In this thesis, I examine the capacity of a generative music system called jam2jam to offer individuals a virtual musical play-space to explore. I outline the development of an iteration of software development named jam2jam blue and the evolution of a games-like user interface in the research design that jointly revealed the nature of this musical exploration. The findings suggest that the jam2jam blue interface provided an expressive gestural instrument to jam and experience musicmaking. By using the computer as an instrument, participants in this study were given access to meaningful musical experiences in both solo and ensemble situations and the researcher is allowed a view of their development of a relationship with the musical materials from the perspective of the individual participants. Through an iterative software development methodology, pedagogy and experience design were created simultaneously. The research reveals the potential for the jam2jam software to be used as a reflective tool for feedback and assessment purposes. The power of access to ensemble music making is realised though the participants’ virtual experiences which are brought into their physical space by sharing their experience with others. It is suggested that this interaction creates an environment conducive to self-initiated learning in which music is the language of interaction. The research concludes that the development of a relationship between the explorer and the musical materials is subject to the collaborative nature of the interaction through which the music is experienced.

Towards local cultures of sustainability : facilitating community created environment education centres through design

Ecological sustainability has been proposed to address the problem of human impacts increasingly degrading planetary resources and ecosystems, threatening biodiversity, eco-services and human survival. Ecological sustainability is an imperative, with Australia having one of the highest eco-footprints per person worldwide. While significant progress has been made via implementation of ecologically sustainable design in urban communities, relatively little has been undertaken in small, disparate regional communities in Australia. Regional communities are disadvantaged by rural economic decline associated with structural change and inequities of resource transfer. The ecologically sustainable solution is holistic, so all settlements need to be globally wise, richly biodiverse yet locally specific. As a regional solution to this global problem, this research offers the practical means by which a small regional community can contribute. It focuses on the design and implementation of a community centre and the fostering of transformative community learning through an integrated ‘learning community’ awareness of ecologically sustainable best practice. Lessons learned are documented by the participant researcher who as a designer, facilitator, local resident and social narrator has been deeply connected with the Tweed-Caldera region over a period since 1980. The collective action of the local community of Chillingham has been diligently recorded over a decade of design and development. Over this period, several positive elements emerged in terms of improvements to the natural and built environment, greater social cohesion and co-operative learning along with a shift towards a greener local economy. Behavioural changes in the community were noted as residents strived to embrace ecological ideals and reduce fossil fuel dependency. They found attractive local solutions to sourcing of food and using local employment opportunities to up skill their residents via transformative learning as a community in transition. Finally, the catalytic impact of external partnering has also been documented. How well the region as a whole has achieved its ecologically sustainable objectives is measured in terms of the delivered success of private and public partnering with the community, the creation of a community centre cum environment education centre, the restoration of local heritage buildings, the repair of riparian forests and improved water conditions in local river systems, better roads and road safety, local skills and knowledge transfer, support of local food and local/regional growers markets to attract tourists via the integrated trails network. In aggregate, each and every element contributes to a measure of eco-positive development for the built environment, its social organisation and its economy that has guided the local community to find its own pathway to sustainability. Within the Tweed-Caldera bioregion in northern New South Wales, there has been a lack of strategic planning, ecologically sustainable knowledge and facilities in isolated communities that could support the development of a local sustained green economy, provide a hub for socio-cultural activities and ecology based education. The first challenge in this research was to model a whole systems approach to eco-positive development in Chillingham, NSW, a small community where Nature and humanity know no specific boundary. The net result was the creation of a community environment education centre featuring best-affordable ecological practice and regionally distinctive, educational building form from a disused heritage building (cow bale). This development, implemented over a decade, resonated with the later regional wide programs that were linked in the Caldera region by the common purpose of extending the reach of local and state government assistance to regional NSW in economic transition coupled with sustainability. The lessons learned from these linked projects reveal that subsequent programs have been significantly easier to initiate, manage, develop and deliver results. In particular, pursuing collaborative networks with all levels of government and external private partners has been economically effective. Each community’s uniqueness has been celebrated and through drawing out these distinctions, has highlighted local vision, strategic planning, sense of belonging and connection of people with place. This step has significantly reduced the level of friction between communities that comes from natural competition for the finite pool of funds. Following the pilot Tweed-Caldera study, several other NSW regional communities are now undertaking a Community Economic Transition Program based on the processes, trials and positive experiences witnessed in the Tweed-Caldera region where it has been demonstrated that regional community transition programs can provide an opportunity to plan and implement effective long term strategies for sustainability, empowering communities to participate in eco-governance. This thesis includes the design and development of a framework for community created environment education centres to provide an equal access place for community to participate to meet their essential needs locally. An environment centre that facilitates community transition based on easily accessible environmental education, skills and infrastructure is necessary to develop local cultures of sustainability. This research draws upon the literatures of ecologically sustainable development, environmental education and community development in the context of regional community transition towards ‘strong sustainability’. The research approach adapted is best described as a four stage collaborative action research cycle where the participant researcher (me) has a significant involvement in the process to foster local cultures of sustainability by empowering its citizens to act locally and in doing so, become more self reliant and socially resilient. This research also draws upon the many fine working exemplars, such as the resilience of the Cuban people, the transition town initiative in Totnes, U.K. and the models of Australian Community Gardens, such as CERES (Melbourne) and Northey Street (Brisbane). The objectives of this study are to research and evaluate exemplars of ecologically sustainable environment education centres, to facilitate the design and development of an environment education centre created by a small regional community as an ecologically sustainable learning environment; to facilitate a framework for community transition based on environmental education, skills and infrastructure necessary to develop local cultures of sustainability. The research was undertaken as action research in the Tweed Caldera in Northern NSW. This involved the author as participant researcher, designer and volunteer in two interconnected initiatives: the Chillingham Community Centre development and the Caldera Economic Transition Program (CETP). Both initiatives involved a series of design-led participatory community workshops that were externally facilitated with the support of government agency partnerships, steering committees and local volunteers. Together the Caldera research programs involved communities participating in developing their own strategic planning process and outcomes. The Chillingham Community Centre was developed as a sustainable community centre/hub using a participatory design process. The Caldera Economic Transition Program (CETP) prioritised Caldera region projects: the Caldera farmer’s market; community gardens and community kitchens; community renewable energy systems and an integrated trails network. The significant findings were: the CETP projects were capable of moving towards an eco-positive design benchmark through transformative learning. Community transition to sustainability programs need to be underpinned by sustainability and environmental education based frameworks and practical on ground experience in local needs based projects through transformative learning. The actioned projects were successfully undertaken through community participation and teamwork. Ecological footprint surveys were undertaken to guide and assess the ongoing community transition process, however the paucity of responses needs to be revisited. The concept of ecologically sustainable development has been adopted internationally, however existing design and planning strategies do not assure future generations continued access to healthy natural life support systems. Sustainable design research has usually been urban focussed, with little attention paid to regional communities. This study seeks to redress this paucity through the design of ecologically sustainable (deep green) learning environments for small regional communities. Through a design-led process of environmental education, this study investigates how regional communities can be facilitated to model the principles of eco-positive development to support transition to local cultures of sustainability. This research shows how community transition processes and projects can incorporate sustainable community development as transformative learning through design. Regional community transition programs can provide an opportunity to plan long term strategies for sustainability, empowering people to participate in eco-governance. A framework is developed for a community created environment education centre to provide an equal access place for the local community to participate in implementing ways to meet their essential needs locally. A community environment education centre that facilitates community transition based on holistic environmental education, skills and infrastructure is necessary to develop local cultures of sustainability.

Pragmatics, perceptions and strategies in Chinese college English learning

This study investigated Chinese College English students. perceptions of pragmatics, their pragmatic competence in selected speech acts, strategies they employed in acquiring pragmatic knowledge, as well as their general approach to learning English as a foreign language. The research was triggered by a national curriculum initiative that prioritizes the need for College English students to enhance their ability to use English effectively in different social interactions (Chinese College English Education and Supervisory Committee, 2007). The traditional "grammar-translation" and "examination-oriented" method is believed to have reduced Chinese College English students to what is dubbed "mute" and "deaf" language learners (Zhang, 2008; Zhao, 2009). Many students lack pragmatic knowledge on how to interpret discourse by relating utterances to their meanings, understanding the intention of language users, and how language is used in specific settings (Bachman & Palmer, 1996, 2010). There is an increasing body of literature on awareness-raising of the importance of pragmatic knowledge and strategies for classroom instruction. However, to date, researchers have tended to focus largely on the teaching of pragmatics, rather than on how students acquire pragmatic competence (Bardovi-Harlig & Dornyei, 1998; Du, 2004; Hou, 2007; Ruan, 2007; Schauer, 2009). It is this gap in the research that this study fills, with a focus on different types of pragmatic knowledge, learner perceptions of such knowledge, and learning strategies that College English students employ in the process of learning English in general, and pragmatics in particular. Three strands of theories of second language acquisition (Ellis, 1985, 1994): pragmatics (Levinson, 1983; Mey, 2001; Yule, 1996), intercultural communications (Kramsch, 1998; Samovar & Porter, 1997; Samovar, Porter & McDaniel, 2009) and English as a lingua franca (ELF) (Canagarajah, 2006; Firth, 1996; Pennycook, 2010) were employed to establish a conceptual framework for data collection and analyses. Key constructs derived from the three related theories helped to form a typology for a detailed examination and theorization of the empirical evidence gathered from different sources. Four research instruments: a questionnaire (N=237), Discourse Completion Tasks (DCTs) (N=55), focus group interviews (N=18), and a textbook tasks analysis were employed to collect data for this systematic inquiry. Data collected by different instruments were analyzed and compared by way of a triangulation to enhance its validity and reliability. Major findings derived from different sources highlighted that, although College English students were grammatically advanced language learners, they displayed limited pragmatic knowledge and a highly restricted repertoire of language learning strategies. The majority of the respondents, however, believed that pragmatic knowledge was as important as linguistic knowledge in the process of developing communicative competence for interaction in different contexts. It was argued that a combination of a less than sufficient English proficiency, limited knowledge of pragmatics, inadequate language materials and tasks, and a small stock of language learning strategies, were a major hindrance to effective learning and communication, resulting in pragmatic failures in many intercultural communication situations. As the first systematic study of how Chinese College English students learned pragmatics, the research provided a solid empirical base for developing a tentative model for the learning of pragmatics in a College English classroom in China and similar educational contexts. The model was strengthened by a unique combination of theories of pragmatics, intercultural communication and ELF. Findings from this research provided insights into how Chinese College English students perceived pragmatics in the English as foreign language (EFL) curriculum, the processes of learning, as well as strategies they utilized in developing linguistic and pragmatic knowledge and competence.

Contextualising learning for a real-world university: how an inverted curriculum in the first year can help better student retention

An identified issue within higher education is the high rates of student attrition after the first year, especially in the STEM disciplines. To address this issue, it is essential to reexamine and redesign the first year curriculum to engage and retain the students' interests while also scaffolding their learning experience. This session reports on an initiative based on the principles of the “inverted curriculum” within the Bachelor of Technology (BIT) course at the Queensland University of Technology (QUT) that began in 2009 and has resulted in a reduction in first-year attrition rates from 18% in 2008 to 10% in 2009 and 2010 despite a growth in student intake of 15% to 40% in the past two years. We present the process and methods that helped achieve this and initiate a discussion on the innovations that are possible within this concept of inverted curriculum and how it can be implemented.

Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

Team teaching : working together to promote student learning

This book chapter examines the concept of team teaching from the perspective of the various stakeholders, in order to discuss the advantages and disadvantages of team teaching for students, to consider the positive and negative dimensions of collaborative teaching for teachers, and to review the implications for educational administration. In addition, attention will be paid to the issues associated with team teaching in the context of e-learning. The chapter concludes with a case study which discusses how the implementation of collaborative teaching within the library and information science discipline at an Australian university helped develop the authors’ understanding of socially constructed knowledge.

Using cases in a mixed learning environment : meeting the challenges of higher education reform

This paper explains the context for pedagogy in a specific undergraduate course; the comparative benefits of using cases in a mixed learning environment (simultaneous large and small groups); and illustrates one significant way for universities to respond to increasing demand for delivery efficiency while maintaining high quality learning outcomes. Thus, to achieve objectives of the subject, tutorial classes expand on what is taught in lectures and provide the necessary context to analyse cases in more detail. A small, qualitative study explored experiences of market research tutors with the use of case method teaching reported. Implications of the study for case teaching in higher education are identified.