A preliminary study of open learner model representation formats to support formative assessment

Open learner models provide a way of showing teachers and students the learning progress of a student against expectations. Creating an effective interface to present a learner model is an important part in open learner modeling. Usefulness of the learner model relies on using a clear andeffective representation format to facilitate users’understanding of the information presented. In this paper, wepropose a range of open learner model representation formatsto display students’ learning task status and achievement interms of learning outcomes. We investigate different types ofrepresentation formats and data useful for users to inspect thelearner model. An interface design prototype has been built toprovide potential users with an evaluation platform thatenables investigation of these aspects. The results obtained willallow us to develop a more effective new open learner modelvisualisation tool.

Beyond curriculum, technology and transformation for an unknown future: towards a holistic model for understanding student resilience in education

Many views of fostering student resilience come from the perspective of a set of individual student traits, skill sets, or the lack of ability to "tough it out", rather than viewing resilience as a holistic entity which involves relationships, community and context. This belief, in turn, disconnects learners from the socio-cultural context in which their learning experience is embedded. These factors can play an equally pivotal role on participation and learning outcomes. This poster proposes a holistic model for understanding student resilience in a time of rapid change in education.

Building resilience: developing a resilience toolkit for employability in built environment graduates

Upon graduation from University many students lose access to support structures such as peers, academic mentoring, etc. This may lead to tension, stress and failure to perform effectively in new workplaces, especially if the workplace itself is stressful. This is particularly the case for graduates who move into work within construction, as this industry provides a uniquely stressful environment where the development of resilience is imperative for success. The ability to cope and draw on resilience skills provides answers for built environment graduates. The development of resilience skills is not included as learning outcomes within courses, units of study or programs of learning within the built environment discipline. This dilemma, from a student's perspective, draws us to the rationale of the proposed research and its aim to show the development of a resilience toolkit for built environment students. There is considerable evidence that incorporating resilience skills into undergraduate curricula in built environment disciplines will have positive outcomes. Outcomes from an initial review of 3 participating University undergraduate programs, devised to determine resilience training for undergraduates is presented. A compilation and collection of noteworthy examples where resilience learning and teaching exists in undergraduate curricula will also be identified.

An empirical study of user perceived usefulness and preference of open learner model visualisations

Many higher education institutions have reformed their academic programmes to adopt unit learning outcomes. It is essential for effective learning management tools to support this fundamental transformation. We see the need for a tool that provides visualisations of Open Learner Models (OLM) and associated e-portfolio content to guide students in achieving intended learning outcomes, help evidence their learning andkeep them engaged in their study. OLMs surface the relationship between learning activities and tasks, formative and summativeassessment, and intended learning outcomes. We have developedand validated a set of candidate visualisations for such OLMs. We report key findings from our study in terms of potential users’ feedback on our tool’s support for tracking learning progress against learning outcomes. Our findings can inform and refine learning management systems.

Utilising point of care ultrasound for vascular access in haemodialysis

Learning outcomes: On completion of this continuing professional development activity, participants will be able to: • Discuss basic ultrasound principles; • Define the roles and responsibilities of the nurse in point of care ultrasound; • Identify strategies to utilise ultrasound to provide quality cannulation practice; • Identify anatomic structures on an ultrasound picture; • Identify anomalies in the anatomy such as thrombus, stenosis, aneurysm and pseudoaneurysm; • Describe the advantages and disadvantages of using ultrasound for assessment and cannulation; • Enable staff to reflect on their current approaches to assessment and cannulation.

Simple techniques for a more inclusive curriculum

Students from low-socioeconomic status or non-English speaking backgrounds, or who have a disability, are Indigenous, or live in a remote area all generally score lower than average grades in Australian higher education. Deakin University’s Faculty of Arts & Education trialled a range of inclusive curriculum strategies in two units during 2015, with the aims of finding and embedding techniques that worked to improve learning outcomes of students in these groups, and at the same time building staff capacity in delivering inclusive curriculum. Staff from across academic and professional divisions collaborated to develop the techniques. This presentation outlines the techniques trialled, their varying impacts and critical success factors, as identified through quantitative and qualitative evaluation methods. Richly annotated readings, visual format seminar papers, and a formative peer assessment activity were found to be the most successful techniques. The presentation also describes briefly the staff capacity-building approach, based on activity systems theory.

Teaching teamwork in design: a framework for understanding effectiveness in student teams

This chapter proposes an Input-Process-Output framework for understanding what impacts the effectiveness of teamwork when higher education students are collaborating on design assignments. Theframework can help design educators integrate teamwork into their courses and better evaluate learning outcomes, and may also elucidate good practice for professional design teams. Explaining the genesis ofthe framework, the literature is assimilated on team effectiveness and predictors of team performance, including: definitions, dimensions and frameworks of team effectiveness in contexts far wider than designeducation. Informed by the challenges specific to teaching design, a 22-factor framework is proposed. The paper concludes with recommendations for teachers informed by the framework. The viability ofthe 22-factor model of team effectiveness is evidenced by national surveys across Australia, which are reported in summary here.

Rhetoric and reality: critical perspectives on education in a 3D virtual world

The emergence of any new educational technology is often accompanied by inflated expectations about its potential for transforming pedagogical practice and improving student learning outcomes. A critique of the rhetoric accompanying the evolution of 3D virtual world education reveals a similar pattern, with the initial hype based more on rhetoric than research demonstrating the extent to which rhetoric matches reality. Addressed are the perceived gaps in the literature through a critique of the rhetoric evident throughout the evolution of the application of virtual worlds in education and the reality based on the reported experiences of experts in the field of educational technology, who are all members of the Australian and New Zealand Virtual Worlds Working Group. The experiences reported highlight a range of effective virtual world collaborative and communicative teaching experiences conducted in members' institutions. Perspectives vary from those whose reality is the actuation of the initial rhetoric in the early years of virtual world education, to those whose reality is fraught with challenges that belie the rhetoric. Although there are concerns over institutional resistance, restrictions, and outdated processes on the one-hand, and excitement over the rapid emergence of innovation on the other, the prevailing reality seems to be that virtual world education is both persistent and sustainable. Explored are critical perspectives on the rhetoric and reality on the educational uptake and use of virtual worlds in higher education, providing an overview of the current and future directions for learning in virtual worlds.

Role of ADRI model in teaching and assessing novice programmers

In this research, an ADRI approach was introduced in the teaching and learning process of an introductory programming course. The result shows that the ADRI approach impacted positively on the students learning outcomes. The ADRI approach not only reduced the failure rate but also improved student’s retention in the course.

International student mobility and its impact on the Australian private VET sector

In recent years governments have legitimated neoliberal educational policy reforms such as the internationalization and commercialization of education through mobilising the discourses of globalization and the knowledge economy. In Australia for instance, a raft of policy initiatives over the last two and a half decades (beginning in the early 1990s) targeted full-fee paying international students prompting a surge in international student enrolments and a burgeoning private vocational education and training (VET) sector for international students. Drawing on a study of situated realities influencing international students in private VET providers in Melbourne Australia, this chapter analyses, from training managers’ and quality assurance auditors’ perspectives, the impact of international student mobility on the private VET sector. The chapter also utilises the notion of social structure as systems of human relations amongst social positions to examine how international student mobility has led to shifts in VET manager and quality assurance auditors’ perceptions and practices outside the boundaries of the education sector, particularly how private VET providers and international students are represented. In this instance by reforming the VET sector, governments change conventional characteristics through which people relate and the relationships that bind them with intended and unintended consequences. The findings suggest that whilst VET policy posits an easy and ready association between the needs of capital and the development of the workforce, this association is highly contestable and problematic as it can lead to negative student learning outcomes.

Revisiting associations between student performance outcomes and formative assessment opportunities: is there any impact on student learning?

This project developed as a result of some inconclusive data from an investigation of whether a relationship existed between the use of formative assessment opportunities and performance, as measured by final grade. We were expecting to show our colleagues and students that use of formative assessment resources had the potential to improve performance. This first study, done in semester 1 2002, indicated that there was no apparent relationship even though the students reported how useful they found the resources. This led us to ask if there was a transition effect
such that students were not yet working in an independent way and making full use of the resources, and/or whether in order to see an effect we needed to persuade non-users of the resources to become users before investigating if use can be correlated with improvement in performance. With the 2002-3 NextEd ASCILITE Research Grant we set out to repeat our project and to look at use and usefulness of resources in both first and second semester, to encourage non-users to become users and to investigate use with performance. Now our story has a different ending.

Communicating outcomes of students' evaluations of teaching and learning: one-size-fits-all?

Student evaluations of teaching are increasingly used to measure the teaching of individual academics in Australian higher education. The outcomes of these evaluations are variably made available to the individual academics themselves, to university management and to the public. However, communicating evaluation outcomes to each of these audiences assumes a different purpose and necessitates different objectives, foci and methodology. The need for these differences is sometimes forgotten with a ‘one-size-fits-all’ approach in Australian higher education. This paper examines these differences and discusses some of the issues surrounding the communication of the outcomes of student evaluations of teaching.

Applying outcomes of lifelong learning to organisational achievement

The focus of this doctoral research study is making the most what a person knows and can do, as an outcome from their lifelong learning, so as to better contribute to organisational achievement. This has been motivated by a perceived gap in the extensive literature linking knowledge with organisational achievement. Whereas there is a rich body of literature addressing the meta-philosophies giving rise to the emergence of learning organisations there is, as yet, scant attention paid to the detail of planning and implementing action which would reveal individual/organisational opportunities of mutual advantage and motivate, and sustain, participation at the day-to-day level of the individual. It is in this space that this dissertation seeks to contribute by offering a mechanism for bringing the, hindsight informed, response “but that’s obvious” into the abiding explicit realm at the level of the individual. In moving beyond the obvious which is prone to be overlooked, the emphasis on “better” in the introductory sentence, is very deliberately made and has a link to awakening latent individual, and hence organisational, capabilities that would otherwise languish. The evolved LCM Model – a purposeful integration valuing the outcomes from lifelong learning (the L) with nurturing a culture supporting this outcome (the C) and with responsiveness to potentially diverse motivations (the M) – is a reflective device for bringing otherwise tacit, and latent, logic into the explicit realm of action. In the course of the development of the model, a number of supplementary models included in this dissertation have evolved from the research. They form a suite of devices which inform action and lead to making the most of what an individual knows and can do within the formal requirements of a job and within the informal influences of a frequently invisible community of practice. The initial inquiry drew upon the views and experiences of water industry engineering personnel and training facilitators associated with the contract cleaning and waste management industries. However, the major research occurred as an Emergency Management Australia (EMA) project with the Country Fire Authority (CFA) as the host organisation. This EMA/CFA research project explored the influence of making the most of what a CFA volunteer knows and can do upon retention of that volunteer. In its aggregate, across the CFA volunteer body, retention is a critical community safety objective. A qualitative research, ethnographic in character, approach was adopted. Data was collected through interviews, workshops and outcomes from attempts at action research projects. Following an initial thirteen month scoping study including respondents other than from the CFA, the research study moved into an exploration of the efficacy of an indicative model with four contextual foci – i.e. the manner of welcoming new members to the CFA, embracing training, strengthening brigade sustainability and leadership. Interestingly, the research environment which forced a truncated implementation of action research projects was, in itself, an informing experience indicative of inhibitors to making the most of what people know and can do. Competition for interest, time and commitment were factors governing the manner in which CFA respondents could be called upon to explore the efficacy of the model, and were a harbinger of the influences shaping the more general environment of drawing upon what CFA volunteers know and can do. Subsequent to the development of the indicative model, a further 16 month period was utilised in the ethnographic exploration of the relevance of the model within the CFA as the host organisation. As a consequence, the model is a more fully developed tool (framework) to aid reflection, planning and action. Importantly, the later phase of the research study has, through application of the model to specific goals within the CFA, yielded operational insight into its effective use, and in which activity systems have an important place. The model – now confidently styled as the LCM Model – has three elements that when enmeshed strengthen the likelihood of organisational achievement ; and the degree of this meshing, as relevant to the target outcome, determines the strength of outcome. i.e. - • Valuing outcomes from learning: When a person recognises and values (appropriately to achievement by the organisation) what they know and can do, and associated others recognise and value what this person knows and can do, then there is increased likelihood of these outcomes from learning being applied to organisational achievement. • Valuing a culture that is conducive to learning: When a person, and associated others, are further developing and drawing upon what they know and can do within the context of a culture that is conducive to learning, then there is increased likelihood that outcomes from learning will be applied to organisational achievement. • Valuing motivation of the individual: When a person’s motivation to apply what they know and can do is valued by them, and associated others, as appropriate to organisational achievement then there is increased likelihood that appropriately drawing upon outcomes from learning will occur. Activity theory was employed as a device to scope and explore understanding of the issues as they emerged in the course of the research study. Viewing the data through the prism of activity theory led not only to the development of the LCM Model but also to an enhanced understanding of the role of leadership as a foundation for acting upon the model. Both formal and informal leadership were found to be germane in asserting influence on empowering engagement with learning and drawing upon its outcomes. It is apparent that a “leaderful organisation”, as postulated by Raelin (2003), is an environment which supports drawing upon the LCM model; and it may be the case that the act of drawing upon the model will move a narrowly leadership focused organisation toward leaderful attributes. As foreshadowed at the beginning of this synopsis, nurturing individual and organisational capability is the guiding mantra for this dissertation - “Capability embraces competence but is also forward-looking, concerned with the realisation of potential” (Stephenson 1998, p. 3). Although the inquiry focussed upon a need for CFA volunteer retention, it began with a broader investigation as part of the scoping foundation and the expanded usefulness of the LCM Model invites further investigation. The dissertation concludes with the encapsulating sentiment that “You have really got to want to”. With this predisposition in mind, this dissertation contributes to knowledge through the development and discussion of the LCM model as a reflective device informing transformative learning (Mezirow and Associates 1990). A leaderful environment (Raelin 2003) aids transformative learning – accruing to the individual and the organisation - through engendering and maintaining making the most of knowledge and skill – motivating and sustaining “the will”. The outcomes from this research study are a strong assertion that wanting to make the most of what is known and can be done is a hallmark of capability. Accordingly, this dissertation is a contribution to the “how” of strengthening the capability, and the commitment to applying that capability, of an individual and an organisation.