eVALUate: an evaluation instrument for measuring students’ perceptions of their engagement and learning outcomes

In the current climate in Australian higher education, quality assurance in university teaching is a priority. In particular, the introduction of the Learning and Teaching Performance Fund (LTPF) has refocused attention on universities’ internal student evaluation survey instruments. This paper reports the development, validation and implementation of a new unit survey instrument which prompts students to reflect on what helps their achievement of unit learning outcomes, and to report their levels of motivation, engagement and overall satisfaction with a semester‐long course or unit of study. The instrument (eVALUate) was created from precepts reported in the research literature, current practices in evaluating teaching, and sound quality assurance practices appropriate to a university outcomes‐focused education paradigm.

Towards a framework for aligning learning outcomes, academic literacies and assessment criteria

Although Australian students spend three or more years studying they can seem quite unaware of any of the expected learning outcomes of their course. They are often single unit focused, paying most attention to individual assessment items thus not developing a holistic view of their course. This paper presents a theoretical framework to support staff and students to recognise, scaffold and achieve learning outcomes and academic skills at unit level and to recognise how these contribute to course and graduate learning outcomes, within the boundaries of Australian university and professional accreditation requirements. A case study is described that demonstrates the manual implementation of the framework. The complex nature of the implementation suggests that a software solution is required to ease the process and ensure the resulting mapping will have some longevity by being maintainable.

Evidencing learning outcomes: a multi-level, multi-dimensional course alignment model

This conceptual framework proposes a multi-level, multi-dimensional course alignment model to implement a contextualised constructive alignment of rubric design that authentically evidences and assesses learning outcomes. By embedding quality control mechanisms at each level for each dimension, this model facilitates the development of an aligned curriculum. The use of rubrics is a crucial theme for many higher education institutions owing to the binding requirement by universities to provide evidence to quality assurance agencies. The success of evidencing learning outcomes through rubrics, however, is only one piece of the puzzle. The other is the contextualised constructive alignment of intertwined factors. Despite the significance of embedding these factors, there has been little, if any, systematic framework in this area. The two key instrumental forces underpinning the conception of this model are: seeking external accreditation and the implementation of programme enhancement thus realising the strategic agenda for an Australian university.

Developement and evidencing achievement of graduate learning outcomes in Deakin University's enhanced mooc

There is now a plethora of Massive Open On-line courses (MOOCs) offered worldwide. Whilst many MOOCs focus on discipline-specific content, little attention has been paid to how MOOCs can explicitly help participants develop generic employability skills such as communication, digital literacy, global citizenship and the like. Similarly little attention been paid to explicitly assuring the quality of MOOCs with respect to alignment with regulatory body standards. Deakin University's first MOOC, DeakinPrimer, is an introduction to humanitarian responses to 21st century disasters. It has been designed to assist participants to explicitly evidence generic or employability skills, some of Deakin's eight Graduate Learning Outcomes (GLOs) including communication, digital literacy, critical thinking and global citizenship. Other key features of DeakinPrimer include opportunities for networking with fellow participants and experts within the humanitarian field, and the opportunity to apply for credit towards the Graduate Certificate in International Community Development (level 8 in the Australian Qualifications Framework [AQF]) and for those with a prior Bachelor degree, the Masters in Humanitarian Assistance or the Masters of International Community Development (level 9 in the AQF). DeakinPrimer is designed as a test bed for a learning innovation, particularly micro-credentialing GLOs using digital badges to enable self and peer endorsement of evidence of learning. Badging is integrated in two ways. Firstly, DeakinPrimer participants build portfolios of learning artefacts associated with learning activities, then assess their work against a set of holistic, generic learning outcomes standards rubrics. If they judge their evidence as meeting the required standard, they can claim a badge (self endorsement) associated with particular GLOs. Secondly, participants can request and provide peer feedback and endorsement (using peer badges). The integration of self and peer review in the assessment tasks helps participants develop important employability skills, the ability to critically self-reflect on their own work and critically analyse the work of others and provide evidence-based feedback. DeakinPrimer is scheduled to commence in July 2013. This paper explains the way in which the course curricula has been designed to use technologies to enable participants to curate evidence of learning, and self and peer endorse such learning against defined standards.

Evaluation of student learning outcomes in fourth year engineering mechatronics through design based learning curriculum

This paper focuses on evaluation of student learning outcomes in fourth year engineering mechatronics through design based learning curriculum. The purpose of all engineering degrees is to provide strong grounding with principles of engineering science and technology. By learning engineering methods and approaches in an academic environment, graduates can enter the world of work and tackle real world problems with innovation and creativity. In many cases, academic staff are responsible for driving and setting high expectations in their classrooms. Sometimes staff are expected to teach subjects outside their expertise. This research paper is concerned with evaluating student learning outcomes through feedback sought from students on design-based learning approach.

Good practice guidelines for curriculum, supervision and assessment of final year engineering projects and AQF8 learning outcomes

Undergraduate engineering programs require final year students to complete capstone final year projects and demonstrate that they can integrate knowledge, skills and professional graduate attributes developed during the program at Australian Qualification Framework, level 8 (AQF8) outcomes. Literature shows that currently there is no guarantee of consistency for curriculum, supervision and assessment practices of FYEPs. Practices differ greatly between universities and littlework has been initiated that seeks to identify good practice, highlighting the need for the development of guidelines for curriculum, supervision and assessment of FYEPs. This workshop is designed to share and disseminate the good practice guidelines that have been developed on curriculum, supervision and assessment of Final Year Engineering Projects as a part of phase 2 of the project ‘Assessing Final Year Engineering Projects (FYEPs): Ensuring Learning and Teaching Standards and AQF8 Outcomes’ funded by the Australian Office for Learning and Teaching (OLT) with people working in the area of FYEPs. The guidelines typically apply to four year undergraduate engineering degrees with embedded Honours and support achievement of AQF8learning outcomes. The project team has 7 partner Universities – Central Queensland University (the lead), University of Technology Sydney, University of Adelaide, Curtin University, Deakin University, University of Tasmania and RMIT University.Participants will be invited to reflect on and evaluate guidelines and findings derived from FYEP coordinators, supervisors and the wider literature and to consider the ways in which these findings might lead to improvements in their practice.

Identifying pedagogy and teaching strategies for achieving nationally prescribed learning outcomes

With the globalisation of university education, national frameworks are commonly used to prescribe standardised learning outcomes and achieve accountability. However, these frameworks are generally not accompanied by guiding pedagogy to support academics in adjusting their teaching practices to achieve the set outcomes. This paper reports the results of a scoping review of health science literature aimed at identifying pedagogy and teaching strategies relevant to achieve the learning outcomes specified by the Australian Qualifications Framework at a master's degree level. Eight practical teaching messages emerged from the review and three broad pedagogical trends were identified: the need to use authentic disciplinary-based learning activities; ensure that students are able to discover different perspectives about future practice and bring student reflection about their own knowledge into curricula. More critically, the review highlights that academics attempting to translate national learning outcome frameworks into their teaching practices face a complex and time-consuming task which may involve searching beyond their own disciplinary focus to identify practical teaching strategies to meet prescribed learning outcomes.