Developement and evidencing achievement of graduate learning outcomes in Deakin University's enhanced mooc

There is now a plethora of Massive Open On-line courses (MOOCs) offered worldwide. Whilst many MOOCs focus on discipline-specific content, little attention has been paid to how MOOCs can explicitly help participants develop generic employability skills such as communication, digital literacy, global citizenship and the like. Similarly little attention been paid to explicitly assuring the quality of MOOCs with respect to alignment with regulatory body standards. Deakin University's first MOOC, DeakinPrimer, is an introduction to humanitarian responses to 21st century disasters. It has been designed to assist participants to explicitly evidence generic or employability skills, some of Deakin's eight Graduate Learning Outcomes (GLOs) including communication, digital literacy, critical thinking and global citizenship. Other key features of DeakinPrimer include opportunities for networking with fellow participants and experts within the humanitarian field, and the opportunity to apply for credit towards the Graduate Certificate in International Community Development (level 8 in the Australian Qualifications Framework [AQF]) and for those with a prior Bachelor degree, the Masters in Humanitarian Assistance or the Masters of International Community Development (level 9 in the AQF). DeakinPrimer is designed as a test bed for a learning innovation, particularly micro-credentialing GLOs using digital badges to enable self and peer endorsement of evidence of learning. Badging is integrated in two ways. Firstly, DeakinPrimer participants build portfolios of learning artefacts associated with learning activities, then assess their work against a set of holistic, generic learning outcomes standards rubrics. If they judge their evidence as meeting the required standard, they can claim a badge (self endorsement) associated with particular GLOs. Secondly, participants can request and provide peer feedback and endorsement (using peer badges). The integration of self and peer review in the assessment tasks helps participants develop important employability skills, the ability to critically self-reflect on their own work and critically analyse the work of others and provide evidence-based feedback. DeakinPrimer is scheduled to commence in July 2013. This paper explains the way in which the course curricula has been designed to use technologies to enable participants to curate evidence of learning, and self and peer endorse such learning against defined standards.

Evaluation of student learning outcomes in fourth year engineering mechatronics through design based learning curriculum

This paper focuses on evaluation of student learning outcomes in fourth year engineering mechatronics through design based learning curriculum. The purpose of all engineering degrees is to provide strong grounding with principles of engineering science and technology. By learning engineering methods and approaches in an academic environment, graduates can enter the world of work and tackle real world problems with innovation and creativity. In many cases, academic staff are responsible for driving and setting high expectations in their classrooms. Sometimes staff are expected to teach subjects outside their expertise. This research paper is concerned with evaluating student learning outcomes through feedback sought from students on design-based learning approach.

Good practice guidelines for curriculum, supervision and assessment of final year engineering projects and AQF8 learning outcomes

Undergraduate engineering programs require final year students to complete capstone final year projects and demonstrate that they can integrate knowledge, skills and professional graduate attributes developed during the program at Australian Qualification Framework, level 8 (AQF8) outcomes. Literature shows that currently there is no guarantee of consistency for curriculum, supervision and assessment practices of FYEPs. Practices differ greatly between universities and littlework has been initiated that seeks to identify good practice, highlighting the need for the development of guidelines for curriculum, supervision and assessment of FYEPs. This workshop is designed to share and disseminate the good practice guidelines that have been developed on curriculum, supervision and assessment of Final Year Engineering Projects as a part of phase 2 of the project ‘Assessing Final Year Engineering Projects (FYEPs): Ensuring Learning and Teaching Standards and AQF8 Outcomes’ funded by the Australian Office for Learning and Teaching (OLT) with people working in the area of FYEPs. The guidelines typically apply to four year undergraduate engineering degrees with embedded Honours and support achievement of AQF8learning outcomes. The project team has 7 partner Universities – Central Queensland University (the lead), University of Technology Sydney, University of Adelaide, Curtin University, Deakin University, University of Tasmania and RMIT University.Participants will be invited to reflect on and evaluate guidelines and findings derived from FYEP coordinators, supervisors and the wider literature and to consider the ways in which these findings might lead to improvements in their practice.

Identifying pedagogy and teaching strategies for achieving nationally prescribed learning outcomes

With the globalisation of university education, national frameworks are commonly used to prescribe standardised learning outcomes and achieve accountability. However, these frameworks are generally not accompanied by guiding pedagogy to support academics in adjusting their teaching practices to achieve the set outcomes. This paper reports the results of a scoping review of health science literature aimed at identifying pedagogy and teaching strategies relevant to achieve the learning outcomes specified by the Australian Qualifications Framework at a master's degree level. Eight practical teaching messages emerged from the review and three broad pedagogical trends were identified: the need to use authentic disciplinary-based learning activities; ensure that students are able to discover different perspectives about future practice and bring student reflection about their own knowledge into curricula. More critically, the review highlights that academics attempting to translate national learning outcome frameworks into their teaching practices face a complex and time-consuming task which may involve searching beyond their own disciplinary focus to identify practical teaching strategies to meet prescribed learning outcomes.

Leadership and Pedagogical Interaction as Predictors of Learning Outcomes in Physical Education

This research aims to understand the relative contribution of leadership styles and teacher-student and student-student pedagogical interaction concerning learning performance and academic achievement in Physical Education. A quantitative methodology was implemented, comprising a sample of 447 students attending a school grouping located in the coastal region of central Portugal. In order to verify the nature, the strength and the direction of the relations among the variables, correlation and multiple regression analyses were used. For this, scales already validated and used in other researches were applied. The results show that the learning performance and the academic achievement are significantly associated with teacher leadership styles and teacher-student and student-student pedagogical interaction. A stronger association was obtained with leadership styles, especially the democratic one. It should be mentioned that these factors provide a higher relative contribution to the learning performance than to the academic achievement. The analysis conducted highlights the importance of the democratic teacher leadership style and of the pedagogical interaction established within the classroom towards the improvement of students’ ability to understand the gains and the effort made in learning.

Leadership and Pedagogical Interaction as Predictors of Learning Outcomes in Physical Education

Problem Statement: This research aims to understand the relative contribution of leadership styles and teacher-student and student-student pedagogical interaction concerning the learning performance and academic achievement in physical education. Research Questions: Are the teacher leadership style and the teacher-student and student-student pedagogical interaction related to the learning performance and academic achievement in physical education in basic schooling? Purpose of Study: There are several factors that contribute for the explanation of learning outcomes, namely teacher leadership styles in the classroom, as well as teacher-student and student-student pedagogical interactions. These factors are considered to be essential in the teaching-learning process and in the subsequent improvement of educational outcomes. Research Methods: A quantitative methodology was implemented, comprising a sample of 447 students attending a School Grouping located in the Central Region of Portugal. In order to verify the nature, the strength and the direction of the relations among the variables, correlation and multiple regression analyses were used. For this, scales already validated and used in other researches were applied. Findings: The results show that the learning performance and the academic achievement are significantly associated with teacher leadership styles and teacher-student and student-student pedagogical interaction. A stronger association was obtained with leadership styles, especially the democratic one. It should be mentioned that these factors provide a higher relative contribution to the learning performance than to the academic achievement. Conclusions: This study sought to deepen the understanding of the explanatory factors of academic success concerning the teaching-learning process in physical education. The analysis conducted highlights the importance of the democratic teacher leadership style and of the pedagogical interaction established within the classroom towards the improvement of students' ability to understand the gains and the effort made in learning.

Managing distraction and attention in diverse cohorts : 21st century challenges to law student engagement

It is imperative that we consider the use of current and emerging technologies in terms of the nature of our learners, the physical environment of the lecture theatre, and how technology may help to support appropriate pedagogies that facilitate the capturing of student attention in active engaging learning experiences. It is argued that a re-evaluation of pedagogy is required to address the tech-savy traits of the 21st century learner and the extent to which their mobile devices are capable of not only distracting them from learning but also enhancing face-to-face learning experiences.

The Chemistry Discipline Network: One Year On

The Chemistry Discipline Network was funded in mid-2011, with the aim of improving communication between chemistry academics in Australia. In our first year of operation, we have grown to over 100 members, established a web presence, and produced substantial mapping reports on chemistry teaching in Australia. We are now working on the definition of standards for a chemistry degree based on the Threshold Learning Outcomes published by the Learning and Teaching Academic Standards Project.

A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

Teaching and assessing ethics and social responsibility in undergraduate science : a position paper

Institutional graduate capabilities and discipline threshold learning outcomes require science students to demonstrate ethical conduct and social responsibility. However, neither the teaching nor the assessment of these concepts is straightforward. Australian chemistry academics participated in a workshop in 2013 to discuss and develop teaching and assessment in these areas and this paper reports on the outcomes of that workshop. Controversial issues discussed included: How broad is the mandate of the teacher, how should the boundaries between personal values and ethics be drawn, and how can ethics be assessed without moral judgement? In this position paper, I argue for a deep engagement with ethics and social justice, achieved through case studies and assessed against criteria that require discussion and debate. Strategies to effectively assess science students’ understanding of ethics and social responsibility are detailed.

Lawyering and Positive Professional Identities

Lawyering and Positive Professional Identities aims to help law students successfully navigate the demands of law studies and legal practice through the development of positive professional legal identities. It does this by focusing on the knowledge, skills and attitudes necessary for law students to be motivated and engaged learners, and psychologically healthy individuals. The text will fill an important gap for many law schools seeking to enact the threshold learning outcomes for law by addressing these important topics in their curricula. It is a valuable guide for all law students who wish to maximise their success and chances of thriving at law school and beyond. Positive lawyering knowledge and practice are central themes of this book, with a particular emphasis on lawyers’ roles as upholders of the rule of law, as dispute resolvers and as ethical professionals. Throughout, the authors provide practical, experience-based advice on the development of core skills for legal education and practice.

Teaching dispute resolution ethics in the law curriculum

Dispute resolution processes such as mediation are now central to contemporary legal practice. For this reason it is critical that the law curriculum includes instruction on mediation ethics, so that law graduates enter the profession equipped to deal with ethical dilemmas arising in this context. However, our recent content analysis of the unit outlines for professional responsibility subjects in Australian law schools indicates that this important area of legal ethics is often excluded from the curriculum. In most Australian law schools, dispute resolution subjects (where mediation ethics might also be considered) continue to be offered as stand-alone electives in the law degree. This means that many law students are graduating without the ethical knowledge and judgment-making skills needed in dispute resolution environments. This is contrary to the intentions of the Threshold Learning Outcomes for Law. This paper argues that the current paucity of mediation ethics instruction in the Australian law curriculum is problematic, given mediation’s relevance to contemporary legal practice. The paper discusses the importance of including mediation ethics in the law curriculum, and the importance of dispute resolution more broadly as a mandatory component of the law degree in Australia. It offers an outline of a possible mediation ethics module that could be included in professional responsibility subjects.

Do perceptions mirror reality? Student perceptions of learning versus grade outcomes

This research addresses whether educators should consider measuring if students have learned what was intended, as recommended by education researchers. Students in an Introductory Marketing subject were asked to complete a voluntary survey rating their own progress on the intended learning outcomes for the course. One hundred and one surveys were completed by students in the second-last teaching week of the semester. Student identification numbers were used to link student perceptions with their grade outcomes. Regression analysis was used to ascertain whether student perceptions of their progress on the intended learning outcomes for the course could be used to predict their grades. While the results were significant, student perceptions of their progress on learning outcomes were a poor predictor of grade outcomes. The results of this study suggest that student perceptions may not mirror the reality. These results are somewhat surprising and future research examining the degree of change in the learning outcomes perceived by students is warranted. This will further contribute to decisions surrounding whether educators should measure if students have learned what was intended.

Systematic evaluation of GoSoapBox in tertiary education : a student response system for improving learning experiences and outcomes

There is currently a wide range of research into the recent introduction of student response systems in higher education and tertiary settings (Banks 2006; Kay and Le Sange, 2009; Beatty and Gerace 2009; Lantz 2010; Sprague and Dahl 2009). However, most of this pedagogical literature has generated ‘how to’ approaches regarding the use of ‘clickers’, keypads, and similar response technologies. There are currently no systematic reviews on the effectiveness of ‘GoSoapBox’ – a more recent, and increasingly popular student response system – for its capacity to enhance critical thinking, and achieve sustained learning outcomes. With rapid developments in teaching and learning technologies across all undergraduate disciplines, there is a need to obtain comprehensive, evidence-based advice on these types of technologies, their uses, and overall efficacy. This paper addresses this current gap in knowledge. Our teaching team, in an undergraduate Sociology and Public Health unit at the Queensland University of Technology (QUT), introduced GoSoapBox as a mechanism for discussing controversial topics, such as sexuality, gender, economics, religion, and politics during lectures, and to take opinion polls on social and cultural issues affecting human health. We also used this new teaching technology to allow students to interact with each other during class – both on both social and academic topics – and to generate discussions and debates during lectures. The paper reports on a data-driven study into how this interactive online tool worked to improve engagement and the quality of academic work produced by students. This paper will firstly, cover the recent literature reviewing student response systems in tertiary settings. Secondly, it will outline the theoretical framework used to generate this pedagogical research. In keeping with the social and collaborative features of Web 2.0 technologies, Bandura’s Social Learning Theory (SLT) will be applied here to investigate the effectiveness of GoSoapBox as an online tool for improving learning experiences and the quality of academic output by students. Bandura has emphasised the Internet as a tool for ‘self-controlled learning’ (Bandura 2001), as it provides the education sector with an opportunity to reconceptualise the relationship between learning and thinking (Glassman & Kang 2011). Thirdly, we describe the methods used to implement the use of GoSoapBox in our lectures and tutorials, and which aspects of the technology we drew on for learning purposes, as well as the methods for obtaining feedback from the students about the effectiveness or otherwise of this tool. Fourthly, we report cover findings from an examination of all student/staff activity on GoSoapBox as well as reports from students about the benefits and limitations of it as a learning aid. We then display a theoretical model that is produced via an iterative analytical process between SLT and our data analysis for use by academics and teachers across the undergraduate curriculum. The model has implications for all teachers considering the use of student response systems to improve the learning experiences of their students. Finally, we consider some of the negative aspects of GoSoapBox as a learning aid.

Comparing different approach and avoidance models of learning and personality in the prediction of work, university, and leadership outcomes

Jackson (2005) developed a hybrid model of personality and learning, known as the learning styles profiler (LSP) which was designed to span biological, socio-cognitive, and experiential research foci of personality and learning research. The hybrid model argues that functional and dysfunctional learning outcomes can be best understood in terms of how cognitions and experiences control, discipline, and re-express the biologically based scale of sensation-seeking. In two studies with part-time workers undertaking tertiary education (N equals 137 and 58), established models of approach and avoidance from each of the three different research foci were compared with Jackson's hybrid model in their predictiveness of leadership, work, and university outcomes using self-report and supervisor ratings. Results showed that the hybrid model was generally optimal and, as hypothesized, that goal orientation was a mediator of sensation-seeking on outcomes (work performance, university performance, leader behaviours, and counterproductive work behaviour). Our studies suggest that the hybrid model has considerable promise as a predictor of work and educational outcomes as well as dysfunctional outcomes.