Developement and evidencing achievement of graduate learning outcomes in Deakin University's enhanced mooc

There is now a plethora of Massive Open On-line courses (MOOCs) offered worldwide. Whilst many MOOCs focus on discipline-specific content, little attention has been paid to how MOOCs can explicitly help participants develop generic employability skills such as communication, digital literacy, global citizenship and the like. Similarly little attention been paid to explicitly assuring the quality of MOOCs with respect to alignment with regulatory body standards. Deakin University's first MOOC, DeakinPrimer, is an introduction to humanitarian responses to 21st century disasters. It has been designed to assist participants to explicitly evidence generic or employability skills, some of Deakin's eight Graduate Learning Outcomes (GLOs) including communication, digital literacy, critical thinking and global citizenship. Other key features of DeakinPrimer include opportunities for networking with fellow participants and experts within the humanitarian field, and the opportunity to apply for credit towards the Graduate Certificate in International Community Development (level 8 in the Australian Qualifications Framework [AQF]) and for those with a prior Bachelor degree, the Masters in Humanitarian Assistance or the Masters of International Community Development (level 9 in the AQF). DeakinPrimer is designed as a test bed for a learning innovation, particularly micro-credentialing GLOs using digital badges to enable self and peer endorsement of evidence of learning. Badging is integrated in two ways. Firstly, DeakinPrimer participants build portfolios of learning artefacts associated with learning activities, then assess their work against a set of holistic, generic learning outcomes standards rubrics. If they judge their evidence as meeting the required standard, they can claim a badge (self endorsement) associated with particular GLOs. Secondly, participants can request and provide peer feedback and endorsement (using peer badges). The integration of self and peer review in the assessment tasks helps participants develop important employability skills, the ability to critically self-reflect on their own work and critically analyse the work of others and provide evidence-based feedback. DeakinPrimer is scheduled to commence in July 2013. This paper explains the way in which the course curricula has been designed to use technologies to enable participants to curate evidence of learning, and self and peer endorse such learning against defined standards.

Assessing the structure of learning outcomes from counselling using the SOLO taxonomy: an exploratory study

Thirty-five clients who had received counselling completed a letter to a friend describing in as much detail as possible what they had learned from counselling. The participants' written responses were analysed and classified using the Structure of Learning Outcomes (SOLO) taxonomy. The results suggested that an expanded SOLO offers a promising and exciting way to view the outcomes of counselling within a learning framework. If the SOLO taxonomy is found to be stable in subsequent research, and clients are easily able to be classified using the taxonomy, then this approach may have implications for the process of counselling. To maximise the learning outcomes, counsellors could use strategies and techniques to enhance their clients' learning.

Implementation of an integrated, technology-based, discovery mode assessment item involving an incubation period to enhance learning outcomes for engineering maths students

In this paper we discuss our current efforts to develop and implement an exploratory, discovery mode assessment item into the total learning and assessment profile for a target group of about 100 second level engineering mathematics students. The assessment item under development is composed of 2 parts, namely, a set of "pre-lab" homework problems (which focus on relevant prior mathematical knowledge, concepts and skills), and complementary computing laboratory exercises which are undertaken within a fixed (1 hour) time frame. In particular, the computing exercises exploit the algebraic manipulation and visualisation capabilities of the symbolic algebra package MAPLE, with the aim of promoting understanding of certain mathematical concepts and skills via visual and intuitive reasoning, rather than a formal or rigorous approach. The assessment task we are developing is aimed at providing students with a significant learning experience, in addition to providing feedback on their individual knowledge and skills. To this end, a noteworthy feature of the scheme is that marks awarded for the laboratory work are primarily based on the extent to which reflective, critical thinking is demonstrated, rather than the amount of CBE-style tasks completed by the student within the allowed time. With regard to student learning outcomes, a novel and potentially critical feature of our scheme is that the assessment task is designed to be intimately linked to the overall course content, in that it aims to introduce important concepts and skills (via individual student exploration) which will be revisited somewhat later in the pedagogically more restrictive formal lecture component of the course (typically a large group plenary format). Furthermore, the time delay involved, or "incubation period", is also a deliberate design feature: it is intended to allow students the opportunity to undergo potentially important internal re-adjustments in their understanding, before being exposed to lectures on related course content which are invariably delivered in a more condensed, formal and mathematically rigorous manner. In our presentation, we will discuss in more detail our motivation and rationale for trailing such a scheme for the targeted student group. Some of the advantages and disadvantages of our approach (as we perceived them at the initial stages) will also be enumerated. In a companion paper, the theoretical framework for our approach will be more fully elaborated, and measures of student learning outcomes (as obtained from eg. student provided feedback) will be discussed.

Student perceptions of the impact of online discussion forum participation on learning outcomes

Choosing the “right” type of technology, either synchronous or asynchronous, to facilitate learning outcomes is a new challenge as the pace of emerging technologies increases and diversifies. Teachers are encouraged to design courses that require collaboration in online learning communities to facilitate the development of higher order thinking skills for life long learning. It is therefore important to gather evidence of the kinds of opportunities afforded to students and whether the students themselves endorse collaborative online tools as a legitimate method of assisting in their learning. This paper outlines the way in which one secondary school has used an online discussion forum to support students in the International Baccalaureate (IB) Diploma Program in enhancing research skills and skills for lifelong learning. The paper considers whether online collaborative tools are perceived by students as a positive way to improve learning outcomes.

Evaluating the learning outcomes of an international field trip in postgraduate lighting design courses

Lighting industry professionals work in an international marketplace and encounter a range of social, geographical and cultural challenges associated with this. Education in lighting should introduce students to aspects of these challenges. To achieve this, an international field trip was recently undertaken that sought to provide an authentic learning experience for students. Twelve Masters of Lighting students from two Australian universities took part in a field trip to Shanghai, China and surrounding areas. The goal was to offer students insight into practical issues in the lighting industry at an international level and to do so in a unique and authentic context. To evaluate the outcomes of the trip, each participant was surveyed afterwards. Benefits were identified in terms of: increased knowledge and insight into manufacturing issues in lighting, experiential learning in lighting design practice not available locally (e.g, master planning), increased understanding of cultural influences in design and enhancing professional contacts within the lighting industry. Field trips may also act as an inverted curriculum experience for new students to engage them and promote learning within a professional context.

How do the learning outcomes of students compare in units with different levels of practical work? A comparative study about the relation between Problem-­Based Learning and assessment approaches

The literature supporting the notion that active, student-centered learning is superior to passive, teacher-centered instruction is encyclopedic (Bonwell & Eison, 1991; Bruning, Schraw, & Ronning, 1999; Haile, 1997a, 1997b, 1998; Johnson, Johnson, & Smith, 1999). Previous action research demonstrated that introducing a learning activity in class improved the learning outcomes of students (Mejias, 2010). People acquire knowledge and skills through practice and reflection, not by watching and listening to others telling them how to do something. In this context, this project aims to find more insights about the level of interactivity in the curriculum a class should have and its alignment with assessment so the intended learning outcomes (ILOs) are achieved. In this project, interactivity is implemented in the form of problem- based learning (PBL). I present the argument that a more continuous formative feedback when implemented with the correct amount of PBL stimulates student engagement bringing enormous benefits to student learning. Different levels of practical work (PBL) were implemented together with two different assessment approaches in two subjects. The outcomes were measured using qualitative and quantitative data to evaluate the levels of student engagement and satisfaction in the terms of ILOs.

The introduction of an interactive teaching and learning activity (TLA) in class and its relationship to students’ learning-outcomes

In the university education arena, it is becoming apparent that traditional methods of conducting classes are not the most effective ways to achieve desired learning outcomes. The traditional class/method involves the instructor verbalizing information for passive, note-taking students who are assumed to be empty receptacles waiting to be filled with knowledge. This method is limited in its effectiveness, as the flow of information is usually only in one direction. Furthermore, “It has been demonstrated that students in many cases can recite and apply formulas in numerical problems, but the actual meaning and understanding of the concept behind the formula is not acquired (Crouch & Mazur)”. It is apparent that memorization is the main technique present in this approach. A more effective method of teaching involves increasing the students’ level of activity during, and hence their involvement in the learning process. This technique stimulates self- learning and assists in keeping these students’ levels of concentration more uniform. In this work, I am therefore interested in studying the influence of a particular TLA on students’ learning-outcomes. I want to foster high-level understanding and critical thinking skills using active learning (Silberman, 1996) techniques. The TLA in question aims to promote self-study by students and to expose them to a situation where their learning-outcomes can be tested. The motivation behind this activity is based on studies which suggest that some sensory modalities are more effective than others. Using various instruments for data collection and by means of a thorough analysis I present evidence of the effectiveness of this action research project which aims to improve my own teaching practices, with the ultimate goal of enhancing student’s learning.

Challenges of Measuring Learning Outcomes for Property Students Engaged in Work Integrated Learning

Work integrated learning (WIL) or professional practice units are recognised as providing learning experiences that help students make successful transitions to professional practice. These units require students to engage in learning in the workplace; to reflect on this learning; and to integrate it with learning at university. However, an analysis of a recent cohort of property economics students at a large urban university provides evidence that there is great variation in work based learning experiences undertaken and that this impacts on students’capacity to respond to assessment tasks which involve critiquing these experiences in the form of reflective reports. This paper highlights the need to recognise the diversity of work based experiences; the impact this has on learning outcomes; and to find more effective and equitable ways of measuring these outcomes. The paper briefly discusses assessing learning outcomes in WIL and then describes the model of WIL in the Faculty of Built Environment and Engineering at the Queensland University of Technology (QUT). The paper elaborates on the diversity of students’ experiences and backgrounds including variations in the length of work experience, placement opportunities and conditions of employment.For example, the analysis shows that students with limited work experience often have difficulty critiquing this work experience and producing high level reflective reports. On the other hand students with extensive, discipline relevant work experience can be frustrated by assessment requirements that do not take their experience into account. Added to this the Global Financial Crisis (GFC) has restricted both part time and full time placement opportunities for some students. These factors affect students’ capacity to a) secure a relevant work experience, b) reflect critically on the work experiences and c) appreciate the impact the overall experience can have on their learning outcomes and future professional opportunities. Our investigation highlights some of the challenges faced in implementing effective and equitable approaches across diverse student cohorts. We suggest that increased flexibility in assessment requirements and increased feedback from industry may help address these challenges.

Applying threshold learning theory to teach sustainable business practice in post-graduate engineering education

This paper presents the results of a qualitative action-research inquiry into how a highly diverse cohort of post-graduate students could develop significant capacity in sustainable development within a single unit (course), in this case a compulsory component of four built environment masters programs. The method comprised applying threshold learning theory within the technical discipline of sustainable development, to transform student understanding of sustainable business practice in the built environment. This involved identifying a number of key threshold concepts, which once learned would provide a pathway to having a transformational learning experience. Curriculum was then revised, to focus on stepping through these targeted concepts using a scaffolded, problem-based-learning approach. Challenges included a large class size of 120 students, a majority of international students, and a wide span of disciplinary backgrounds across the spectrum of built environment professionals. Five ‘key’ threshold learning concepts were identified and the renewed curriculum was piloted in Semester 2 of 2011. The paper presents details of the study and findings from a mixed-method evaluation approach through the semester. The outcomes of this study will be used to inform further review of the course in 2012, including further consideration of the threshold concepts. In future, it is anticipated that this case study will inform a framework for rapidly embedding sustainability within curriculum.

‘Works well with others’ : examining the different types of small group learning approaches and their implications for law student learning outcomes

In the current regulatory climate, there is increasing expectation that law schools will be able to demonstrate students’ acquisition of learning outcomes regarding collaboration skills. We argue that this is best achieved through a stepped and structured whole-of-curriculum approach to small group learning. ‘Group work’ provides deep learning and opportunities to develop professional skills, but these benefits are not always realised for law students. An issue is that what is meant by ‘group work’ is not always clear, resulting in a learning regime that may not support the attainment of desired outcomes. This paper describes different types of ‘group work', each associated with distinct learning outcomes. It suggests that ‘group work’ as an umbrella term to describe these types is confusing, as it provides little indication to students and teachers of the type of learning that is valued and is expected to take place. ‘Small group learning’ is a preferable general descriptor. Identifying different types of small group learning allows law schools to develop and demonstrate a scaffolded, sequential and incremental approach to fostering law students’ collaboration skills. To support learning and the acquisition of higherorder skills, different types of small group learning are more appropriate at certain stages of the program. This structured approach is consistent with social cognitive theory, which suggests that with the guidance of a supportive teacher, students can develop skills and confidence in one type of activity which then enhances motivation to participate in another.

Virtual versus classroom language teaching : A comparative study of the learning outcomes and student responses between two English reading comprehension groups

A 26-hour English reading comprehension course was taught to two groups of second year Finnish Pharmacy students: a virtual group (33 students) and a teacher-taught group (25 students). The aims of the teaching experiment were to find out: 1.What has to be taken into account when teaching English reading comprehension to students of pharmacy via the Internet and using TopClass? 2. How will the learning outcomes of the virtual group and the control group differ? 3. How will the students and the Department of Pharmacy respond to the different and new method, i.e. the virtual teaching method? 4. Will it be possible to test English reading comprehension learning material using the groupware tool TopClass? The virtual exercises were written within the Internet authoring environment, TopClass. The virtual group was given the reading material and grammar booklet on paper, but they did the reading comprehension tasks (written by the teacher), autonomously via the Internet. The control group was taught by the same teacher in 12 2-hour sessions, while the virtual group could work independently within the given six weeks. Both groups studied the same material: ten pharmaceutical articles with reading comprehension tasks as well as grammar and vocabulary exercises. Both groups took the same final test. Students in both groups were asked to evaluate the course using a 1 to 5 rating scale and they were also asked to assess their respective courses verbally. A detailed analysis of the different aspects of the student evaluation is given. Conclusions: 1.The virtual students learned pharmaceutical English relatively well but not significantly better than the classroom students 2. The overall student satisfaction in the virtual pharmacy English reading comprehension group was found to be higher than that in the teacher-taught control group. 3. Virtual learning is easier for linguistically more able students; less able students need more time with the teacher. 4. The sample in this study is rather small, but it is a pioneering study. 5. The Department of Pharmacy in the University of Helsinki wishes to incorporate virtual English reading comprehension teaching in its curriculum. 6. The sophisticated and versatile TopClass system is relatively easy for a traditional teacher and quite easy for the students to learn. It can be used e.g. for automatic checking of routine answers and document transfer, which both lighten the workloads of both parties. It is especially convenient for teaching reading comprehension. Key words: English reading comprehension, teacher-taught class, virtual class, attitudes of students, learning outcomes

When did you last predict a good idea? Exploring the case of assessing creativity through learning outcomes

It has been noted elsewhere that an idea is acknowledged to be creative if it is novel, or surprising and adaptive. So how does that fit with education's desire to measure student performance against fixed, consistent and predicted learning outcomes? This study explores practical measures and theoretical constructs that address the dearth of teaching, learning and assessment strategies to enhance creative capacity in enterprise and entrepreneurship education. It is argued that inappropriate assessment strategies can be significant inhibitors of the creativity of students and teachers. Referring to the broader discipline of 'design', as defined by Bruce and Besant (2002) – the application of human creativity to a purpose – both broad employer satisfaction with education and fast growing economic success are found (DCMS, 2014). As predictable assessment outcomes equal predictable students, these understandings can inform educators who wish to map and develop enhanced creative endeavours such as opportunity recognition, communication and innovation.

The relationship between class participation and law students' learning, engagement and stress: Do demographics matter?

Student participation in the classroom has long been regarded as an important means of increasing student engagement and enhancing learning outcomes by promoting active learning. However, the approach to class participation common in U.S. law schools, commonly referred to as the Socratic method, has been criticised for its negative impacts on student wellbeing. A multiplicity of American studies have identified that participating in law class discussions can be alienating, intimidating and stressful for some law students, and may be especially so for women, and students from minority backgrounds. Using data from the Law School Student Assessment Survey (LSSAS), conducted at UNSW Law School in 2012, this Chapter provides preliminary insights into whether assessable class participation (ACP) at an Australian law school is similarly alienating and stressful for students, including the groups identified in the American literature. In addition, we compare the responses of undergraduate Bachelor of Laws (LLB) and graduate Juris Doctor (JD) students. The LSSAS findings indicate that most respondents recognise the potential learning and social benefits associated with class participation in legal education, but remain divided over their willingness to participate. Further, in alignment with general trends identified in American studies, LLB students, women, international students, and non-native English speakers perceive they contribute less frequently to class discussions than JD students, males, domestic students, and native English speakers, respectively. Importantly, the LSSAS indicates students are more likely to be anxious about contributing to class discussions if they are LLB students (compared to their JD counterparts), and if English is not their first language (compared to native English speakers). There were no significant differences in students’ self-reported anxiety levels based on gender, which diverges from the findings of American research.