An inquiry into the effectiveness of student generated MCQs as a method of assessment to improve teaching and learning

 In anticipation of helping students mature from passive to more active learners while engaging with the issues and concepts surrounding computer security, a student generated Multiple Choice Question (MCQ) learning strategy was designed and deployed as a replacement for an assessment task that was previously based on students providing solutions to a series of short-answer questions. To determine whether there was any educational value in students generating their own MCQs students were required to design MCQs. Prior to undertaking this assessment activity each participant completed a pre-test which consisted of 45 MCQs based on the topics of the assessment. Following the assessment activity the participants completed a post-test which consisted of the same MCQs as the pre-test. The pre and post test results as well as the post test and assessment activity results were tested for statistical significance. The results indicated that having students generate their own MCQs as a method of assessment did not have a negative effect on the learning experience. By providing a framework to the students based on the literature to support their engagement with the learning material, we believe the creation of well-structured MCQs resulted in a more advanced understanding of the relationships between the concepts of the learning material as compared with plainly answering a series of short-answer questions from a textbook. Further study is required to determine to what degree this learning strategy encouraged a deeper approach to learning.

Use and perceptions of worked example videos for first-year students studying mathematics in a primary education degree

Worked example videos have great potential to be useful for students when learning mathematics as they can work through the questions at their own pace, pausing as needed, but still learn from the way the demonstrator thinks and solves problems. We created worked example videos each week for a mathematics subject taught in the first year of a primary education degree and investigated student perceptions and their usage patterns. An additional aspect of this undertaking was the inclusion of subtitles to make the videos accessible to hearing impaired and ESL students. This report will reflect on the process of creating these videos, as well as some initial findings on their success.

O where are you going? O do you imagine? Reproduction and response : a reflexive sociology of scholarship of teaching and learning in practical legal training

My doctoral research studies Australian PLT practitioners’ engagement with scholarship of teaching and learning. I argue that many PLT practitioners are motivated to engage with scholarship of teaching and learning in their work. There are, however, individual and extra-individual impediments.
PLT practitioners are lawyers that teach in institutional practical legal training (“PLT”). Satisfactory completion of mandatory PLT is an eligibility requirement for admission to the Australian legal profession. The PLT requirement is additional to academic legal qualifications. PLT is undertaken at a post-graduate level with, or after, the academic law degree.
My study investigates PLT practitioners’ motivations and capabilities to engage with scholarship of teaching and learning (“SoTL”). I study organisational symbolic support for SoTL in PLT, and organisational allocation of resources to SoTL in PLT.
The study involves individual and extra-individual domains of PLT practitioners’ work. It considers how social structures (e.g. “the juridical”) are inscribed into individuals’ practices (“teaching”) and, conversely, whether practices influence social structures.
My research adopts qualitative methodologies. These involve inter-disciplinary exchanges between law, legal education, practice research, sociology of law, cultural theory, and theory and practice of teaching and learning. My theoretical framework draws on Pierre Bourdieu’s “reflexive sociology”, and Michel de Certeau’s “heterological science”.
I sourced data from documents, and semi-structured interviews with 36 Australian PLT practitioners. Documentary sources include statutory instruments, speeches, reports, practice directions, histories, and scholarly publications.
To analyse the data I adopted Kelle’s characterisation of “theoretical sensitivity”, drawing on “explicit” and “emergent” analysis strategies derived from “grounded theory”. The explicit strategies were based on my theoretical framework. The emergent strategy involved sensitivity to non-explicit concepts and theories that emerged from the data. Computer-aided qualitative data analysis software expedited these methods.
My findings to date question dominant legal structures’ readiness for change, the implications of this for teaching and learning in PLT, and in particular for PLT practitioners’ engagement with SoTL in PLT.
The espoused rationale for mandatory PLT (in statutes) is improvement for the protection of clients, the administration of justice, and to assure quality legal services. The tacit rationale is improved quality of legal education, and experiences, for lawyers-to-be. My thesis argues dominant structures in legal education impede the espoused and tacit objectives, and impede PLT practitioners’ engagement with scholarship of teaching and learning.

Lecturing and other face-to-face teaching – too much or too little? An assessment based on student feedback and fail rates

Institutes of higher learning are tending to reduce the amount of face-to-face teaching that they offer, and particularly through the traditional pedagogical method of lecturing. There is ongoing debate about the educational value of lectures as a teaching approach, in terms of both whether they facilitate understanding of subject material and whether they augment the student educational experience. In this study, student evaluation of teaching scores plus academic outcome (percentage of students who fail) was assessed for 236 course units offered by a science faculty at an Australian university over the course of one year. These measures were related to the degree to which lectures and other face-to-face teaching were used in these units, controlling for factors such as class size, school and year level. An information-theoretic model selection approach was employed to identify the best models and predictors of student assessments and fail rates. All the top models of student feedback included a measure reflecting amount of face-to-face teaching, with the evaluation of quality of teaching being higher in units with higher proportions of lectures. However, these models explained only 12–20% of the variation in student evaluation scores, suggesting that many other factors come into play. By contrast, units with fewer lectures have lower failure rates. These results suggest that moving away from lectures and face-to-face teaching may not harm, and indeed may improve the number of students who pass the subject, but that this may be incurred at the expense of greater dissatisfaction in students' learning experience.

Evaluation of a filmed clinical scenario as a teaching resource for an introductory pharmacology unit for undergraduate health students: A pilot study.

BACKGROUND: Simulation is frequently being used as a learning and teaching resource for both undergraduate and postgraduate students, however reporting of the effectiveness of simulation particularly within the pharmacology context is scant. OBJECTIVES: The aim of this pilot study was to evaluate a filmed simulated pharmacological clinical scenario as a teaching resource in an undergraduate pharmacological unit. DESIGN: Pilot cross-sectional quantitative survey. SETTING: An Australian university. PARTICIPANTS: 32 undergraduate students completing a healthcare degree including nursing, midwifery, clinical science, health science, naturopathy, and osteopathy. METHODS: As a part of an undergraduate online pharmacology unit, students were required to watch a filmed simulated pharmacological clinical scenario. To evaluate student learning, a measurement instrument developed from Bloom's cognitive domains (knowledge, comprehension, application, analysis, synthesis and evaluation) was employed to assess pharmacological knowledge conceptualisation and knowledge application within the following fields: medication errors; medication adverse effects; medication interactions; and, general pharmacology. RESULTS: The majority of participants were enrolled in an undergraduate nursing or midwifery programme (72%). Results demonstrated that the majority of nursing and midwifery students (56.52%) found the teaching resource complementary or more useful compared to a lecture although less so compared to a tutorial. Students' self-assessment of learning according to Bloom's cognitive domains indicated that the filmed scenario was a valuable learning tool. Analysis of variance indicated that health science students reported higher levels of learning compared to midwifery and nursing. CONCLUSION: Students' self-report of the learning benefits of a filmed simulated clinical scenario as a teaching resource suggest enhanced critical thinking skills and knowledge conceptualisation regarding pharmacology, in addition to being useful and complementary to other teaching and learning methods.

Language background and language mastery in Indonesia : implications for the maintenance and teaching of the national language

The linguistic environment in Indonesia is extremely complex with some 700 local languages existing alongside the national language, bahasa Indonesia. The majority of Indonesians speak one of these local languages as their first language and begin formal study of the national language in school. This paper discusses some of the difficulties in creating a population that is fluent in the national language and considers the impact to those who are unable to master Indonesian to a degree that allows them to participate fully in the modern state. The role of teachers as models for language mastery is also considered in the context of their de facto role as language teachers, regardless of subject taught.

Identifying pedagogy and teaching strategies for achieving nationally prescribed learning outcomes

With the globalisation of university education, national frameworks are commonly used to prescribe standardised learning outcomes and achieve accountability. However, these frameworks are generally not accompanied by guiding pedagogy to support academics in adjusting their teaching practices to achieve the set outcomes. This paper reports the results of a scoping review of health science literature aimed at identifying pedagogy and teaching strategies relevant to achieve the learning outcomes specified by the Australian Qualifications Framework at a master's degree level. Eight practical teaching messages emerged from the review and three broad pedagogical trends were identified: the need to use authentic disciplinary-based learning activities; ensure that students are able to discover different perspectives about future practice and bring student reflection about their own knowledge into curricula. More critically, the review highlights that academics attempting to translate national learning outcome frameworks into their teaching practices face a complex and time-consuming task which may involve searching beyond their own disciplinary focus to identify practical teaching strategies to meet prescribed learning outcomes.