Course evaluation : reconfigurations for learning with learning management systems

The introduction of online delivery platforms such as learning management systems (LMS) in tertiary education has changed the methods and modes of curriculum delivery and communication. While course evaluation methods have also changed from paper-based in-class-administered methods to largely online-administered methods, the data collection instruments have remained unchanged. This paper reports on a small exploratory study of two tertiary-level courses. The study investigated why design of the instruments and methods to administer surveys in the courses are ineffective measures against the intrinsic characteristics of online learning. It reviewed the students' response rates of the conventional evaluations for the courses over an eight-year period. It then compared a newly developed online evaluation and the conventional methods over a two-year period. The results showed the response rates with the new evaluation method increased by more than 80% from the average of the conventional evaluations (below 30%), and the students' written feedback was more detailed and comprehensive than in the conventional evaluations. The study demonstrated the possibility that the LMS-based learning evaluation can be effective and efficient in terms of the quality of students' participation and engagement in their learning, and for an integrated pedagogical approach in an online learning environment.

Researching information experience : methodological approaches

This chapter highlights the varied scope of research in the emerging information experience domain. First, I share my perspective as educator-researcher on information experience and its association with informed learning. Then, in six methodological snapshots I present a selection of qualitative approaches which are suited to investigating information experience. The snapshots feature: action research, constructivist grounded theory, ethnomethodology, expanded critical incident approach, phenomenography and qualitative case study. By way of illustration, six researchers explain how and why they use one of these methods. Finally, I review the key characteristics of the six methods and their respective benefits for information experience research.

Academic honors and performance

Despite the social importance of awards, they have been largely disregarded by academic research in economics. This paper investigates whether receiving prestigious academic awards—the John Bates Clark Medal and the Fellowship of the Econometric Society—is associated with higher subsequent research productivity and status compared to a synthetic control group of non-recipient scholars with similar previous research performance. Our results suggest statistically significant positive publication and citation differences after award receipt.

Peer leadership and capability building in law and justice

The aim of this project was to create a model mapping the scaffolding and development of: peer leadership opportunities and capacity; and graduate capabilities, work-related skills and outcomes, across the range of peer assisted learning programs offered in the Faculty of Law during 2013. In doing so, it conceptualised Law and Justice students’ roles and opportunities for peer leadership across the whole of their learning experience and aimed to raise awareness of the benefits to leaders of participating in peer programs (relevant to the development of their graduate capabilities and employability). Through the mapping, the project also sought to increase student understanding of the range of peer leader opportunities available across the Faculty and therefore promote participation in such programs.

Development of an online role-play assessment initiative for nursing students in their bioscience studies

Devising assessment tasks for large units that embrace academic goals of authenticity and assessment variety can be a challenge. We developed an online Role-Play Assessment Initiative for first year nursing students in bioscience. Students responded to a case study by preparing two role-play dialogues: as a nurse with the patient, and between two nurses. The aims were to assess whether the students could: 1) understand the underlying disease process (pathophysiology) and relate it to clinical practice; 2) use language appropriate for lay and medical conversation; and 3) apply information using active learning. We conducted a student survey using quantitative questions (Likert scale: 1=strongly disagree to 5=strongly agree), and qualitative questions. 65 completed surveys were received. 80% of respondents agreed (includes agree or strongly agree) that it was a useful way to learn and understand pathophysiology of the case study. 86% agreed that it was useful to apply pathophysiology from lectures to a clinical setting. Overall, students found it enjoyable, which is beneficial for enhanced student engagement, and agreed that it allowed them to work well in a group (74% and 85%, respectively). Most qualitative suggestions for improvement related to group work, despite the encouraging response to group work in quantitative questions. Most positive comments surrounded different communication with a nurse compared with a patient. These results demonstrate that students developed deeper understanding of pathophysiology through active learning and were able to expand their nursing career skills during the role-play. Learning using role-play to simulate the workforce has fostered active learning.

Sessional academic success : the QUT Law School experience

Sessional academics are an important part of the provision of legal education in higher education with many institutions relying to a large extent on their sessional academics to deliver the teaching program, particularly in the first year. This is particularly relevant to Law Schools as many sessional academics are legal practitioners rather than HDR students. Therefore it is important for both the staff and student experience as well as to the attainment of the learning outcomes that consideration is given to the professional development and training of sessional academics. The QUT Law School has been a participant in a university pilot providing opportunities through the Sessional Academic Success program for academic development, support and developing a sense of belonging for sessional academics. This article will explain the program and initial outcomes and report on the results of surveys and focus groups of sessional academics as well as feedback from fulltime staff. The article will conclude with an analysis of the benefits to sessional academics, students and the School as a whole.

Playing Monopoly(TM) with 1st year property economics students

Game playing contributes to the acquisition of required skills and competencies whilst supporting collaboration, communication and problem solving. This project introduced the board game Monopoly CityTM to tie theoretical class room learning with collaborative, play based problem solving.

The invisibility cloak of creativity

There is often a gap between teaching beliefs and actual practice, between ‘what is valued and what is taught’ (Jones, 2009, p. 175). This may be particularly true when it comes to teaching creatively and teaching for creativity in higher education. This lack of congruence is not necessarily due to a lack of awareness about what is possible, or the desire to enact change in this domain. It may, however, be due to a mix of less easily manipulated contextual factors (environmental, socio-cultural, political and economic), and a lack of discourse (Jackson, 2006) around the problem...

Final Report: University of Technology, Sydney Student Feedback Survey Review

This evaluation was commissioned by Martin Hanlon, Director of the Planning and Quality Unit of the University of Technology, Sydney (UTS) to investigate the Student Feedback Survey (SFS) system, engagement in stakeholder feedback and provide recommendations against the Terms of Reference.

Reframe Workshops 2014 End of Year Report

Reframe: QUT's Evaluation Framework has repositioned the evaluations model away from a single survey instrument to a richer, customisable model that enables and supports QUT's academics in implementing teaching strategies and also provides holistic strategic capability. The Framework has established an approach to evaluation wherein the central role is that of individual academics strategising evaluation to support students as learners, enabled and supported by faculty and learning and teaching specialists. QUT has sought to refocus academic centrality and planning while also ensuring anticipated external reporting obligations to agencies such as TEQSA are achieved. 2014 is the year for embedding the Framework as core business within the University, with the the following providing a detailed report of the staff workshops that have been designed and delivered to support academic and professional staff in engaging with and using the Framework.

The QUT Training Model for Peer Leader Capacity Building

QUT has enacted a university-wide Peer Program’s Strategy which aims to improve student success and graduate outcomes. A component of this strategy is a training model providing relevant, quality-assured and timely training for all students who take on leadership roles. The training model is designed to meet the needs of the growing scale and variety of peer programs, and to recognise the multiple roles and programs in which students may be involved during their peer leader journey. The model builds peer leader capacity by offering centralised, beginning and ongoing training modules, delivered by in-house providers, covering topics which prepare students to perform their role safely, inclusively, accountably and skilfully. The model also provides efficiencies by differentiating between ‘core competency' and ‘program-specific’ modules, thus avoiding training duplication across multiple programs, and enabling training to be individually and flexibly formatted to suit the specific and unique needs of each program.

Enhanced student learning in accounting utilising web-based technology, peer-review feedback and reflective practices: A learning community approach to assessment

Higher education is becoming a major driver of economic competitiveness in an increasingly knowledge-driven global economy. Maintaining the competitive edge has seen an increase in public accountability of higher education institutions through the mechanism of ranking universities based on the quality of their teaching and learning outcomes. As a result, assessment processes are under scrutiny, creating tensions between standardisation and measurability and the development of creative and reflective learners. These tensions are further highlighted in the context of large undergraduate subjects, learner diversity and time-poor academics and students. Research suggests that high level and complex learning is best developed when assessment, combined with effective feedback practices, involves students as partners in these processes. This article reports on a four-phase, cross-institution and cross-discipline project designed to embed peer-review processes as part of the assessment in two large, undergraduate accounting classes. Using a social constructivist view of learning, which emphasises the role of both teacher and learner in the development of complex cognitive understandings, we undertook an iterative process of peer review. Successive phases built upon students’ feedback and achievements and input from language/learning and curriculum experts to improve the teaching and learning outcomes.