Challenges of Measuring Learning Outcomes for Property Students Engaged in Work Integrated Learning

Work integrated learning (WIL) or professional practice units are recognised as providing learning experiences that help students make successful transitions to professional practice. These units require students to engage in learning in the workplace; to reflect on this learning; and to integrate it with learning at university. However, an analysis of a recent cohort of property economics students at a large urban university provides evidence that there is great variation in work based learning experiences undertaken and that this impacts on students’capacity to respond to assessment tasks which involve critiquing these experiences in the form of reflective reports. This paper highlights the need to recognise the diversity of work based experiences; the impact this has on learning outcomes; and to find more effective and equitable ways of measuring these outcomes. The paper briefly discusses assessing learning outcomes in WIL and then describes the model of WIL in the Faculty of Built Environment and Engineering at the Queensland University of Technology (QUT). The paper elaborates on the diversity of students’ experiences and backgrounds including variations in the length of work experience, placement opportunities and conditions of employment.For example, the analysis shows that students with limited work experience often have difficulty critiquing this work experience and producing high level reflective reports. On the other hand students with extensive, discipline relevant work experience can be frustrated by assessment requirements that do not take their experience into account. Added to this the Global Financial Crisis (GFC) has restricted both part time and full time placement opportunities for some students. These factors affect students’ capacity to a) secure a relevant work experience, b) reflect critically on the work experiences and c) appreciate the impact the overall experience can have on their learning outcomes and future professional opportunities. Our investigation highlights some of the challenges faced in implementing effective and equitable approaches across diverse student cohorts. We suggest that increased flexibility in assessment requirements and increased feedback from industry may help address these challenges.

Using reflective practice assessment in the first year of law to encourage a positive professional identity and promote law student well-being

In this paper we argue that intentional curriculum design in the first year of law should encourage law students to develop an emergent sense of a positive professional identity. When first year law students engage with a nascent notion of a positive professional identity, their well-being is supported because their studies are informed and contextualised by a sense of purpose for their future professional life. In a first year law subject run for the first time at the QUT Law School in 2011, reflective practice was successfully used to achieve these goals. The paper discusses the subject, the opportunity of using reflective practice to teach a positive sense of professional identity, and some student perspectives on the subject’s design.

Reflective practice as a tool for addressing high levels of psychological distress in Australian law schools and the legal profession

This paper discusses: -The need for law schools to use curriculum as a site for positive interventions to support student psychological well-being. -The potential for law school interventions to impact on the psychological well-being of the profession. -Reflective practice as a possible tool for promoting psychological well-being in law school and the profession because it provides a way of coping with ‘indeterminate zones’ of experience.

International pre-service teachers' self-confidence in critical reflective thinking and writing through an intercultural Patches program

This paper describes part of an action research study that was designed to explore the outcomes of an ongoing program in which the participants, a group of domestic and international pre-service teachers and lecturers, worked together in reflective writing workshops. While the primary long-term goal of the program was to develop the intercultural competence and understanding of all of the participants through social activities, the development of social relationships was initiated and supported by involving the participants in weekly writing workshops that focused on shared salient skills of critical reflective thinking and writing. The focus of this paper is upon the outcomes for the international students, a cohort of second year pre-service teachers from Malaysia. Findings indicated that the program was successful in developing the Malaysian pre-service teachers’ self-confidence in perceiving themselves as writers and future teachers of writing, in shifting their focus from writing product to writing process and content, and in increasing the depth of their critical reflective thinking and writing

Multimodal approaches to reflective teaching and assessment in higher education

Reflection is not a new concept in the teaching of higher education and is often an important component of many disciplinary courses. Despite this, past research shows that whilst there are examples of rich reflective strategies used in some areas of higher education, most approaches to and conceptualisations of reflective learning and assessment have been perfunctory and inconsistent. In many disciplinary areas reflection is often assessed as a written activity ‘tagged onto’ assessment practices. In creative disciplines however, reflective practice is an integral and cumulative form of learning and is often expressed in ways other than in the written form. This paper will present three case studies of reflective practice in the area of Creative Industries in higher education – Dance, Fashion and Music. It will discuss the ways in which higher education teachers and students use multi-modal approaches to expressing knowledge and reflective practice in context. The paper will argue that unless students are encouraged to participate in deep reflective disciplinary discourse via multi-modes then reflection will remain superficial in the higher education context.

The Socratic classroom : reflective thinking through collaborative inquiry

This book was written to serve two functions. First it is an exploration of what I have called Socratic pedagogy, a collaborative inquiry-based approach to teaching and learning suitable not only to formal educational settings such as the school classroom but to all educational settings. The term is intended to capture a variety of philosophical approaches to classroom practice that could broadly be described Socratic in form. The term ‘philosophy in schools’ is ambiguous and could refer to teaching university style philosophy to high school students or to the teaching of philosophy and logic or critical reasoning in senior years of high school. It is also used to describe the teaching of philosophy in schools generally. In the early and middle phases of schooling the term philosophy for children is often used. But this too is ambiguous as the name was adopted from Matthew Lipman’s Philosophy for Children curriculum that he and his colleagues at the Institute for the Advancement of Philosophy for Children developed. In Britain the term ‘philosophy with children’ is sometimes employed to mark two methods of teaching that have Socratic roots but have distinct differences, namely Philosophy for Children and Socratic Dialogue developed by Leonard Nelson. The use of the term Socratic pedagogy and its companion term Socratic classroom (to refer to the kind of classroom that employs Socratic teaching) avoids the problem of distinguishing between various approaches to philosophical inquiry in the Socratic tradition but also separates it from the ‘study of philosophy’, such as university style philosophy or other approaches which place little or no emphasis on collaborative inquiry based teaching and learning. The second function builds from the first. It is to develop an effective framework for understanding the relationship between what I call the generative, evaluative and connective aspects of communal dialogue, which I think are necessary to the Socratic notion of inquiry. In doing so it is hoped that this book offers some way to show how philosophy as inquiry can contribute to educational theory and practice, while also demonstrating how it can be an effective way to approach teaching and learning. This has meant striking a balance between speaking to philosophers and to teachers and educators together, with the view that both see the virtues of such a project. In the strictest sense this book is not philosophy of education, insofar as its chief focus is not on the analysis of concepts or formulation of definitions specific to education with the aim of formulating directives that guide educational practice. It relinquishes the role of philosopher as ‘spectator’, to one of philosopher ‘immersed in matter’ – in this case philosophical issues in education, specifically those related to philosophical inquiry, pedagogy and classroom practice. Put another way, it is a book about philosophical education.

Mentoring preservice teachers' reflective practices towards producing teaching outcomes

Reflective practice appears crucial for professional growth, and making connections between mentoring practices and mentees’ reflections may assist mentors to guide reflective processes. This interpretive study initially explores, through the literature (e.g., Dewey, Schön), common processes of reflective thinking and uses a mentoring feedback framework with six practices to collect and analyse video, audio and observational data around two mentor-mentee case studies. The findings showed that these mentors (experienced primary teachers) articulated expectations for teaching, modelled reflective practices to their mentees (preservice teachers), and facilitated time and opportunities for advancing teaching practices, which influenced the mentees’ reflective practices and their pedagogical development. This study showed that the mentors’ personal attributes influenced the mentoring relationship and the mentees’ abilities to critically reflect on their practices.

A framework for determining the authenticity of assessment tasks : applied to an example in law

Authentic assessment tasks enhance engagement, retention and the aspirations of students. This paper explores the discipline-generic features of authentic assessment, which reflect what students need to achieve in the real world. Some assessment tasks are more authentic than others and this paper designs a proposed framework supported by the literature that aids unit co-ordinators to determine the level of authenticity of an assessment task. The framework is applied to three summative assessment tasks, that is, tutorial participation, advocacy exercise and problem-based exam, in a law unit. The level of authenticity of the assessment tasks is compared and opportunities to improve authenticity are identified.

A framework for mathematics graphical tasks : The influence of the graphic element on student sense making

Graphical tasks have become a prominent aspect of mathematics assessment. From a conceptual stance, the purpose of this study was to better understand the composition of graphical tasks commonly used to assess students’ mathematics understandings. Through an iterative design, the investigation described the sense making of 11–12-year-olds as they decoded mathematics tasks which contained a graphic. An ongoing analysis of two phases of data collection was undertaken as we analysed the extent to which various elements of text, graphics, and symbols influenced student sense making. Specifically, the study outlined the changed behaviour (and performance) of the participants as they solved graphical tasks that had been modified with respect to these elements. We propose a theoretical framework for understanding the composition of a graphical task and identify three specific elements which are dependently and independently related to each other, namely: the graphic; the text; and the symbols. Results indicated that although changes to the graphical tasks were minimal, a change in student success and understanding was most evident when the graphic element was modified. Implications include the need for test designers to carefully consider the graphics embedded within mathematics tasks since the elements within graphical tasks greatly influence student understanding.

Hybrid game evolutionary algorithm for mission path planning of aerial survey tasks

The aim of this paper is to implement a Game-Theory based offline mission path planner for aerial inspection tasks of large linear infrastructures. Like most real-world optimisation problems, mission path planning involves a number of objectives which ideally should be minimised simultaneously. The goal of this work is then to develop a Multi-Objective (MO) optimisation tool able to provide a set of optimal solutions for the inspection task, given the environment data, the mission requirements and the definition of the objectives to minimise. Results indicate the robustness and capability of the method to find the trade-off between the Pareto-optimal solutions.

On the reliability of classifying programming tasks using a Neo-Piagetian theory of cognitive development

Recent research has proposed Neo-Piagetian theory as a useful way of describing the cognitive development of novice programmers. Neo-Piagetian theory may also be a useful way to classify materials used in learning and assessment. If Neo-Piagetian coding of learning resources is to be useful then it is important that practitioners can learn it and apply it reliably. We describe the design of an interactive web-based tutorial for Neo-Piagetian categorization of assessment tasks. We also report an evaluation of the tutorial's effectiveness, in which twenty computer science educators participated. The average classification accuracy of the participants on each of the three Neo-Piagetian stages were 85%, 71% and 78%. Participants also rated their agreement with the expert classifications, and indicated high agreement (91%, 83% and 91% across the three Neo-Piagetian stages). Self-rated confidence in applying Neo-Piagetian theory to classifying programming questions before and after the tutorial were 29% and 75% respectively. Our key contribution is the demonstration of the feasibility of the Neo-Piagetian approach to classifying assessment materials, by demonstrating that it is learnable and can be applied reliably by a group of educators. Our tutorial is freely available as a community resource.

Developing intercultural competence in pre-service teachers from Australia and Malaysia : insights from the “Patches” programme

Developing intercultural competence in pre-service teachers from Australia and Malaysia: Insights from a Patches program. Innovative pedagogies can offer pre-service teachers the opportunity to develop their intercultural competence and take up more globalised viewpoints. One such innovation is the Patches program which brought together Malaysian and Australian pre-service teachers who were studying at the same university in Brisbane, Australia, to actively explore issues of cultural and linguistic difference. The participants were 14 Australian fourth-year pre-service teachers who were enrolled in a program on inclusive education, and 58 Malaysian pre-service teachers who had recently arrived at the university in Brisbane to commence their second year of an international education program. In peer groupings, these domestic and international pre-service teachers engaged in a series of interactive tasks and reflective writing workshops exploring intercultural experiences, over a period of ten weeks. Each element or ‘patch’ in the program was designed to build up into a mosaic of intercultural learning. The flexible structuring of the Patches Program provided a supportive framework for participant interaction whilst allowing the groups to decide for themselves the nature and extent of their involvement in a series of community-related tasks. The process of negotiating and implementing these activities formed the basis for establishing meaningful relationships between the participants. The development of the participants’ intercultural competence is traced through their reflective narratives and focus group discussions, drawing on Byram’s concept of the five savoirs. Explaining aspects of Australian culture to their newly arrived Malaysian peers, allowed the Australian pre-service teachers to take a perspective of outsideness towards their own familiar social practices. In addition, being unusually positioned as the linguistic other amongst a group of Bahasa Melayu speakers, highlighted for the Australian pre-service teachers the importance of being inclusive. For the Malaysian pre-service teachers, participation in the Patches program helped to extend intercultural understandings, establish social networks with local students, and build a sense of community in their new learning environment. Both groups of pre-service teachers noted the power of “learning directly by interacting rather than through books”. In addition to interacting interculturally, the process of reflecting on these intercultural experiences is seen as integral to the development of intercultural competence.

Rock, paper, scissors : reflective practice for design process in the novice landscape architect

We describe a pedagogical approach that addresses challenges in design education for novices. These include an inability to frame new problems and limited-to-no design capability or domain knowledge. Such challenges can reduce student engagement with design practice, cause derivative design solutions as well as the inappropriate simplification of design assignments and assessment criteria by educators. We argue that a curriculum that develops the student’s design process will enable them to deal with the uncertain and dynamic situations that characterise design. We describe how this may be achieved and explain our pedagogical approach in terms of methods from Reflective Practice and theories of abstraction and creativity. We present a landscape architecture unit, recently taught, as an example. It constitutes design exercises that require little domain or design expertise to support the development of conceptual thinking and a design rationale. We show how this approach (a) leveraged the novice’s existing spatial and thinking skills while (b) retaining contextually-rich design situations. Examples of the design exercises taught are described along with samples of student work. The assessment rationale is also presented and explained. Finally, we conclude by reflecting on how this approach relates to innovation, sustainability and other disciplines.

Qualitative criminology : Stories from the field

Qualitative researchers in the discipline of criminology perform a wide range of challenging tasks. They interview prisoners, police officers, magistrates and judges. They speak with survivors of domestic violence, and drink tea with the mothers of murdered children. They observe courts and communities, investigate the decision-making processes of juries and immerse themselves in the data they collect. They ask ‘big’ questions – ‘how do we criminalise the producers of toxic toys?’ – as well as ‘little’ questions – ‘what should I wear to conduct this interview?’ Qualitative Criminology: Stories from the Field brings to life the stories behind the research of both emerging and established scholars in Australian criminology. The book’s contributors provided honest, reflective, and decidedly unsanitised accounts of their qualitative research journeys - the lively tales of what really happens when conducting research of this nature, the stories that often make for parenthetical asides in conference papers but tend to be excised from journal articles. This book considers the gap between research methods and the realities of qualitative research. As such, it aims to help researchers and students who conduct qualitative criminological research reflect upon their role as researchers, and the practical, ideological and ethical issues which may arise in the course of their research. It is also a call to criminologists to make public the ‘failures’ and missteps of their research endeavours so that we can learn from one another and become better informed and more reflexive qualitative criminologists.

Addressing Public and Private Issues in a Virtual Ethnography Study of an Open Online Community: a Reflective Paper

This paper discusses the ethical consequences of employing virtual ethnography to observe human behaviour in open online communities. In this paper, we discuss the nature of the online community being studied as well as the lessons learned from both literature and also the ethical clearance application process undertaken by the research team. A key finding was that despite the community being open to the public, generally community members expected the research team to employ strategies similar to those required when dealing with a private community.