Improving criteria and feedback in student assessment in law

Spurred on by both the 1987 Pearce Report1 and the general changes to higher education spawned by the “Dawkins revolution” from 1988, there has been much critical self-evaluation leading to profound improvements to the quality of teaching in Australian law schools.2 Despite the changes there are still areas of general law teaching practice which have lagged behind recent developments in our understanding of what constitutes high quality teaching. One such area is assessment criteria and feedback. The project Improving Feedback in Student Assessment in Law is an attempt to remedy this. It aims to produce a manual containing key principles for the design of assessment and the provision of feedback, with practical yet flexible ideas and illustrations which law teachers may adopt or modify. Most of the examples have been developed by teachers at the University of Melbourne Law School. The project was supported in 1996 by a Committee for the Advancement of University Teaching grant and the manual will be published late in 1997.3 This note summarises the core principles which are elaborated further in the manual.

Stochastic output feedback model predictive control

This paper addresses the issue of output feedback model predictive control for linear systems with input constraints and stochastic disturbances. We show that the optimal policy uses the Kalman filter for state estimation, but the resultant state estimates are not utilized in a certainty equivalence control law

Learning-based Relevance Feedback for Web-based Relation Completion

In a pilot application based on web search engine calledWeb-based Relation Completion (WebRC), we propose to join two columns of entities linked by a predefined relation by mining knowledge from the web through a web search engine. To achieve this, a novel retrieval task Relation Query Expansion (RelQE) is modelled: given an entity (query), the task is to retrieve documents containing entities in predefined relation to the given one. Solving this problem entails expanding the query before submitting it to a web search engine to ensure that mostly documents containing the linked entity are returned in the top K search results. In this paper, we propose a novel Learning-based Relevance Feedback (LRF) approach to solve this retrieval task. Expansion terms are learned from training pairs of entities linked by the predefined relation and applied to new entity-queries to find entities linked by the same relation. After describing the approach, we present experimental results on real-world web data collections, which show that the LRF approach always improves the precision of top-ranked search results to up to 8.6 times the baseline. Using LRF, WebRC also shows performances way above the baseline.

Consumer misbehavior: a concurrent look at the impact that the size of the victim and size of the loss have on opinions regarding the acceptance or unacceptance of 12 questionable consumer actions

This study examines the role that the size of a victimised organisation and the size of the victim’s loss have on attitudes regarding the acceptance or unacceptance of 12 questionable consumer actions. A sample of 815 American adults rated each scenario on a scale anchored by very acceptable and very unacceptable. It was shown that the size of the victimised organisation tends to influence consumers’ opinions with more disdain directed towards consumers who take advantage of smaller businesses. Similarly, the respondents tended to be more critical of these actions when the loss incurred by the victimised organisation was large. A 2x2 matrix concurrently delineated the nature of the extent to which opinions regarding the 12 actions differed depending upon the mediating variable under scrutiny.

Setting measureable goals with young people : qualitative feedback from the Goal Attainment Scale in youth mental health

Introduction Measuring occupational performance is an essential part of clinical practice; however, there is little research on service user perceptions of measures. The aim of this investigation was to explore the acceptability and utility of one occupational performance outcome measure, Goal Attainment Scaling, with young people (12–25 years old) seeking psychological help. Method Semi-structured interviews were conducted with ten young people seeking help from a youth mental health clinic. Interviews were audio taped and a field diary kept. Interviews were transcribed verbatim and analysed using content analysis. Results were verified by member checking. Results All participants were able to engage in using Goal Attainment Scaling to set goals for therapy, and reported the process to be useful. The participants identified the physical location and ownership of the scale was important to help motivate them to work on their goals. Conclusion Young help-seekers see Goal Attainment Scaling as an acceptable tool to facilitate the establishment of functional goals. Young service users were particularly keen to maintain control over the physical location of completed forms.

The perspectives of older drivers on the impact of feedback on their driving behaviours : a qualitative study

Self-regulation is a coping strategy that allows older drivers to drive safely for longer. Self-regulation depends largely on the ability of drivers to evaluate their own driving. Therefore the success of self-regulation, in terms of driving safety, is influenced by the ability of older drivers to have insight into their declining driving performance. In addition, previous studies suggest that providing feedback to older adults regarding their driving skills may lead them to change their driving behaviour. However, little is currently known about the impact of feedback on older drivers’ self-awareness and their subsequent driving regulatory behaviour. This study explored the process of self-regulation and driving cessation among older drivers using the PAPM as a framework. It also investigated older adults’ perceptions and opinions about receiving feedback in regards to their driving abilities. Qualitative focus groups with 27 participants aged 70 years or more were conducted. Thematic analysis resulted in the development of five main themes; the meaning of driving, changes in driving pattern, feedback, the planning process, and solutions. The analysis also resulted in an initial model of driving self-regulation among older drivers that is informed by the current research and the Precaution Adoption Process Model as the theoretical framework. It identifies a number of social, personal, and environmental factors that can either facilitate or hinder people’s transition between stages of change. The findings from this study suggest that further elaboration of the PAPM is needed to take into account the role of insight and feedback on the process of self-regulation among older drivers.

Mentor feedback : models, viewpoints and strategies

A mentor’s feedback can present professional insights to allow a mentee to reflect and develop practice. This paper positions two models for feedback that have emanated from empirical studies. It also demonstrates the diverse viewpoints of mentors and suggests strategies for providing quality feedback. In one qualitative study, 24 mentors observed a final-year preservice teacher through a professionally video-recorded lesson and wrote their observations towards giving feedback to the potential mentee. Tables illustrated in the paper, show that mentors’ positive feedback and constructive criticisms vary considerably on the same observed events. Data from this study were synthesised to posit a theoretical model for analysing mentor feedback in an interconnected, three-way Venn diagram, namely: visual, auditory and conceptual frames. Another study (n=28), which is a collection of mentor teachers’ work samples during the Mentoring for Effective Teaching (MET) program, provides strategies within six feedback practices, that is: (1) negotiated mentor-mentee expectations for providing feedback on practices, (2) reviewing teaching plans, (3) arranging for observations of practices, (4) providing oral feedback, (5) providing written feedback, and; (6) presenting opportunities for the mentee to evaluate teaching practices with consideration of the mentor’s feedback. For example, on the last mentioned practice (6) there were strategies such as “Plan a time for evaluation of practices (guided reflection)”, “Read the mentee’s reflection on practice and discuss how it aligns with your observations of their practices”, and “Highlight verbally and/or in writing where the mentee is perceptive about the reflection and how the reflection could be enhanced for future evaluations”. Developing a range of strategies that may assist the mentee in professional growth, include enlisting a community of mentors, ensuring mentors have a repertoire of strategies for articulating feedback, and using mentor feedback tools and models. This study has implications for the development of feedback models and strategies.

When an eco-feedback system joins the family

The dynamic, chaotic, intimate and social nature of family life presents many challenges when designing interactive systems in the household space. This paper presents findings from a whole-of-family approach to studying the use of an energy awareness and management system called “Ecosphere”. Using a novel methodology of inviting 12 families to create their own self-authored videos documenting their energy use, we report on the family dynamics and nuances of family life that shape and affect this use. Our findings suggest that the momentum of existing family dynamics in many cases obstructs behaviour change and renders some family members unaware of energy consumption despite the presence of an energy monitor display in the house. The implication for eco-feedback design is that it needs to recognise and respond to the kinds of family relations into which the system is embedded. In response, we suggest alternative ways of sharing energy-related information among families and incentivising engagement among teenagers.

The effect of feedback from pupil to teacher on assessment for leaning and visible learning: An ethnographic case study in a community school in England and the outcome in a state high school in Queensland, Australia

This study shows that there is positive regulatory effect of feedback from pupils to teachers on Assessment for Learning (AfL), classroom proactiveness, and on visible and progressive learning but not on behaviour. This research finding further articulates feedback from pupil to teacher as a paradigm shift from the classical paradigm of feedback from teacher to pupil. Here, the emphasis is geared towards pupils understanding of objectives built from previous knowledge. These are then feedback onto the teachers by the pupils in the form of discrete loops of cues and questions, where they are with their learning. This therefore enables them to move to the next level of understanding, and thus acquired independence, which in turn is reflected by their success in both formative and summative assessments. This study therefore shows that when feedback from pupil to teacher is used in combination with teacher to pupil feedback, AfL is ameliorated and hence, visible and accelerated learning occurs in a gender, nor subject non-dependent manner.

Interpretation of morphological data to inform design Bridge to Bridge: Ridge to Ridge urban design workshop

The importance of design practice informed by urban morphology has led to intensification in interest, signalled by the formation of the ISUF Research and Practice Task Force and voiced through several recent academic publications cognisant of this current debate, this paper reports on a recent urban design workshop at which morphology was set as one of the key themes. Initially planned to be programmed as a augmented concurrent event to the 2013 20th ISUF conference held in Brisbane, the two day Bridge to Bridge: Ridge to Ridge urban design workshop nevertheless took place the following month, and involved over one hundred design professionals and academics. The workshop sought to develop several key urban design principles and recommendations addressing a major government development proposal sited in the most important heritage precinct of the city. The paper will focus specifically on one of the nine groups, in which the design proposal was purposefully guided by morphological input. The discussion will examine the design outcomes and illicit review and feedback from participants, shedding critical light on the issues that arise from such a design approach.

Learning through feedback loop metaphors

The metaphor of a feedback loop underpinned a significant curriculum change in a first year teacher-education unit. Assessment for Learning (AfL) practices such as discussing examples of previous student work and giving peer feedback were embedded within the curriculum design. The metaphor of a feedback loop connected these AfL practices into a purposeful process that informed student learning as well as tutor learning about student understanding, that then informed the next teaching episode. Student teachers (n=350) in twelve tutorial groups taught by eight university tutors were able to develop a shared understanding of quality performances before completing each assessment task. As well as providing ongoing insights to improve teaching, data from this action research project enabled the participant tutor-researchers to interrogate the concept of feedback loops. The researchers theorised sociocultural feedback loops as emergent, entangled and dynamic moves in a dance of knowing during which participants negotiated meaning and identities of capability.

Mini-Orb : A personal indoor climate preference feedback interface

The control of environmental factors in open-office environments, such as lighting and temperature is becoming increasingly automated. This development means that office inhabitants are losing the ability to manually adjust environmental conditions according to their needs. In this paper we describe the design, use and evaluation of MiniOrb, a system that employs ambient and tangible interaction mechanisms to allow inhabitants of office environments to maintain awareness of environmental factors, report on their own subjectively perceived office comfort levels and see how these compare to group average preferences. The system is complemented by a mobile application, which enables users to see and set the same sensor values and preferences, but using a screen-based interface. We give an account of the system’s design and outline the results of an in-situ trial and user study. Our results show that devices that combine ambient and tangible interaction approaches are well suited to the task of recording indoor climate preferences and afford a rich set of possible interactions that can complement those enabled by more conventional screen-based interfaces.