Improving criteria and feedback in student assessment in law

Spurred on by both the 1987 Pearce Report1 and the general changes to higher education spawned by the “Dawkins revolution” from 1988, there has been much critical self-evaluation leading to profound improvements to the quality of teaching in Australian law schools.2 Despite the changes there are still areas of general law teaching practice which have lagged behind recent developments in our understanding of what constitutes high quality teaching. One such area is assessment criteria and feedback. The project Improving Feedback in Student Assessment in Law is an attempt to remedy this. It aims to produce a manual containing key principles for the design of assessment and the provision of feedback, with practical yet flexible ideas and illustrations which law teachers may adopt or modify. Most of the examples have been developed by teachers at the University of Melbourne Law School. The project was supported in 1996 by a Committee for the Advancement of University Teaching grant and the manual will be published late in 1997.3 This note summarises the core principles which are elaborated further in the manual.

“I’m Happy with Who I Am” : A Discursive Analysis of the Self-characterisation Practices of Boys in “Behaviour” Schools

In this chapter, I draw on poststructural theories of language to examine the self-characterisation practices of 33 boys attending special schools for students with disruptive behaviour. During a semi-structured interview, each boy was asked to describe his personality and then to choose from a selection of positive/negative word pairs. The objective was to determine whether these young people would characterise themselves in positive or negative ways. Participants were then asked if there was anything they would change about themselves if they could. Responses were analysed and compared against a discourse model developed from media reports and interviews with their principals. Findings suggest that while discourse may well ‘form the objects of which it speaks’ (Foucault, 1972, p. 49) in the eyes of teachers, principals, psychiatrists and paediatricians, it also offers a means through which the constituted subject can re-author itself in a more positive frame.

'Women on a Wiki’ : the role of interactive websites in reflective learning practices for undergraduate women’s health students

Aim Our pedagogical research addressed the following research questions: 1) Can shared ‘cyber spaces’, such as a ‘wiki’, be occupied by undergraduate women’s health students to improve their critical thinking skills? 2) What are the learning processes via which this occurs? 3) What are the implications of this assessment trial for achieving learning objectives and outcomes in future public health undergraduate courses? Methods The students contributed written, critical reflections (approximately 250 words) to the Wiki each week following the lecture. Students reflected on a range of topics including the portrayal of women in the media, femininity, gender inequality, child bearing and rearing, domestic violence, mental health, Indigenous women, older women, and LGBTIQ communities. Their entries were anonymous, but visible to their peers. Each wiki entry contained a ‘discussion tab’ wherein online conversations were initiated. We used a social constructivist approach to grounded theory to analyse the 480 entries posted over the semester. (http://pub336womenshealth.wikispaces.com/) Results The social constructivist approach initiated by Vygotsky (1978) and further developed by Jonasson (1994) was used to analyse the students’ contributions in relation to four key thematic outcomes including: 1) Complexities in representations across contexts; 2) Critical evaluation in real world scenarios; 3) Reflective practice based on experience, and; 4) Collaborative co-construction of knowledge. Both text and image/visual contributions are provided as examples within each of these learning processes. A theoretical model depicting the interactive learning processes that occurred via discussion of the textual and visual stimulus is presented.

Preparing pre-service teachers to teach primary science : an integrated approach using the theme of sustainability

An integrated approach to assessment afforded pre-service teachers the opportunity to learn about a local sustainability issue through three learning areas: science and technology,the arts and studies of society and environment (SOSE). Three sustainability issues chosen by the pre-service teachers are presented in this paper highlighting the science concepts explored. Affordances and constraints of the integrated task are discussed in the conclusion.

Linking pedagogical knowledge practices and student outcomes in STEM education for primary schools

STEM education is a new frontier in Australia, particularly for primary schools. However, the E in STEM needs to have a stronger focus with science and mathematics concepts aligned to the presiding curricula. In addition, pedagogical knowledge practices such as planning, preparation, teaching strategies, assessment and so forth need to be connected to key concepts for developing a STEM education. One of the aims of this study was to understand how a pedagogical knowledge practice framework could be linked to student outcomes in STEM education. Specifically, this qualitative research investigated Year 4 students’ involvement in an integrated STEM education program that focused on science concepts (e.g., states of matter, testing properties of materials) and mathematics concepts (such as 3D shapes and metric measurements: millilitres, temperature, grams, centimetres) for designing, making and testing a strong and safe medical kit to insulate medicines at desirable temperatures. Eleven pedagogical knowledge practices (e.g., planning, preparation, teaching strategies, classroom management, and assessment) were used as a framework for understanding how teaching may be linked to student outcomes in STEM education. For instance, “planning” involved devising a student booklet as a resource for students to understand the tasks required of them, which also provided space for them to record ideas, results and information. Planning involved linking national and state curriculum documents to the STEM education activities. More studies are required around pedagogical knowledge frameworks to understand what students learn when involved in STEM education, particularly with the inclusion of engineering education.

Literacy and numeracy project: Final report 2009

Literacy and numeracy are critical for young people during and after their schooling. The subjects and courses that students undertake during their school years incorporate a range of academic literacy and numeracy practices which students must be able manage if they are to be successful. Pathways beyond schooling also require specific, and changing, understandings of, and proficiencies with, literacy and numeracy as new communication technologies increasingly impact on further study, work, and everyday life. Teaching and learning numeracy is a new emphasis in the SACE and as yet we have little understanding about the ways in which secondary schools handle this area. Students in Years 10 and 11 are at a crucial point in their educational and life pathways as they begin to refine their future aspirations. For those who have difficulty with academic literacies and numeracies – and often a long history of such problems – this period can be fraught unless teachers are able to provide specific support when it is needed, or students are able to access it from care-givers or community members. The School to Work Literacy and Numeracy Project involved teachers from nine schools across the three sectors and university researchers working together to design curriculum interventions for students with a history of low measurable achievement in literacy and/or numeracy. The project started from the premise that working with ‘rich tasks’, an approach to learning and assessment developed in the Productive Pedagogies work undertaken in Queensland (Hayes et al., 2006), would improve students’ motivation, engagement and learning and that this work could best be done by teachers working in school-based, cross-curriculum teams with a school leadership team member and a university researcher as mentor. A key idea in designing rich tasks is that students will have opportunities to demonstrate their learning in assessments which are aligned with the learning expectations (for example a film festival to publicly launch student-produced films, advertising to sell student-made cubby-houses, a household budget based on students’ likely incomes in future work). In other words the assessments should be designed to allow for authentic communication and displays of what the students have learned through serious engagement with the curriculum. The project was conducted from Term 1-4 2009, with follow-up checks with some project teachers in the early weeks of 2010.

Digital literacies: Understanding the literate practices of refugee kids in an Afterschool Media Club

Since the 2000s, teachers in an increasing number of Australian schools have been learning how to support students with refugee backgrounds. For some of these students, entry into the Australian school system is not easy. English literacy is integral to some of the challenges confronting the students. In response, educators have been developing and researching ways of engaging with the students’ language and literacy learning. Much of the focus has been on traditional print-based school literacies. In contrast, I look here at student engagement in digital literacies in an after-school media club. Several concepts from the theory of French sociologist, Pierre Bourdieu are useful for understanding the position of students of refugee background in the Australian school system. Like other conflict theories, Bourdieusian theory has sometimes been criticised as ‘pessimistic’, that is, for suggesting that schools necessarily reproduce social disadvantage. However, others have used Bourdieusian theory to analyse and critique the reproductive work of schooling for groups of students who experience educational disadvantage. I align myself with this latter tradition. Specifically, I use Bourdieu’s triad of concepts to explain aspects of the literacy education experiences of some young people of refugee background: field, capital and habitus. In particular, I look at questions of the legitimation of students’ competences as capital in literate fields within and beyond the school context. Data are drawn from an Australian Research Council-funded project, Digital Learning and Print Literacy: A design experiment for the reform of low socio-economic, culturally diverse schools (2009-14). The data analysed in this chapter include interviews and observations relating to the participation of two Congolese girls in an after school media club. Implications are drawn for teachers of literacy in culturally and linguistically diverse contexts. Consideration is made of early childhood, primary and secondary settings.

Class participation as a learning and assessment strategy in law : facilitating students’ engagement, skills development and deep learning

Assessment has widely been described as being ‘at the centre of the student experience’. It would be difficult to conceive of the modern teaching university without it. Assessment is accepted as one of the most important tools that an educator can deploy to influence both what and how students learn. Evidence suggests that how students allocate time and effort to tasks and to developing an understanding of the syllabus is affected by the method of assessment utilised and the weighting it is given. This is particularly significant in law schools where law students may be more preoccupied with achieving high grades in all courses than their counterparts from other disciplines. However, well-designed assessment can be seen as more than this. It can be a vehicle for encouraging students to learn and engage more broadly than with the minimums required to complete the assessment activity. In that sense assessment need not merely ‘drive’ learning, but can instead act as a catalyst for further learning beyond what a student had anticipated. In this article we reconsider the potential roles and benefits in legal education of a form of interactive classroom learning we term assessable class participation (‘ACP’), both as part of a pedagogy grounded in assessment and learning theory, and as a platform for developing broader autonomous approaches to learning amongst students. We also consider some of the barriers students can face in ACP and the ways in which teacher approaches to ACP can positively affect the socio-emotional climates in classrooms and thus reduce those barriers. We argue that the way in which a teacher facilitates ACP is critical to the ability to develop positive emotional and learning outcomes for law students, and for teachers themselves.

The birthday cake: Social relations and professional practices around mealtimes with toddlers and child care

Events that involve food and eating are important parts of the daily routine in which adults and children participate in child care settings. These events can be viewed as cultural practices because they involve certain everyday ways of acting, thinking or feeling (Grusec JE et al, Child Dev 71(1): 205–211, 2000). The cultural practices around food and eating symbolise and guide the social relations, emotions, social structures and behaviours of the participants. Identities and roles for the participants are created in these practices, marked by ambiguity, movement and fluidity through ongoing processes of negotiation (Punch S et al, Child Geogr 8(3): 227–232, 2010). The formal professional systems that guide these practices in early education and care programs often focus on the nutritional value of the food, while the children and teachers involved in these mealtime events account for the intersubjective experiences. Mealtimes provide opportunities for children and teachers to interact and co-construct meaning around the situations that arise. Of special interest in this research are teachers’ and children’s intentions for communication in the context of events involving food and eating and the kind of learning embedded in the communications that occur. Throughout this chapter, these events are referred to as mealtimes. This study is informed by phenomenological theory which aims to reach understandings about interactions and their meaning from the perspective of the participating individuals.

Towards a theoretical framework for online professional discussions

Online interactions are becoming commonplace for a multitude of educational purposes. Each context presents a unique and dynamic mix of variables that combine to shape the practice and the identities of those involved. In this article, sociocultural theories of learning and sociocultural theories of technology are explored as a way to view and to map the complex interactions that can occur. The case of synchronous online moderation meetings are used as an example of the combination of variables that can impact on the development of shared understandings of a practice. Online moderation can involve teachers from geographically diverse areas discussing and negotiating their judgement decisions. These discussions represent an intersection of a national curriculum, standards-referenced assessment, moderation protocols, site-specific practices and understandings, and individual teachers’ knowledges and histories. It is suggested that the proposed theoretical combination addresses some of the limitations of each of the theories when investigating such a dynamic context. As higher education moves into increasing use of online modes of communication and a higher level of accountability the relevance of this discussion to higher education is evident.

The effect of feedback from pupil to teacher on assessment for leaning and visible learning: An ethnographic case study in a community school in England and the outcome in a state high school in Queensland, Australia

This study shows that there is positive regulatory effect of feedback from pupils to teachers on Assessment for Learning (AfL), classroom proactiveness, and on visible and progressive learning but not on behaviour. This research finding further articulates feedback from pupil to teacher as a paradigm shift from the classical paradigm of feedback from teacher to pupil. Here, the emphasis is geared towards pupils understanding of objectives built from previous knowledge. These are then feedback onto the teachers by the pupils in the form of discrete loops of cues and questions, where they are with their learning. This therefore enables them to move to the next level of understanding, and thus acquired independence, which in turn is reflected by their success in both formative and summative assessments. This study therefore shows that when feedback from pupil to teacher is used in combination with teacher to pupil feedback, AfL is ameliorated and hence, visible and accelerated learning occurs in a gender, nor subject non-dependent manner.

Learning through feedback loop metaphors

The metaphor of a feedback loop underpinned a significant curriculum change in a first year teacher-education unit. Assessment for Learning (AfL) practices such as discussing examples of previous student work and giving peer feedback were embedded within the curriculum design. The metaphor of a feedback loop connected these AfL practices into a purposeful process that informed student learning as well as tutor learning about student understanding, that then informed the next teaching episode. Student teachers (n=350) in twelve tutorial groups taught by eight university tutors were able to develop a shared understanding of quality performances before completing each assessment task. As well as providing ongoing insights to improve teaching, data from this action research project enabled the participant tutor-researchers to interrogate the concept of feedback loops. The researchers theorised sociocultural feedback loops as emergent, entangled and dynamic moves in a dance of knowing during which participants negotiated meaning and identities of capability.

An early feeding practices intervention for obesity prevention

Objective - Report long term outcomes of the NOURISH randomized controlled trial (RCT) that evaluated a universal intervention commencing in infancy to provide anticipatory guidance to first-time mothers on ‘protective’ complementary feeding practices which were hypothesized to reduce childhood obesity risk. Subjects and Methods - The NOURISH RCT enrolled 698 mothers (mean age 30.1 years, SD=5.3) with healthy term infants (51% female). Mothers were randomly allocated to usual care or to attend two 6-session, 12-week group education modules. Outcomes were assessed five times: baseline (infants 4.3 months); 6 months after module 1 (infants 14 months); 6 months after module 2 (infants 2 years) and at 3.5 and 5 years of age. Maternal feeding practices were self-reported using validated questionnaires. BMI Z-score was calculated from measured child height and weight. Linear Mixed Models evaluated intervention (group) effect across time. Results - Retention at 5 years of age was 61%. Across ages 2-5 years, intervention mothers reported less frequent use of non-responsive feeding practices on 6/9 scales. At 5 years they also reported more appropriate responses to food refusal on 7/12 items (Ps ≤.05). No statistically significant group effect was noted for anthropometric outcomes (BMI Z-score: P=.06), or the prevalence of overweight/obesity (control 13.3% vs. intervention 11.4%, P=.66). Conclusions - Anticipatory guidance on complementary feeding resulted in first-time mothers reporting increased use of protective feeding practices. These intervention effects were sustained up to five years of age and were paralleled by a non-significant trend for lower child BMI Z-scores at all post-intervention assessment points.

Making trouble: Ethnographic designs on ruling relations for students and teachers in non-academic pathways

Since 2009, all Australian states require young people to be ‘earning or learning’ until age 17. Secondary schools and vocational colleges now accommodate students for whom the conventional academic pathways of the past were not designed. The paper reflects on a project designed to explore the moral orders in these institutional settings for managing such students in extended compulsory schooling. Originally designed as classroom ethnographies, the project involved observations over three to four weeks and interviews with teachers and students in five sites in towns experiencing high youth unemployment. The project aimed to support teachers to work productively in such classrooms with such students, under the assumption that teachers orchestrate classroom interactions. However, it became clear events in these classrooms were being shaped by relations and parties above and beyond the classroom, as much as by those present. Teachers and students were observed to both comply with, and push against, the layers of policy and institutional processes regulating their behaviours. This paper re-thinks the original project through the gaze and resources of institutional ethnography, to better account for the layers of accountabilities and documentation practices that impacted on both teacher and student behaviours. By tracing the extended webs of ‘ruling relations’, it shows both how teachers and students could make trouble for the institutional moral order, and then be held accountable for this trouble.

Analysis of moderation practices in a large STEM-focused faculty

Moderation of assessment constitutes a crucial element of the learning and teaching process at the university. Yet, despite its importance, many academics have confusing beliefs and attitudes towards moderation practices, processes and procedures. This paper reports on a qualitative study conducted in a Science, Technology, Engineering and Mathematics (STEM)-focused faculty at a large Australian higher education institution. The findings of the study revealed a strong need for further investigation on the ways moderation is understood and enacted by academics within a STEM-specific context and informed redevelopment of the faculty’s internal moderation policy.