Discourse and assessment

Many contemporary currents in applied linguistics have favored discourse studies within assessment; there have been calls for cross-fertilization with other areas within applied linguistics, critiques of the positivist tradition within language testing research, and the growing impact of Conversation Analysis (CA) and sociocultural theory. This chapter focuses on the resulting increase in discourse-based studies of oral proficiency assessment techniques. These studies initially focused on the traditional oral proficiency interview but have since been extended to new test formats, including paired and group interaction. We discuss the research carried out on a number of factors in the assessment setting, including the role of the interlocutor, candidate, and rater, and the impact of tasks, task performance conditions, and rating criteria. Recent research has also concentrated more specifically on the assessment of pragmatic competence and on the applications of technology within the assessment of spoken language, including the comparability of semidirect and direct methods for such assessment and the use of computer corpora.

Kids, counsellors and troubles-telling : morality-in-action in talk on an Australian children’s helpline

This chapter investigates one instance of ‘morality-in-action’, which transpires when children describe their troubles to the adult counsellors at Kids Help Line, an Australian national helpline that deals specifically with callers aged approximately 5-18 years. We focus, in particular, on how a young female caller who has forged a medical certificate in relation to a problem with school attendance, determines both what to report, and how this should be disclosed. Throughout the call, the moral implications of the troubles talk are delicately managed by both caller and counsellor. The call takes the form of an extended story (Labov & Waletzky, 1997) that includes a preface (‘I have some problems at school’), an orientation (“I was sick, went to the doctor, stayed home”), a complicating action (“I went back to school and photocopied my certificate from last time”), result (“I got caught”) and evaluation (“I don’t know why it happened”). As the account unfolds, we observe how both the student and counsellor seek to make sense of these actions. While this account is partly about deception, both the caller and counsellor delicately sidestep naming this action, precluding this implication. For example, the counsellor lets stand the caller’s main assessment of the trouble. He simply asks, “so what happened then,” when the caller reports that her forgery was discovered. The caller, from the very beginning of the call, seeks to find out why she could have done this, “you see I don’t know why it happened”. As the call unfolds, the counsellor follows the opening provided by the caller and they put forward motives for consideration. By agreeing that the motives are to be explored, the act takes on a character other than deception.

"Well, now I'm upset": Moral and social orders in the playground

There is much still to learn about how young children’s membership with peers shapes their constructions of moral and social obligations within everyday activities in the school playground. This paper investigates how a small group of girls, aged four to six years, account for their everyday social interactions in the playground. They were video-recorded as they participated in a pretend game of school. Several days later, a video-recorded excerpt of the interaction was shown to them and invited to comment on what was happening in the video. This conversation was audio-recorded. Drawing on a conversation analysis approach, this chapter shows that, despite their discontent and complaining about playing the game of school, the girls’ actions showed their continued orientation to the particular codes of the game, of ‘no going away’ and ‘no telling’. By making relevant these codes, jointly constructed by the girls during the interview, they managed each other’s continued participation within two arenas of action: the pretend, as a player in a pretend game of school; and the real, as a classroom member of a peer group. Through inferences to explicit and implicit codes of conduct, moral obligations were invoked as the girls attempted to socially exclude or build alliances with others, and enforce their own social position. As well, a shared history that the girls re-constructed has moral implications for present and future relationships. The girls oriented to the history as an interactional resource for accounting for their actions in the pretend game. This paper uncovers how children both participate in, and shape, their everyday social worlds through talk and interaction and the consequences a taken-for-granted activity such as playing school has for their moral and social positions in the peer group.

Documentary practice in a participatory culture

Debates concerning the veracity, ethics and politics of the documentary form circle endlessly around the function of those who participate in it, and the meaning attributed to their participation. Great significance is attached to the way that documentary filmmakers do or do not participate in the world they seek to represent, just as great significance is attached to those subjects whose participation extends beyond playing the part of eyewitness or expert, such that they become part of the very filmmaking process itself. This Ph.D. explores the interface between documentary practice and participatory culture by looking at how their practices, discursive fields and histories intersect, but also by looking at how participating in one might mean participating in the other. In short, the research is an examination of participatory culture through the lens of documentary practice and documentary criticism. In the process, however, this examination of participatory culture will in turn shed light on documentary thinking, especially the meaning and function of ‘the participant’ in contemporary documentary practice. A number of ways of conceiving of participation in documentary practice are discussed in this research, but one of the ideas that gives purpose to that investigation is the notion that the participant in contemporary documentary practice is someone who belongs to a participatory culture in particular. Not only does this mean that those subjects who play a part in a documentary are already informed by their engagement with a range of everyday media practices before the documentary apparatus arrives, the audience for such films are similarly informed and engaged. This audience have their own expectations about how they should be addressed by media producers in general, a fact that feeds back into their expectations about participatory approaches to documentary practice too. It is the ambition of this research to get closer to understanding the relationship between participants in the audience, in documentary and ancillary media texts, as well as behind the camera, and to think about how these relationships constitute a context for the production and reception of documentary films, but also how this context might provide a model for thinking about participatory culture itself. One way that documentary practice and participatory culture converge in this research is in the kind of participatory documentary that I call the ‘Camera Movie’, a narrow mode of documentary filmmaking that appeals directly to contemporary audiences’ desires for innovation and participation, something that is achieved in this case by giving documentary subjects control of the camera. If there is a certain inevitability about this research having to contend with the notion of the ‘participatory documentary’, the ‘participatory camera’ also emerges strongly in this context, especially as a conduit between producer and consumer. Making up the creative component of this research are two documentaries about the reality television event Band In A Bubble, and participatory media practices more broadly. The single-screen film, Hubbub , gives form to the collective intelligence and polyphonous voice of contemporary audiences who must be addressed and solicited in increasingly innovative ways. One More Like That is a split-screen, DVD-Video with alternate audio channels selected by a user who thereby chooses who listens and who speaks in the ongoing conversation between media producers and media consumers. It should be clear from the description above that my own practice does not extend to highly interactive, multi-authored or web-enabled practices, nor the distributed practices one might associate with social media and online collaboration. Mine is fundamentally a single authored, documentary video practice that seeks to analyse and represent participatory culture on screen, and for this reason the Ph.D. refrains from a sustained discussion of the kinds of collaborative practices listed above. This is not to say that such practices don’t also represent an important intersection of documentary practice and participatory culture, they simply represent a different point of intersection. Being practice-led, this research takes its procedural cues from the nature of the practice itself, and sketches parameters that are most enabling of the idea that the practice sets the terms of its own investigation.

Sociometric stability and the behavioral correlates of peer acceptance in early childhood

This paper presents findings from an Australian study examining the behavioral correlates and stability of social status for preschool-aged children. The social status of an initial sample of 187 (94 boys and 93 girls) preschool children (mean age 62.4 months, SD = 4.22) was determined through sociometric assessment. Children classified as rejected, neglected and popular (n = 70) were selected for observation. Children were observed for a total of 25 minutes over a three-month period engaging in free play within their preschool centers. Results indicated that children classified as popular were more likely than rejected or neglected children to engage in cooperative play, ongoing connected conversation and to display positive affect. Popular children were less likely than rejected or neglected children to engage in parallel play, onlooker behavior or alone directed behavior. Six months after initial sociometric classification, sociometric interviews were repeated to test for stability and change. Results indicated that preschool-aged children’s social status classifications showed a moderate to high rate of stability for those children classified as popular, rejected and neglected.

Coping with Generation Y in schools

In recent times, complaining about the Y Generation and its perceived lack of work ethic has become standard dinner-party conversation amongst Baby Boomers. Discussions in the popular press (Salt, 2008) and amongst some social commentators (Levy, Carroll, Francoeur, & Logue, 2003) indicate that the group labelled Gen Y have distinct and different generational characteristics. Whether or not the differences are clearly delineated on age is still open to discussion but in the introduction to "The Generational Mirage? a pilot study into the perceptions of leadership by Generation X and Y", Levy et al. argue that "the calibre of leadership in competing organisations and the way they value new and existing employees will play a substantial role in attracting or discouraging these workers regardless of generational labels". Kunreuther's (2002) suggests that the difference between younger workers and their older counterparts may have more to do with situational phenomena and their position in the life cycle than deeper generational difference. However this is still an issue for leadership in schools.

Tricking up the suburb

The following article arises from the projects submitted for the 2004 Awards fo the Western Australian Chapter of the Australian Institute of Landscape Architects, for which we were judges, together with Craig Burton of CAB Consulting and Natalie palleros of Tierra Design. This article is an attempt to understand some dominant trends that emerged from viewing a range of new suburban developments. Suburban developments dominated the awards and seemed to characterise much of the work being done by landscape architects in the west. It is easy to be critical of contemporary landscape architecture in Perth, as the projects presented were mostly the same in that their scope of design activity was restricted to the decorative rather than the structural. However, as critics, we feel it is important to initate a conversation about what has been presented as the best of the profession, in order to begin to understand the current state of the profession.

Aligning ICT in assessment with teaching and learning : enhancing student achievement in the middle years

Student underachievement in the middle years (typically Years 4 to 9) is a concern in education. Incorporating Information and Communication Technologies (ICT) in assessment that is aligned to teaching and learning has the potential to engage students in higher cognitive processes that lead to increased student achievement. To examine this proposition an investigation was undertaken into teachers’ perceptions of alignment and the implications of those for student achievement in ICT enhanced middle years assessment tasks. This investigation used a collective case study design underpinned by socio-cultural theory. Two methods were used for data collection, namely, semi-structured interviews with individual teachers and a focus group discussion with teachers and another with students. Findings revealed teachers’ perceptions that alignment: assists in mediating achievement of learning outcomes in quality middle years assessment tasks, assists in creating a challenging but supportive environment in which positive learning dispositions and success is encouraged for all students, and contributes to more rigorous use of ICT in assessment. The process of implementing alignment was found to be complex but assisted through prioritising particular practices. These findings enabled the development of eight steps which serve as a guide to the effective implementation of alignment in middle years assessment tasks.

Young children enacting governance : child’s play?

Schools, homes and communities are increasingly perceived as risky spaces for children. This concern is a driving force behind many forms of governance imposed upon Australian children by well-meaning adults. Children are more and more the subjects of both overt and covert regulation by teachers and other adults in school contexts. Are children, though, passive in this process of governance? It is this issue that is the focus of this paper. In order to respond to the question of how young children enact governance in their everyday lives, video-recorded episodes of naturally occurring interactions among children in a preparatory classroom were captured. These data were then transcribed and analysed using the methods of conversation analysis and membership categorisation analysis. This paper shows a number of strategies that the children used when enacting governance within their peer cultures in the classroom. It focuses specifically on how adult and child-formulated rules and social orders of the classroom were drawn upon and developed in order to control and govern during the interaction. This paper illustrates that children are not passive in enacting governance, but actively and competently enact governance through their peer cultures. These findings are significant for educators to consider, as they help to develop an understanding of the complex social orders that children are continually constructing in the early childhood classroom.

Justifications in young children’s language in an early childhood classroom

This paper examines the interactional phenomenon of justification as it is produced in young children’s language. A justification provides a reason for one’s position and can be produced in children’s language at an early age. There are various pragmatic reasons for justifications. For example, justifications may be drawn upon by members to compensate for the disruption of the existing social order or to explain something that is possibly questionable. Justifications are also drawn upon to extend or close disputes. This study uses the analytical techniques of conversation analysis and membership categorisation to analyse video-recorded and transcribed interactions of young children (aged 4-6 years) in a preparatory classroom in a primary school in Australia. The focus is an episode that occurred within the block play area of the classroom that involved a dispute of ownership relating to a small, wooden plank. In analysing this dispute, justifications were frequent occurrences and the young participants drew upon justificatory devices in their everyday arguments. As the turns surrounding the justificatory language were examined, a pattern emerged: in each excerpt observed, a justification arose in response to a challenge. This pattern provided the basis for developing a model that helped to discern where, why and what type of justifications occurred in the interaction. To depict this interactional phenomenon, the model of ‘if x, then y’ was used, ‘x’ referring to the challenge or prompt, and ‘y’ referring to the justificatory response. Justifications related to the concepts of ownership and were used as devices by those engaged in disputes to support their positions and provide reasons for their actions. The children drew upon these child-constructed rules as resources to use in disputes with their peers, in order to construct and maintain the social order of the block area in the classroom.

Enhancing peer support

A useful way to enhance peer support among young people is to provide peer counsellor training programmes. Research has shown, however, that there are problems associated with typical peer counselling programmes for young people. Most rely on teaching young people counselling skills that are commonly used by professional counsellors when counselling adults and these are not compatible with typical conversation behaviours used by young people. Another problem is that they suggest some commonly used communication processes evident in the conversations of young people are unhelpful, whereas research has shown that this is not the case (Geldard, 2006). In order to overcome these problems, a peer counsellor training programme has been developed for young people as an outcome of research into training young people as peer counsellors (Geldard, 2006).

AITPM Email Newsletter Volume 0909, September 2009: Presidents Message

President’s Message Hello fellow AITPM members, A few weeks have now passed since our 2009 AITPM National Conference, Traffic Beyond Tomorrow, which was held at the Adelaide Convention Centre from 5 to 7 August. I personally had a most enjoyable and enriching time at the Conference and felt these same “vibes” all around me. Top marks go to the South Australia organising committee, convened by Andrew Leedham, for their dedication to this our flagship event for the year. I could go on to cite my highlights but there were too many to give due diligence here. I had a number of official functions to perform at the Conference, but one in particular worth mentioning was being interviewed by radio stations 5AA, the main news/talk commercial broadcaster in Adelaide, and 891 ABC Adelaide. All interviewers were focussed on the issue of congestion charging, which is interesting in its emergence as a public conversation piece. My main responses focussed on the importance of providing alternatives for travel to the motorist otherwise being charged by a scheme, if and when decisions were made to implement congestion charging. I found that these opportunities to present AITPM as a professional peak body were very fruitful. The Queensland organising committee is now in full swing organising the 2010 AITPM National Conference, What’s New?, so please keep a lookout for related content. You’ll also find within this edition a transcript of my President’s Report to the 2009 AITPM National Annual General Meeting, which was held during the Adelaide Conference. Best regards to all, Jon Bunker

Departing from the virtual community : a discussion of the ways and means to uncover localised order in online games

This paper is part one of a three part study into the collective regulation processes of players in massive multiplayer online games (MMOG). Traditionally game playing has not been classed as problematic, however with introduction of new media technologies and new ways to play games, certain contexts have become obscure, namely the localised order of ‘playing online’ or how players manage and maintain order between each other as opposed to ‘following the rules’. Principally this paper will examine concepts of ‘virtual community’. These will be illustrated as particularly unhelpful when considering how people conduct themselves in these spaces. Thus, ‘virtual community’ will be seen as critical in implicating various online behaviours as superior to other online behaviours causing obscurity and blurring actions. This obscurity is grounded by strong associations in the virtual community as logic of practise in and of itself; behaviours that fall outside this category become common sense and as such are made invisible for investigation. This paper will draw upon the theories of Basil Bernstein and Pierre Bourdieu to produce a distinction between online behaviours and ultimately make them visible for further investigation. In doing so this paper seeks to form a basis for future research where interaction in these spaces can be identified as belonging to a certain framework to inform the design of online games and applications more effectively.

When 'listeners can't talk' : comparing active listening in opening sequences of telephone and online counselling

While there is growing use of online counselling, little is known about its interactional organisation and how it compares to telephone counselling. This is despite past research suggesting that both counsellors and clients report the impact of the different modalities on the presentation and management of the counselling interaction. This paper compares the interactional affordances of telephone and online web counselling in opening sequences on Kids Help Line, a 24-hour Australian counselling service for children and young people up to the age of 25. We examine two ways that counsellors show active listening through response tokens and formulations. The analysis describes how counsellors’ use of minimal response tokens facilitate the clients’ problem presentation and are used in the management of turn taking and sequence organisation. For example, counsellors use the response token Mm hm to show that they understand that the client’s unit of talk to is not yet complete, and to affirm or invite the client to continue speaking. Formulations in phone and web counselling are another way that counsellors display active listening to re-present stretches of the clients’ preceding talk. In phone and web counselling, however, the respective modalities can complicate matters of turn transition and sequence organisation. By examining actual phone and online counselling sessions, this paper offers empirical demonstrations of the interactional affordances of phone and online counselling, and shows how the institutional practice of active listening is accomplished across different counselling modalities

Participation and social order in the playground

This study investigates the everyday practices of young children acting in their social worlds within the context of the school playground. It employs an ethnographic ethnomethodological approach using conversation analysis. In the context of child participation rights advanced by the United Nations Convention on the Rights of the Child (UNCRC) and childhood studies, the study considers children’s social worlds and their participation agendas. The participants of the study were a group of young children in a preparatory year setting in a Queensland school. These children, aged 4 to 6 years, were videorecorded as they participated in their day-to-day activities in the classroom and in the playground. Data collection took place over a period of three months, with a total of 26 hours of video data. Episodes of the video-recordings were shown to small groups of children and to the teacher to stimulate conversations about what they saw on the video. The conversations were audio-recorded. This method acknowledged the child’s standpoint and positioned children as active participants in accounting for their relationships with others. These accounts are discussed as interactionally built comments on past joint experiences and provided a starting place for analysis of the video-recorded interaction. Four data chapters are presented in this thesis. Each data chapter investigates a different topic of interaction. The topics include how children use “telling” as a tactical tool in the management of interactional trouble, how children use their “ideas” as possessables to gain ownership of a game and the interactional matters that follow, how children account for interactional matters and bid for ownership of “whose idea” for the game and finally, how a small group of girls orientated to a particular code of conduct when accounting for their actions in a pretend game of “school”. Four key themes emerged from the analysis. The first theme addresses two arenas of action operating in the social world of children, pretend and real: the “pretend”, as a player in a pretend game, and the “real”, as a classroom member. These two arenas are intertwined. Through inferences to explicit and implicit “codes of conduct”, moral obligations are invoked as children attempt to socially exclude one another, build alliances and enforce their own social positions. The second theme is the notion of shared history. This theme addresses the history that the children reconstructed, and acts as a thread that weaves through their interactions, with implications for present and future relationships. The third theme is around ownership. In a shared context, such as the playground, ownership is a highly contested issue. Children draw on resources such as rules, their ideas as possessables, and codes of behaviour as devices to construct particular social and moral orders around owners of the game. These themes have consequences for children’s participation in a social group. The fourth theme, methodological in nature, shows how the researcher was viewed as an outsider and novice and was used as a resource by the children. This theme is used to inform adult-child relationships. The study was situated within an interest in participation rights for children and perspectives of children as competent beings. Asking children to account for their participation in playground activities situates children as analysers of their own social worlds and offers adults further information for understanding how children themselves construct their social interactions. While reporting on the experiences of one group of children, this study opens up theoretical questions about children’s social orders and these influences on their everyday practices. This thesis uncovers how children both participate in, and shape, their everyday social worlds through talk and interaction. It investigates the consequences that taken-for-granted activities of “playing the game” have for their social participation in the wider culture of the classroom. Consideration of this significance may assist adults to better understand and appreciate the social worlds of young children in the school playground.