Discourse and assessment

Many contemporary currents in applied linguistics have favored discourse studies within assessment; there have been calls for cross-fertilization with other areas within applied linguistics, critiques of the positivist tradition within language testing research, and the growing impact of Conversation Analysis (CA) and sociocultural theory. This chapter focuses on the resulting increase in discourse-based studies of oral proficiency assessment techniques. These studies initially focused on the traditional oral proficiency interview but have since been extended to new test formats, including paired and group interaction. We discuss the research carried out on a number of factors in the assessment setting, including the role of the interlocutor, candidate, and rater, and the impact of tasks, task performance conditions, and rating criteria. Recent research has also concentrated more specifically on the assessment of pragmatic competence and on the applications of technology within the assessment of spoken language, including the comparability of semidirect and direct methods for such assessment and the use of computer corpora.

Developing speaking assessment tasks to reflect the 'social turn' in language testing

Interactional competence has emerged as a focal point for language testing researchers in recent years. In spoken communication involving two or more interlocutors, the co-construction of discourse is central to successful interaction. The acknowledgement of co-construction has led to concern over the impact of the interlocutor and the separability of performances in speaking tests involving interaction. The purpose of this article is to review recent studies of direct relevance to the construct of interactional competence and its operationalisation by raters in the context of second language speaking tests. The review begins by tracing the emergence of interaction as a criterion in speaking tests from a theoretical perspective, and then focuses on research salient to interactional effectiveness that has been carried out in the context of language testing interviews and group and paired speaking tests.

The 'Dirty Work' of the Lie

The panel "Duplicity/Complicity: Performing and Misperforming Lies" at PSi #15 in Croatia in July 2009 examined the half-truths, hidden assumptions and power relations embedded in every act of performance through an analysis of the way bodies, buildings, personae and communities perform and misperform lies. It was a collection of new academic voices from Australia and Croatia, intersecting and colliding and, at times, outright lying, with each other and with commentary from Alan Read. Inspired by this successful adventure in collaborative academic mis-performance, "The ‘Dirty Work’ of the Lie" takes the challenge set by the Prelude Panel at PSI #15 and subjects the ideas emerging from this panel to "friendly fire" in order to build a multi authored response to 'performance that lies', with reference to the work of A Chorus of Women, disabled artists Bill Shannon, Aaron Williamson and Kathryn Araneillo, US dance performer Ann Liv Young and US theatre and festival director Peter Sellars. In doing so, "The 'Dirty Work' of the Lie" provides a reflexive response to the duplicity inherent in the performances, and also in our own academic analyses. With Alan Read acting as interlocutor, each contributor will creatively respond to a paper presented by another, developing the key intersecting issues that emerged through the formation of the panel. These issues include impression management, self-belief and performers who are 'taken in by their own act', the dirty work of taking others in with an act, the guerrilla dimension of lying, the productivity of the lie, and questions of audience engagement and ethics. As a result, this new paper tests how the 'misperformance' of lies across different cultural sites, be it deliberate or accidental, can become a productive – and, indeed, politicised – aspect of cultural performance, betraying accepted attitudes, ideas and structures of authority and offering alternative visions. Through it’s distinctively multi vocal texture, "The 'Dirty Work' of the Lie" also interrogates the modes of analysis available to us, questioning the 'duplicity' in our reflecting, responding and listening to each other as well as the work.

Interactional competence in a paired speaking test : features salient to raters

Paired speaking tests are now commonly used in both high-stakes testing and classroom assessment contexts. The co-construction of discourse by candidates is regarded as a strength of paired speaking tests, as candidates have the opportunity to display a wider range of interactional competencies, including turn taking, initiating topics and engaging in extended discourse with a partner, rather than an examiner. However, the impact of the interlocutor in such jointly negotiated discourse and the implications for assessing interactional competence are areas of concern. This article reports on the features of interactional competence that were salient to four trained raters of 12 paired speaking tests through the analysis of rater notes, stimulated verbal recalls and rater discussions. Findings enabled the identification of features of the performance noted by raters when awarding scores for interactional competence, and the particular features associated with higher and lower scores. A number of these features were seen by the raters as mutual achievements, which raises the issue of the extent to which it is possible to assess individual contributions to the co-constructed performance. The findings have implications for defining the construct of interactional competence in paired speaking tests and operationalising this in rating scales.

Crow

Poem.

Making arrangements in talk-in-interaction

Arrangement-making is understood to be a ‘closing-relevant action’ (Schegloff & Sacks 1973), but little attention has been given to how people arrive at mutually acceptable plans for the future. Telephone conversations between clients and staff of Community and Home Care (CHC) services were studied to identify how arrangements for future services were made. A recurrent sequence was observed in which clients were informed of future arrangement and were prompted to reply with ‘response solicitation’ (Jefferson 1981). Response solicitations were observed at two points: either tagged to the end of an informing, or following a recipient’s response to the informing. We show how response solicitations are routinely used in instances where recipients have some discretion in relation to the arrangement under discussion. They are a means by which an informing party can display to their interlocutor that they, as recipient, have some discretion to exercise in the matter. These findings are discussed with reference to prior research on arrangement-making in other settings, which suggests the general nature of this practice.