Eye Gaze and Turn Taking in Aphasia Patients

In every conversation you have, there is an unspoken code – a set of social rules that guide you. When to stop talking, where to look, when to listen and when to talk…

Speaking out of turn? Taking the initiative in teacher-fronted classroom interaction.

Teacher-fronted interaction is generally seen to place limitations on the contributions that learners can make to classroom discourse and the conclusion is that learners are unable to experiment with, for example, turn-taking mechanisms. This article looks at teacher-fronted interaction in the language classroom from the perspective of learner talk by examining how learners might take the initiative during this apparently more rigid form of interaction. Detailed microanalysis of classroom episodes, using a conversation analysis institutional discourse approach, shows how learners orient to the institutional context to make sophisticated and effective use of turn-taking mechanisms to take the initiative and direct the interaction, even in the controlled environment of teacher-fronted talk. The article describes some of the functions of such learner initiative, examines how learners and teachers co-construct interaction and how learners can create learning opportunities for themselves. It also briefly looks at teacher reactions to such initiative. The article concludes that learner initiative in teacher-fronted interaction may constitute a significant opportunity for learning and that teachers should find ways of encouraging such interaction patterns.

Disrupted Turn Adjacency and Coherence Maintenance in Instant Messaging Conversations

This article reports on a study of coherence in text-based log files from 120 two-party Instant Messaging (IM) conversations among a group of international students at a design school. The goals of the study were to investigate whether disrupted turn adjacency was an obstacle to coherence and to identify the linguistic strategies employed to maintain coherence. Additional signs of problematic coherence creation were also investigated, focusing on explicit signs of miscommunication. In this particular context, disrupted turn adjacency was not found to be a problem. Whereas devices for textual cohesion can be important, links between utterances can also be identified based on timing and distinctions between different types of feedback, as well as sequencing. The additional signs of miscommunication were all related to different aspects of problematic grounding. The article concludes with suggestions for design improvements to the IM tool.

Eye Gaze Behavior at Turn Transition: How Aphasic Patients Process Speakers' Turns during Video Observation

The human turn-taking system regulates the smooth and precise exchange of speaking turns during face-to-face interaction. Recent studies investigated the processing of ongoing turns during conversation by measuring the eye movements of noninvolved observers. The findings suggest that humans shift their gaze in anticipation to the next speaker before the start of the next turn. Moreover, there is evidence that the ability to timely detect turn transitions mainly relies on the lexico-syntactic content provided by the conversation. Consequently, patients with aphasia, who often experience deficits in both semantic and syntactic processing, might encounter difficulties to detect and timely shift their gaze at turn transitions. To test this assumption, we presented video vignettes of natural conversations to aphasic patients and healthy controls, while their eye movements were measured. The frequency and latency of event-related gaze shifts, with respect to the end of the current turn in the videos, were compared between the two groups. Our results suggest that, compared with healthy controls, aphasic patients have a reduced probability to shift their gaze at turn transitions but do not show significantly increased gaze shift latencies. In healthy controls, but not in aphasic patients, the probability to shift the gaze at turn transition was increased when the video content of the current turn had a higher lexico-syntactic complexity. Furthermore, the results from voxel-based lesion symptom mapping indicate that the association between lexico-syntactic complexity and gaze shift latency in aphasic patients is predicted by brain lesions located in the posterior branch of the left arcuate fasciculus. Higher lexico-syntactic processing demands seem to lead to a reduced gaze shift probability in aphasic patients. This finding may represent missed opportunities for patients to place their contributions during everyday conversation.

Social rules govern vocal competition in the barn owl

To resolve the share of limited resources, animals often compete through exchange of signals about their relative motivation to compete. When two competitors are similarly motivated, the resolution of conflicts may be achieved in the course of an interactive process. In barn owls, Tyto alba, in which siblings vocally compete during the prolonged absence of parents over access to the next delivered food item, we investigated what governs the decision to leave or enter a contest, and at which level. Siblings alternated periods during which one of the two individuals vocalized more than the other. Individuals followed turn-taking rules to interrupt each other and momentarily dominate the vocal competition. These social rules were weakly sensitive to hunger level and age hierarchy. Hence, the investment in a conflict is determined not only by need and resource-holding potential, but also by social interactions. The use of turn-taking rules governing individual vocal investment has rarely been shown in a competitive context. We hypothesized that these rules would allow individuals to remain alert to one another's motivation while maintaining the cost of vocalizing at the lowest level.

Sibling rivalry and vocal negotiation in the barn owl Tyto alba

Chez les animaux, les jeunes dépendant des parents durant leur développement sont en compétition pour obtenir la nourriture, qu'ils quémandent par des cris et postures ostentatoires et se disputent physiquement. Les frères et soeurs n'ont pas la même compétitivité, en particulier s'ils diffèrent en âge, et leur niveau de faim fluctue dans le temps. Comme dans tout type de compétition, chacun doit ajuster son investissement aux rivaux, c'est à dire aux besoins et comportements de ses frères et soeurs. Dans le contexte de la famille, selon la théorie de sélection de parentèle, les jeunes bénéficient de leur survie mutuelle et donc de la propagation de la part de gènes qu'ils ont en commun. L'hypothèse de la « négociation frères-soeurs » prédit que, sous certaines conditions, les jeunes négocient entre eux la nourriture, ce qui réduit les coûts de compétition et permet de favoriser les frères et soeurs les plus affamés. La littérature actuelle se focalise sur les signaux de quémande entre enfants et parents et les interactions compétitives frères-soeurs sont étudiées principalement au sein de paires, alors que les nichées ou portées en comprennent souvent de nombreux. Cette thèse vise à mieux comprendre comment et jusqu'à quel point plusieurs jeunes ajustent mutuellement leurs signaux de besoin. C'est une question importante, étant donné que cela influence la répartition de nourriture entre eux, donc la résolution du conflit qui les oppose et à terme leur valeur évolutive. Le modèle d'étude est la chouette effraie (Tyto alba), chez laquelle jusqu'à neufs poussins émettent des milliers de cris chacun par nuit. Ils négocieraient entre eux la prochaine proie indivisible rapportée au nid avant que les parents ne reviennent : un poussin affamé crie plus qu'un autre moins affamé, ce qui dissuade ce dernier de crier en retour et par la suite de quémander la nourriture aux parents. L'investissement optimal correspondrait donc à écarter son frère en permanence vu que l'arrivée des parents est imprévisible, mais à moindre coût. Dans un premier axe, nous avons exploré au sein de dyades les mécanismes acoustiques permettant aux poussins de doser leur effort vocal durant les heures de compétition où ils sont laissés seuls au nid. Nous avons trouvé que les poussins évitent de crier simultanément, ce qui optimiserait la discrimination du nombre et de la durée de leurs cris, lesquels reflètent de façon honnête leur niveau de faim et donc leur motivation. L'alternance des cris paraît particulièrement adaptée au fait que les poussins se fient à des variations temporelles subtiles dans le rythme et la durée de leurs vocalisations pour prendre la parole. En particulier, allonger ses cris tout en criant moins dissuade efficacement le rival de répondre, ce qui permet de monopoliser la parole dans de longs « monologues ». Ces règles seraient universelles puisqu'elles ne dépendent pas de la séniorité, de la faim, ni de la parenté et les poussins répondent à un playback de façon similaire à un vrai frère. Tous ces résultats apportent la première preuve expérimentale que les juvéniles communiquent de façon honnête sur leurs besoins, ajustent activement le rythme de leurs cris et utilisent des composantes multiples de leurs vocalisations d'une façon qui réduit le coût de la compétition. De plus, il s'agit de la première démonstration que des règles de conversation régissent de longs échanges vocaux chez les animaux de façon comparable aux règles basiques observées chez l'Homme. Dans un second axe, nous avons exploré les stratégies comportementales que les poussins adoptent pour rivaliser avec plusieurs frères et soeurs, par le biais d'expériences de playback. Nous avons trouvé que les poussins mémorisent des asymétries de compétitivité entre deux individus qui dialoguent et répondent plus agressivement au moins compétitif une fois qu'ils sont confrontés à chacun isolément. Dans la même ligne, quand ils entendent un nombre variable d'individus criant à un taux variable, les poussins investissent le plus contre des rivaux moins nombreux et moins motivés. En accord avec les prédictions des modèles théoriques, les poussins de chouette effraie escaladent donc les conflits pour lesquels leur chance de gagner contrebalance le plus l'énergie dépensée. Nous révélons ainsi que 1) les jeunes frères et soeurs 'espionnent' les interactions de leurs rivaux pour évaluer leur compétitivité relative, ce qui est sans doute moins coûteux qu'une confrontation directe avec chacun, et 2) dosent leur investissement vocal en fonction du nombre de rivaux actuellement en compétition et de leur motivation de façon concomitante. Ces résultats montrent que les interactions entre frères et soeurs au nid reposent sur des mécanismes similaires à ceux observés, mais encore de façon anecdotique, chez les adultes non apparentés qui se disputent les territoires et partenaires sexuels. Cette thèse souligne donc combien il est crucial de considérer dorénavant la famille comme un réseau de communication à part entière pour mieux comprendre comment les jeunes résolvent les conflits autour du partage des ressources parentales. Plus généralement, elle révèle l'importance de la dynamique temporelle des vocalisations dans les conflits et la communication des animaux. A la lumière de nos résultats, la chouette effraie apparaît comme un modèle clé pour de futures recherches sur la résolution des conflits et la communication acoustique. - In species with parental care, offspring contest priority access to food by begging through conspicuous postures and vocalisations and by physically jockeying. Siblings differ in their competitiveness, especially in the case of age and size hierarchies, and their hunger level fluctuates in time. As in competition in general, each individual should adjust its investment to opponents that is to say to its siblings' needs and behaviours. In the particular context of family, according to kin selection theory, siblings derive extra fitness benefits from their mutual survival and hence the spreading of the genes they share. The "sibling negotiation" predicts that, under certain conditions, young would negotiate among them priority access to food, which reduces competition costs and enables promoting the most hungry siblings. To date, the literature focuses on signals of need between parents and offspring and competitive interactions (in particular among siblings) are mostly studied within pairwise interactions, yet they commonly involve more numerous rivals. This PhD aims at better understanding how and the extent to which several young siblings compete through signalling. This is important since this influences how food is allocated among them, thus the outcome of sibling rivalry and ultimately their fitness. I use the barn owl (Tyto alba) as a model, in which the one to nine nestlings emit a simple noisy call thousands of times per night. Thereby, they would negotiate among them priority access to the indivisible food next delivered prior to parents' feeding visits. A hungry nestling emits more calls than a less hungry sibling, which deters it to call in return and ultimately beg food at parents. The optimal investment thus corresponds to constantly deterring the rival to compete, given that parents' arrival is unpredictable, but at the lowest costs. In the first axis of my thesis, we explored within dyads the acoustic mechanisms by which owlets dose vocal effort when competing during the hours they are left alone. We found that owlets avoid overlapping each other's calls. This would enhance the discrimination of both call number and duration, which honestly reflect individuals' hunger level and hence motivation to compete. Such antiphony seems best adapted to the fact that siblings actually use subtle temporal variations in the rhythm and duration of their calls to take or give their turn. Owlets alternate monologs, in which lengthening calls efficiently deters the rival to respond while reducing call number. Such rules depend neither on seniority, hunger level nor kinship since nestlings responded similarly to a live sibling and an unrelated playback individual. Taken together, these findings provide the first experimental proof that dependent young honestly communicate about their need, actively adjust the timing of their calls and use multicomponent signals in a way that reduces vocal costs. Moreover, this is the first demonstration of conversational rules underlying animal long-lasting vocal exchanges comparable to the basic turn-taking signals observed in humans. In the second axis, we focused on the behavioural strategies owlets adopt to compete with more than one sibling, using playback experiments. We found that singleton bystanders memorised competitive asymmetries between two playback individuals dialoguing and responded more aggressively to the submissive one once they later faced each of both alone. Moreover, when hearing a varying number of nestlings calling at varying rates, owlets vocally invested the most towards fewer and less motivated rivals. In line with predictions from models on conflict settlement, barn owls thus escalate contests in which their chance of winning best counterbalances the energy spent. These results reveal that young socially eavesdrop on their siblings' interactions to assess their relative competitiveness at likely lower costs than direct confrontation, and dose vocal effort relative to both their number and motivation. This shows that young siblings' interactions imply mechanisms similar to those observed, yet still anecdotally, in unrelated adults that contest mates and territories. This PhD therefore highlights how crucial it is to further consider family as a communication network to better understand how siblings resolve conflicts over the share of parental resources. More generally, it provides important insights into the role of the temporal dynamics of signalling during animal contests and communication. In the light of our findings, the barn owl emerges as a key model for future research on conflict resolution and acoustic communication in animals.

Vuorottelujäsennys ryhmäterapiassa

Summary: The organisation of turn-taking in group therapy

Histoire formelle du jeu d’aventure sur ordinateur (le cas de l’Amérique du Nord de 1976-1999)

Cette étude s’intéresse à l’évolution formelle du jeu d’aventure de 1976 à 1999. Elle se propose de mieux comprendre les facteurs historiques contribuant à l’apparition du genre, son institution et ses transformations. La recherche est fondée sur l’analyse du discours de la presse spécialisée en jeux d’ordinateur et d’un corpus étendu d’œuvres. L’une des thèses proposées est que l’identité générique du jeu d’aventure est fondée sur une expérience vidéoludique demeurant relativement constante malgré des variations importantes de formes. Cette expérience est assurée par la reproduction des principaux éléments d’une architecture générale de design de jeu inaugurée par Adventure en 1977. Les variations formelles ponctuelles résultent d’une négociation entre la volonté de s’adapter aux changements de contexte de l’écologie du jeu d’ordinateur et la résistance d’une architecture ludique établie. La pertinence d’une histoire d’un genre vidéoludique est justifiée au premier chapitre en fonction de l’état actuel des connaissances sur l’histoire du jeu vidéo et du jeu d’aventure. On y précise également le cadre théorique, la méthodologie et les sources étudiées. Le deuxième chapitre s’intéresse à la genèse d’Adventure de Crowther et Woods (1976; 1977) en fonction des diverses pratiques culturelles dans lesquelles l’œuvre s’inscrit. Cette analyse permet d’en dégager l’architecture ludique. Le troisième chapitre porte sur le « tournant narratif » du jeu d’aventure ayant lieu au début des années 1980. On y décrit différents facteurs historiques poussant le genre vers l’enchâssement d’histoires pré-écrites afin d’en faire un véhicule narratif. Le quatrième chapitre décrit le contexte du « tournant graphique », passage du jeu d’aventure d’une représentation textuelle à un régime visuel, ainsi que ses conséquences expérientielles. Le « tournant ergonomique » décrit au cinquième chapitre traite de l’apparition du modèle « pointer et cliquer » en fonction des avancées des connaissances concernant les interactions humain-machine ainsi que de la maturation du design de jeu comme pratique autonome. Le dernier chapitre relate l’apogée du jeu d’aventure au début de la révolution multimédia sous ses formes de film interactif et « Myst-like » puis du ralentissement – voire de l’arrêt – de son évolution formelle.

Social interaction deficits and conversational inadequacy in Williams syndrome

Research on social communication skills in individuals with Williams syndrome has been inconclusive, with some arguing that these skills are a relative strength and others that they are a weakness. The aim of the present study was to investigate social interaction abilities in a group of children with WS, and to compare them to a group of children with specific language impairment and a group of typically developing children. Semi-structured conversations were conducted and 100-150 utterances were selected for analysis in terms of exchange structure, turn taking, information transfer and conversational inadequacy. The statistical analyses showed that the children with WS had difficulties with exchange structure and responding appropriately to the interlocutor's requests for information and clarification. They also had significant difficulties with interpreting meaning and providing enough information for the conversational partner. Despite similar language abilities with a group of children with specific language impairment, the children with WS had different social interaction skills, which suggests that they follow an atypical trajectory of development and their neurolinguistic profile does not directly support innate modularity. (c) 2005 Elsevier Ltd. All rights reserved.

Interpretazione per i media: il caso particolare delle interviste sul podio della Formula 1

This dissertation analyses the live simultaneous interpretation from English into Italian of six 2013 Formula 1 World Championship podium interviews and focuses on four main aspects: how the interpreter handled the décalage at the end of the interview and during the turn-taking; if he used any marker to indicate that he was starting to translate a new turn of the source text; what he did when overlapped speech in the source texts occurred; what happened when the Italian commentators talked during the interpreter’s translation. In the first chapter a description mainly of what a Formula 1 podium interview is and what an interpreter translates during the Formula 1 weekends is present. In the second chapter a literature review on media interpreting, with particular attention put on Straniero Sergio’s paper on translating Formula 1 press-conferences (2003), and turn-taking is provided. In the third chapter the methodology used to obtain and process the video and audio files of source and target texts and to transcribe them is described. We concentrated primarily on Thibault’s multimodal text transcription techniques (2000) and on how they were used and adapted to fit the purposes of this dissertation. In the fourth chapter the results obtained through the analysis of the source and target texts are shown and described, focusing only on the objectives of the dissertation, without aiming to provide a qualitative evaluation of the interpretations. In the fifth and last chapter the conclusions and some final remarks are made, based on the results obtained during the analysis and the hope for a more in depth knowledge of Italian Formula 1 interpreter’s working conditions.

Evaluation of Binocular Eye Trackers and Algorithms for 3D Gaze Interaction in Virtual Reality Environments

Tracking user’s visual attention is a fundamental aspect in novel human-computer interaction paradigms found in Virtual Reality. For example, multimodal interfaces or dialogue-based communications with virtual and real agents greatly benefit from the analysis of the user’s visual attention as a vital source for deictic references or turn-taking signals. Current approaches to determine visual attention rely primarily on monocular eye trackers. Hence they are restricted to the interpretation of two-dimensional fixations relative to a defined area of projection. The study presented in this article compares precision, accuracy and application performance of two binocular eye tracking devices. Two algorithms are compared which derive depth information as required for visual attention-based 3D interfaces. This information is further applied to an improved VR selection task in which a binocular eye tracker and an adaptive neural network algorithm is used during the disambiguation of partly occluded objects.