An fMRI study of Joint Attention Experience

Although much is now known about eye movement detection, little is known about the higher cognitive processes involved in joint attention. We developed video stimuli which when watched, engender an experience of joint attention in the observer. This allowed us to compare an experience of joint attention to nonjoint attention within an fMRI scanning environment. Joint attention was associated with activity in the ventromedial frontal cortex, the left superior frontal gyrus (BA10), cingulate cortex, and caudate nuclei. The ventromedial frontal cortex has been consistently shown to be activated during mental state attribution tasks. BA10 may serve a cognitive integration function, which in this case seems to utilize a perception–action matching process. The activation we identified in BA10 overlaps with a location of increased grey matter density that we recently found to be associated with autistic spectrum disorder. This study therefore constitutes evidence that the neural substrate of joint attention also serves a mentalizing function. The developmental failure of this substrate in the left anterior frontal lobe may be important in the etiology of autistic spectrum disorder.

Early social experience and individual differences in infants' joint attention

Fifty-nine healthy infants were filmed with their mothers and with a researcher at two, four, six and nine months in face-to-face play, and in toy-play at six and nine months. During toy-play at both ages, two indices of joint attention (JA)—infant bids for attention, and percent of time in shared attention—were assessed, along with other behavioural measures. Global ratings were made at all four ages of infants’ and mothers’ interactive style. The mothers varied in psychiatric history (e.g., half had experienced postpartum depression) and socioeconomic status, so their interactive styles were diverse. Variation in nine-month infant JA — with mother and with researcher — was predicted by variation in maternal behaviour and global ratings at six months, but not at two or four months. Concurrent adult behaviour also influenced nine-month JA, independent of infant ratings. Six-month maternal behaviours that positively predicted later JA (some of which remained important at nine months) included teaching, conjoint action on a toy, and global sensitivity. Other behaviours (e.g., entertaining) negatively predicted later JA. Findings are discussed in terms of social-learning and neurobiological accounts of JA emergence.

Spontaneous facial mimicry is modulated by joint attention and autistic traits

Joint attention (JA) and spontaneous facial mimicry (SFM) are fundamental processes in social interactions, and they are closely related to empathic abilities. When tested independently, both of these processes have been usually observed to be atypical in individuals with autism spectrum conditions (ASC). However, it is not known how these processes interact with each other in relation to autistic traits. This study addresses this question by testing the impact of JA on SFM of happy faces using a truly interactive paradigm. Sixty-two neurotypical participants engaged in gaze-based social interaction with an anthropomorphic, gaze-contingent virtual agent. The agent either established JA by initiating eye contact or looked away, before looking at an object and expressing happiness or disgust. Eye tracking was used to make the agent's gaze behavior and facial actions contingent to the participants' gaze. SFM of happy expressions was measured by Electromyography (EMG) recording over the Zygomaticus Major muscle. Results showed that JA augments SFM in individuals with low compared with high autistic traits. These findings are in line with reports of reduced impact of JA on action imitation in individuals with ASC. Moreover, they suggest that investigating atypical interactions between empathic processes, instead of testing these processes individually, might be crucial to understanding the nature of social deficits in autism

Joint Attention in Young Children with Autism

Autism spectrum disorders (ASDs) are classified as pervasive developmental disorders characterized by social, communicative, and behavioral impairments. According to formal and informal reports, children with ASD present with receptive and expressive language delay. Joint attention (JA: the behavior that occurs when two individuals focus on the same object or event) has been identified as a possible marker of delayed language development in children with ASD. In this study, the JA behaviors in children with ASD were contrasted with initially language-matched typically developing (TYP) children across three visits. Measures of language, the frequency, duration, and source of initiation of JA episodes, and the choice of toy during those episodes, were coded. Across visits and groups, mothers initiated more JA episodes than children; however, typical children also initiated more JA episodes than ASD children at visits 1 and 2. Also, the total duration of typically developing children’s JA episodes was generally longer than that of the ASD children’s, significantly so at Visit 2. Significant associations emerged between children’s vocabulary and two measures of JA: frequency and number of maternal initiations. Teaching parents to incorporate JA training in their interactions with their children may likely help children with ASD acquire language.

Functional near infrared spectroscopy study of language, joint attention and motor skills

Near infrared spectroscopy (NIRS) is an emerging non-invasive optical neuro imaging technique that monitors the hemodynamic response to brain activation with ms-scale temporal resolution and sub-cm spatial resolution. The overall goal of my dissertation was to develop and apply NIRS towards investigation of neurological response to language, joint attention and planning and execution of motor skills in healthy adults. Language studies were performed to investigate the hemodynamic response, synchrony and dominance feature of the frontal and fronto-temporal cortex of healthy adults in response to language reception and expression. The mathematical model developed based on granger causality explicated the directional flow of information during the processing of language stimuli by the fronto-temporal cortex. Joint attention and planning/ execution of motor skill studies were performed to investigate the hemodynamic response, synchrony and dominance feature of the frontal cortex of healthy adults and in children (5-8 years old) with autism (for joint attention studies) and individuals with cerebral palsy (for planning/execution of motor skills studies). The joint attention studies on healthy adults showed differences in activation as well as intensity and phase dependent connectivity in the frontal cortex during joint attention in comparison to rest. The joint attention studies on typically developing children showed differences in frontal cortical activation in comparison to that in children with autism. The planning and execution of motor skills studies on healthy adults and individuals with cerebral palsy (CP) showed difference in the frontal cortical dominance, that is, bilateral and ipsilateral dominance, respectively. The planning and execution of motor skills studies also demonstrated the plastic and learning behavior of brain wherein correlation was found between the relative change in total hemoglobin in the frontal cortex and the kinematics of the activity performed by the participants. Thus, during my dissertation the NIRS neuroimaging technique was successfully implemented to investigate the neurological response of language, joint attention and planning and execution of motor skills in healthy adults as well as preliminarily on children with autism and individuals with cerebral palsy. These NIRS studies have long-term potential for the design of early stage interventions in children with autism and customized rehabilitation in individuals with cerebral palsy.

Mother-Infant Reciprocity and the Development of Joint Attention in 12 Month Old Infants

Social contingency is the ability to connect social stimuli, such as those behaviors performed by oneself and those performed by others. Detecting social contingencies occurs by means of reciprocity through shared experiences with others. Reciprocity denotes a circumstance in which two individuals participate in a collaborative exchange, and is distinguished from an event in which two individuals engage in separate, unrelated activities. Specifically, reciprocity incorporates joint attention (JA), which occurs when two individuals simultaneously and visually attend to the same item. JA is facilitated by gazing and pointing, whereby one individual initiates the action and the second individual follows suit by, for example, gaze-following. However, little is known about the role the mother may play in the development of JA. The purpose of our study was to investigate social contingency between mothers and infants engaging in dyadic interactions. Thirty-three 12-month-old typically developing infants (M = 12.2, SD = .19; N = 19 males) were filmed for 10 minutes during free play with their mothers and toys provided by an experimenter. Reciprocity was measured by coding mother-infant interactions when a precise chain of events occurred: (1) mother initiated a bid by introducing a toy/activity or request to the infant, (2) infant accepted the bid/request by engaging in play with the given toy/activity, and (3) mother persisted by continuing to engage in play with said toy/activity. We computed a Pearson Correlation to assess the relation between the mothers’ initiations of JA and their infants’ responses to JA. We found a moderately positive correlation between the two variables (r= 0.37, p<.05). Our findings suggest that reciprocity, an important component of social relationships, during parent-infant dyads may serve as a scaffold for joint attention abilities, which have been linked to social and language development.

Joint attention enhances visual working memory

Peer reviewed

Funtional Near Infrared Spectroscopy Study of Language, Joint Attention and Motor Skills

Near infrared spectroscopy (NIRS) is an emerging non-invasive optical neuro imaging technique that monitors the hemodynamic response to brain activation with ms-scale temporal resolution and sub-cm spatial resolution. The overall goal of my dissertation was to develop and apply NIRS towards investigation of neurological response to language, joint attention and planning and execution of motor skills in healthy adults. Language studies were performed to investigate the hemodynamic response, synchrony and dominance feature of the frontal and fronto-temporal cortex of healthy adults in response to language reception and expression. The mathematical model developed based on granger causality explicated the directional flow of information during the processing of language stimuli by the fronto-temporal cortex. Joint attention and planning/ execution of motor skill studies were performed to investigate the hemodynamic response, synchrony and dominance feature of the frontal cortex of healthy adults and in children (5-8 years old) with autism (for joint attention studies) and individuals with cerebral palsy (for planning/execution of motor skills studies). The joint attention studies on healthy adults showed differences in activation as well as intensity and phase dependent connectivity in the frontal cortex during joint attention in comparison to rest. The joint attention studies on typically developing children showed differences in frontal cortical activation in comparison to that in children with autism. The planning and execution of motor skills studies on healthy adults and individuals with cerebral palsy (CP) showed difference in the frontal cortical dominance, that is, bilateral and ipsilateral dominance, respectively. The planning and execution of motor skills studies also demonstrated the plastic and learning behavior of brain wherein correlation was found between the relative change in total hemoglobin in the frontal cortex and the kinematics of the activity performed by the participants. Thus, during my dissertation the NIRS neuroimaging technique was successfully implemented to investigate the neurological response of language, joint attention and planning and execution of motor skills in healthy adults as well as preliminarily on children with autism and individuals with cerebral palsy. These NIRS studies have long-term potential for the design of early stage interventions in children with autism and customized rehabilitation in individuals with cerebral palsy.

Learning of shared attention in sociable robotics

Sociable robots are embodied agents that are part of a heterogeneous society of robots and humans. They Should be able to recognize human beings and each other, and to engage in social, interactions. The use of a robotic architecture may strongly reduce the time and effort required to construct a sociable robot. Such architecture must have structures and mechanisms to allow social interaction. behavior control and learning from environment. Learning processes described oil Science of Behavior Analysis may lead to the development of promising methods and Structures for constructing robots able to behave socially and learn through interactions from the environment by a process of contingency learning. In this paper, we present a robotic architecture inspired from Behavior Analysis. Methods and structures of the proposed architecture, including a hybrid knowledge representation. are presented and discussed. The architecture has been evaluated in the context of a nontrivial real problem: the learning of the shared attention, employing an interactive robotic head. The learning capabilities of this architecture have been analyzed by observing the robot interacting with the human and the environment. The obtained results show that the robotic architecture is able to produce appropriate behavior and to learn from social interaction. (C) 2009 Elsevier Inc. All rights reserved.

Modelling shared attention through relational reinforcement learning

Shared attention is a type of communication very important among human beings. It is sometimes reserved for the more complex form of communication being constituted by a sequence of four steps: mutual gaze, gaze following, imperative pointing and declarative pointing. Some approaches have been proposed in Human-Robot Interaction area to solve part of shared attention process, that is, the most of works proposed try to solve the first two steps. Models based on temporal difference, neural networks, probabilistic and reinforcement learning are methods used in several works. In this article, we are presenting a robotic architecture that provides a robot or agent, the capacity of learning mutual gaze, gaze following and declarative pointing using a robotic head interacting with a caregiver. Three learning methods have been incorporated to this architecture and a comparison of their performance has been done to find the most adequate to be used in real experiment. The learning capabilities of this architecture have been analyzed by observing the robot interacting with the human in a controlled environment. The experimental results show that the robotic head is able to produce appropriate behavior and to learn from sociable interaction.

A gênese da comunicação gestual e o desenvolvimento sociocognitivo: um estudo longitudinal

Mesmo antes das crianças começarem a falar, elas utilizam gestos, como dar, mostrar e apontar. O início da comunicação gestual pode ser percebido muito cedo na infância humana, mas ainda não está claro como ocorre a progressão deste desenvolvimento. O presente estudo investiga o papel e as características do desenvolvimento gestual no primeiro ano de vida. Um bebê de sexo masculino e sua mãe foram observados longitudinalmente, a cada semana, do nascimento aos 12 meses de idade. A díade foi filmada em casa enquanto realizava atividades de rotina. Nas idades de 9 a 12 meses, uma vez ao mês a mãe foi solicitada a brincar com seu bebê em situação estruturada. Os vídeos foram analisados qualitativa e quantitativamente em termos da percentagem de ocorrência de categorias de gestos comunicativos de ambos os parceiros e de seus comportamentos. Cenários comunicativos foram identificados. O aparecimento de diferentes comportamentos e suas trajetórias de desenvolvimento foram registrados. As possíveis relações com o surgimento posterior de gestos foram discutidas, analisando comportamentos que se tornaram ou não precursores e o modo como eles tenderam a apresentar mudanças com o tempo. Alguns resultados interessantes foram observados: pré-apontar foi identificado desde os primeiros meses e apresentou declínio de ocorrência. Pré-alcançar foi identificado aos 5 meses de idade e declinou no mesmo período em que foi observado o aparecimento do gesto de alcançar, o qual tendeu a aumentar com o tempo. Virar a cabeça enquanto rejeição foi observado aos 4 meses. Conforme o bebê foi se tornando mais velho, ele passou mais tempo engajado com sua mãe e com objetos de forma coordenada. Desde o início do primeiro ano, a mãe exibiu gestos de mostrar objetos e apontar proximal declarativo. Comportamentos de atenção conjunta foram observados e tenderam a aumentar no período de 9 a 12 meses de idade. Gestos proximais e declarativos realizados pelo bebê ocorreram mais precocemente se comparados a gestos imperativos e distais. As transições observadas a partir dos cenários comunicativos não compartilhados rumo aos de natureza simbólica foram identificadas. Percentagens de tempo de cenários comunicativos não-compartilhados e atencionais primários diminuíram enquanto as de cenários atencionais secundários aumentaram, tornando-se predominantes no final do primeiro ano. Neste período, cenários convencionais e simbólicos surgiram, apresentando breve duração. Embora estes resultados não sejam conclusivos, podem contribuir para a compreensão das primeiras modalidades de comunicação mãe-bebê, ajudando a fornecer suportes para a discussão sobre a existência de precursores gestuais precoces.