Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations

Background: Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. Methods: Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. Results: Both aphasic patients and healthy controls mainly fixated the speaker’s face. We found a significant co-speech gesture x ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction x ROI x group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker’s face compared to healthy controls. Conclusion: Co-speech gestures guide the observer’s attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker’s face. Keywords: Gestures, visual exploration, dialogue, aphasia, apraxia, eye movements

Can medial temporal lobe regions distinguish true from false? An event-related functional MRI study of veridical and illusory recognition memory

To investigate the types of memory traces recovered by the medial temporal lobe (MTL), neural activity during veridical and illusory recognition was measured with the use of functional MRI (fMRI). Twelve healthy young adults watched a videotape segment in which two speakers alternatively presented lists of associated words, and then the subjects performed a recognition test including words presented in the study lists (True items), new words closely related to studied words (False items), and new unrelated words (New items). The main finding was a dissociation between two MTL regions: whereas the hippocampus was similarly activated for True and False items, suggesting the recovery of semantic information, the parahippocampal gyrus was more activated for True than for False items, suggesting the recovery of perceptual information. The study also yielded a dissociation between two prefrontal cortex (PFC) regions: whereas bilateral dorsolateral PFC was more activated for True and False items than for New items, possibly reflecting monitoring of retrieved information, left ventrolateral PFC was more activated for New than for True and False items, possibly reflecting semantic processing. Precuneus and lateral parietal regions were more activated for True and False than for New items. Orbitofrontal cortex and cerebellar regions were more activated for False than for True items. In conclusion, the results suggest that activity in anterior MTL regions does not distinguish True from False, whereas activity in posterior MTL regions does.

Avaliação de linguagem por ressonância magnética funcional em pacientes com epilepsia associada à esclerose mesial temporal unilateral: correlação com avaliação clínica de linguagem

Introdução: A esclerose mesial temporal (EMT) é a principal causa de epilepsia resistente ao tratamento medicamentoso. Pacientes com EMT apresentam dificuldades no processamento semântico e fonológico de linguagem e maior incidência de reorganização cerebral da linguagem (bilateral ou à direita) em relação à população geral. A ressonância magnética funcional (RMf) permite avaliar a reorganização cerebral das redes de linguagem, comparando padrões de ativação cerebral entre diversas regiões cerebrais. Objetivo: Investigar o desempenho linguístico de pacientes com EMT unilateral esquerda e direita e a ocorrência de reorganização das redes de linguagem com RMf para avaliar se a reorganização foi benéfica para a linguagem nestes pacientes. Métodos: Utilizamos provas clínicas de linguagem e paradigmas de nomeação visual e responsiva para RMf, desenvolvidos para este estudo. Foram avaliados 24 pacientes com EMTe, 22 pacientes com EMTd e 24 controles saudáveis, submetidos a provas de linguagem (fluência semântica e fonológica, nomeação de objetos, verbos, nomes próprios e responsiva, e compreensão de palavras) e a três paradigmas de linguagem por RMf [nomeação por confrontação visual (NCV), nomeação responsiva à leitura (NRL) e geração de palavras (GP)]. Seis regiões cerebrais de interesse (ROI) foram selecionadas (giro frontal inferior, giro frontal médio, giro frontal superior, giro temporal inferior, giro temporal médio e giro temporal superior). Índices de Lateralidade (ILs) foram calculados com dois métodos: bootstrap, do programa LI-Toolbox, independe de limiar, e PSC, que indica a intensidade da ativação cerebral de cada voxel. Cada grupo de pacientes (EMTe e EMTd) foi dividido em dois subgrupos, de acordo com o desempenho em relação aos controles na avaliação clinica de linguagem. O <= -1,5 foi utilizado como nota de corte para dividir os grupos em pacientes com bom e com mau desempenho de linguagem. Em seguida, comparou-se o desempenho linguístico dos subgrupos ao índices IL-boot. Resultados: Pacientes com EMT esquerda e direita mostraram pior desempenho que controles nas provas clínicas de nomeação de verbos, nomeação de nomes próprios, nomeação responsiva e fluência verbal. Os mapas de ativação cerebral por RMf mostraram efeito BOLD em regiões frontais e temporoparietais de linguagem. Os mapas de comparação de ativação cerebral entre os grupos revelaram que pacientes com EMT esquerda e direita apresentam maior ativação em regiões homólogas do hemisfério direito em relação aos controles. Os ILs corroboraram estes resultados, mostrando valores médios menores para os pacientes em relação aos controles e, portanto, maior simetria na representação da linguagem. A comparação entre o IL-boot e o desempenho nas provas clínicas de linguagem indicou que, no paradigma de nomeação responsiva à leitura, a reorganização funcional no giro temporal médio, e possivelmente, nos giros temporal inferior e superior associou-se a desempenho preservado em provas de nomeação. Conclusão: Pacientes com EMT direita e esquerda apresentam comprometimento de nomeação e fluência verbal e reorganização da rede cerebral de linguagem. A reorganização funcional de linguagem em regiões temporais, especialmente o giro temporal médio associou-se a desempenho preservado em provas de nomeação em pacientes com EMT esquerda no paradigma de RMf de nomeação responsiva à leitura

Araknion: inducción de modelos lingüísticos a partir de corpora

El proyecto Araknion tiene como objetivo general dotar al español y al catalán de una infraestructura básica de recursos lingüísticos para el procesamiento semántico de corpus en el marco de la Web 2.0 sean de origen oral o escrito.

Top-down influences on lexical selection during spoken word production: A 4T fMRI investigation of refractory effects in picture naming

Spoken word production is assumed to involve stages of processing in which activation spreads through layers of units comprising lexical-conceptual knowledge and their corresponding phonological word forms. Using high-field (4T) functional magnetic resonance imagine (fMRI), we assessed whether the relationship between these stages is strictly serial or involves cascaded-interactive processing, and whether central (decision/control) processing mechanisms are involved in lexical selection. Participants performed the competitor priming paradigm in which distractor words, named from a definition and semantically related to a subsequently presented target picture, slow picture-naming latency compared to that with unrelated words. The paradigm intersperses two trials between the definition and the picture to be named, temporally separating activation in the word perception and production networks. Priming semantic competitors of target picture names significantly increased activation in the left posterior temporal cortex, and to a lesser extent the left middle temporal cortex, consistent with the predictions of cascaded-interactive models of lexical access. In addition, extensive activation was detected in the anterior cingulate and pars orbitalis of the inferior frontal gyrus. The findings indicate that lexical selection during competitor priming is biased by top-down mechanisms to reverse associations between primed distractor words and target pictures to select words that meet the current goal of speech.

Investigation of the neural correlates of recognition memory using magnetoencephalography

Neuroimaging literature has identified several regions involved in encoding and recognition processes. A review of the literature illustrated considerable variations in the precise location and mechanisms of these processes, and it was these variations that were investigated in the studies in this thesis. Magnetoencephalography (MEG) was used as the neuroimaging tool and a preliminary study identified Synthetic Aperture Magnetometry (SAM) and not a traditional dipole fitting technique, as an appropriate tool for identifying the multiple cortical regions involved in recognition memory. It has been suggested that there is hemispheric asymmetry in encoding and recognition processes. There are two main hypotheses: the first suggesting that there is task-specificity, the second that this specificity is determined by stimulus modality. A series of experiments was completed with two main aims: first to produce consistent and complementary recognition memory data with MEG, and second to determine whether there exists any hemispheric asymmetry in recognition memory. The results obtained from five experiments demonstrated activation of prefrontal and middle temporal structures, which were consistent with those reported in previous neuroimaging studies. It was suggested that this diverse activation may be explained by the involvement of a semantic network during recognition memory processes. In support of this, a subsequent study involving a semantic encoding task demonstrated that category-specific differences in cortical activation also existed in the recognition memory phase. Controlling for the involvement of such semantic processes produced predominantly bilateral activation. It was suggested that the apparent hemispheric asymmetry findings reported in the literature may be due to the 'coarse' temporal analysis available with earlier imaging techniques, which over-simplified the networks reported by being unable to recognise the early complex processes associated with semantic processing which these MEG studies were able to identify. The importance of frequency-specific activations, specifically theta synchronisation and alpha desynchronisation, in memory processes was also investigated.

Pediatric CNS pathophysiology

Research in pediatric central nervous system pathophysiology is focused around three primary goals: identification of neurodevelopmental disorders, understanding the differences in brain development which underlie these disorders, and improving treatment for these young children. Autism spectrum disorders (ASDs) are a complex set of disorders which are characterized by difficulties in language and social interactions. These behavioral measures are highly variable and a number of underlying causes can generate similar behavioral effects. Therefore, it is important to identify neurophysiological markers to better identify and characterize these disorders. Recent ASD findings using MEG show atypical latency and amplitude responses and poor cortical connectivity in children with ASDs across the cognitive spectrum from basic auditory processing, multisensory integration, to face and semantic processing. These results further support the view that ASDs are a complex neurologically-based disorder. On the other hand, the cause of Down syndrome is well understood as originating from a partial or full replication of chromosome 21. However, the cognitive and neurological consequences of this chromosomal abnormality are not yet well understood. Using a simple observation and motor execution task, poor functional connectivity in sensory-motor areas, particularly in the gamma band range, has been identified in children with Down syndrome and is consistent with behavioral deficits in the sensory-motor realm. Additional studies are needed to better understand whether targeted identification of these abnormalities can facilitate treatment in this disorder. Finally, while epilepsy can be reliably diagnosed, seizure control is still limited in many cases where the seizure onset zone is not readily apparent. Advances in pre-surgical evaluation and intra-operative co-registration will be described. These studies describing pediatric CNS pathophysiology will be discussed. © Springer-Verlag 2010.

Journal publishing with Acrobat: the CAJUN project

The publication of material in electronic form should ideally preserve, in a unified document representation, all of the richness of the printed document while maintaining enough of its underlying structure to enable searching and other forms of semantic processing. Until recently it has been hard to find a document representation which combined these attributes and which also stood some chance of becoming a de facto multi-platform standard. This paper sets out experience gained within the Electronic Publishing Research Group at the University of Nottingham in using Adobe Acrobat software and its underlying PDF (Portable Document Format) notation. The CAJUN project1 (CD-ROM Acrobat Journals Using Networks) began in 1993 and has used Acrobat software to produce electronic versions of journal papers for network and CD-ROM dissemination. The paper describes the project's progress so far and also gives a brief assessment of PDF's suitability as a universal document interchange standard.

Altered Electrophysiology of Semantic Word Processing in Alzheimer's Disease and Semantic Dementia

With the progressing course of Alzheimer's disease (AD), deficits in declarative memory increasingly restrict the patients' daily activities. Besides the more apparent episodic (biographical) memory impairments, the semantic (factual) memory is also affected by this neurodegenerative disorder. The episodic pathology is well explored; instead the underlying neurophysiological mechanisms of the semantic deficits remain unclear. For a profound understanding of semantic memory processes in general and in AD patients, the present study compares AD patients with healthy controls and Semantic Dementia (SD) patients, a dementia subgroup that shows isolated semantic memory impairments. We investigate the semantic memory retrieval during the recording of an electroencephalogram, while subjects perform a semantic priming task. Precisely, the task demands lexical (word/nonword) decisions on sequentially presented word pairs, consisting of semantically related or unrelated prime-target combinations. Our analysis focuses on group-dependent differences in the amplitude and topography of the event related potentials (ERP) evoked by related vs. unrelated target words. AD patients are expected to differ from healthy controls in semantic retrieval functions. The semantic storage system itself, however, is thought to remain preserved in AD, while SD patients presumably suffer from the actual loss of semantic representations.

Semantic, perceptual and number space: relations between category width and spatial processing.

Coarse semantic encoding and broad categorization behavior are the hallmarks of the right cerebral hemisphere's contribution to language processing. We correlated 40 healthy subjects' breadth of categorization as assessed with Pettigrew's category width scale with lateral asymmetries in perceptual and representational space. Specifically, we hypothesized broader category width to be associated with larger leftward spatial biases. For the 20 men, but not the 20 women, this hypothesis was confirmed both in a lateralized tachistoscopic task with chimeric faces and a random digit generation task; the higher a male participant's score on category width, the more pronounced were his left-visual field bias in the judgement of chimeric faces and his small-number preference in digit generation ("small" is to the left of "large" in number space). Subjects' category width was unrelated to lateral displacements in a blindfolded tactile-motor rod centering task. These findings indicate that visual-spatial functions of the right hemisphere should not be considered independent of the same hemisphere's contribution to language. Linguistic and spatial cognition may be more tightly interwoven than is currently assumed.

Applying semantic knowledge to the automatic processing of temporal expressions and events in natural language

This paper addresses the problem of the automatic recognition and classification of temporal expressions and events in human language. Efficacy in these tasks is crucial if the broader task of temporal information processing is to be successfully performed. We analyze whether the application of semantic knowledge to these tasks improves the performance of current approaches. We therefore present and evaluate a data-driven approach as part of a system: TIPSem. Our approach uses lexical semantics and semantic roles as additional information to extend classical approaches which are principally based on morphosyntax. The results obtained for English show that semantic knowledge aids in temporal expression and event recognition, achieving an error reduction of 59% and 21%, while in classification the contribution is limited. From the analysis of the results it may be concluded that the application of semantic knowledge leads to more general models and aids in the recognition of temporal entities that are ambiguous at shallower language analysis levels. We also discovered that lexical semantics and semantic roles have complementary advantages, and that it is useful to combine them. Finally, we carried out the same analysis for Spanish. The results obtained show comparable advantages. This supports the hypothesis that applying the proposed semantic knowledge may be useful for different languages.

Semantic caching for multiresolution spatial query processing in mobile environments

Spatial data are particularly useful in mobile environments. However, due to the low bandwidth of most wireless networks, developing large spatial database applications becomes a challenging process. In this paper, we provide the first attempt to combine two important techniques, multiresolution spatial data structure and semantic caching, towards efficient spatial query processing in mobile environments. Based on the study of the characteristics of multiresolution spatial data (MSD) and multiresolution spatial query, we propose a new semantic caching model called Multiresolution Semantic Caching (MSC) for caching MSD in mobile environments. MSC enriches the traditional three-category query processing in semantic cache to five categories, thus improving the performance in three ways: 1) a reduction in the amount and complexity of the remainder queries; 2) the redundant transmission of spatial data already residing in a cache is avoided; 3) a provision for satisfactory answers before 100% query results have been transmitted to the client side. Our extensive experiments on a very large and complex real spatial database show that MSC outperforms the traditional semantic caching models significantly