fMRI delineation of working memory for emotional prosody in the brain: commonalities with the lexico-semantic emotion network

Decoding emotional prosody is crucial for successful social interactions, and continuous monitoring of emotional intent via prosody requires working memory. It has been proposed by Ross and others that emotional prosody cognitions in the right hemisphere are organized in an analogous fashion to propositional language functions in the left hemisphere. This study aimed to test the applicability of this model in the context of prefrontal cortex working memory functions. BOLD response data were therefore collected during performance of two emotional working memory tasks by participants undergoing fMRI. In the prosody task, participants identified the emotion conveyed in pre-recorded sentences, and working memory load was manipulated in the style of an N-back task. In the matched lexico-semantic task, participants identified the emotion conveyed by sentence content. Block-design neuroimaging data were analyzed parametrically with SPM5. At first, working memory for emotional prosody appeared to be right-lateralized in the PFC, however, further analyses revealed that it shared much bilateral prefrontal functional neuroanatomy with working memory for lexico-semantic emotion. Supplementary separate analyses of males and females suggested that these language functions were less bilateral in females, but their inclusion did not alter the direction of laterality. It is concluded that Ross et al.'s model is not applicable to prefrontal cortex working memory functions, that evidence that working memory cannot be subdivided in prefrontal cortex according to material type is increased, and that incidental working memory demands may explain the frontal lobe involvement in emotional prosody comprehension as revealed by neuroimaging studies. (c) 2007 Elsevier Inc. All rights reserved.

Gaps in second language sentence processing

Four groups of second language (L2) learners of English from different language backgrounds (Chinese, Japanese, German, and Greek) and a group of native speaker controls participated in an online reading time experiment with sentences involving long-distance whdependencies. Although the native speakers showed evidence of making use of intermediate syntactic gaps during processing, the L2 learners appeared to associate the fronted wh-phrase directly with its lexical subcategorizer, regardless of whether the subjacency constraint was operative in their native language. This finding is argued to support the hypothesis that nonnative comprehenders underuse syntactic information in L2 processing.

False recognition of abstract versus common objects in older and younger adults: testing the semantic categorization account

Older adults often demonstrate higher levels of false recognition than do younger adults. However, in experiments using novel shapes without preexisting semantic representations, this age-related elevation in false recognition was found to be greatly attenuated. Two experiments tested a semantic categorization account of these findings, examining whether older adults show especially heightened false recognition if the stimuli have preexisting semantic representations, such that semantic category information attenuates or truncates the encoding or retrieval of item-specific perceptual information. In Experiment 1, ambiguous shapes were presented with or without disambiguating semantic labels. Older adults showed higher false recognition when labels were present but not when labels were never presented. In Experiment 2, older adults showed higher false recognition for concrete but not abstract objects. The semantic categorization account was supported.

Effects of divided attention and speeded responding on implicit and explicit retrieval of artificial grammar knowledge

The artificial grammar (AG) learning literature (see, e.g., Mathews et al., 1989; Reber, 1967) has relied heavily on a single measure of implicitly acquired knowledge. Recent work comparing this measure (string classification) with a more indirect measure in which participants make liking ratings of novel stimuli (e.g., Manza & Bornstein, 1995; Newell & Bright, 2001) has shown that string classification (which we argue can be thought of as an explicit, rather than an implicit, measure of memory) gives rise to more explicit knowledge of the grammatical structure in learning strings and is more resilient to changes in surface features and processing between encoding and retrieval. We report data from two experiments that extend these findings. In Experiment 1, we showed that a divided attention manipulation (at retrieval) interfered with explicit retrieval of AG knowledge but did not interfere with implicit retrieval. In Experiment 2, we showed that forcing participants to respond within a very tight deadline resulted in the same asymmetric interference pattern between the tasks. In both experiments, we also showed that the type of information being retrieved influenced whether interference was observed. The results are discussed in terms of the relatively automatic nature of implicit retrieval and also with respect to the differences between analytic and nonanalytic processing (Whittlesea Price, 2001).

Temporal interval production and short-term memory

Interference with time estimation from concurrent nontemporal processing has been shown to depend on the short-term memory requirements of the concurrent task (Fortin Breton, 1995; Fortin, Rousseau, Bourque, & Kirouac, 1993). In particular, it has been claimed that active processing of information in short-term memory produces interference, whereas simply maintaining information does not. Here, four experiments are reported in which subjects were trained to produce a 2,500-msec interval and then perform concurrent memory tasks. Interference with timing was demonstrated for concurrent memory tasks involving only maintenance. In one experiment, increasing set size in a pitch memory task systematically lengthened temporal production. Two further experiments suggested that this was due to a specific interaction between the short-term memory requirements of the pitch task and those of temporal production. In the final experiment, subjects performed temporal production while concurrently remembering the durations of a set of tones. Interference with interval production was comparable to that produced by the pitch memory task. Results are discussed in terms of a pacemaker-counter model of temporal processing, in which the counter component is supported by short-term memory.

The DREAM Framework: using a network of scalable ontologies for intelligent indexing and retrieval of visual content

There are still major challenges in the area of automatic indexing and retrieval of digital data. The main problem arises from the ever increasing mass of digital media and the lack of efficient methods for indexing and retrieval of such data based on the semantic content rather than keywords. To enable intelligent web interactions or even web filtering, we need to be capable of interpreting the information base in an intelligent manner. Research has been ongoing for a few years in the field of ontological engineering with the aim of using ontologies to add knowledge to information. In this paper we describe the architecture of a system designed to automatically and intelligently index huge repositories of special effects video clips, based on their semantic content, using a network of scalable ontologies to enable intelligent retrieval.

Workflow data exchange semantics, object discovery & integration architecture for cross media production & distribution

There has been a clear lack of common data exchange semantics for inter-organisational workflow management systems where the research has mainly focused on technical issues rather than language constructs. This paper presents the neutral data exchanges semantics required for the workflow integration within the AXAEDIS framework and presents the mechanism for object discovery from the object repository where little or no knowledge about the object is available. The paper also presents workflow independent integration architecture with the AXAEDIS Framework.

Multimodal semantic-associative collateral labelling and indexing of still images

A novel framework for multimodal semantic-associative collateral image labelling, aiming at associating image regions with textual keywords, is described. Both the primary image and collateral textual modalities are exploited in a cooperative and complementary fashion. The collateral content and context based knowledge is used to bias the mapping from the low-level region-based visual primitives to the high-level visual concepts defined in a visual vocabulary. We introduce the notion of collateral context, which is represented as a co-occurrence matrix, of the visual keywords, A collaborative mapping scheme is devised using statistical methods like Gaussian distribution or Euclidean distance together with collateral content and context-driven inference mechanism. Finally, we use Self Organising Maps to examine the classification and retrieval effectiveness of the proposed high-level image feature vector model which is constructed based on the image labelling results.

Parallel Monte Carlo algorithms for information retrieval

In any data mining applications, automated text and text and image retrieval of information is needed. This becomes essential with the growth of the Internet and digital libraries. Our approach is based on the latent semantic indexing (LSI) and the corresponding term-by-document matrix suggested by Berry and his co-authors. Instead of using deterministic methods to find the required number of first "k" singular triplets, we propose a stochastic approach. First, we use Monte Carlo method to sample and to build much smaller size term-by-document matrix (e.g. we build k x k matrix) from where we then find the first "k" triplets using standard deterministic methods. Second, we investigate how we can reduce the problem to finding the "k"-largest eigenvalues using parallel Monte Carlo methods. We apply these methods to the initial matrix and also to the reduced one. The algorithms are running on a cluster of workstations under MPI and results of the experiments arising in textual retrieval of Web documents as well as comparison of the stochastic methods proposed are presented. (C) 2003 IMACS. Published by Elsevier Science B.V. All rights reserved.

Collaterally cued labelling framework underpinning semantic-level visual content descriptor

In this paper, we introduce a novel high-level visual content descriptor devised for performing semantic-based image classification and retrieval. The work can be treated as an attempt for bridging the so called "semantic gap". The proposed image feature vector model is fundamentally underpinned by an automatic image labelling framework, called Collaterally Cued Labelling (CCL), which incorporates the collateral knowledge extracted from the collateral texts accompanying the images with the state-of-the-art low-level visual feature extraction techniques for automatically assigning textual keywords to image regions. A subset of the Corel image collection was used for evaluating the proposed method. The experimental results indicate that our semantic-level visual content descriptors outperform both conventional visual and textual image feature models.

Motion detection and motion verbs: language affects low-level visual perception

Recent theories propose that semantic representation and sensorimotor processing have a common substrate via simulation. We tested the prediction that comprehension interacts with perception, using a standard psychophysics methodology.While passively listening to verbs that referred to upward or downward motion, and to control verbs that did not refer to motion, 20 subjects performed a motion-detection task, indicating whether or not they saw motion in visual stimuli containing threshold levels of coherent vertical motion. A signal detection analysis revealed that when verbs were directionally incongruent with the motion signal, perceptual sensitivity was impaired. Word comprehension also affected decision criteria and reaction times, but in different ways. The results are discussed with reference to existing explanations of embodied processing and the potential of psychophysical methods for assessing interactions between language and perception.

On the nature and cause of Specific Language Impairment: a view from sentence processing and infant research

This paper addresses the nature and cause of Specific Language Impairment (SLI) by reviewing recent research in sentence processing of children with SLI compared to typically developing (TD) children and research in infant speech perception. These studies have revealed that children with SLI are sensitive to syntactic, semantic, and real-world information, but do not show sensitivity to grammatical morphemes with low phonetic saliency, and they show longer reaction times than age-matched controls. TD children from the age of 4 show trace reactivation, but some children with SLI fail to show this effect, which resembles the pattern of adults and TD children with low working memory. Finally, findings from the German Language Development (GLAD) Project have revealed that a group of children at risk for SLI had a history of an auditory delay and impaired processing of prosodic information in the first months of their life, which is not detectable later in life. Although this is a single project that needs to be replicated with a larger group of children, it provides preliminary support for accounts of SLI which make an explicit link between an early deficit in the processing of phonology and later language deficits, and the Computational Complexity Hypothesis that argues that the language deficit in children with SLI lies in difficulties integrating different types of information at the interfaces.

Production of relative clauses in monolingual Turkish children

Research on the production of relative clauses (RCs) has shown that in English, although children start using intransitive RCs at an earlier age, more complex, bi-propositional object RCs appear later (Hamburger & Crain, 1982; Diessel and Tomasello, 2005), and children use resumptive pronouns both in acceptable and unacceptable ways (McKee, McDaniel, & Snedeker, 1998; McKee & McDaniel, 2001). To date, it is unclear whether or not the same picture emerges in Turkish, a language with an SOV word-order and overt case marking. Some studies suggested that subject RCs are more frequent in adults and children (Slobin, 1986) and yield a better performance than object RCs (Özcan, 1996), but others reported the opposite pattern (Ekmekçi, 1990). Our study addresses this issue in Turkish children and adults, and uses participants’ errors to account for the emerging asymmetry between subject and object RCs. 37 5-to-8 year old monolingual Turkish children and 23 adult controls participated in a novel elicitation task involving cards, each consisting of four different pictures (see Figure 1). There were two sets of cards, one for the participant and one for the researcher. The former had animals with accessories (e.g., a hat) whereas the latter had no accessories. Participants were instructed to hold their card without showing it to the researcher and describe the animals with particular accessories. This prompted the use of subject and object RCs. The researcher had to identify the animals in her card (see Figure 2). A preliminary repeated measures ANOVA with the factor Group (pre-school, primary-school children) showed no differences between the groups in the use of RCs (p>.1), who were therefore collapsed into one for further analyses. A repeated measures ANOVA with the factors Group (children, adults) and RC-Type (Subject, Object) showed that children used fewer RCs than adults (F(1,58)=7.54, p<.01), and both groups used fewer object than subject RCs (F(1,58)=22.46, p<.001), but there was no Group by RC-Type interaction (see Figure 3). A similar ANOVA on the rate of grammatical RCs showed a main effect of Group (F(1,58)=77.25, p<.001), a main effect of RC-Type (F(1,58)=66.33, p<.001), and an interaction of Group by RC-Type (F(1,58)=64.6, p<.001) (see Figure 4). Children made more errors than adults in object RCs (F(1,58)=87.01, p<.001), and children made more errors in object compared to subject RCs (F(1,36)=106.35, p<.001), but adults did not show this asymmetry. The error analysis revealed that children systematically avoided the object-relativizing morpheme –DIK, which requires possessive agreement with the genitive-marked subject. They also used resumptive pronouns and resumptive full-DPs in the extraction site similarly to English children (see Figure 5). These findings are in line with Slobin (1986) and Özcan (1996). Children’s errors suggest that they avoid morphosyntactic complexity of object RCs and try to preserve the canonical word order by inserting resumptive pronouns in the extraction site. Finally, cross-linguistic similarity in the acquisition of RCs in typologically different languages suggests a higher accessibility of subject RCs both at the structural (Keenan and Comrie, 1977) and conceptual level (Bock and Warren, 1986).

To 'be', and not to 'have': auxiliary selection in unaccusative verbs in Italian

This paper investigates the characteristics of unaccusative verbs in Italian with respect to the consistency with which these verbs select the auxiliaries ‘be’ (essere) and ‘have’ (avere) in compound tense forms. The study builds on the gradient approach to split intransitivity (Sorace 2000) by exploring the behaviour of 29 intransitive Italian verbs with respect to their core-peripheral features: auxiliary selection acceptability ratings and associated variance measures. Although there is clear support for the gradient approach in relation to the general order of semantic categories along the unaccusativity gradient, the results reveal that the ordering of subclasses within the Change group conflict with that currently proposed in the literature. In addition, the findings demonstrate the aspectual and lexical semantic characteristics of internally-caused change-of-state verbs in Italian require further investigation before their auxiliary selection behaviour can be properly understood. Furthermore, contrary to the gradient account, Existence verbs, the most stative and therefore the most peripheral subclass in the unaccusativity hierarchy, exhibit behaviour more characteristic of core unaccusative verbs. This study examines a wider range of semantic subclasses of unaccusative verbs than has hitherto been reported and identifies the core-peripheral boundary for Italian.1

Operationalising and measuring language dominance

The paper offers a new way to measure language ability in bilinguals, based on measures of lexical richness. The validity of proposed approach is tested in a variety of ways.