N1 enhancement in synesthesia during visual and audio-visual perception in semantic cross-modal conflict situations: an ERP study

Synesthesia entails a special kind of sensory perception, where stimulation in one sensory modality leads to an internally generated perceptual experience of another, not stimulated sensory modality. This phenomenon can be viewed as an abnormal multisensory integration process as here the synesthetic percept is aberrantly fused with the stimulated modality. Indeed, recent synesthesia research has focused on multimodal processing even outside of the specific synesthesia-inducing context and has revealed changed multimodal integration, thus suggesting perceptual alterations at a global level. Here, we focused on audio-visual processing in synesthesia using a semantic classification task in combination with visually or auditory-visually presented animated and in animated objects in an audio-visual congruent and incongruent manner. Fourteen subjects with auditory-visual and/or grapheme-color synesthesia and 14 control subjects participated in the experiment. During presentation of the stimuli, event-related potentials were recorded from 32 electrodes. The analysis of reaction times and error rates revealed no group differences with best performance for audio-visually congruent stimulation indicating the well-known multimodal facilitation effect. We found enhanced amplitude of the N1 component over occipital electrode sites for synesthetes compared to controls. The differences occurred irrespective of the experimental condition and therefore suggest a global influence on early sensory processing in synesthetes.

Situation assessment through multi-modal sensing of dynamic environments to support cognitive robot control

Awareness of emerging situations in a dynamic operational environment of a robotic assistive device is an essential capability of such a cognitive system, based on its effective and efficient assessment of the prevailing situation. This allows the system to interact with the environment in a sensible (semi)autonomous / pro-active manner without the need for frequent interventions from a supervisor. In this paper, we report a novel generic Situation Assessment Architecture for robotic systems directly assisting humans as developed in the CORBYS project. This paper presents the overall architecture for situation assessment and its application in proof-of-concept Demonstrators as developed and validated within the CORBYS project. These include a robotic human follower and a mobile gait rehabilitation robotic system. We present an overview of the structure and functionality of the Situation Assessment Architecture for robotic systems with results and observations as collected from initial validation on the two CORBYS Demonstrators.

Bound Variable, Split Antecedent and Ellipsis Interpretations in L2 Portuguese: Implications for L2 Acquisition Theories.

Recently, in light of minimalist assumptions, some partial UG accessibility accounts to adult second language acquisition have made a distinction between the post-critical period ability to acquire new features based on their LF-interpretability (i.e. interpretable vs. uninterpretable features) (HAWKINS, 2005; HAWKINS; HATTORI, 2006; TSIMPLI; MASTROPAVLOU, 2007; TSIMPLI; DIMITRAKOPOULOU, 2007). The Interpretability Hypothesis (TSIMPLI; MASTROPAVLOU, 2007; TSIMPLI; DIMITRAKOPOULOU, 2007) claims that only uninterpretable features suffer a post-critical period failure and, therefore, cannot be acquired. Conversely, Full Access approaches claim that L2 learners have full access to UG’s entire inventory of features, and that L1/L2 differences obtain outside the narrow syntax. The phenomenon studied herein, adult acquisition of the Overt Pronoun Constraint (OPC) (MONTALBETTI, 1984) and inflected infinitives in nonnative Portuguese, challenges the Interpretability hypothesis insofar as it makes the wrong predictions for what is observed. The present data demonstrate that advanced learners of L2 Portuguese acquire the OPC and the syntax and semantics of inflected infinitives with native-like accuracy. Since inflected infinitives require the acquisition of new uninterpretable φ-features, the present data provide evidence in contra Tsimpli and colleagues’ Interpretability Hypothesis.