Mental imagery in interpreting – a neurocognitive perspective

The paper discusses mental imagery as an important part of information processing performed during interpreting. Mental imagery is examined to see if visual processing used to remember the source text or to facilitate its understanding helps to ‗off-load‘ other cognitive (mainly linguistic) resources in interpreting. The discussion is based on a neurocognitively-oriented depictivist model by Kosslyn (1994). The overview of mental imagery processes and systems is followed by the discussion of imagery used in interpreting. First, imagery development in student interpreters is described on the basis of a note-taking course for would-be consecutive interpreters organized by the author at AMU. The initial part of the course devoted to imagery involves visualizations of geographical, descriptive and narrative texts. The description abounds in authentic examples and presents conclusions for interpreting trainers. Later, imagery as employed by professional interpreters is discussed on the basis of a qualitative survey. General implications of the use of mental imagery for cognitive processing limitations in interpreting are presented in the concluding section.

Sistema de auto calibração visual para robots do ISePorto, baseado em EKF

Os sistemas de perceção existentes nos robôs autónomos, hoje em dia, são bastante complexos. A informação dos vários sensores, existentes em diferentes partes do robôs, necessitam de estar relacionados entre si face ao referencial do robô ou do mundo. Para isso, o conhecimento da atitude (posição e rotação) entre os referenciais dos sensores e o referencial do robô é um fator critico para o desempenho do mesmo. O processo de calibração dessas posições e translações é chamado calibração dos parâmetros extrínsecos. Esta dissertação propõe o desenvolvimento de um método de calibração autónomo para robôs como câmaras direcionais, como é o caso dos robôs da equipa ISePorto. A solução proposta consiste na aquisição de dados da visão, giroscópio e odometria durante uma manobra efetuada pelo robô em torno de um alvo com um padrão conhecido. Esta informação é então processada em conjunto através de um Extended Kalman Filter (EKF) onde são estimados necessários para relacionar os sensores existentes no robô em relação ao referencial do mesmo. Esta solução foi avaliada com recurso a vários testes e os resultados obtidos foram bastante similares aos obtidos pelo método manual, anteriormente utilizado, com um aumento significativo em rapidez e consistência.

Intraocular Pressure Correlates with Optic Nerve Sheath Diameter in Patients with Normal Tension Glaucoma

PURPOSE: 1. Identify differences in optic nerve sheath diameter (ONSD) as an indirect measure of intracranial pressure (ICP) in glaucoma patients and a healthy population. 2. Identify variables that may correlate with ONSD in primary open-angle glaucoma (POAG) and normal tension glaucoma (NTG) patients. METHODS: Patients with NTG (n = 46) and POAG (n = 61), and healthy controls (n = 42) underwent B-scan ultrasound measurement of ONSD by an observer masked to the patient diagnosis. Intraocular pressure (IOP) was measured in all groups, with additional central corneal thickness (CCT) and visual field defect measurements in glaucomatous patients. Only one eye per patient was selected. Kruskal-Wallis or Mann-Whitney were used to compare the different variables between the diagnostic groups. Spearman correlations were used to explore relationships among these variables. RESULTS: ONSD was not significantly different between healthy, NTG and POAG patients (6.09 ± 0.78, 6.03 ± 0.69, and 5.71 ± 0.83 respectively; p = 0.08). Visual field damage and CCT were not correlated with ONSD in either of the glaucoma groups (POAG, p = 0.31 and 0.44; NTG, p = 0.48 and 0.90 respectively). However, ONSD did correlate with IOP in NTG patients (r = 0.53, p < 0.001), while it did not in POAG patients and healthy controls (p = 0.86, p = 0.46 respectively). Patient's age did not relate to ONSD in any of the groups (p > 0.25 in all groups). CONCLUSIONS: Indirect measurements of ICP by ultrasound assessment of the ONSD may provide further insights into the retrolaminar pressure component in glaucoma. The correlation of ONSD with IOP solely in NTG patients suggests that the translaminar pressure gradient may be of particular importance in this type of glaucoma.

Feature Extraction in Densely Sensed Environments: Extensions to Multiple Broadcast Domains

The vision of the Internet of Things (IoT) includes large and dense deployment of interconnected smart sensing and monitoring devices. This vast deployment necessitates collection and processing of large volume of measurement data. However, collecting all the measured data from individual devices on such a scale may be impractical and time consuming. Moreover, processing these measurements requires complex algorithms to extract useful information. Thus, it becomes imperative to devise distributed information processing mechanisms that identify application-specific features in a timely manner and with a low overhead. In this article, we present a feature extraction mechanism for dense networks that takes advantage of dominance-based medium access control (MAC) protocols to (i) efficiently obtain global extrema of the sensed quantities, (ii) extract local extrema, and (iii) detect the boundaries of events, by using simple transforms that nodes employ on their local data. We extend our results for a large dense network with multiple broadcast domains (MBD). We discuss and compare two approaches for addressing the challenges with MBD and we show through extensive evaluations that our proposed distributed MBD approach is fast and efficient at retrieving the most valuable measurements, independent of the number sensor nodes in the network.

Sensorimotor synchronization when walking side by side with a point light walker

[Excerpt] Synchronization of periodic movements like side-by-side walking [7] is frequently modeled by coupled oscillators [5] and the coupling strength is defined quantitatively [3]. In contrast, in most studies on sensorimotor synchronization (SMS), simple movements like finger taps are synchronized with simple stimuli like metronomes [4]. While the latter paradigm simplifies matters and allows for the assessment of the relative weights of sensory modalities through systematic variation of the stimuli [1], it might lack ecological validity. Conversely, using more complex movements and stimuli might complicate the specification of mechanisms underlying coupling. We merged the positive aspects of both approaches to study the contribution of auditory and visual information on synchronization during side-by-side walking. As stimuli, we used Point Light Walkers (PLWs) and auralized steps sound; both were constructed from previously captured walking individuals [2][6]. PLWs were retro-projected on a screen and matched according to gender, hip height, and velocity. The participant walked for 7.20m side by side with 1) a PLW, 2) steps sound, or 3) both displayed in temporal congruence. Instruction to participants was to synchronize with the available stimuli. [...]

Development of procedures for the design, optimization and manufacturing of customized orthopaedic and trauma implants: Geometrical/anatomical modelling from 3D medical imaging

Tese de Doutoramento (Programa Doutoral em Engenharia Biomédica)

Repeated assessment and practice effects of the written symbol digit modalities test using a short inter-test interval

The Symbol Digit Modalities Test (SDMT) is a widely used instrument to assess information processing speed, attention, visual scanning, and tracking. Considering that repeated evaluations are a common need in neuropsychological assessment routines, we explored test–retest reliability and practice effects of two alternate SDMT forms with a short inter-assessment interval. A total of 123 university students completed the written SDMT version in two different time points separated by a 150-min interval. Half of the participants accomplished the same form in both occasions, while the other half filled different forms. Overall, reasonable test–retest reliabilities were found (r = .70), and the subjects that completed the same form revealed significant practice effects (p < .001, dz = 1.61), which were almost non-existent in those filling different forms. These forms were found to be moderately reliable and to elicit a similar performance across participants, suggesting their utility in repeated cognitive assessments when brief inter-assessment intervals are required.

Effects of anxiety on visuospatial pattern discrimination and decision-making processes: what can we learn from brain dynamics ?

Detection and discrimination of visuospatial input involve at least extracting, selecting and encoding relevant information and decision-making processes allowing selecting a response. These two operations are altered, respectively, by attentional mechanisms that change discrimination capacities, and by beliefs concerning the likelihood of uncertain events. Information processing is tuned by the attentional level that acts like a filter on perception, while decision-making processes are weighed by subjective probability of risk. In addition, it has been shown that anxiety could affect the detection of unexpected events through the modification of the level of arousal. Consequently, purpose of this study concerns whether and how decision-making and brain dynamics are affected by anxiety. To investigate these questions, the performance of women with either a high (12) or a low (12) STAI-T (State-Trait Anxiety Inventory, Spielberger, 1983) was examined in a decision-making visuospatial task where subjects have to recognize a target visual pattern from non-target patterns. The target pattern was a schematic image of furniture arranged in such a way as to give the impression of a living room. Non-target patterns were created by either the compression or the dilatation of the distances between objects. Target and non-target patterns were always presented in the same configuration. Preliminary behavioral results show no group difference in reaction time. In addition, visuo-spatial abilities were analyzed trough the signal detection theory for quantifying perceptual decisions in the presence of uncertainty (Green and Swets, 1966). This theory treats detection of a stimulus as a decision-making process determined by the nature of the stimulus and cognitive factors. Astonishingly, no difference in d' (corresponding to the distance between means of the distributions) and c (corresponds to the likelihood ratio) indexes was observed. Comparison of Event-related potentials (ERP) reveals that brain dynamics differ according to anxiety. It shows differences in component latencies, particularly a delay in anxious subjects over posterior electrode sites. However, these differences are compensated during later components by shorter latencies in anxious subjects compared to non-anxious one. These inverted effects seem indicate that the absence of difference in reaction time rely on a compensation of attentional level that tunes cortical activation in anxious subjects, but they have to hammer away to maintain performance.

The role of multisensory memories in unisensory object discrimination.

Past multisensory experiences can influence current unisensory processing and memory performance. Repeated images are better discriminated if initially presented as auditory-visual pairs, rather than only visually. An experience's context thus plays a role in how well repetitions of certain aspects are later recognized. Here, we investigated factors during the initial multisensory experience that are essential for generating improved memory performance. Subjects discriminated repeated versus initial image presentations intermixed within a continuous recognition task. Half of initial presentations were multisensory, and all repetitions were only visual. Experiment 1 examined whether purely episodic multisensory information suffices for enhancing later discrimination performance by pairing visual objects with either tones or vibrations. We could therefore also assess whether effects can be elicited with different sensory pairings. Experiment 2 examined semantic context by manipulating the congruence between auditory and visual object stimuli within blocks of trials. Relative to images only encountered visually, accuracy in discriminating image repetitions was significantly impaired by auditory-visual, yet unaffected by somatosensory-visual multisensory memory traces. By contrast, this accuracy was selectively enhanced for visual stimuli with semantically congruent multisensory pasts and unchanged for those with semantically incongruent multisensory pasts. The collective results reveal opposing effects of purely episodic versus semantic information from auditory-visual multisensory events. Nonetheless, both types of multisensory memory traces are accessible for processing incoming stimuli and indeed result in distinct visual object processing, leading to either impaired or enhanced performance relative to unisensory memory traces. We discuss these results as supporting a model of object-based multisensory interactions.

Olfactory and/or visual cues for spatial navigation through ontogeny: olfactory cues enable the use of visual cues

This study analyzed the spatial memory capacities of rats in darkness with visual and/or olfactory cues through ontogeny. Tests were conducted with the homing board, where rats had to find the correct escape hole. Four age groups (24 days, 48 days, 3-6 months, and 12 months) were trained in 3 conditions: (a) 3 identical light cues; (b) 5 different olfactory cues; and (c) both types of cues, followed by removal of the olfactory cues. Results indicate that immature rats first take into account olfactory information but are unable to orient with only the help of discrete visual cues. Olfaction enables the use of visual information by 48-day-old rats. Visual information predominantly supports spatial cognition in adult and 12-month-old rats. Results point out cooperation between vision and olfaction for place navigation during ontogeny in rats.

Hemispheric asymmetry and theory of mind: Is there an association?

Introduction. In autism and schizophrenia attenuated/atypical functional hemispheric asymmetry and theory of mind impairments have been reported, suggesting common underlying neuroscientific correlates. We here investigated whether impaired theory of mind performance is associated with attenuated/atypical hemispheric asymmetry. An association may explain the co-occurrence of both dysfunctions in psychiatric populations. Methods. Healthy participants (n 129) performed a left hemisphere (lateralised lexical decision task) and right hemisphere (lateralised face decision task) dominant task as well as a visual cartoon task to assess theory of mind performance. Results. Linear regression analyses revealed inconsistent associations between theory of mind performance and functional hemisphere asymmetry: enhanced theory of mind performance was only associated with (1) faster right hemisphere language processing, and (2) reduced right hemisphere dominance for face processing (men only). Conclusions. The majority of non-significant findings suggest that theory of mind and functional hemispheric asymmetry are unrelated. Instead of ''overinterpreting'' the two significant results, discrepancies in the previous literature relating to the problem of the theory of mind concept, the variety of tasks, and the lack of normative data are discussed. We also suggest how future studies could explore a possible link between hemispheric asymmetry and theory of mind.

Imaging Properties of MS Lesions Correlate with Attention Deficits in Early Multiple Sclerosis

Introduction: Cognitive impairment affects 40-65% of multiple sclerosis (MS) patients, often since early stages of the disease (relapsing remitting MS, RRMS). Frequently affected functions are memory, attention or executive abilities but the most sensitive measure of cognitive deficits in early MS is the information processing speed (Amato, 2008). MRI has been extensively exploited to investigate the substrate of cognitive dysfunction in MS but the underlying physiopathological mechanisms remain unclear. White matter lesion load, whole-brain atrophy and cortical lesions' number play a role but correlations are in some cases modest (Rovaris, 2006; Calabrese, 2009). In this study, we aimed at characterizing and correlating the T1 relaxation times of cortical and sub-cortical lesions with cognitive deficits detected by neuropsychological tests in a group of very early RR MS patients. Methods: Ten female patients with very early RRMS (age: 31.6 ±4.7y; disease duration: 3.8 ±1.9y; EDSS disability score: 1.8 ±0.4) and 10 age- and gender-matched healthy volunteers (mean age: 31.2 ±5.8y) were included in the study. All participants underwent the following neuropsychological tests: Rao's Brief Repeatable Battery of Neuropsychological tests (BRB-N), Stockings of Cambridge, Trail Making Test (TMT, part A and B), Boston Naming Test, Hooper Visual Organization Test and copy of the Rey-Osterrieth Complex Figure. Within 2 weeks from neuropsychological assessment, participants underwent brain MRI at 3T (Magnetom Trio a Tim System, Siemens, Germany) using a 32-channel head coil. The imaging protocol included 3D sequences with 1x1x1.2 mm3 resolution and 256x256x160 matrix, except for axial 2D-FLAIR: -DIR (T2-weighted, suppressing both WM and CSF; Pouwels, 2006) -MPRAGE (T1-weighted; Mugler, 1991) -MP2RAGE (T1-weighted with T1 maps; Marques, 2010) -FLAIR SPACE (only for patient 4-10, T2-weighted; Mugler, 2001) -2D Axial FLAIR (0.9x0.9x2.5 mm3, 256x256x44 matrix). Lesions were identified by one experienced neurologist and radiologist using all contrasts, manually contoured and assigned to regional locations (cortical or sub-cortical). Lesion number, volume and T1 relaxation time were calculated for lesions in each contrast and in a merged mask representing the union of the lesions from all contrasts. T1 relaxation times of lesions were normalized with the mean T1 value in corresponding control regions of the healthy subjects. Statistical analysis was performed using GraphPad InStat software. Cognitive scores were compared between patients and controls with paired t-tests; p values ≤ 0.05 were considered significant. Spearmann correlation tests were performed between the cognitive tests, which differed significantly between patients and controls, and lesions' i) number ii) volume iii) T1 relaxation time iv) disease duration and v) years of study. Results: Cortical and sub-cortical lesions count, T1 values and volume are reported in Table 1 (A and B). All early RRMS patients showed cortical lesions (CLs) and the majority consisted of CLs type I (lesions with a cortical component extending to the sub-cortical tissue). The rest of cortical lesions were characterized as type II (intra-cortical lesions). No type III/IV lesions (large sub-pial lesions) were detected. RRMS patients were slightly less educated (13.5±2.5y vs. 16.3±1.8y of study, p=0.02) than the controls. Signs of cortical dysfunction (i.e. impaired learning, language, visuo-spatial skills or gnosis) were rare in all patients. However, patients showed on average lower scores on measures of visual attention and information processing speed (TMT-part A: p=0.01; TMT-part B: p=0.006; PASAT-included in the BRB-N: p=0.04). The T1 relaxation values of CLs type I negatively correlated with the TMT-part A score (r=0.78, p<0.01). The correlations of TMT-part B score and PASAT score with T1 relaxation time of lesions as well and the correlation between TMT-part A, TMT-part B and PASAT score with lesions' i) number ii) volume iii) disease duration and iv) years of study did not reach significance. In order to preclude possible influences from partial volume effects on the T1 values, the correlation between lesion volume and T1 value of CLs type I was calculated; no correlation was found, suggesting that partial volume effects did not affect the statistics. Conclusions: The present pilot study reports for the first time the presence and the T1 characteristics at 3 T of cortical lesions in very early RRMS (< 6 y disease duration). It also shows that CLS type I represents the most frequent cortical lesion type in this cohort of RRMS patients. In addition, it reveals a negative correlation between the attentional test TMT-part A and the T1 properties of cortical lesions type I. In other words, lower attention deficits are concomitant with longer T1-relaxation time in cortical lesions. In respect to this last finding, it could be speculated that long relaxation time correspond to a certain degree of tissue loss that is enough to stimulate compensatory mechanisms. This hypothesis is in line with previous fMRI studies showing functional compensatory mechanisms to help maintaining normal or sub-normal attention performances in RR MS patients (Penner, 2003).

Cluster analysis of behavioural and event-related potentials during a contingent negative variation paradigm in remitting-relapsing and benign forms of multiple sclerosis

Background: Event-related potentials (ERPs) may be used as a highly sensitive way of detecting subtle degrees of cognitive dysfunction. On the other hand, impairment of cognitive skills is increasingly recognised as a hallmark of patients suffering from multiple sclerosis (MS). We sought to determine the psychophysiological pattern of information processing among MS patients with the relapsing-remitting form of the disease and low physical disability considered as two subtypes: 'typical relapsing-remitting' (RRMS) and 'benign MS' (BMS). Furthermore, we subjected our data to a cluster analysis to determine whether MS patients and healthy controls could be differentiated in terms of their psychophysiological profile.Methods: We investigated MS patients with RRMS and BMS subtypes using event-related potentials (ERPs) acquired in the context of a Posner visual-spatial cueing paradigm. Specifically, our study aimed to assess ERP brain activity in response preparation (contingent negative variation -CNV) and stimuli processing in MS patients. Latency and amplitude of different ERP components (P1, eN1, N1, P2, N2, P3 and late negativity -LN) as well as behavioural responses (reaction time -RT; correct responses -CRs; and number of errors) were analyzed and then subjected to cluster analysis. Results: Both MS groups showed delayed behavioural responses and enhanced latency for long-latency ERP components (P2, N2, P3) as well as relatively preserved ERP amplitude, but BMS patients obtained more important performance deficits (lower CRs and higher RTs) and abnormalities related to the latency (N1, P3) and amplitude of ERPs (eCNV, eN1, LN). However, RRMS patients also demonstrated abnormally high amplitudes related to the preparation performance period of CNV (cCNV) and post-processing phase (LN). Cluster analyses revealed that RRMS patients appear to make up a relatively homogeneous group with moderate deficits mainly related to ERP latencies, whereas BMS patients appear to make up a rather more heterogeneous group with more severe information processing and attentional deficits. Conclusions: Our findings are suggestive of a slowing of information processing for MS patients that may be a consequence of demyelination and axonal degeneration, which also seems to occur in MS patients that show little or no progression in the physical severity of the disease over time.

Online Robust 3D Mapping Using Structure from Motion Cues

This paper presents a complete solution for creating accurate 3D textured models from monocular video sequences. The methods are developed within the framework of sequential structure from motion, where a 3D model of the environment is maintained and updated as new visual information becomes available. The camera position is recovered by directly associating the 3D scene model with local image observations. Compared to standard structure from motion techniques, this approach decreases the error accumulation while increasing the robustness to scene occlusions and feature association failures. The obtained 3D information is used to generate high quality, composite visual maps of the scene (mosaics). The visual maps are used to create texture-mapped, realistic views of the scene

Selective integration of auditory-visual looming cues by humans.

An object's motion relative to an observer can confer ethologically meaningful information. Approaching or looming stimuli can signal threats/collisions to be avoided or prey to be confronted, whereas receding stimuli can signal successful escape or failed pursuit. Using movement detection and subjective ratings, we investigated the multisensory integration of looming and receding auditory and visual information by humans. While prior research has demonstrated a perceptual bias for unisensory and more recently multisensory looming stimuli, none has investigated whether there is integration of looming signals between modalities. Our findings reveal selective integration of multisensory looming stimuli. Performance was significantly enhanced for looming stimuli over all other multisensory conditions. Contrasts with static multisensory conditions indicate that only multisensory looming stimuli resulted in facilitation beyond that induced by the sheer presence of auditory-visual stimuli. Controlling for variation in physical energy replicated the advantage for multisensory looming stimuli. Finally, only looming stimuli exhibited a negative linear relationship between enhancement indices for detection speed and for subjective ratings. Maximal detection speed was attained when motion perception was already robust under unisensory conditions. The preferential integration of multisensory looming stimuli highlights that complex ethologically salient stimuli likely require synergistic cooperation between existing principles of multisensory integration. A new conceptualization of the neurophysiologic mechanisms mediating real-world multisensory perceptions and action is therefore supported.