Electrical neuroimaging of memory discrimination based on single-trial multisensory learning.

Multisensory experiences influence subsequent memory performance and brain responses. Studies have thus far concentrated on semantically congruent pairings, leaving unresolved the influence of stimulus pairing and memory sub-types. Here, we paired images with unique, meaningless sounds during a continuous recognition task to determine if purely episodic, single-trial multisensory experiences can incidentally impact subsequent visual object discrimination. Psychophysics and electrical neuroimaging analyses of visual evoked potentials (VEPs) compared responses to repeated images either paired or not with a meaningless sound during initial encounters. Recognition accuracy was significantly impaired for images initially presented as multisensory pairs and could not be explained in terms of differential attention or transfer of effects from encoding to retrieval. VEP modulations occurred at 100-130ms and 270-310ms and stemmed from topographic differences indicative of network configuration changes within the brain. Distributed source estimations localized the earlier effect to regions of the right posterior temporal gyrus (STG) and the later effect to regions of the middle temporal gyrus (MTG). Responses in these regions were stronger for images previously encountered as multisensory pairs. Only the later effect correlated with performance such that greater MTG activity in response to repeated visual stimuli was linked with greater performance decrements. The present findings suggest that brain networks involved in this discrimination may critically depend on whether multisensory events facilitate or impair later visual memory performance. More generally, the data support models whereby effects of multisensory interactions persist to incidentally affect subsequent behavior as well as visual processing during its initial stages.

Cognitive and emotional effects of carotid stenosis.

PRINCIPLES: Patients with carotid artery stenosis (CAS) are at risk of ipsilateral stroke and chronic compromise of cerebral blood flow. It is under debate whether the hypo-perfusion or embolism in CAS is directly related to cognitive impairment. Alternatively, CAS may be a marker for underlying risk factors, which themselves influence cognition. We aimed to determine cognitive performance level and the emotional state of patients with CAS. We hypo-thesised that patients with high grade stenosis, bilateral stenosis, symptomatic patients and/or those with relevant risk factors would suffer impairment of their cognitive performance and emotional state. METHODS: A total of 68 patients with CAS of ≥70% were included in a prospective exploratory study design. All patients underwent structured assessment of executive functions, language, verbal and visual memory, motor speed, anxiety and depression. RESULTS: Significantly more patients with CAS showed cognitive impairments (executive functions, word production, verbal and visual memory, motor speed) and anxiety than expected in a normative sample. Bilateral and symptomatic stenosis was associated with slower processing speed. Cognitive performance and anxiety level were not influenced by the side and the degree of stenosis or the presence of collaterals. Factors associated with less co-gnitive impairment included higher education level, female gender, ambidexterity and treated hypercholesterolemia. CONCLUSIONS: Cognitive impairment and increased level of anxiety are frequent in patients with carotid stenosis. The lack of a correlation between cognitive functioning and degree of stenosis or the presence of collaterals, challenges the view that CAS per se leads to cognitive impairment.

The Impact of Cannabis Use on Cognitive Functioning in Patients With Schizophrenia: A Meta-analysis of Existing Findings and New Data in a First-Episode Sample.

Cannabis use is highly prevalent among people with schizophrenia, and coupled with impaired cognition, is thought to heighten the risk of illness onset. However, while heavy cannabis use has been associated with cognitive deficits in long-term users, studies among patients with schizophrenia have been contradictory. This article consists of 2 studies. In Study I, a meta-analysis of 10 studies comprising 572 patients with established schizophrenia (with and without comorbid cannabis use) was conducted. Patients with a history of cannabis use were found to have superior neuropsychological functioning. This finding was largely driven by studies that included patients with a lifetime history of cannabis use rather than current or recent use. In Study II, we examined the neuropsychological performance of 85 patients with first-episode psychosis (FEP) and 43 healthy nonusing controls. Relative to controls, FEP patients with a history of cannabis use (FEP + CANN; n = 59) displayed only selective neuropsychological impairments while those without a history (FEP - CANN; n = 26) displayed generalized deficits. When directly compared, FEP + CANN patients performed better on tests of visual memory, working memory, and executive functioning. Patients with early onset cannabis use had less neuropsychological impairment than patients with later onset use. Together, these findings suggest that patients with schizophrenia or FEP with a history of cannabis use have superior neuropsychological functioning compared with nonusing patients. This association between better cognitive performance and cannabis use in schizophrenia may be driven by a subgroup of "neurocognitively less impaired" patients, who only developed psychosis after a relatively early initiation into cannabis use.

Visuospatial working memory deficits and visual pursuit impairments are not directly related in schizophrenia.

OBJECTIVE: Patients with schizophrenia show deficits in visuospatial working memory and visual pursuit processes. It is currently unclear, however, whether both impairments are related to a common neuropathological origin. The purpose of the present study was therefore to examine the possible relations between the encoding and the discrimination of dynamic visuospatial stimuli in schizophrenia. METHOD: Sixteen outpatients with schizophrenia and 16 control subjects were asked to encode complex disc displacements presented on a screen. After a delay, participants had to identify the previously presented disc trajectory from a choice of six static linear paths, among which were five incorrect paths. The precision of visual pursuit eye movements during the initial presentation of the dynamic stimulus was assessed. The fixations and scanning time in definite regions of the six paths presented during the discrimination phase were investigated. RESULTS: In comparison with controls, patients showed poorer task performance, reduced pursuit accuracy during incorrect trials and less time scanning the correct stimulus or the incorrect paths approximating its global structure. Patients also spent less time scanning the leftmost portion of the correct path even when making a correct choice. The accuracy of visual pursuit and head movements, however, was not correlated with task performance. CONCLUSIONS: The present study provides direct support for the hypothesis that active integration of visuospatial information within working memory is deficient in schizophrenia. In contrast, a general impairment of oculomotor mechanisms involved in smooth pursuit did not appear to be directly related to lower visuospatial working memory performance in schizophrenia.

Working memory load improves early stages of independent visual processing.

Increasing evidence suggests that working memory and perceptual processes are dynamically interrelated due to modulating activity in overlapping brain networks. However, the direct influence of working memory on the spatio-temporal brain dynamics of behaviorally relevant intervening information remains unclear. To investigate this issue, subjects performed a visual proximity grid perception task under three different visual-spatial working memory (VSWM) load conditions. VSWM load was manipulated by asking subjects to memorize the spatial locations of 6 or 3 disks. The grid was always presented between the encoding and recognition of the disk pattern. As a baseline condition, grid stimuli were presented without a VSWM context. VSWM load altered both perceptual performance and neural networks active during intervening grid encoding. Participants performed faster and more accurately on a challenging perceptual task under high VSWM load as compared to the low load and the baseline condition. Visual evoked potential (VEP) analyses identified changes in the configuration of the underlying sources in one particular period occurring 160-190 ms post-stimulus onset. Source analyses further showed an occipito-parietal down-regulation concurrent to the increased involvement of temporal and frontal resources in the high VSWM context. Together, these data suggest that cognitive control mechanisms supporting working memory may selectively enhance concurrent visual processing related to an independent goal. More broadly, our findings are in line with theoretical models implicating the engagement of frontal regions in synchronizing and optimizing mnemonic and perceptual resources towards multiple goals.

Visual binding abilities in the initial and advanced stages of schizophrenia

OBJECTIVE: The study tests the hypothesis that intramodal visual binding is disturbed in schizophrenia and should be detectable in all illness stages as a stable trait marker. METHOD: Three groups of patients (rehospitalized chronic schizophrenic, first admitted schizophrenic and schizotypal patients believed to be suffering from a pre-schizophrenic prodrome) and a group of normal control subjects were tested on three tasks targeting visual 'binding' abilities (Muller-Lyer's illusion and two figure detection tasks) in addition to control parameters such as reaction time, visual selective attention, Raven's test and two conventional cortical tasks of spatial working memory (SWM) and a global local test. RESULTS: Chronic patients had a decreased performance on the binding tests. Unexpectedly, the prodromal group exhibited an enhanced Gestalt extraction on these tests compared both to schizophrenic patients and to healthy subjects. Furthermore, chronic schizophrenia was associated with a poor performance on cortical tests of SWM, global local and on Raven. This association appears to be mediated by or linked to the chronicity of the illness. CONCLUSION: The study confirms a variety of neurocognitive deficits in schizophrenia which, however, in this sample seem to be linked to chronicity of illness. However, certain aspects of visual processing concerned with Gestalt extraction deserve attention as potential vulnerability- or prodrome- indicators. The initial hypothesis of the study is rejected.

As the world turns: short-term human spatial memory in egocentric and allocentric coordinates

We aimed to determine whether human subjects' reliance on different sources of spatial information encoded in different frames of reference (i.e., egocentric versus allocentric) affects their performance, decision time and memory capacity in a short-term spatial memory task performed in the real world. Subjects were asked to play the Memory game (a.k.a. the Concentration game) without an opponent, in four different conditions that controlled for the subjects' reliance on egocentric and/or allocentric frames of reference for the elaboration of a spatial representation of the image locations enabling maximal efficiency. We report experimental data from young adult men and women, and describe a mathematical model to estimate human short-term spatial memory capacity. We found that short-term spatial memory capacity was greatest when an egocentric spatial frame of reference enabled subjects to encode and remember the image locations. However, when egocentric information was not reliable, short-term spatial memory capacity was greater and decision time shorter when an allocentric representation of the image locations with respect to distant objects in the surrounding environment was available, as compared to when only a spatial representation encoding the relationships between the individual images, independent of the surrounding environment, was available. Our findings thus further demonstrate that changes in viewpoint produced by the movement of images placed in front of a stationary subject is not equivalent to the movement of the subject around stationary images. We discuss possible limitations of classical neuropsychological and virtual reality experiments of spatial memory, which typically restrict the sensory information normally available to human subjects in the real world.

Olfactory and/or visual cues for spatial navigation through ontogeny: olfactory cues enable the use of visual cues

This study analyzed the spatial memory capacities of rats in darkness with visual and/or olfactory cues through ontogeny. Tests were conducted with the homing board, where rats had to find the correct escape hole. Four age groups (24 days, 48 days, 3-6 months, and 12 months) were trained in 3 conditions: (a) 3 identical light cues; (b) 5 different olfactory cues; and (c) both types of cues, followed by removal of the olfactory cues. Results indicate that immature rats first take into account olfactory information but are unable to orient with only the help of discrete visual cues. Olfaction enables the use of visual information by 48-day-old rats. Visual information predominantly supports spatial cognition in adult and 12-month-old rats. Results point out cooperation between vision and olfaction for place navigation during ontogeny in rats.

A new electrophysiological index for working memory load in humans.

Working memory, the ability to store and simultaneously manipulate information, is affected in several neuropsychiatric disorders which lead to severe cognitive and functional deficits. An electrophysiological marker for this process could help identify early cerebral function abnormalities. In subjects performing working memory-specific n-back tasks, event-related potential analysis revealed a positive-negative waveform (PNwm) component modulated in amplitude by working memory load. It occurs in the expected time range for this process, 140-280 ms after stimulus onset, superimposed on the classical P200 and N200 components. Independent Component Analysis extracted two functional components with latencies and topographical scalp distributions similar to the PNwm. Our results imply that the PNwm represents a new electrophysiological index for working memory load in humans.

Time processing in visual cortices: How the visual brain encodes and keeps track of time

Time is embedded in any sensory experience: the movements of a dance, the rhythm of a piece of music, the words of a speaker are all examples of temporally structured sensory events. In humans, if and how visual cortices perform temporal processing remains unclear. Here we show that both primary visual cortex (V1) and extrastriate area V5/MT are causally involved in encoding and keeping time in memory and that this involvement is independent from low-level visual processing. Most importantly we demonstrate that V1 and V5/MT are functionally linked and temporally synchronized during time encoding whereas they are functionally independent and operate serially (V1 followed by V5/MT) while maintaining temporal information in working memory. These data challenge the traditional view of V1 and V5/MT as visuo-spatial features detectors and highlight the functional contribution and the temporal dynamics of these brain regions in the processing of time in millisecond range. The present project resulted in the paper entitled: 'How the visual brain encodes and keeps track of time' by Paolo Salvioni, Lysiann Kalmbach, Micah Murray and Domenica Bueti that is now submitted for publication to the Journal of Neuroscience.

Absence of snapshot memory of the target view interferes with place navigation learning by rats in the water maze

Contribution of visual and nonvisual mechanisms to spatial behavior of rats in the Morris water maze was studied with a computerized infrared tracking system, which switched off the room lights when the subject entered the inner circular area of the pool with an escape platform. Naive rats trained under light-dark conditions (L-D) found the escape platform more slowly than rats trained in permanent light (L). After group members were swapped, the L-pretrained rats found under L-D conditions the same target faster and eventually approached latencies attained during L navigation. Performance of L-D-trained rats deteriorated in permanent darkness (D) but improved with continued D training. Thus L-D navigation improves gradually by procedural learning (extrapolation of the start-target azimuth into the zero-visibility zone) but remains impaired by lack of immediate visual feedback rather than by absence of the snapshot memory of the target view.

Accurate memory for object location by individuals with intellectual disability: Absolute spatial tagging instead of configural processing?

Using head-mounted eye tracker material, we assessed spatial recognition abilities (e.g., reaction to object permutation, removal or replacement with a new object) in participants with intellectual disabilities. The "Intellectual Disabilities (ID)" group (n=40) obtained a score totalling a 93.7% success rate, whereas the "Normal Control" group (n=40) scored 55.6% and took longer to fix their attention on the displaced object. The participants with an intellectual disability thus had a more accurate perception of spatial changes than controls. Interestingly, the ID participants were more reactive to object displacement than to removal of the object. In the specific test of novelty detection, however, the scores were similar, the two groups approaching 100% detection. Analysis of the strategies expressed by the ID group revealed that they engaged in more systematic object checking and were more sensitive than the control group to changes in the structure of the environment. Indeed, during the familiarisation phase, the "ID" group explored the collection of objects more slowly, and fixed their gaze for a longer time upon a significantly lower number of fixation points during visual sweeping.

Event-related potentials and changes of brain rhythm oscillations during working memory activation in patients with first-episode psychosis.

Background: Earlier contributions have documented significant changes in sensory, attention-related endogenous event-related potential (ERP) components and θ band oscillatory responses during working memory activation in patients with schizophrenia. In patients with first-episode psychosis, such studies are still scarce and mostly focused on auditory sensory processing. The present study aimed to explore whether subtle deficits of cortical activation are present in these patients before the decline of working memory performance. Methods: We assessed exogenous and endogenous ERPs and frontal θ event-related synchronization (ERS) in patients with first-episode psychosis and healthy controls who successfully performed an adapted 2-back working memory task, including 2 visual n-backworking memory tasks as well as oddball detection and passive fixation tasks. Results: We included 15 patients with first-episode psychosis and 18 controls in this study. Compared with controls, patients with first-episode psychosis displayed increased latencies of early visual ERPs and phasic θ ERS culmination peak in all conditions. However, they also showed a rapid recruitment of working memory-related neural generators, even in pure attention tasks, as indicated by the decreased N200 latency and increased amplitude of sustained θ ERS in detection compared with controls. Limitations: Owing to the limited sample size, no distinction was made between patients with first-episode psychosis with positive and negative symptoms. Although we controlled for the global load of neuroleptics, medication effect cannot be totally ruled out. Conclusion: The present findings support the concept of a blunted electroencephalographic response in patients with first-episode psychosis who recruit the maximum neural generators in simple attention conditions without being able to modulate their brain activation with increased complexity of working memory tasks.

Visuo-spatial processing in a dynamic and a static working memory paradigm in schizophrenia.

Recent findings suggest that the visuo-spatial sketchpad (VSSP) may be divided into two sub-components processing dynamic or static visual information. This model may be useful to elucidate the confusion of data concerning the functioning of the VSSP in schizophrenia. The present study examined patients with schizophrenia and matched controls in a new working memory paradigm involving dynamic (the Ball Flight Task - BFT) or static (the Static Pattern Task - SPT) visual stimuli. In the BFT, the responses of the patients were apparently based on the retention of the last set of segments of the perceived trajectory, whereas control subjects relied on a more global strategy. We assume that the patients' performances are the result of a reduced capacity in chunking visual information since they relied mainly on the retention of the last set of segments. This assumption is confirmed by the poor performance of the patients in the static task (SPT), which requires a combination of stimulus components into object representations. We assume that the static/dynamic distinction may help us to understand the VSSP deficits in schizophrenia. This distinction also raises questions about the hypothesis that visuo-spatial working memory can simply be dissociated into visual and spatial sub-components.

How the visual brain encodes and keeps track of time.

Time is embedded in any sensory experience: the movements of a dance, the rhythm of a piece of music, the words of a speaker are all examples of temporally structured sensory events. In humans, if and how visual cortices perform temporal processing remains unclear. Here we show that both primary visual cortex (V1) and extrastriate area V5/MT are causally involved in encoding and keeping time in memory and that this involvement is independent from low-level visual processing. Most importantly we demonstrate that V1 and V5/MT come into play simultaneously and seem to be functionally linked during interval encoding, whereas they operate serially (V1 followed by V5/MT) and seem to be independent while maintaining temporal information in working memory. These data help to refine our knowledge of the functional properties of human visual cortex, highlighting the contribution and the temporal dynamics of V1 and V5/MT in the processing of the temporal aspects of visual information.