Distinct neural correlates of visual long-term memory for spatial location and object identity: a positron emission tomography study in humans.

The purpose of the present study was to investigate by using positron emission tomography (PET) whether the cortical pathways that are involved in visual perception of spatial location and object identity are also differentially implicated in retrieval of these types of information from episodic long-term memory. Subjects studied a set of displays consisting of three unique representational line drawings arranged in different spatial configurations. Later, while undergoing PET scanning, subjects' memory for spatial location and identity of the objects in the displays was tested and compared to a perceptual baseline task involving the same displays. In comparison to the baseline task, each of the memory tasks activated both the dorsal and the ventral pathways in the right hemisphere but not to an equal extent. There was also activation of the right prefrontal cortex. When PET scans of the memory tasks were compared to each other, areas of activation were very circumscribed and restricted to the right hemisphere: For retrieval of object identity, the area was in the inferior temporal cortex in the region of the fusiform gyrus (area 37), whereas for retrieval of spatial location, it was in the inferior parietal lobule in the region of the supramarginal gyrus (area 40). Thus, our study shows that distinct neural pathways are activated during retrieval of information about spatial location and object identity from long-term memory.

Visual motion perception.

The primate visual motion system performs numerous functions essential for survival in a dynamic visual world. Prominent among these functions is the ability to recover and represent the trajectories of objects in a form that facilitates behavioral responses to those movements. The first step toward this goal, which consists of detecting the displacement of retinal image features, has been studied for many years in both psychophysical and neurobiological experiments. Evidence indicates that achievement of this step is computationally straightforward and occurs at the earliest cortical stage. The second step involves the selective integration of retinal motion signals according to the object of origin. Realization of this step is computationally demanding, as the solution is formally underconstrained. It must rely--by definition--upon utilization of retinal cues that are indicative of the spatial relationships within and between objects in the visual scene. Psychophysical experiments have documented this dependence and suggested mechanisms by which it may be achieved. Neurophysiological experiments have provided evidence for a neural substrate that may underlie this selective motion signal integration. Together they paint a coherent portrait of the means by which retinal image motion gives rise to our perceptual experience of moving objects.

3D visual sensing of human hand for remote operation of a robotic hand

New low cost sensors and open free libraries for 3D image processing are making important advances in robot vision applications possible, such as three-dimensional object recognition, semantic mapping, navigation and localization of robots, human detection and/or gesture recognition for human-machine interaction. In this paper, a novel method for recognizing and tracking the fingers of a human hand is presented. This method is based on point clouds from range images captured by a RGBD sensor. It works in real time and it does not require visual marks, camera calibration or previous knowledge of the environment. Moreover, it works successfully even when multiple objects appear in the scene or when the ambient light is changed. Furthermore, this method was designed to develop a human interface to control domestic or industrial devices, remotely. In this paper, the method was tested by operating a robotic hand. Firstly, the human hand was recognized and the fingers were detected. Secondly, the movement of the fingers was analysed and mapped to be imitated by a robotic hand.

Active Visual Features Based on Events to Guide Robot Manipulators in Tracking Tasks

Traditional visual servoing systems do not deal with the topic of moving objects tracking. When these systems are employed to track a moving object, depending on the object velocity, visual features can go out of the image, causing the fail of the tracking task. This occurs specially when the object and the robot are both stopped and then the object starts the movement. In this work, we have employed a retina camera based on Address Event Representation (AER) in order to use events as input in the visual servoing system. The events launched by the camera indicate a pixel movement. Event visual information is processed only at the moment it occurs, reducing the response time of visual servoing systems when they are used to track moving objects.

Visual perception for the 3D recognition of geometric pieces in robotic manipulation

During grasping and intelligent robotic manipulation tasks, the camera position relative to the scene changes dramatically because the robot is moving to adapt its path and correctly grasp objects. This is because the camera is mounted at the robot effector. For this reason, in this type of environment, a visual recognition system must be implemented to recognize and “automatically and autonomously” obtain the positions of objects in the scene. Furthermore, in industrial environments, all objects that are manipulated by robots are made of the same material and cannot be differentiated by features such as texture or color. In this work, first, a study and analysis of 3D recognition descriptors has been completed for application in these environments. Second, a visual recognition system designed from specific distributed client-server architecture has been proposed to be applied in the recognition process of industrial objects without these appearance features. Our system has been implemented to overcome problems of recognition when the objects can only be recognized by geometric shape and the simplicity of shapes could create ambiguity. Finally, some real tests are performed and illustrated to verify the satisfactory performance of the proposed system.

3D Visual Data-Driven Spatiotemporal Deformations for Non-Rigid Object Grasping Using Robot Hands

Sensing techniques are important for solving problems of uncertainty inherent to intelligent grasping tasks. The main goal here is to present a visual sensing system based on range imaging technology for robot manipulation of non-rigid objects. Our proposal provides a suitable visual perception system of complex grasping tasks to support a robot controller when other sensor systems, such as tactile and force, are not able to obtain useful data relevant to the grasping manipulation task. In particular, a new visual approach based on RGBD data was implemented to help a robot controller carry out intelligent manipulation tasks with flexible objects. The proposed method supervises the interaction between the grasped object and the robot hand in order to avoid poor contact between the fingertips and an object when there is neither force nor pressure data. This new approach is also used to measure changes to the shape of an object’s surfaces and so allows us to find deformations caused by inappropriate pressure being applied by the hand’s fingers. Test was carried out for grasping tasks involving several flexible household objects with a multi-fingered robot hand working in real time. Our approach generates pulses from the deformation detection method and sends an event message to the robot controller when surface deformation is detected. In comparison with other methods, the obtained results reveal that our visual pipeline does not use deformations models of objects and materials, as well as the approach works well both planar and 3D household objects in real time. In addition, our method does not depend on the pose of the robot hand because the location of the reference system is computed from a recognition process of a pattern located place at the robot forearm. The presented experiments demonstrate that the proposed method accomplishes a good monitoring of grasping task with several objects and different grasping configurations in indoor environments.

Avoidance of obstacles in the absence of visual awareness

The spatial character of our reaching movements is extremely sensitive to potential obstacles in the workspace. We recently found that this sensitivity was retained by most patients with left visual neglect when reaching between two objects, despite the fact that they tended to ignore the leftward object when asked to bisect the space between them. This raises the possibility that obstacle avoidance does not require a conscious awareness of the obstacle avoided. We have now tested this hypothesis in a patient with visual extinction following right temporoparietal damage. Extinction is an attentional disorder in which patients fail to report stimuli on the side of space opposite a brain lesion under conditions of bilateral stimulation. Our patient avoided obstacles during reaching, to exactly the same degree, regardless of whether he was able to report their presence. This implicit processing of object location, which may depend on spared superior parietal-lobe pathways, demonstrates that conscious awareness is not necessary for normal obstacle avoidance.

"mind the gap": The size-distance dissociation in visual neglect is a cueing effect

There is a growing body of evidence that the processes mediating the allocation of spatial attention within objects may be separable from those governing attentional distribution between objects. In the neglect literature, a related proposal has been made regarding the perception of (within-object) sizes and (between-object) distances. This proposal follows observations that, in size-matching and bisection tasks, neglect is more strongly expressed when patients are required to attend to the sizes of discrete objects than to the (unfilled) distances between objects. These findings are consistent with a partial dissociation between size and distance processing, but a simpler alternative must also be considered. Whilst a neglect patient may fail to explore the full extent of a solid stimulus, the estimation of an unfilled distance requires that both endpoints be inspected before the task can be attempted at all. The attentional cueing implicit in distance estimation tasks might thus account for their superior performance by neglect patients. We report two bisection studies that address this issue. The first confirmed, amongst patients with left visual neglect, a reliable reduction of rightward error for unfilled gap stimuli as compared with solid lines. The second study assessed the cause of this reduction, deconfounding the effects of stimulus type (lines vs. gaps) and attentional cueing, by applying an explicit cueing manipulation to line and gap bisection tasks. Under these matched cueing conditions, all patients performed similarly on line and gap bisection tasks, suggesting that the reduction of neglect typically observed for gap stimuli may be attributable entirely to cueing effects. We found no evidence that a spatial extent, once fully attended, is judged any differently according to whether it is filled or unfilled.

Associative knowledge controls deployment of visual selective attention

According to some models of visual selective attention, objects in a scene activate corresponding neural representations, which compete for perceptual awareness and motor behavior. During a visual search for a target object, top-down control exerted by working memory representations of the target's defining properties resolves competition in favor of the target. These models, however, ignore the existence of associative links among object representations. Here we show that such associations can strongly influence deployment of attention in humans. In the context of visual search, objects associated with the target were both recalled more often and recognized more accurately than unrelated distractors. Notably, both target and associated objects competitively weakened recognition of unrelated distractors and slowed responses to a luminance probe. Moreover, in a speeded search protocol, associated objects rendered search both slower and less accurate. Finally, the first saccades after onset of the stimulus array were more often directed toward associated than control items.

Visual search for object orientation can be modulated by canonical orientation

The authors studied the influence of canonical orientation on visual search for object orientation. Displays consisted of pictures of animals whose axis of elongation was either vertical or tilted in their canonical orientation. Target orientation could be either congruent or incongruent with the object's canonical orientation. In Experiment 1, vertical canonical targets were detected faster when they were tilted (incongruent) than when they were vertical (congruent). This search asymmetry was reversed for tilted canonical targets. The effect of canonical orientation was partially preserved when objects were high-pass filtered, but it was eliminated when they were low-pass filtered, rendering them as unfamiliar shapes (Experiment 2). The effect of canonical orientation was also eliminated by inverting the objects (Experiment 3) and in a patient with visual agnosia (Experiment 4). These results indicate that orientation search with familiar objects can be modulated by canonical orientation, and they indicate a top-down influence on orientation processing. (PsycINFO Database Record (c) 2010 APA, all rights reserved)

Behavioural and neuroimaging investigations of the relationship between visual attention, affordance and action

In this thesis the relationship between visual attention, affordance and action was investigated using a combination of neuroimaging and behavioural studies. Neuronal activity and movement construction were assessed when individuals passively viewed or produced action towards stimuli varying in their affordance and/or attentional attributes. The main findings were: (i) the passive perception of both object and abstract visual patterns was associated with decreased alpha and/or beta activity in sensori-motor cortex, occipito-temporal cortex and cerebellum. These are brain regions associated with the planning and production of visually guided action; (ii) for object patterns, decreased alpha and beta activity was also observed in regions of superior parietal and premotor cortex. These regions contain neurons argued to be essential for matching hand kinematics with manipulate objects; and (iii) in both control participants and a deafferented individual, studies of planned and unplanned pointing manoeuvres revealed that the attentional bias of a stimulus was critical for fast, efficient action production whereas the affordance bias was critical in determining end-point accuracy. Taken together, these findings demonstrate that affordance is not a necessary prerequisite for the potential of motor codes. Rather, affordance enables the construction of motor responses that reflect object functionality and/or manipulability. They further demonstrate that visual attention is associated with the potentiation of motor codes. Indeed, directed visual attention would appear critical for speeded responses. These findings provide new insights into the roles of directed visual attention and affordance upon action.

The visual cortex in Alzheimer disease:laminar distribution of the pathological changes in visual areas V1 and V2

Alzheimer’s disease (AD) is an important neurodegenerative disorder causing visual problems in the elderly population. The pathology of AD includes the deposition in the brain of abnormal aggregates of ?-amyloid (A?) in the form of senile plaques (SP) and abnormally phosphorylated tau in the form of neurofibrillary tangles (NFT). A variety of visual problems have been reported in patients with AD including loss of visual acuity (VA), colour vision and visual fields; changes in pupillary responses to mydriatics, defects in fixation and in smooth and saccadic eye movements; changes in contrast sensitivity and in visual evoked potentials (VEP); and disturbances in complex visual tasks such as reading, visuospatial function, and in the naming and identification of objects. In addition, pathological changes have been observed to affect the eye, visual pathway, and visual cortex in AD. To better understand degeneration of the visual cortex in AD, the laminar distribution of the SP and NFT was studied in visual areas V1 and V2 in 18 cases of AD which varied in disease onset and duration. In area V1, the mean density of SP and NFT reached a maximum in lamina III and in laminae II and III respectively. In V2, mean SP density was maximal in laminae III and IV and NFT density in laminae II and III. The densities of SP in laminae I of V1 and NFT in lamina IV of V2 were negatively correlated with patient age. No significant correlations were observed in any cortical lamina between the density of NFT and disease onset or duration. However, in area V2, the densities of SP in lamina II and lamina V were negatively correlated with disease duration and disease onset respectively. In addition, there were several positive correlations between the densities of SP and NFT in V1 with those in area V2. The data suggest: (1) NFT pathology is greater in area V2 than V1, (2) laminae II/III of V1 and V2 are most affected by the pathology, (3) the formation of SP and NFT in V1 and V2 are interconnected, and (4) the pathology may spread between visual areas via the feed-forward short cortico-cortical connections.

A penny for your thoughts! Patterns of fMRI activity reveal the content and the spatial topography of visual mental images

Visual mental imagery is a complex process that may be influenced by the content of mental images. Neuropsychological evidence from patients with hemineglect suggests that in the imagery domain environments and objects may be represented separately and may be selectively affected by brain lesions. In the present study, we used functional magnetic resonance imaging (fMRI) to assess the possibility of neural segregation among mental images depicting parts of an object, of an environment (imagined from a first-person perspective), and of a geographical map, using both a mass univariate and a multivariate approach. Data show that different brain areas are involved in different types of mental images. Imagining an environment relies mainly on regions known to be involved in navigational skills, such as the retrosplenial complex and parahippocampal gyrus, whereas imagining a geographical map mainly requires activation of the left angular gyrus, known to be involved in the representation of categorical relations. Imagining a familiar object mainly requires activation of parietal areas involved in visual space analysis in both the imagery and the perceptual domain. We also found that the pattern of activity in most of these areas specifically codes for the spatial arrangement of the parts of the mental image. Our results clearly demonstrate a functional neural segregation for different contents of mental images and suggest that visuospatial information is coded by different patterns of activity in brain areas involved in visual mental imagery. Hum Brain Mapp 36:945-958, 2015.

Visual hallucinations in the Parkinsonian syndromes

Differential clinical diagnosis of the parkinsonian syndromes,viz., Parkinson's disease (PD), progressive supranuclear palsy (PSP), dementia with Lewy bodies (DLB), multiple system atrophy (MSA), and corticobasal degeneration (CBD) can be difficult. Visual hallucinations, however, are a chronic complication of some parkinsonian disorders and their presence may be a useful aid to diagnosis. The visual hallucinations in parkinsonism are often recurrent, well-formed, and detailed and occur in a significant proportion of cases of DLB and PD but are less common in PSP, MSA, and CBD. Hallucinations in PD often occur later in the disease and are complex, with flickering lights, and illusionary misconceptions often preceding the most common manifestation, viz., stereotypical colourful images. Hallucinations in DLB, however, are often present earlier in the disease and are similar to those in the 'misidentification syndromes', 'visual agnosias', and in 'delerium' but differ from those produced by hallucinogenic drugs such as LSD. Most typically in DLB, the hallucinations involve people or animals invading the patient's home but may also include inanimate objects and the appearance of writing on walls or ceilings. Visual hallucinations may involve a number of brain mechanisms including a change in the balance of neurotransmitter activity between the cholinergic and monoaminergic systems and may be a specific consequence of Lewy body (LB) pathology in brain stem nuclei. Ocular and retinal pathology may also contribute to hallucinations by reducing occipital stimulation. Hence, in patients with unclassifiable or with indeterminate parkinsonian symptoms, the presence of visual hallucinations should be regarded as a 'red flag' symptom indicating underlying Lewy body pathology and therefore, supporting a diagnosis of PD or DLB rather than PSP, MSA, or CBD. The presence of early visual hallucinations would support a diagnosis of DLB rather than PD. © 2013 Nova Science Publishers, Inc. All rights reserved.

Retrieval of implicit inhibitory processes:the impact of visual field, object-identity, and memory dynamics

After exogenously cueing attention to a peripheral location, the return of attention and response to the location can be inhibited. We demonstrate that these inhibitory mechanisms of attention can be associated with objects and can be automatically and implicitly retrieved over relatively long periods. Furthermore, we also show that when face stimuli are associated with inhibition, the effect is more robust for faces presented in the left visual field. This effect can be even more spatially specific, where most robust inhibition is obtained for faces presented in the upper as compared to the lower visual field. Finally, it is revealed that the inhibition is associated with an object’s identity, as inhibition moves with an object to a new location; and that the retrieved inhibition is only transiently present after retrieval.