Faithful representation of similarities among three-dimensional shapes in human vision.

Efficient and reliable classification of visual stimuli requires that their representations reside a low-dimensional and, therefore, computationally manageable feature space. We investigated the ability of the human visual system to derive such representations from the sensory input-a highly nontrivial task, given the million or so dimensions of the visual signal at its entry point to the cortex. In a series of experiments, subjects were presented with sets of parametrically defined shapes; the points in the common high-dimensional parameter space corresponding to the individual shapes formed regular planar (two-dimensional) patterns such as a triangle, a square, etc. We then used multidimensional scaling to arrange the shapes in planar configurations, dictated by their experimentally determined perceived similarities. The resulting configurations closely resembled the original arrangements of the stimuli in the parameter space. This achievement of the human visual system was replicated by a computational model derived from a theory of object representation in the brain, according to which similarities between objects, and not the geometry of each object, need to be faithfully represented.

Selective attention to stimulus location modulates the steady-state visual evoked potential.

Steady-state visual evoked potentials (SSVEPs) were recorded from the scalp of human subjects who were cued to attend to a rapid sequence of alphanumeric characters presented to one visual half-field while ignoring a concurrent sequence of characters in the opposite half-field. These two-character sequences were each superimposed upon a small square background that was flickered at a rate of 8.6 Hz in one half-field and 12 Hz in the other half-field. The amplitude of the frequency-coded SSVEP elicited by either of the task-irrelevant flickering backgrounds was significantly enlarged when attention was focused upon the character sequence at the same location. This amplitude enhancement with attention was most prominent over occipital-temporal scalp areas of the right cerebral hemisphere regardless of the visual field of stimulation. These findings indicate that the SSVEP reflects an enhancement of neural responses to all stimuli that fall within the "spotlight" of spatial attention, whether or not the stimuli are task-relevant. Recordings of the SSVEP provide a new approach for studying the neural mechanisms and functional properties of selective attention to multi-element visual displays.

Activity of primate inferotemporal neurons related to a sought target in pair-association task.

Visual long-term memory in primates has been assessed by using the pair-association (PA) task, in which a subject retrieves and chooses the paired associate of a cue picture. Our previous studies on single neurons in the anterior inferotemporal (AIT) cortex suggested their roles in representing paired associates in the mind. To test the possibility that the delay activity of AIT neurons is related to a particular picture as a sought target, we devised the PA with color switch (PACS) task. In the PACS task, the necessity for memory retrieval and its initiation time were controlled by a color switch in the middle of the delay period. A control task, in which there is no color switch, corresponds to the conventional delayed matching-to-sample (DMS) task where the monkey chooses the same picture as a cue. We found that AIT neurons started to respond just after the color switch in the PACS task, when the cue-optimal picture's associate was presented as a cue. In contrast, they showed no response change in the DMS task. We confirmed that this effect is not due to the visual response to colors. Furthermore, when the cue-optimal picture was presented as a cue, these neurons showed suppression after the color switch in the PACS task. These results suggest that the activity of AIT neurons mediates gating mechanisms that preferentially pass information about a sought target, even when the sought target is retrieved from long-term memory.

Identification of a Drosophila G protein alpha subunit (dGq alpha-3) expressed in chemosensory cells and central neurons.

We have identified another Drosophila GTP-binding protein (G protein) alpha subunit, dGq alpha-3. Transcripts encoding dGq alpha-3 are derived from alternative splicing of the dGq alpha locus previously shown to encode two visual-system-specific transcripts [Lee, Y.-J., Dobbs, M.B., Verardi, M.L. & Hyde, D.R. (1990) Neuron 5, 889-898]. Immunolocalization studies using dGq alpha-3 isoform-specific antibodies and LacZ fusion genes show that dGq alpha-3 is expressed in chemosensory cells of the olfactory and taste structures, including a subset of olfactory and gustatory neurons, and in cells of the central nervous system, including neurons in the lamina ganglionaris. These data are consistent with a variety of roles for dGq alpha-3, including mediating a subset of olfactory and gustatory responses in Drosophila, and supports the idea that some chemosensory responses use G protein-coupled receptors and the second messenger inositol 1,4,5-trisphosphate.

Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex.

The stages of integration leading from local feature analysis to object recognition were explored in human visual cortex by using the technique of functional magnetic resonance imaging. Here we report evidence for object-related activation. Such activation was located at the lateral-posterior aspect of the occipital lobe, just abutting the posterior aspect of the motion-sensitive area MT/V5, in a region termed the lateral occipital complex (LO). LO showed preferential activation to images of objects, compared to a wide range of texture patterns. This activation was not caused by a global difference in the Fourier spatial frequency content of objects versus texture images, since object images produced enhanced LO activation compared to textures matched in power spectra but randomized in phase. The preferential activation to objects also could not be explained by different patterns of eye movements: similar levels of activation were observed when subjects fixated on the objects and when they scanned the objects with their eyes. Additional manipulations such as spatial frequency filtering and a 4-fold change in visual size did not affect LO activation. These results suggest that the enhanced responses to objects were not a manifestation of low-level visual processing. A striking demonstration that activity in LO is uniquely correlated to object detectability was produced by the "Lincoln" illusion, in which blurring of objects digitized into large blocks paradoxically increases their recognizability. Such blurring led to significant enhancement of LO activation. Despite the preferential activation to objects, LO did not seem to be involved in the final, "semantic," stages of the recognition process. Thus, objects varying widely in their recognizability (e.g., famous faces, common objects, and unfamiliar three-dimensional abstract sculptures) activated it to a similar degree. These results are thus evidence for an intermediate link in the chain of processing stages leading to object recognition in human visual cortex.

The deferred imitation task as a nonverbal measure of declarative memory.

We tested amnesic patients, patients with frontal lobe lesions, and control subjects with the deferred imitation task, a nonverbal test used to demonstrate memory abilities in human infants. On day 1, subjects were given sets of objects to obtain a baseline measure of their spontaneous performance of target actions. Then different event sequences were modeled with the object sets. On day 2, the objects were given to the subjects again, first without any instructions to imitate the sequences, and then with explicit instructions to imitate the actions exactly as they had been modeled. Control subjects and frontal lobe patients reproduced the events under both uninstructed and instructed conditions. In contrast, performance by the amnesic patients did not significantly differ from that of a second control group who had the same opportunities to handle the objects but were not shown the modeled actions. These findings suggest that deferred imitation is dependent on the brain structures essential for declarative memory that are damaged in amnesia, and they support the view that infants who imitate actions after long delays have an early capacity for long-term declarative memory.

Parameters affecting conscious versus unconscious visual discrimination with damage to the visual cortex (V1).

When the visual (striate) cortex (V1) is damaged in human subjects, cortical blindness results in the contralateral visual half field. Nevertheless, under some experimental conditions, subjects demonstrate a capacity to make visual discriminations in the blind hemifield (blindsight), even though they have no phenomenal experience of seeing. This capacity must, therefore, be mediated by parallel projections to other brain areas. It is also the case that some subjects have conscious residual vision in response to fast moving stimuli or sudden changes in light flux level presented to the blind hemifield, characterized by a contentless kind of awareness, a feeling of something happening, albeit not normal seeing. The relationship between these two modes of discrimination has never been studied systematically. We examine, in the same experiment, both the unconscious discrimination and the conscious visual awareness of moving stimuli in a subject with unilateral damage to V1. The results demonstrate an excellent capacity to discriminate motion direction and orientation in the absence of acknowledged perceptual awareness. Discrimination of the stimulus parameters for acknowledged awareness apparently follows a different functional relationship with respect to stimulus speed, displacement, and stimulus contrast. As performance in the two modes can be quantitatively matched, the findings suggest that it should be possible to image brain activity and to identify the active areas involved in the same subject performing the same discrimination task, both with and without conscious awareness, and hence to determine whether any structures contribute uniquely to conscious perception.

Visual motion perception.

The primate visual motion system performs numerous functions essential for survival in a dynamic visual world. Prominent among these functions is the ability to recover and represent the trajectories of objects in a form that facilitates behavioral responses to those movements. The first step toward this goal, which consists of detecting the displacement of retinal image features, has been studied for many years in both psychophysical and neurobiological experiments. Evidence indicates that achievement of this step is computationally straightforward and occurs at the earliest cortical stage. The second step involves the selective integration of retinal motion signals according to the object of origin. Realization of this step is computationally demanding, as the solution is formally underconstrained. It must rely--by definition--upon utilization of retinal cues that are indicative of the spatial relationships within and between objects in the visual scene. Psychophysical experiments have documented this dependence and suggested mechanisms by which it may be achieved. Neurophysiological experiments have provided evidence for a neural substrate that may underlie this selective motion signal integration. Together they paint a coherent portrait of the means by which retinal image motion gives rise to our perceptual experience of moving objects.