Binocular visual surface perception.

Binocular disparity, the differential angular separation between pairs of image points in the two eyes, is the well-recognized basis for binocular distance perception. Without denying disparity's role in perceiving depth, we describe two perceptual phenomena, which indicate that a wider view of binocular vision is warranted. First, we show that disparity can play a critical role in two-dimensional perception by determining whether separate image fragments should be grouped as part of a single surface or segregated as parts of separate surfaces. Second, we show that stereoscopic vision is not limited to the registration and interpretation of binocular disparity but that it relies on half-occluded points, visible to one eye and not the other, to determine the layout and transparency of surfaces. Because these half-visible points are coded by neurons carrying eye-of-origin information, we suggest that the perception of these surface properties depends on neural activity available at visual cortical area V1.

Binocular vision in insects: How mantids solve the correspondence problem

Praying mantids use binocular cues to judge whether their prey is in striking distance. When there are several moving targets within their binocular visual field, mantids need to solve the correspondence problem. They must select between the possible pairings of retinal images in the two eyes so that they can strike at a single real target. In this study, mantids were presented with two targets in various configurations, and the resulting fixating saccades that precede the strike were analyzed. The distributions of saccades show that mantids consistently prefer one out of several possible matches. Selection is in part guided by the position and the spatiotemporal features of the target image in each eye. Selection also depends upon the binocular disparity of the images, suggesting that insects can perform local binocular computations. The pairing rules ensure that mantids tend to aim at real targets and not at “ghost” targets arising from false matches.

Neural fate of seen and unseen faces in visuospatial neglect: A combined event-related functional MRI and event-related potential study

To compare neural activity produced by visual events that escape or reach conscious awareness, we used event-related MRI and evoked potentials in a patient who had neglect and extinction after focal right parietal damage, but intact visual fields. This neurological disorder entails a loss of awareness for stimuli in the field contralateral to a brain lesion when stimuli are simultaneously presented on the ipsilateral side, even though early visual areas may be intact, and single contralateral stimuli may still be perceived. Functional MRI and event-related potential study were performed during a task where faces or shapes appeared in the right, left, or both fields. Unilateral stimuli produced normal responses in V1 and extrastriate areas. In bilateral events, left faces that were not perceived still activated right V1 and inferior temporal cortex and evoked nonsignificantly reduced N1 potentials, with preserved face-specific negative potentials at 170 ms. When left faces were perceived, the same stimuli produced greater activity in a distributed network of areas including right V1 and cuneus, bilateral fusiform gyri, and left parietal cortex. Also, effective connectivity between visual, parietal, and frontal areas increased during perception of faces. These results suggest that activity can occur in V1 and ventral temporal cortex without awareness, whereas coupling with dorsal parietal and frontal areas may be critical for such activity to afford conscious perception.

Shift in speed selectivity of visual cortical neurons: A neural basis of perceived motion contrast

The perceived speed of motion in one part of the visual field is influenced by the speed of motion in its surrounding fields. Little is known about the cellular mechanisms causing this phenomenon. Recordings from mammalian visual cortex revealed that speed preference of the cortical cells could be changed by displaying a contrast speed in the field surrounding the cell’s classical receptive field. The neuron’s selectivity shifted to prefer faster speed if the contextual surround motion was set at a relatively lower speed, and vice versa. These specific center–surround interactions may underlie the perceptual enhancement of speed contrast between adjacent fields.

Excitatory–inhibitory network in the visual cortex: Psychophysical evidence

At early stages in visual processing cells respond to local stimuli with specific features such as orientation and spatial frequency. Although the receptive fields of these cells have been thought to be local and independent, recent physiological and psychophysical evidence has accumulated, indicating that the cells participate in a rich network of local connections. Thus, these local processing units can integrate information over much larger parts of the visual field; the pattern of their response to a stimulus apparently depends on the context presented. To explore the pattern of lateral interactions in human visual cortex under different context conditions we used a novel chain lateral masking detection paradigm, in which human observers performed a detection task in the presence of different length chains of high-contrast-flanked Gabor signals. The results indicated a nonmonotonic relation of the detection threshold with the number of flankers. Remote flankers had a stronger effect on target detection when the space between them was filled with other flankers, indicating that the detection threshold is caused by dynamics of large neuronal populations in the neocortex, with a major interplay between excitation and inhibition. We considered a model of the primary visual cortex as a network consisting of excitatory and inhibitory cell populations, with both short- and long-range interactions. The model exhibited a behavior similar to the experimental results throughout a range of parameters. Experimental and modeling results indicated that long-range connections play an important role in visual perception, possibly mediating the effects of context.

Memory fields of neurons in the primate prefrontal cortex

Many prefrontal (PF) neurons convey information about both an object’s identity (what) and its location (where). To explore how they represent conjunctions of what and where, we explored the receptive fields of their mnemonic activity (i.e., their “memory fields”) by requiring monkeys to remember both an object and its location at many positions throughout a wide portion of central vision. Many PF neurons conveyed object information and had highly localized memory fields that emphasized the contralateral, but not necessarily foveal, visual field. These results indicate that PF neurons can simultaneously convey precise location and object information and thus may play a role in constructing a unified representation of a visual scene.

Neural mechanisms underlying binocular fusion and stereopsis: Position vs. phase

The visual system utilizes binocular disparity to discriminate the relative depth of objects in space. Since the striate cortex is the first site along the central visual pathways at which signals from the left and right eyes converge onto a single neuron, encoding of binocular disparity is thought to begin in this region. There are two possible mechanisms for encoding binocular disparity through simple cells in the striate cortex: a difference in receptive field (RF) position between the two eyes (RF position disparity) and a difference in RF profile between the two eyes (RF phase disparity). Although there have been studies supporting each of the two encoding mechanisms, both mechanisms have not been examined in a single study. Therefore, the relative roles of the two mechanisms have not been determined. To address this issue, we have mapped left and right eye RFs of simple cells in the cat’s striate cortex using binary m-sequence noise, and then we have estimated RF position and phase disparities. We find that RF position disparities are generally limited to small values that are not sufficient to encode large binocular disparities. In contrast, RF phase disparities cover a wide range of binocular disparities and exhibit dependencies on orientation and spatial frequency in a manner expected for a mechanism that encodes binocular disparity. These results indicate that binocular disparity is mainly encoded through RF phase disparity. However, RF position disparity may play a significant role for cells with high spatial frequency selectivity, which are constrained to small RF phase disparities.

Synchronization of oscillatory responses in visual cortex correlates with perception in interocular rivalry

In subjects suffering from early onset strabismus, signals conveyed by the two eyes are not perceived simultaneously but in alternation. We exploited this phenomenon of interocular suppression to investigate the neuronal correlate of binocular rivalry in primary visual cortex of awake strabismic cats. Monocularly presented stimuli that were readily perceived by the animal evoked synchronized discharges with an oscillatory patterning in the γ-frequency range. Upon dichoptic stimulation, neurons responding to the stimulus that continued to be perceived increased the synchronicity and the regularity of their oscillatory patterning while the reverse was true for neurons responding to the stimulus that was no longer perceived. These differential changes were not associated with modifications of discharge rate, suggesting that at early stages of visual processing the degree of synchronicity rather than the amplitude of responses determines which signals are perceived and control behavioral responses.

N-methyl-d-aspartate receptor activation and visual activity induce elongation factor-2 phosphorylation in amphibian tecta: A role for N-methyl-d-aspartate receptors in controlling protein synthesis

N-methyl-d-aspartate receptor (NMDAR) activation has been implicated in forms of synaptic plasticity involving long-term changes in neuronal structure, function, or protein expression. Transcriptional alterations have been correlated with NMDAR-mediated synaptic plasticity, but the problem of rapidly targeting new proteins to particular synapses is unsolved. One potential solution is synapse-specific protein translation, which is suggested by dendritic localization of numerous transcripts and subsynaptic polyribosomes. We report here a mechanism by which NMDAR activation at synapses may control this protein synthetic machinery. In intact tadpole tecta, NMDAR activation leads to phosphorylation of a subset of proteins, one of which we now identify as the eukaryotic translation elongation factor 2 (eEF2). Phosphorylation of eEF2 halts protein synthesis and may prepare cells to translate a new set of mRNAs. We show that NMDAR activation-induced eEF2 phosphorylation is widespread in tadpole tecta. In contrast, in adult tecta, where synaptic plasticity is reduced, this phosphorylation is restricted to short dendritic regions that process binocular information. Biochemical and anatomical evidence shows that this NMDAR activation-induced eEF2 phosphorylation is localized to subsynaptic sites. Moreover, eEF2 phosphorylation is induced by visual stimulation, and NMDAR blockade before stimulation eliminates this effect. Thus, NMDAR activation, which is known to mediate synaptic changes in the developing frog, could produce local postsynaptic alterations in protein synthesis by inducing eEF2 phosphorylation.

Requirement of the nicotinic acetylcholine receptor β2 subunit for the anatomical and functional development of the visual system

In the mammalian visual system the formation of eye-specific layers at the thalamic level depends on retinal waves of spontaneous activity, which rely on nicotinic acetylcholine receptor activation. We found that in mutant mice lacking the β2 subunit of the neuronal nicotinic receptor, but not in mice lacking the α4 subunit, retinofugal projections do not segregate into eye-specific areas, both in the dorso-lateral geniculate nucleus and in the superior colliculus. Moreover, β2−/− mice show an expansion of the binocular subfield of the primary visual cortex and a decrease in visual acuity at the cortical level but not in the retina. We conclude that the β2 subunit of the nicotinic acetylcholine receptor is necessary for the anatomical and functional development of the visual system.

Lightness constancy in primary visual cortex

When the illumination of a visual scene changes, the quantity of light reflected from objects is altered. Despite this, the perceived lightness of the objects generally remains constant. This perceptual lightness constancy is thought to be important behaviorally for object recognition. Here we show that interactions from outside the classical receptive fields of neurons in primary visual cortex modulate neural responses in a way that makes them immune to changes in illumination, as is perception. This finding is consistent with the hypothesis that the responses of neurons in primary visual cortex carry information about surface lightness in addition to information about form. It also suggests that lightness constancy, which is sometimes thought to involve “higher-level” processes, is manifest at the first stage of visual cortical processing.

Subthreshold facilitation and suppression in primary visual cortex revealed by intrinsic signal imaging.

Neurons in primary visual cortex (area 17) respond vigorously to oriented stimuli within their receptive fields; however, stimuli presented outside the suprathreshold receptive field can also influence their responses. Here we describe a fundamental feature of the spatial interaction between suprathreshold center and subthreshold surround. By optical imaging of intrinsic signals in area 17 in response to a stimulus border, we show that a given stimulus generates activity primarily in iso-orientation domains, which extend for several millimeters across the cortical surface in a manner consistent with the architecture of long-range horizontal connections in area 17. By mapping the receptive fields of single neurons and imaging responses from the same cortex to stimuli that include or exclude the aggregate suprathreshold receptive field, we show that intrinsic signals strongly reveal the subthreshold surround contribution. Optical imaging and single-unit recording both demonstrate that the relative contrast of center and surround stimuli regulates whether surround interactions are facilitative or suppressive: the same surround stimulus facilitates responses when center contrast is low, but suppresses responses when center contrast is high. Such spatial interactions in area 17 are ideally suited to contribute to phenomena commonly regarded as part of "higher-level" visual processing, such as perceptual "popout" and "filling-in."

Temporal events in cyclopean vision.

The majority of neurons in the primary visual cortex of primates can be activated by stimulation of either eye; moreover, the monocular receptive fields of such neurons are located in about the same region of visual space. These well-known facts imply that binocular convergence in visual cortex can explain our cyclopean view of the world. To test the adequacy of this assumption, we examined how human subjects integrate binocular events in time. Light flashes presented synchronously to both eyes were compared to flashes presented alternately (asynchronously) to one eye and then the other. Subjects perceived very-low-frequency (2 Hz) asynchronous trains as equivalent to synchronous trains flashed at twice the frequency (the prediction based on binocular convergence). However, at higher frequencies of presentation (4-32 Hz), subjects perceived asynchronous and synchronous trains to be increasingly similar. Indeed, at the flicker-fusion frequency (approximately 50 Hz), the apparent difference between the two conditions was only 2%. We suggest that the explanation of these anomalous findings is that we parse visual input into sequential episodes.

Spatial integration and cortical dynamics.

Cells in adult primary visual cortex are capable of integrating information over much larger portions of the visual field than was originally thought. Moreover, their receptive field properties can be altered by the context within which local features are presented and by changes in visual experience. The substrate for both spatial integration and cortical plasticity is likely to be found in a plexus of long-range horizontal connections, formed by cortical pyramidal cells, which link cells within each cortical area over distances of 6-8 mm. The relationship between horizontal connections and cortical functional architecture suggests a role in visual segmentation and spatial integration. The distribution of lateral interactions within striate cortex was visualized with optical recording, and their functional consequences were explored by using comparable stimuli in human psychophysical experiments and in recordings from alert monkeys. They may represent the substrate for perceptual phenomena such as illusory contours, surface fill-in, and contour saliency. The dynamic nature of receptive field properties and cortical architecture has been seen over time scales ranging from seconds to months. One can induce a remapping of the topography of visual cortex by making focal binocular retinal lesions. Shorter-term plasticity of cortical receptive fields was observed following brief periods of visual stimulation. The mechanisms involved entailed, for the short-term changes, altering the effectiveness of existing cortical connections, and for the long-term changes, sprouting of axon collaterals and synaptogenesis. The mutability of cortical function implies a continual process of calibration and normalization of the perception of visual attributes that is dependent on sensory experience throughout adulthood and might further represent the mechanism of perceptual learning.

Spatial heterogeneity of inhibitory surrounds in the middle temporal visual area.

A recurrent theme in the organization of vertebrate visual cortex is that of receptive fields with an associated "silent" opponency component. In the middle temporal area (area MT), a cortical visual area involved in the analysis of retinal motion in primates, this opponency appears in the form of a region outside the classical receptive field (CRF) that in itself gives no response but suppresses responses to motion evoked within the CRF. This antagonistic motion surround has been described as very large and symmetrically arrayed around the CRF. On the basis of this view, the primary function of the surround has long been thought to consist of simple figure-ground segregation based on movement. We have made use of small stimulus patches to map the form and extent of the surround and find evidence that the surround inhibition of many MT cells is in fact confined to restricted regions on one side or on opposite sides of the CRF. Such regions endow MT cells with the ability to make local-to-local motion comparisons, capable of extracting more complex features from the visual environment, and as such, may be better viewed as intrinsic parts of the receptive field, rather than as separate entities responsible for local-to-global comparisons.