A wholly empirical explanation of perceived motion

Because the retinal activity generated by a moving object cannot specify which of an infinite number of possible physical displacements underlies the stimulus, its real-world cause is necessarily uncertain. How, then, do observers respond successfully to sequences of images whose provenance is ambiguous? Here we explore the hypothesis that the visual system solves this problem by a probabilistic strategy in which perceived motion is generated entirely according to the relative frequency of occurrence of the physical sources of the stimulus. The merits of this concept were tested by comparing the directions and speeds of moving lines reported by subjects to the values determined by the probability distribution of all the possible physical displacements underlying the stimulus. The velocities reported by observers in a variety of stimulus contexts can be accounted for in this way.

Parallel detection of violations of color constancy

The perceived colors of reflecting surfaces generally remain stable despite changes in the spectrum of the illuminating light. This color constancy can be measured operationally by asking observers to distinguish illuminant changes on a scene from changes in the reflecting properties of the surfaces comprising it. It is shown here that during fast illuminant changes, simultaneous changes in spectral reflectance of one or more surfaces in an array of other surfaces can be readily detected almost independent of the numbers of surfaces, suggesting a preattentive, spatially parallel process. This process, which is perfect over a spatial window delimited by the anatomical fovea, may form an early input to a multistage analysis of surface color, providing the visual system with information about a rapidly changing world in advance of the generation of a more elaborate and stable perceptual representation.

Faithful representation of similarities among three-dimensional shapes in human vision.

Efficient and reliable classification of visual stimuli requires that their representations reside a low-dimensional and, therefore, computationally manageable feature space. We investigated the ability of the human visual system to derive such representations from the sensory input-a highly nontrivial task, given the million or so dimensions of the visual signal at its entry point to the cortex. In a series of experiments, subjects were presented with sets of parametrically defined shapes; the points in the common high-dimensional parameter space corresponding to the individual shapes formed regular planar (two-dimensional) patterns such as a triangle, a square, etc. We then used multidimensional scaling to arrange the shapes in planar configurations, dictated by their experimentally determined perceived similarities. The resulting configurations closely resembled the original arrangements of the stimuli in the parameter space. This achievement of the human visual system was replicated by a computational model derived from a theory of object representation in the brain, according to which similarities between objects, and not the geometry of each object, need to be faithfully represented.

Psychophysical evidence for fast region-based segmentation processes in motion and color.

Theories of image segmentation suggest that the human visual system may use two distinct processes to segregate figure from background: a local process that uses local feature contrasts to mark borders of coherent regions and a global process that groups similar features over a larger spatial scale. We performed psychophysical experiments to determine whether and to what extent the global similarity process contributes to image segmentation by motion and color. Our results show that for color, as well as for motion, segmentation occurs first by an integrative process on a coarse spatial scale, demonstrating that for both modalities the global process is faster than one based on local feature contrasts. Segmentation by motion builds up over time, whereas segmentation by color does not, indicating a fundamental difference between the modalities. Our data suggest that segmentation by motion proceeds first via a cooperative linking over space of local motion signals, generating almost immediate perceptual coherence even of physically incoherent signals. This global segmentation process occurs faster than the detection of absolute motion, providing further evidence for the existence of two motion processes with distinct dynamic properties.

Neural plasticity in adults with amblyopia.

Amblyopia is a neuronal abnormality of vision that is often considered irreversible in adults. We found strong and significant improvement of Vernier acuity in human adults with naturally occurring amblyopia following practice. Learning was strongest at the trained orientation and did not transfer to an untrained task (detection), but it did transfer partially to the untrained eye (primarily at the trained orientation). We conclude that this perceptual learning reflects alterations in early neural processes that are localized beyond the site of convergence of the two eyes. Our results suggest a significant degree of plasticity in the visual system of adults with amblyopia.

Magnetic resonance imaging (MRI) detection of the murine brain response to light: temporal differentiation and negative functional MRI changes.

Using a 9.4 T MRI instrument, we have obtained images of the mouse brain response to photic stimulation during a period between deep anesthesia and the early stages of arousal. The large image enhancements we observe (often >30%) are consistent with literature results extrapolated to 9.4 T. However, there are also two unusual aspects to our findings. (i) The visual area of the brain responds only to changes in stimulus intensity, suggesting that we directly detect operations of the M visual system pathway. Such a channel has been observed in mice by invasive electrophysiology, and described in detail for primates. (ii) Along with the typical positive response in the area of the occipital portion of the brain containing the visual cortex, another area displays decreased signal intensity upon stimulation.

Evolution of GABAergic circuitry in the mammalian medial geniculate body.

Many features in the mammalian sensory thalamus, such as the types of neurons, their connections, or their neurotransmitters, are conserved in evolution. We found a wide range in the proportion of gamma-aminobutyric acidergic (GABAergic) neurons in the medial geniculate body, from <1% (bat and rat) to 25% or more (cat and monkey). In the bat, some medial geniculate body subdivisions have no GABAergic cells. Species-specific variation also occurs in the somesthetic ventrobasal complex. In contrast, the lateral geniculate body of the visual system has about the same proportion of GABAergic cells in many species. In the central auditory pathway, only the medial geniculate body shows this arrangement; the relative number of GABAergic cells in the inferior colliculus and auditory cortex is similar in each species. The range in the proportion of GABAergic neurons suggests that there are comparative differences in the neural circuitry for thalamic inhibition. We conclude that the number of GABAergic neurons in thalamic sensory nuclei may have evolved independently or divergently in phylogeny. Perhaps these adaptations reflect neurobehavioral requirements for more complex, less stereotyped processing, as in speech-like communication.

How photons start vision.

Recent studies have elucidated how the absorption of a photon in a rod or cone cell leads to the generation of the amplified neural signal that is transmitted to higher-order visual neurons. Photoexcited visual pigment activates the GTP-binding protein transducin, which in turn stimulates cGMP phosphodiesterase. This enzyme hydrolyzes cGMP, allowing cGMP-gated cationic channels in the surface membrane to close, hyperpolarize the cell, and modulate transmitter release at the synaptic terminal. The kinetics of reactions in the cGMP cascade limit the temporal resolution of the visual system as a whole, while statistical fluctuations in the reactions limit the reliability of detection of dim light. Much interest now focuses on the processes that terminate the light response and dynamically regulate amplification in the cascade, causing the single photon response to be reproducible and allowing the cell to adapt in background light. A light-induced fall in the internal free Ca2+ concentration coordinates negative feedback control of amplification. The fall in Ca2+ stimulates resynthesis of cGMP, antagonizes rhodopsin's catalytic activity, and increases the affinity of the light-regulated cationic channel for cGMP. We are using physiological methods to study the molecular mechanisms that terminate the flash response and mediate adaptation. One approach is to observe transduction in truncated, dialyzed photoreceptor cells whose internal Ca2+ and nucleotide concentrations are under experimental control and to which exogenous proteins can be added. Another approach is to observe transduction in transgenic mouse rods in which specific proteins within the cascade are altered or deleted.

Motion perception: seeing and deciding.

The primate visual system offers unprecedented opportunities for investigating the neural basis of cognition. Even the simplest visual discrimination task requires processing of sensory signals, formation of a decision, and orchestration of a motor response. With our extensive knowledge of the primate visual and oculomotor systems as a base, it is now possible to investigate the neural basis of simple visual decisions that link sensation to action. Here we describe an initial study of neural responses in the lateral intraparietal area (LIP) of the cerebral cortex while alert monkeys discriminated the direction of motion in a visual display. A subset of LIP neurons carried high-level signals that may comprise a neural correlate of the decision process in our task. These signals are neither sensory nor motor in the strictest sense; rather they appear to reflect integration of sensory signals toward a decision appropriate for guiding movement. If this ultimately proves to be the case, several fascinating issues in cognitive neuroscience will be brought under rigorous physiological scrutiny.

Identification of a Drosophila G protein alpha subunit (dGq alpha-3) expressed in chemosensory cells and central neurons.

We have identified another Drosophila GTP-binding protein (G protein) alpha subunit, dGq alpha-3. Transcripts encoding dGq alpha-3 are derived from alternative splicing of the dGq alpha locus previously shown to encode two visual-system-specific transcripts [Lee, Y.-J., Dobbs, M.B., Verardi, M.L. & Hyde, D.R. (1990) Neuron 5, 889-898]. Immunolocalization studies using dGq alpha-3 isoform-specific antibodies and LacZ fusion genes show that dGq alpha-3 is expressed in chemosensory cells of the olfactory and taste structures, including a subset of olfactory and gustatory neurons, and in cells of the central nervous system, including neurons in the lamina ganglionaris. These data are consistent with a variety of roles for dGq alpha-3, including mediating a subset of olfactory and gustatory responses in Drosophila, and supports the idea that some chemosensory responses use G protein-coupled receptors and the second messenger inositol 1,4,5-trisphosphate.

A neural system for human visual working memory

Working memory is the process of actively maintaining a representation of information for a brief period of time so that it is available for use. In monkeys, visual working memory involves the concerted activity of a distributed neural system, including posterior areas in visual cortex and anterior areas in prefrontal cortex. Within visual cortex, ventral stream areas are selectively involved in object vision, whereas dorsal stream areas are selectively involved in spatial vision. This domain specificity appears to extend forward into prefrontal cortex, with ventrolateral areas involved mainly in working memory for objects and dorsolateral areas involved mainly in working memory for spatial locations. The organization of this distributed neural system for working memory in monkeys appears to be conserved in humans, though some differences between the two species exist. In humans, as compared with monkeys, areas specialized for object vision in the ventral stream have a more inferior location in temporal cortex, whereas areas specialized for spatial vision in the dorsal stream have a more superior location in parietal cortex. Displacement of both sets of visual areas away from the posterior perisylvian cortex may be related to the emergence of language over the course of brain evolution. Whereas areas specialized for object working memory in humans and monkeys are similarly located in ventrolateral prefrontal cortex, those specialized for spatial working memory occupy a more superior and posterior location within dorsal prefrontal cortex in humans than in monkeys. As in posterior cortex, this displacement in frontal cortex also may be related to the emergence of new areas to serve distinctively human cognitive abilities.

The visual response of retinal ganglion cells is not altered by optic nerve transection in transgenic mice overexpressing Bcl-2

Attempts to rescue retinal ganglion cells from retrograde degeneration have had limited success, and the residual function of surviving neurons is not known. Recently, it has been found that axotomized retinal ganglion cells die by apoptotic mechanisms. We have used adult transgenic mice overexpressing the Bcl-2 protein, a powerful inhibitor of apoptosis, as a model for preventing injury-induced cell death in vivo. Several months after axotomy, the majority of retinal ganglion cells survived and exhibited normal visual responses. In control wild-type mice, the vast majority of axotomized retinal ganglion cells degenerated, and the physiological responses were abolished. These results suggest that strategies aimed at increasing Bcl-2 expression, or mimicking its function, might effectively counteract trauma-induced cell death in the central nervous system. Neuronal survival is a necessary condition in the challenge for promoting regeneration and eventually restoring neuronal function.

Visual motion perception.

The primate visual motion system performs numerous functions essential for survival in a dynamic visual world. Prominent among these functions is the ability to recover and represent the trajectories of objects in a form that facilitates behavioral responses to those movements. The first step toward this goal, which consists of detecting the displacement of retinal image features, has been studied for many years in both psychophysical and neurobiological experiments. Evidence indicates that achievement of this step is computationally straightforward and occurs at the earliest cortical stage. The second step involves the selective integration of retinal motion signals according to the object of origin. Realization of this step is computationally demanding, as the solution is formally underconstrained. It must rely--by definition--upon utilization of retinal cues that are indicative of the spatial relationships within and between objects in the visual scene. Psychophysical experiments have documented this dependence and suggested mechanisms by which it may be achieved. Neurophysiological experiments have provided evidence for a neural substrate that may underlie this selective motion signal integration. Together they paint a coherent portrait of the means by which retinal image motion gives rise to our perceptual experience of moving objects.