Frontoparietal cortical networks for directing attention and the eye to visual locations: Identical, independent, or overlapping neural systems?

Functional anatomical and single-unit recording studies indicate that a set of neural signals in parietal and frontal cortex mediates the covert allocation of attention to visual locations, as originally proposed by psychological studies. This frontoparietal network is the source of a location bias that interacts with extrastriate regions of the ventral visual system during object analysis to enhance visual processing. The frontoparietal network is not exclusively related to visual attention, but may coincide or overlap with regions involved in oculomotor processing. The relationship between attention and eye movement processes is discussed at the psychological, functional anatomical, and cellular level of analysis.

Subthreshold facilitation and suppression in primary visual cortex revealed by intrinsic signal imaging.

Neurons in primary visual cortex (area 17) respond vigorously to oriented stimuli within their receptive fields; however, stimuli presented outside the suprathreshold receptive field can also influence their responses. Here we describe a fundamental feature of the spatial interaction between suprathreshold center and subthreshold surround. By optical imaging of intrinsic signals in area 17 in response to a stimulus border, we show that a given stimulus generates activity primarily in iso-orientation domains, which extend for several millimeters across the cortical surface in a manner consistent with the architecture of long-range horizontal connections in area 17. By mapping the receptive fields of single neurons and imaging responses from the same cortex to stimuli that include or exclude the aggregate suprathreshold receptive field, we show that intrinsic signals strongly reveal the subthreshold surround contribution. Optical imaging and single-unit recording both demonstrate that the relative contrast of center and surround stimuli regulates whether surround interactions are facilitative or suppressive: the same surround stimulus facilitates responses when center contrast is low, but suppresses responses when center contrast is high. Such spatial interactions in area 17 are ideally suited to contribute to phenomena commonly regarded as part of "higher-level" visual processing, such as perceptual "popout" and "filling-in."

Formation of mnemonic neuronal responses to visual paired associates in inferotemporal cortex is impaired by perirhinal and entorhinal lesions.

Functional roles of the cortical backward signal in long-term memory formation were studied in monkeys performing a visual pair-association task. Before the monkeys learned the task, the anterior commissure was transected, disconnecting the anterior temporal cortex of each hemisphere. After training with 12 pairs of pictures, single units were recorded from the inferotemporal cortex of the monkeys as the control. By injecting a grid of ibotenic acid, we unilaterally lesioned the entorhinal and perirhinal cortex, which provides massive direct and indirect backward projections ipsilaterally to the inferotemporal cortex. After the lesion, the monkeys fixated the cue stimulus normally, relearned the preoperatively learned set (set A), and learned a new set (set B) of paired associates. Then, single units were recorded from the same area as for the prelesion control. We found that (i) in spite of the lesion, the sampled neurons responded strongly and selectively to both the set A and set B patterns and (ii) the paired associates elicited significantly correlated responses in the control neurons before the lesion but not in the cells tested after the lesion, either for set A or set B stimuli. We conclude that the ability of inferotemporal neurons to represent association between picture pairs was lost after the lesion of entorhinal and perirhinal cortex, most likely through disruption of backward neural signals to the inferotemporal neurons, while the ability of the neurons to respond to a particular visual stimulus was left intact.

Processing of speech signals for physical and sensory disabilities.

Assistive technology involving voice communication is used primarily by people who are deaf, hard of hearing, or who have speech and/or language disabilities. It is also used to a lesser extent by people with visual or motor disabilities. A very wide range of devices has been developed for people with hearing loss. These devices can be categorized not only by the modality of stimulation [i.e., auditory, visual, tactile, or direct electrical stimulation of the auditory nerve (auditory-neural)] but also in terms of the degree of speech processing that is used. At least four such categories can be distinguished: assistive devices (a) that are not designed specifically for speech, (b) that take the average characteristics of speech into account, (c) that process articulatory or phonetic characteristics of speech, and (d) that embody some degree of automatic speech recognition. Assistive devices for people with speech and/or language disabilities typically involve some form of speech synthesis or symbol generation for severe forms of language disability. Speech synthesis is also used in text-to-speech systems for sightless persons. Other applications of assistive technology involving voice communication include voice control of wheelchairs and other devices for people with mobility disabilities.

Receptive field structure in the visual cortex: does selective stimulation induce plasticity?

Sensory areas of adult cerebral cortex can reorganize in response to long-term alterations in patterns of afferent signals. This long-term plasticity is thought to play a crucial role in recovery from injury and in some forms of learning. However, the degree to which sensory representations in primary cortical areas depend on short-term (i.e., minute to minute) stimulus variations remains unclear. A traditional view is that each neuron in the mature cortex has a fixed receptive field structure. An alternative view, with fundamentally different implications for understanding cortical function, is that each cell's receptive field is highly malleable, changing according to the recent history of the sensory environment. Consistent with the latter view, it has been reported that selective stimulation of regions surrounding the receptive field induces a dramatic short-term increase in receptive field size for neurons in the visual cortex [Pettet, M. W. & Gilbert, C. D. (1992) Proc. Natl. Acad. Sci. USA 89, 8366-8370]. In contrast, we report here that there is no change in either the size or the internal structure of the receptive field following several minutes of surround stimulation. However, for some cells, overall responsiveness increases. These results suggest that dynamic alterations of receptive field structure do not underlie short-term plasticity in the mature primary visual cortex. However, some degree of short-term adaptability could be mediated by changes in responsiveness.

Visual motion perception.

The primate visual motion system performs numerous functions essential for survival in a dynamic visual world. Prominent among these functions is the ability to recover and represent the trajectories of objects in a form that facilitates behavioral responses to those movements. The first step toward this goal, which consists of detecting the displacement of retinal image features, has been studied for many years in both psychophysical and neurobiological experiments. Evidence indicates that achievement of this step is computationally straightforward and occurs at the earliest cortical stage. The second step involves the selective integration of retinal motion signals according to the object of origin. Realization of this step is computationally demanding, as the solution is formally underconstrained. It must rely--by definition--upon utilization of retinal cues that are indicative of the spatial relationships within and between objects in the visual scene. Psychophysical experiments have documented this dependence and suggested mechanisms by which it may be achieved. Neurophysiological experiments have provided evidence for a neural substrate that may underlie this selective motion signal integration. Together they paint a coherent portrait of the means by which retinal image motion gives rise to our perceptual experience of moving objects.

Detectable warnings: detectability by individuals with visual impairments, and safety and negotiability on slopes for persons with physical impairments. Final report.

Federal Transit Administration, Washington, D.C.

Human factors requirements for real-time motorist information displays. Volume 4: bibliography and selected annotations: visual systems. Final report.

Federal Highway Administration, Office of Research, Washington, D.C.

Intraspecific and intraspecific views of colour signals in the strawberry poison frog Dendrobates Pumilio

Poison frogs in the anuran family Dendrobatidae use bright colors on their bodies to advertise toxicity. The species Dendrobates pumilio Schmidt 1858, the strawberry poison frog, shows extreme polymorphism in color and pattern in Panama. It is known that females of D. pumilio preferentially choose mates of their own color morph. Nevertheless, potential predators must clearly see and recognize all color morphs if the aposermatic signaling system is to function effectively. We examined the ability of conspecifics and a model predator to discriminate a diverse selection of D. pumilio colors from each other and from background colors. Microspectrophotometry of isolated rod and cone photoreceptors of D. pumilio revealed the presence of a trichromatic photopic visual system. A typical tetrachromatic bird system was used for the model predator. Reflectance spectra of frog and background colors were obtained, and discrimination among spectra in natural illuminants was mathematically modeled. The results revealed that both D. pumilio and the model predator discriminate most colors quite well, both from each other and from typical backgrounds, with the predator generally performing somewhat better than the conspecifics. Each color morph displayed at least one color signal that is highly visible against backgrounds to both visual systems. Our results indicate that the colors displayed by the various color morphs of D. pumilio are effective signals both to conspecifics and to a model predator.

Stimuli of varying spatial scale induce gamma activity with distinct temporal characteristics in human visual cortex

Gamma activity to stationary grating stimuli was studied non-invasively using MEG recordings in humans. Using a spatial filtering technique, we localized gamma activity to primary visual cortex. We tested the hypothesis that spatial frequency properties of visual stimuli may be related to the temporal frequency characteristics of the associated cortical responses. We devised a method to assess temporal frequency differences between stimulus-related responses that typically exhibit complex spectral shapes. We applied this methodology to either single-trial (induced) or time-averaged (evoked) responses in four frequency ranges (0-40, 20-60, 40-80 and 60-100 Hz) and two time windows (either the entire duration of stimulus presentation or the first second following stimulus onset). Our results suggest that stimuli of varying spatial frequency induce responses that exhibit significantly different temporal frequency characteristics. These effects were particularly accentuated for induced responses in the classical gamma frequency band (20-60 Hz) analyzed over the entire duration of stimulus presentation. Strikingly, examining the first second of the responses following stimulus onset resulted in significant loss in stimulus specificity, suggesting that late signal components contain functionally relevant information. These findings advocate a functional role of gamma activity in sensory representation. We suggest that stimulus specific frequency characteristics of MEG signals can be mapped to processes of neuronal synchronization within the framework of coupled dynamical systems.

Psychophysical evidence for two routes to suppression before binocular summation of signals in human vision

Visual mechanisms in primary visual cortex are suppressed by the superposition of gratings perpendicular to their preferred orientations. A clear picture of this process is needed to (i) inform functional architecture of image-processing models, (ii) identify the pathways available to support binocular rivalry, and (iii) generally advance our understanding of early vision. Here we use monoptic sine-wave gratings and cross-orientation masking (XOM) to reveal two cross-oriented suppressive pathways in humans, both of which occur before full binocular summation of signals. One is a within-eye (ipsiocular) pathway that is spatially broadband, immune to contrast adaptation and has a suppressive weight that tends to decrease with stimulus duration. The other pathway operates between the eyes (interocular), is spatially tuned, desensitizes with contrast adaptation and has a suppressive weight that increases with stimulus duration. When cross-oriented masks are presented to both eyes, masking is enhanced or diminished for conditions in which either ipsiocular or interocular pathways dominate masking, respectively. We propose that ipsiocular suppression precedes the influence of interocular suppression and tentatively associate the two effects with the lateral geniculate nucleus (or retina) and the visual cortex respectively. The interocular route is a good candidate for the initial pathway involved in binocular rivalry and predicts that interocular cross-orientation suppression should be found in cortical cells with predominantly ipsiocular drive. © 2007 IBRO.

Subtractive and divisive adaptation in visual motion computations

Models of visual motion processing that introduce priors for low speed through Bayesian computations are sometimes treated with scepticism by empirical researchers because of the convenient way in which parameters of the Bayesian priors have been chosen. Using the effects of motion adaptation on motion perception to illustrate, we show that the Bayesian prior, far from being convenient, may be estimated on-line and therefore represents a useful tool by which visual motion processes may be optimized in order to extract the motion signals commonly encountered in every day experience. The prescription for optimization, when combined with system constraints on the transmission of visual information, may lead to an exaggeration of perceptual bias through the process of adaptation. Our approach extends the Bayesian model of visual motion proposed byWeiss et al. [Weiss Y., Simoncelli, E., & Adelson, E. (2002). Motion illusions as optimal perception Nature Neuroscience, 5:598-604.], in suggesting that perceptual bias reflects a compromise taken by a rational system in the face of uncertain signals and system constraints. © 2007.

The relative contributions of colour and luminance signals towards the visuomotor localisation of targets in human peripheral vision

We sought to determine the extent to which colour (and luminance) signals contribute towards the visuomotor localization of targets. To do so we exploited the movement-related illusory displacement a small stationary window undergoes when it has a continuously moving carrier grating behind it. We used drifting (1.0-4.2 Hz) red/green-modulated isoluminant gratings or yellow/black luminance-modulated gratings as carriers, each curtailed in space by a stationary, two-dimensional window. After each trial, the perceived location of the window was recorded with reference to an on-screen ruler (perceptual task) or the on-screen touch of a ballistic pointing movement made without visual feedback (visuomotor task). Our results showed that the perceptual displacement measures were similar for each stimulus type and weakly dependent on stimulus drift rate. However, while the visuomotor displacement measures were similar for each stimulus type at low drift rates (<4 Hz), they were significantly larger for luminance than colour stimuli at high drift rates (>4 Hz). We show that the latter cannot be attributed to differences in perceived speed between stimulus types. We assume, therefore, that our visuomotor localization judgements were more susceptible to the (carrier) motion of luminance patterns than colour patterns. We suggest that, far from being detrimental, this susceptibility may indicate the operation of mechanisms designed to counter the temporal asynchrony between perceptual experiences and the physical changes in the environment that give rise to them. We propose that perceptual localisation is equally supported by both colour and luminance signals but that visuomotor localisation is predominantly supported by luminance signals. We discuss the neural pathways that may be involved with visuomotor localization. © 2007 Springer-Verlag.

Binocular combination at threshold: temporal filtering and summation of signals in separate ON and OFF channels

How does the brain combine spatio-temporal signals from the two eyes? We quantified binocular summation as the improvement in 2AFC contrast sensitivity for flickering gratings seen by two eyes compared with one. Binocular gratings in-phase showed sensitivity up to 1.8 times higher, suggesting nearly linear summation of contrasts. The binocular advantage decreased to 1.4 at lower spatial and higher temporal frequencies (0.25 cycle deg-1, 30 Hz). Dichoptic, antiphase gratings showed only a small binocular advantage, by a factor of 1.1 to 1.2, but no evidence of cancellation. We present a signal-processing model to account for the contrast-sensitivity functions and the pattern of binocular summation. It has linear sustained and transient temporal filters, nonlinear transduction, and half-wave rectification that creates ON and OFF channels. Binocular summation occurs separately within ON and OFF channels, thus explaining the phase-specific binocular advantage. The model also accounts for earlier findings on detection of brief antiphase flashes and the surprising finding that dichoptic antiphase flicker is seen as frequency-doubled (Cavonius et al, 1992 Ophthalmic and Physiological Optics 12 153 - 156). [Supported by EPSRC project GR/S74515/01].

Estimation of functional connectivity from electromagnetic signals and the amount of empirical data required

An increasing number of neuroimaging studies are concerned with the identification of interactions or statistical dependencies between brain areas. Dependencies between the activities of different brain regions can be quantified with functional connectivity measures such as the cross-correlation coefficient. An important factor limiting the accuracy of such measures is the amount of empirical data available. For event-related protocols, the amount of data also affects the temporal resolution of the analysis. We use analytical expressions to calculate the amount of empirical data needed to establish whether a certain level of dependency is significant when the time series are autocorrelated, as is the case for biological signals. These analytical results are then contrasted with estimates from simulations based on real data recorded with magnetoencephalography during a resting-state paradigm and during the presentation of visual stimuli. Results indicate that, for broadband signals, 50-100 s of data is required to detect a true underlying cross-correlations coefficient of 0.05. This corresponds to a resolution of a few hundred milliseconds for typical event-related recordings. The required time window increases for narrow band signals as frequency decreases. For instance, approximately 3 times as much data is necessary for signals in the alpha band. Important implications can be derived for the design and interpretation of experiments to characterize weak interactions, which are potentially important for brain processing.