Added luminance ramp alters perceived edge blur and contrast:A critical test for derivative-based models of edge coding

In many models of edge analysis in biological vision, the initial stage is a linear 2nd derivative operation. Such models predict that adding a linear luminance ramp to an edge will have no effect on the edge's appearance, since the ramp has no effect on the 2nd derivative. Our experiments did not support this prediction: adding a negative-going ramp to a positive-going edge (or vice-versa) greatly reduced the perceived blur and contrast of the edge. The effects on a fairly sharp edge were accurately predicted by a nonlinear multi-scale model of edge processing [Georgeson, M. A., May, K. A., Freeman, T. C. A., & Hesse, G. S. (in press). From filters to features: Scale-space analysis of edge and blur coding in human vision. Journal of Vision], in which a half-wave rectifier comes after the 1st derivative filter. But we also found that the ramp affected perceived blur more profoundly when the edge blur was large, and this greater effect was not predicted by the existing model. The model's fit to these data was much improved when the simple half-wave rectifier was replaced by a threshold-like transducer [May, K. A. & Georgeson, M. A. (2007). Blurred edges look faint, and faint edges look sharp: The effect of a gradient threshold in a multi-scale edge coding model. Vision Research, 47, 1705-1720.]. This modified model correctly predicted that the interaction between ramp gradient and edge scale would be much larger for blur perception than for contrast perception. In our model, the ramp narrows an internal representation of the gradient profile, leading to a reduction in perceived blur. This in turn reduces perceived contrast because estimated blur plays a role in the model's estimation of contrast. Interestingly, the model predicts that analogous effects should occur when the width of the window containing the edge is made narrower. This has already been confirmed for blur perception; here, we further support the model by showing a similar effect for contrast perception. © 2007 Elsevier Ltd. All rights reserved.

Colour and luminance interactions in the visual perception of motion

We sought to determine the extent to which red–green, colour–opponent mechanisms in the human visual system play a role in the perception of drifting luminance–modulated targets. Contrast sensitivity for the directional discrimination of drifting luminance–modulated (yellow–black) test sinusoids was measured following adaptation to isoluminant red–green sinusoids drifting in either the same or opposite direction. When the test and adapt stimuli drifted in the same direction, large sensitivity losses were evident at all test temporal frequencies employed (1–16 Hz). The magnitude of the loss was independent of temporal frequency. When adapt and test stimuli drifted in opposing directions, large sensitivity losses were evident at lower temporal frequencies (1–4 Hz) and declined with increasing temporal frequency. Control studies showed that this temporal–frequency–dependent effect could not reflect the activity of achromatic units. Our results provide evidence that chromatic mechanisms contribute to the perception of luminance–modulated motion targets drifting at speeds of up to at least 32°s-1. We argue that such mechanisms most probably lie within a parvocellular–dominated cortical visual pathway, sensitive to both chromatic and luminance modulation, but only weakly selective for the direction of stimulus motion.

Perceiving edge contrast

We have shown previously that a template model for edge perception successfully predicts perceived blur for a variety of edge profiles (Georgeson, 2001 Journal of Vision 1 438a; Barbieri-Hesse and Georgeson, 2002 Perception 31 Supplement, 54). This study concerns the perceived contrast of edges. Our model spatially differentiates the luminance profile, half-wave rectifies this first derivative, and then differentiates again to create the edge's 'signature'. The spatial scale of the signature is evaluated by filtering it with a set of Gaussian derivative operators. This process finds the correlation between the signature and each operator kernel at each position. These kernels therefore act as templates, and the position and scale of the best-fitting template indicate the position and blur of the edge. Our previous finding, that reducing edge contrast reduces perceived blur, can be explained by replacing the half-wave rectifier with a smooth, biased rectifier function (May and Georgeson, 2003 Perception 32 388; May and Georgeson, 2003 Perception 32 Supplement, 46). With the half-wave rectifier, the peak template response R to a Gaussian edge with contrast C and scale s is given by: R=Cp-1/4s-3/2. Hence, edge contrast can be estimated from response magnitude and blur: C=Rp1/4s3/2. Use of this equation with the modified rectifier predicts that perceived contrast will decrease with increasing blur, particularly at low contrasts. Contrast-matching experiments supported this prediction. In addition, the model correctly predicts the perceived contrast of Gaussian edges modified either by spatial truncation or by the addition of a ramp.

A critical evaluation of contrast susceptibility as a predictor of driving accident involvement

Contrast susceptibility is defined as the difference in visual acuity recorded for high and low contrast optotypes. Other researchers refer to this parameter as "normalised low contrast acuity". Pilot surveys have revealed that contrast susceptibility deficits are more strongly related to driving accident involvement than are deficits in high contrast visual acuity. It has been hypothesised that driving situation avoidance is purely based upon high contrast visual acuity. Hence, the relationship between high contrast visual acuity and accidents is masked by situation avoidance whilst drivers with contrast susceptibility deficits remain prone to accidents in poor visibility conditions. A national survey carried out to test this hypothesis provided no support for either the link between contrast susceptibility deficits and accidents involvement or the proposed hypothesis. Further, systematically worse contrast susceptibility scores emerged from vision screeners compared to wall mounted test charts. This discrepancy was not due to variations in test luminance or instrument myopia. Instead, optical imperfections inherent in vision screeners were considered to be responsible. Although contrast susceptibility is unlikely to provide a useful means of screening drivers' vision, previous research does provide support for its ability to detect visual deficits that may influence everyday tasks. In this respect, individual contrast susceptibility variations were found to reflect variations in the contrast sensitivity function - a parameter that provides a global estimate of human contrast sensitivity.

Development of visual evoked responses to tritan,red-green and luminance stimuli in human infants

The principal aim of this work was to investigate the development of the S-cone colour-opponent pathway in human infants aged 4 weeks to 6 months. This was achieved by recording transient visual evoked responses to pattern-onset stimuli along a tritanopic confusion axis (tritan stimuli) at and around the adult isoluminant match. For comparison, visual evoked responses to red-green and luminance-modulated stimuli were recorded from the same infants at the same ages. Evoked responses were also recorded from colour-normal adults for comparison with those of the infants. The transient VEP allowed observation of response morphology as luminance differences were introduced to the chromatic stimuli. In this way, an estimate of isoluminance was possible in infants. Estimated isoluminant points for a group of six infants aged 6 to 10 weeks closely approximated the adult isoluminant match. This finding has implications for the use of photometric isoluminance in infant work, and suggests that photopic spectral sensitivity is similar in infants and adults. Abnormalities of the visual evoked responses to tritan, red-green and luminance-modulated stimuli in an infant with cystic fibrosis are reported. The results suggest abnormal function of the retino-striate visual pathway in this infant, and it is argued that these may be secondary to his illness, although data from more infants with cystic fibrosis are needed to clarify this further. A group of nine healthy infants demonstrated evoked responses to tritan stimuli by 4 to 10 weeks and to red-green stimuli by 6 to 11 weeks post-term age. Responses to luminance-modulated stimuli were present in all nine infants at the earliest age tested, namely 4 weeks post-term. The slightly earlier age of onset of evoked responses to tritan stimuli than for red-green may be explained by the relatively lower cone contrast afforded by red-green stimuli. Latency of the evoked response to both types of chromatic stimuli and to luminance-modulated stimuli decreased with age at a similar rate, suggesting that the visual pathways transmitting luminance and chromatic information mature at similar rates in young infants.

Studies on the luminance-related characteristics of the transient pattern reversal electroretinogram

The electroretinogram evoked by reversal pattern stimulation (rPERG) is known to contain both pattern contrast and luminance related components. The retinal mechanisms of the transient rPERGs subserving these functional characteristics are the main concern in the present studies. Considerable attention has been paid to the luminance-related characteristics of the response. The transient PERGs were found to consist of two subsequent processes using low frequency attenuation analysis. The processes overlapped and the individual difference in each process timings formed the major cause for the variations of the negative potential waveform of the transient rPERGs. Attention has been paid to those having ‘notch’ type of variation. Under different contrast levels, the amplitudes of the positive and negative potentials were linearly increased with higher contrast level and the negative potential showed a higher sensitivity to contrast changes and higher contrast gain. Under lower contrast levels, the decreased amplitudes made the difference in the timing course of the positive and negative processes evident, interpreting the appearance of the notch in some cases. Visual adaptation conditions for recording the transient rPERG were discussed. Another effort was to study the large variation of the transient rPERGs (especially the positive potential, P50) in the elderly who’s distant and near visual acuity were normal. It was found that reduction of retinal illumination contributed mostly to the P50 amplitude loss and contrast loss mostly to the negative potential (N95) amplitude loss. Senile miosis was thought to have little effect on the reduction of the retinal illumination, while the changes in the optics of the eye was probably the major cause for it, which interpreted the larger individual variation of the P50 amplitude of the elderly PERGs. Convex defocus affected the transient rPERGs more effectively than concave lenses, especially the N95 amplitude in the elderly. The disability of accommodation and the type and the degree of subjects’ ametropia should be taken into consideration when the elderly rPERGs were analysed.

Pupil response to color signals in cone-contrast space

Purpose: It is widely accepted that pupil responses to visual stimuli are determined by the ambient illuminance, and recently it has been shown that changes in stimulus color also contributes to a pupillary control mechanism. However, the role of pupillary responses to chromatic stimuli is not clear. The aim of this study was to investigate how color and luminance signals contribute to the pupillary control mechanism. Methods: We measured pupillary iso-response contours in M-and L-cone contrast space. The iso-response contours in cone-contrast space have been determined to examine what mechanisms contribute to the pupillary pathway. The shapes of the iso-response contour change when different mechanisms determine the response. Results: It was shown that for all subjects, the pupillary iso-response contours form an ellipse with positive slope in cone-contrast space, indicating that the sensitivities to the chromatic stimuli are higher than those for the luminance stimuli. The pupil responds maximally to a grating that has a stronger L-cone modulation than the red-green isoluminant grating. Conclusions: The sensitivity of the chromatic pathway, in terms of pupillary response, is three times larger than that of the luminance pathway, a property that might have utility in clinical applications. Copyright © Taylor & Francis Group, LLC.

Area summation of first- and second-order modulations of luminance

To extend our understanding of the early visual hierarchy, we investigated the long-range integration of first- and second-order signals in spatial vision. In our first experiment we performed a conventional area summation experiment where we varied the diameter of (a) luminance-modulated (LM) noise and (b) contrastmodulated (CM) noise. Results from the LM condition replicated previous findings with sine-wave gratings in the absence of noise, consistent with long-range integration of signal contrast over space. For CM, the summation function was much shallower than for LM suggesting, at first glance, that the signal integration process was spatially less extensive than for LM. However, an alternative possibility was that the high spatial frequency noise carrier for the CM signal was attenuated by peripheral retina (or cortex), thereby impeding our ability to observe area summation of CM in the conventional way. To test this, we developed the ''Swiss cheese'' stimulus of Meese and Summers (2007) in which signal area can be varied without changing the stimulus diameter, providing some protection against inhomogeneity of the retinal field. Using this technique and a two-component subthreshold summation paradigm we found that (a) CM is spatially integrated over at least five stimulus cycles (possibly more), (b) spatial integration follows square-law signal transduction for both LM and CM and (c) the summing device integrates over spatially-interdigitated LM and CM signals when they are co-oriented, but not when crossoriented. The spatial pooling mechanism that we have identified would be a good candidate component for amodule involved in representing visual textures, including their spatial extent.

Fourth-root summation of contrast over area:no end in sight when spatially inhomogeneous sensitivity is compensated by a witch's hat

Measurements of area summation for luminance-modulated stimuli are typically confounded by variations in sensitivity across the retina. Recently we conducted a detailed analysis of sensitivity across the visual field (Baldwin et al, 2012) and found it to be well-described by a bilinear “witch’s hat” function: sensitivity declines rapidly over the first 8 cycles or so, more gently thereafter. Here we multiplied luminance-modulated stimuli (4 c/deg gratings and “Swiss cheeses”) by the inverse of the witch’s hat function to compensate for the inhomogeneity. This revealed summation functions that were straight lines (on double log axes) with a slope of -1/4 extending to ≥33 cycles, demonstrating fourth-root summation of contrast over a wider area than has previously been reported for the central retina. Fourth-root summation is typically attributed to probability summation, but recent studies have rejected that interpretation in favour of a noisy energy model that performs local square-law transduction of the signal, adds noise at each location of the target and then sums over signal area. Modelling shows our results to be consistent with a wide field application of such a contrast integrator. We reject a probability summation model, a quadratic model and a matched template model of our results under the assumptions of signal detection theory. We also reject the high threshold theory of contrast detection under the assumption of probability summation over area.

Binocular functional architecture for detection of contrast-modulated gratings

Combination of signals from the two eyes is the gateway to stereo vision. To gain insight into binocular signal processing, we studied binocular summation for luminance-modulated gratings (L or LM) and contrast-modulated gratings (CM). We measured 2AFC detection thresholds for a signal grating (0.75 c/deg, 216msec) shown to one eye, both eyes, or both eyes out-of-phase. For LM and CM, the carrier noise was in both eyes, even when the signal was monocular. Mean binocular thresholds for luminance gratings (L) were 5.4dB better than monocular thresholds - close to perfect linear summation (6dB). For LM and CM the binocular advantage was again 5-6dB, even when the carrier noise was uncorrelated, anti-correlated, or at orthogonal orientations in the two eyes. Binocular combination for CM probably arises from summation of envelope responses, and not from summation of these conflicting carrier patterns. Antiphase signals produced no binocular advantage, but thresholds were about 1-3dB higher than monocular ones. This is not consistent with simple linear summation, which should give complete cancellation and unmeasurably high thresholds. We propose a three-channel model in which noisy monocular responses to the envelope are binocularly combined in a contrast-weighted sum, but also remain separately available to perception via a max operator. Vision selects the largest of the three responses. With in-phase gratings the binocular channel dominates, but antiphase gratings cancel in the binocular channel and the monocular channels mediate detection. The small antiphase disadvantage might be explained by a subtle influence of background responses on binocular and monocular detection.

MEG responses to the perception of global structure within glass patterns

The perception of global form requires integration of local visual cues across space and is the foundation for object recognition. Here we used magnetoencephalography (MEG) to study the location and time course of neuronal activity associated with the perception of global structure from local image features. To minimize neuronal activity to low-level stimulus properties, such as luminance and contrast, the local image features were held constant during all phases of the MEG recording. This allowed us to assess the relative importance of striate (V1) versus extrastriate cortex in global form perception.

On the decline of 1st and 2nd order sensitivity with eccentricity

We studied the relationship between the decline in sensitivity that occurs with eccentricity for stimuli of different spatial scale defined by either luminance (LM) or contrast (CM) modulation. We show that the detectability of CM stimuli declines with eccentricity in a spatial frequency-dependent manner, and that the rate of sensitivity decline for CM stimuli is roughly that expected from their 1st order carriers, except, possibly, at finer scales. Using an equivalent noise paradigm, we investigated the possible reasons for why the foveal sensitivity for detecting LM and CM stimuli differs as well as the reason why the detectability of 1st order stimuli declines with eccentricity. We show the former can be modeled by an increase in internal noise whereas the latter involves both an increase in internal noise and a loss of efficiency. To encompass both the threshold and suprathreshold transfer properties of peripheral vision, we propose a model in terms of the contrast gain of the underlying mechanisms.

Binocular interaction:Contrast matching and contrast discrimination are predicted by the same model

How do signals from the 2 eyes combine and interact? Our recent work has challenged earlier schemes in which monocular contrast signals are subject to square-law transduction followed by summation across eyes and binocular gain control. Much more successful was a new 'two-stage' model in which the initial transducer was almost linear and contrast gain control occurred both pre- and post-binocular summation. Here we extend that work by: (i) exploring the two-dimensional stimulus space (defined by left- and right-eye contrasts) more thoroughly, and (ii) performing contrast discrimination and contrast matching tasks for the same stimuli. Twenty-five base-stimuli made from 1 c/deg patches of horizontal grating, were defined by the factorial combination of 5 contrasts for the left eye (0.3-32%) with five contrasts for the right eye (0.3-32%). Other than in contrast, the gratings in the two eyes were identical. In a 2IFC discrimination task, the base-stimuli were masks (pedestals), where the contrast increment was presented to one eye only. In a matching task, the base-stimuli were standards to which observers matched the contrast of either a monocular or binocular test grating. In the model, discrimination depends on the local gradient of the observer's internal contrast-response function, while matching equates the magnitude (rather than gradient) of response to the test and standard. With all model parameters fixed by previous work, the two-stage model successfully predicted both the discrimination and the matching data and was much more successful than linear or quadratic binocular summation models. These results show that performance measures and perception (contrast discrimination and contrast matching) can be understood in the same theoretical framework for binocular contrast vision. © 2007 VSP.

Binocular summation of contrast remains intact in strabismic amblyopia

PURPOSE. Strabismic amblyopia is typically associated with several visual deficits, including loss of contrast sensitivity in the amblyopic eye and abnormal binocular vision. Binocular summation ratios (BSRs) are usually assessed by comparing contrast sensitivity for binocular stimuli (sens BIN) with that measured in the good eye alone (sensGOOD), giving BSR = sensBIN/sensGOOD. This calculation provides an operational index of clinical binocular function, but does not assess whether neuronal mechanisms for binocular summation of contrast remain intact. This study was conducted to investigate this question. METHODS. Horizontal sine-wave gratings were used as stimuli (3 or 9 cyc/deg; 200 ms), and the conventional method of assessment (above) was compared with one in which the contrast in the amblyopic eye was adjusted (normalized) to equate monocular sensitivities. RESULTS. In nine strabismic amblyopes (mean age, 32 years), the results confirmed that the BSR was close to unity when the conventional method was used (little or no binocular advantage), but increased to approximately √2 or higher when the normalization method was used. The results were similar to those for normal control subjects (n = 3; mean age, 38 years) and were consistent with the physiological summation of contrast between the eyes. When the normal observers performed the experiments with a neutral-density (ND) filter in front of one eye, their performance was similar to that of the amblyopes in both methods of assessment. CONCLUSIONS. The results indicate that strabismic amblyopes have mechanisms for binocular summation of contrast and that the amblyopic deficits of binocularity can be simulated with an ND filter. The implications of these results for best clinical practice are discussed. Copyright © Association for Research in Vision and Ophthalmology.

Natural images dominate in binocular rivalry

Ecological approaches to perception have demonstrated that information encoding by the visual system is informed by the natural environment, both in terms of simple image attributes like luminance and contrast, and more complex relationships corresponding to Gestalt principles of perceptual organization. Here, we ask if this optimization biases perception of visual inputs that are perceptually bistable. Using the binocular rivalry paradigm, we designed stimuli that varied in either their spatiotemporal amplitude spectra or their phase spectra. We found that noise stimuli with “natural” amplitude spectra (i.e., amplitude content proportional to 1/f, where f is spatial or temporal frequency) dominate over those with any other systematic spectral slope, along both spatial and temporal dimensions. This could not be explained by perceived contrast measurements, and occurred even though all stimuli had equal energy. Calculating the effective contrast following attenuation by a model contrast sensitivity function suggested that the strong contrast dependency of rivalry provides the mechanism by which binocular vision is optimized for viewing natural images. We also compared rivalry between natural and phase-scrambled images and found a strong preference for natural phase spectra that could not be accounted for by observer biases in a control task. We propose that this phase specificity relates to contour information, and arises either from the activity of V1 complex cells, or from later visual areas, consistent with recent neuroimaging and single-cell work. Our findings demonstrate that human vision integrates information across space, time, and phase to select the input most likely to hold behavioral relevance.