Preferred Spatial Frequencies for Human Face Processing Are Associated with Optimal Class Discrimination in the Machine

Psychophysical studies suggest that humans preferentially use a narrow band of low spatial frequencies for face recognition. Here we asked whether artificial face recognition systems have an improved recognition performance at the same spatial frequencies as humans. To this end, we estimated recognition performance over a large database of face images by computing three discriminability measures: Fisher Linear Discriminant Analysis, Non-Parametric Discriminant Analysis, and Mutual Information. In order to address frequency dependence, discriminabilities were measured as a function of (filtered) image size. All three measures revealed a maximum at the same image sizes, where the spatial frequency content corresponds to the psychophysical found frequencies. Our results therefore support the notion that the critical band of spatial frequencies for face recognition in humans and machines follows from inherent properties of face images, and that the use of these frequencies is associated with optimal face recognition performance.

Low spatial frequencies are suppressively masked across spatial scale, orientation, field position, and eye of origin

Masking is said to occur when a mask stimulus interferes with the visibility of a target (test) stimulus. One widely held view of this process supposes interactions between mask and test mechanisms (cross-channel masking), and explicit models (e.g., J. M. Foley, 1994) have proposed that the interactions are inhibitory. Unlike a within-channel model, where masking involves the combination of mask and test stimulus within a single mechanism, this cross-channel inhibitory model predicts that the mask should attenuate the perceived contrast of a test stimulus. Another possibility is that masking is due to an increase in noise, in which case, perception of contrast should be unaffected once the signal exceeds detection threshold. We use circular patches and annuli of sine-wave grating in contrast detection and contrast matching experiments to test these hypotheses and investigate interactions across spatial frequency, orientation, field position, and eye of origin. In both types of experiments we found substantial effects of masking that can occur over a factor of 3 in spatial frequency, 45° in orientation, across different field positions and between different eyes. We found the effects to be greatest at the lowest test spatial frequency we used (0.46 c/deg), and when the mask and test differed in all four dimensions simultaneously. This is surprising in light of previous work where it was concluded that suppression from the surround was strictly monocular (C. Chubb, G. Sperling, & J. A. Solomon, 1989). The results confirm that above detection threshold, cross-channel masking involves contrast suppression and not (purely) mask-induced noise. We conclude that cross-channel masking can be a powerful phenomenon, particularly at low test spatial frequencies and when mask and test are presented to different eyes. © 2004 ARVO.

Interocular transfer of spatial adaptation is weak at low spatial frequencies

Adapting one eye to a high contrast grating reduces sensitivity to similar target gratings shown to the same eye, and also to those shown to the opposite eye. According to the textbook account, interocular transfer (IOT) of adaptation is around 60% of the within-eye effect. However, most previous studies on this were limited to using high spatial frequencies, sustained presentation, and criterion-dependent methods for assessing threshold. Here, we measure IOT across a wide range of spatiotemporal frequencies, using a criterion-free 2AFC method. We find little or no IOT at low spatial frequencies, consistent with other recent observations. At higher spatial frequencies, IOT was present, but weaker than previously reported (around 35%, on average, at 8c/deg). Across all conditions, monocular adaptation raised thresholds by around a factor of 2, and observers showed normal binocular summation, demonstrating that they were not binocularly compromised. These findings prompt a reassessment of our understanding of the binocular architecture implied by interocular adaptation. In particular, the output of monocular channels may be available to perceptual decision making at low spatial frequencies.

Psychophysical measurements of luminance and chromatic spatial and temporal contrast sensitivity in Duchenne muscular dystrophy

In children with Duchenne muscular dystrophy, color vision losses have been related to dystrophin deletions downstream of exon 30, which affect a dystrophin isoform, Dp260, present in the retina. To further evaluate visual function in DMD children, we measured spatial, temporal, and chromatic red-green and blue-yellow contrast sensitivity in two groups of DMD children with gene deletion downstream and upstream of exon 30. Psychophysical spatial contrast sensitivity was measured for low, middle, and high spatial frequencies with achromatic gratings and for low and middle frequencies with red-green and blue-yellow chromatic gratings. Temporal contrast sensitivity was also measured with achromatic stimuli. A reduction in sensitivity at all spatial luminance contrasts was found for the DMD patients with deletion downstream of exon 30. Similar results were found for temporal luminance contrast sensitivity. Red-green chromatic contrast sensitivity was reduced in DMD children with deletion downstream of exon 30, whereas blue-yellow chromatic contrast sensitivity showed no significant differences. We conclude that visual function is impaired in DMD children. Furthermore, we report a genotype-phenotype relationship because the visual impairment occurred in children with deletion downstream but not upstream of exon 30, affecting the retinal isoform of dystrophin Dp260.

Chromatic spatial contrast sensitivity estimated by visual evoked cortical potential and psychophysics

The purpose of the present study was to measure contrast sensitivity to equiluminant gratings using steady-state visual evoked cortical potential (ssVECP) and psychophysics. Six healthy volunteers were evaluated with ssVECPs and psychophysics. The visual stimuli were red-green or blue-yellow horizontal sinusoidal gratings, 5° × 5°, 34.3 cd/m2 mean luminance, presented at 6 Hz. Eight spatial frequencies from 0.2 to 8 cpd were used, each presented at 8 contrast levels. Contrast threshold was obtained by extrapolating second harmonic amplitude values to zero. Psychophysical contrast thresholds were measured using stimuli at 6 Hz and static presentation. Contrast sensitivity was calculated as the inverse function of the pooled cone contrast threshold. ssVECP and both psychophysical contrast sensitivity functions (CSFs) were low-pass functions for red-green gratings. For electrophysiology, the highest contrast sensitivity values were found at 0.4 cpd (1.95 ± 0.15). ssVECP CSF was similar to dynamic psychophysical CSF, while static CSF had higher values ranging from 0.4 to 6 cpd (P < 0.05, ANOVA). Blue-yellow chromatic functions showed no specific tuning shape; however, at high spatial frequencies the evoked potentials showed higher contrast sensitivity than the psychophysical methods (P < 0.05, ANOVA). Evoked potentials can be used reliably to evaluate chromatic red-green CSFs in agreement with psychophysical thresholds, mainly if the same temporal properties are applied to the stimulus. For blue-yellow CSF, correlation between electrophysiology and psychophysics was poor at high spatial frequency, possibly due to a greater effect of chromatic aberration on this kind of stimulus.

Differential effects of aging on spatial contrast sensitivity to linear and polar sine-wave gratings

Changes in visual function beyond high-contrast acuity are known to take place during normal aging. We determined whether sensitivity to linear sine-wave gratings and to an elementary stimulus preferentially processed in extrastriate areas could be distinctively affected by aging. We measured spatial contrast sensitivity twice for concentric polar (Bessel) and vertical linear gratings of 0.6, 2.5, 5, and 20 cycles per degree (cpd) in two age groups (20-30 and 60-70 years). All participants were free of identifiable ocular disease and had normal or corrected-to-normal visual acuity. Participants were more sensitive to Cartesian than to polar gratings in all frequencies tested, and the younger adult group was more sensitive to all stimuli tested. Significant differences between sensitivities of the two groups were found for linear (only 20 cpd; P<0.01) and polar gratings (all frequencies tested; P<0.01). The young adult group was significantly more sensitive to linear than to circular gratings in the 20 cpd frequency. The older adult group was significantly more sensitive to linear than to circular gratings in all spatial frequencies, except in the 20 cpd frequency. The results suggest that sensitivity to the two kinds of stimuli is affected differently by aging. We suggest that neural changes in the aging brain are important determinants of this difference and discuss the results according to current models of human aging.

Impairment of color spatial vision in chronic alcoholism measured by psychophysical methods

We used psychophysical tests to evaluate spatial vision in 15 subjects with a clinical history of chronic alcoholism by measuring luminance contrast sensitivity and color discrimination. The subjects were initially subjected to clinical inquiry and ophthalmological exam. Subjects then performed psychophysical tests to measure spatial contrast thresholds using sine wave gratings of different spatial frequencies and contrasts and chromatic discrimination thresholds using the Mollon-Reffin test. For the analysis, subjects were divided into three groups according to age and compared with age-matched controls. Ten subjects had some degree of color vision loss, which was quite severe in seven cases. All subjects had normal luminance contrast sensitivity. The results suggest that color vision changes related to chronic alcoholism can occur in the absence of impairment of spatial luminance contrast sensitivity and thus is an important aspect to be considered in the clinical evaluation of this condition.

Chromatic spatial contrast sensitivity estimated by visual evoked cortical potential and psychophysics

The purpose of the present study was to measure contrast sensitivity to equiluminant gratings using steady-state visual evoked cortical potential (ssVECP) and psychophysics. Six healthy volunteers were evaluated with ssVECPs and psychophysics. The visual stimuli were red-green or blue-yellow horizontal sinusoidal gratings, 5^° × 5^°, 34.3 cd/m2 mean luminance, presented at 6 Hz. Eight spatial frequencies from 0.2 to 8 cpd were used, each presented at 8 contrast levels. Contrast threshold was obtained by extrapolating second harmonic amplitude values to zero. Psychophysical contrast thresholds were measured using stimuli at 6 Hz and static presentation. Contrast sensitivity was calculated as the inverse function of the pooled cone contrast threshold. ssVECP and both psychophysical contrast sensitivity functions (CSFs) were low-pass functions for red-green gratings. For electrophysiology, the highest contrast sensitivity values were found at 0.4 cpd (1.95 ± 0.15). ssVECP CSF was similar to dynamic psychophysical CSF, while static CSF had higher values ranging from 0.4 to 6 cpd (P < 0.05, ANOVA). Blue-yellow chromatic functions showed no specific tuning shape; however, at high spatial frequencies the evoked potentials showed higher contrast sensitivity than the psychophysical methods (P < 0.05, ANOVA). Evoked potentials can be used reliably to evaluate chromatic red-green CSFs in agreement with psychophysical thresholds, mainly if the same temporal properties are applied to the stimulus. For blue-yellow CSF, correlation between electrophysiology and psychophysics was poor at high spatial frequency, possibly due to a greater effect of chromatic aberration on this kind of stimulus.

Spatial and temporal dependencies of cross-orientation suppression in human vision.

A well-known property of orientation-tuned neurons in the visual cortex is that they are suppressed by the superposition of an orthogonal mask. This phenomenon has been explained in terms of physiological constraints (synaptic depression), engineering solutions for components with poor dynamic range (contrast normalization) and fundamental coding strategies for natural images (redundancy reduction). A common but often tacit assumption is that the suppressive process is equally potent at different spatial and temporal scales of analysis. To determine whether it is so, we measured psychophysical cross-orientation masking (XOM) functions for flickering horizontal Gabor stimuli over wide ranges of spatio-temporal frequency and contrast. We found that orthogonal masks raised contrast detection thresholds substantially at low spatial frequencies and high temporal frequencies (high speeds), and that small and unexpected levels of facilitation were evident elsewhere. The data were well fit by a functional model of contrast gain control, where (i) the weight of suppression increased with the ratio of temporal to spatial frequency and (ii) the weight of facilitatory modulation was the same for all conditions, but outcompeted by suppression at higher contrasts. These results (i) provide new constraints for models of primary visual cortex, (ii) associate XOM and facilitation with the transient magno- and sustained parvostreams, respectively, and (iii) reconcile earlier conflicting psychophysical reports on XOM.

Spatial contrast sensitivity and external noise: applications to optical and neural modulation transfer functions

The thesis will show how to equalise the effect of quantal noise across spatial frequencies by keeping the retinal flux (If-2) constant. In addition, quantal noise is used to study the effect of grating area and spatial frequency on contrast sensitivity resulting in the extension of the new contrast detection model describing the human contrast detection system as a simple image processor. According to the model the human contrast detection system comprises low-pass filtering due to ocular optics, addition of light dependent noise at the event of quantal absorption, high-pass filtering due to the neural visual pathways, addition of internal neural noise, after which detection takes place by a local matched filter, whose sampling efficiency decreases as grating area is increased. Furthermore, this work will demonstrate how to extract both the optical and neural modulation transfer functions of the human eye. The neural transfer function is found to be proportional to spatial frequency up to the local cut-off frequency at eccentricities of 0 - 37 deg across the visual field. The optical transfer function of the human eye is proposed to be more affected by the Stiles-Crawford -effect than generally assumed in the literature. Similarly, this work questions the prevailing ideas about the factors limiting peripheral vision by showing that peripheral optical acts as a low-pass filter in normal viewing conditions, and therefore the effect of peripheral optics is worse than generally assumed.

Spatial tuning studies of the pattern evoked electroretinogram

The locus of origin of the pattern evoked electroretinogram, (PERG), has been the subject of considerable discussion. A novel approach was adopted in this study to further elaborate the nature of the PERG evoked by pattern onset/offset presentation. The PERG was found to be linearly related to stimulus contrast and in particular was linearly related to the temporal contrast of the retinal image, when elicited by patterns of low spatial frequency. At high spatial frequencies the retinal image contrast is significantly reduced because of optical degradation. This is described by the eye's modulation transfer function (MTF). The retinal contrast of square wave grating and chequerboard patterns of increasing spatial frequency were found by filtering their Fourier transforms by the MTF. The filtered pattern harmonics were then resynthesised to constitute a profile of retinal image illuminance from which the temporal and spatial contrast of the image could be calculated. If the PERG is a pure illuminance response it should be spatially insensitive and dependent upon the temporal contrast of stimulation. The calculated loss of temporal contrast for finer patterns was expressed as a space-averaged temporal contrast attentuation factor. This factor, applied to PERGs evoked by low spatial frequency patterns, was used to predict the retinal illuminance response elicited by a finer pattern. The predicted response was subtracted from the recorded signal and residual waveform was proposed to represent specific activity. An additional correction for the attenuation of spatial contrast was applied to the extracted pattern specific response. Pattern specific responses computed for different spatial frequency patterns in this way are the predicted result of iso-contrast pattern stimulation. The pattern specific responses demonstrate a striking bandpass spatial selectivity which peaks at higher spatial frequencies in the more central retina. The variation of spatial sensitivity with eccentricity corresponds closely with estimated ganglion receptive field centre separation and psychophysical data. The variation of retinal structure with eccentricity, in the form of the volumes of the nuclear layers, was compared with the amplitudes of the computed retinal illuminance and pattern specific responses. The retinal illuminance response corresponds more closely to the outer and inner nuclear layers whilst the pattern specific response appears more closely related to the ganglion cell layer. In general the negative response transients correspond to the more proximal retinal layers. This thesis therefore supports the proposed contribution of proximal retinal cell activity to the PERG and describes techniques which may be further elaborated for more detailed studies of retinal receptive field dimensions.

Pooling and suppression in human spatial vision

A distinct feature of several recent models of contrast masking is that detecting mechanisms are divisively inhibited by a broadly tuned ‘gain pool’ of narrow-band spatial pattern mechanisms. The contrast gain control provided by this ‘cross-channel’ architecture achieves contrast normalisation of early pattern mechanisms, which is important for keeping them within the non-saturating part of their biological operating characteristic. These models superseded earlier ‘within-channel’ models, which had supposed that masking arose from direct stimulation of the detecting mechanism by the mask. To reveal the extent of masking, I measured the levels produced with large ranges of pattern spatial relationships that have not been explored before. Substantial interactions between channels tuned to different orientations and spatial frequencies were found. Differences in the masking levels produced with single and multiple component mask patterns provided insights into the summation rules within the gain pool. A widely used cross-channel masking model was tested on these data and was found to perform poorly. The model was developed and a version in which linear summation was allowed between all components within the gain pool but with the exception of the self-suppressing route typically provided the best account of the data. Subsequently, an adaptation paradigm was used to probe the processes underlying pooled responses in masking. This delivered less insight into the pooling than the other studies and areas were identified that require investigation for a new unifying model of masking and adaptation. In further experiments, levels of cross-channel masking were found to be greatly influenced by the spatio-temporal tuning of the channels involved. Old masking experiments and ideas relying on within-channel models were re-elevated in terms of contemporary cross-channel models (e.g. estimations of channel bandwidths from orientation masking functions) and this led to different conclusions than those originally arrived at. The investigation of effects with spatio-temporally superimposed patterns is focussed upon throughout this work, though it is shown how these enquiries might be extended to investigate effects across spatial and temporal position.

Low spatial frequency filtering modulates early brain processing of affective complex pictures

Recent research on affective processing has suggested that low spatial frequency information of fearful faces provide rapid emotional cues to the amygdala, whereas high spatial frequencies convey fine-grained information to the fusiform gyrus, regardless of emotional expression. In the present experiment, we examined the effects of low (LSF, <15 cycles/image width) and high spatial frequency filtering (HSF, >25 cycles/image width) on brain processing of complex pictures depicting pleasant, unpleasant, and neutral scenes. Event-related potentials (ERP), percentage of recognized stimuli and response times were recorded in 19 healthy volunteers. Behavioral results indicated faster reaction times in response to unpleasant LSF than to unpleasant HSF pictures. Unpleasant LSF pictures and pleasant unfiltered pictures also elicited significant enhancements of P1 amplitudes at occipital electrodes as compared to neutral LSF and unfiltered pictures, respectively; whereas no significant effects of affective modulation were found for HSF pictures. Moreover, mean ERP amplitudes in the time between 200 and 500ms post-stimulus were significantly greater for affective (pleasant and unpleasant) than for neutral unfiltered pictures; whereas no significant affective modulation was found for HSF or LSF pictures at those latencies. The fact that affective LSF pictures elicited an enhancement of brain responses at early, but not at later latencies, suggests the existence of a rapid and preattentive neural mechanism for the processing of motivationally relevant stimuli, which could be driven by LSF cues. Our findings confirm thus previous results showing differences on brain processing of affective LSF and HSF faces, and extend these results to more complex and social affective pictures.

The Lea Grating Test In Assessing Detection Grating Acuity In Normal Infants Less Than 4 Months Of Age.

To assess binocular detection grating acuity using the LEA GRATINGS test to establish age-related norms in healthy infants during their first 3 months of life. In this prospective, longitudinal study of healthy infants with clear red reflex at birth, responses to gratings were measured at 1, 2, and 3 months of age using LEA gratings at a distance of 28 cm. The results were recorded as detection grating acuity values, which were arranged in frequency tables and converted to a one-octave scale for statistical analysis. For the repeated measurements, analysis of variance (ANOVA) was used to compare the detection grating acuity results between ages. A total of 133 infants were included. The binocular responses to gratings showed development toward higher mean values and spatial frequencies, ranging from 0.55 ± 0.70 cycles per degree (cpd), or 1.74 ± 0.21 logMAR, in month 1 to 3.11 ± 0.54 cpd, or 0.98 ± 0.16 logMAR, in month 3. Repeated ANOVA indicated differences among grating acuity values in the three age groups. The LEA GRATINGS test allowed assessment of detection grating acuity and its development in a cohort of healthy infants during their first 3 months of life.

Visual contrast sensitivity in tonic-clonic epileptic patients

We measured the effects of epilepsy on visual contrast sensitivity to linear and vertical sine-wave gratings. Sixteen female adults, aged 21 to 50 years, comprised the sample in this study, including eight adults with generalized tonic-clonic seizure-type epilepsy and eight age-matched controls without epilepsy. Contrast threshold was measured using a temporal two-alternative forced-choice binocular psychophysical method at a distance of 150 cm from the stimuli, with a mean luminance of 40.1 cd/m². A one-way analysis of variance (ANOVA) applied to the linear contrast threshold showed significant differences between groups (F[3,188] = 14.829; p < .05). Adults with epilepsy had higher contrast thresholds (1.45, 1.04, and 1.18 times for frequencies of 0.25, 2.0, and 8.0 cycles per degree of visual angle, respectively). The Tukey Honestly Significant Difference post hoc test showed significant differences (p < .05) for all of the tested spatial frequencies. The largest difference between groups was in the lowest spatial frequency. Therefore, epilepsy may cause more damage to the neural pathways that process low spatial frequencies. However, epilepsy probably alters both the magnocellular visual pathway, which processes low spatial frequencies, and the parvocellular visual pathway, which processes high spatial frequencies. The experimental group had lower visual contrast sensitivity to all tested spatial frequencies.