Dynamic facial expressions evoke distinct activation in the face perception network:a connectivity analysis study

Very little is known about the neural structures involved in the perception of realistic dynamic facial expressions. In the present study, a unique set of naturalistic dynamic facial emotional expressions was created. Through fMRI and connectivity analysis, a dynamic face perception network was identified, which is demonstrated to extend Haxby et al.'s [Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. The distributed human neural system for face perception. Trends in Cognitive Science, 4, 223–233, 2000] distributed neural system for face perception. This network includes early visual regions, such as the inferior occipital gyrus, which is identified as insensitive to motion or affect but sensitive to the visual stimulus, the STS, identified as specifically sensitive to motion, and the amygdala, recruited to process affect. Measures of effective connectivity between these regions revealed that dynamic facial stimuli were associated with specific increases in connectivity between early visual regions, such as the inferior occipital gyrus and the STS, along with coupling between the STS and the amygdala, as well as the inferior frontal gyrus. These findings support the presence of a distributed network of cortical regions that mediate the perception of different dynamic facial expressions.

Contrast discrimination with simultaneous monocular and dichoptic masks

In experiments reported elsewhere at this conference, we have revealed two striking results concerning binocular interactions in a masking paradigm. First, at low mask contrasts, a dichoptic masking grating produces a small facilitatory effect on the detection of a similar test grating. Second, the psychometric slope for dichoptic masking starts high (Weibull ß~4) at detection threshold, becomes low (ß~1.2) in the facilitatory region, and then unusually steep at high mask contrasts (ß~5.5). Neither of these results is consistent with Legge's (1984 Vision Research 24 385 - 394) model of binocular summation, but they are predicted by a two-stage gain control model in which interocular suppression precedes binocular summation. Here, we pose a further challenge for this model by using a 'twin-mask' paradigm (cf Foley, 1994 Journal of the Optical Society of America A 11 1710 - 1719). In 2AFC experiments, observers detected a patch of grating (1 cycle deg-1, 200 ms) presented to one eye in the presence of a pedestal in the same eye and a spatially identical mask in the other eye. The pedestal and mask contrasts varied independently, producing a two-dimensional masking space in which the orthogonal axes (10X10 contrasts) represent conventional dichoptic and monocular masking. The resulting surface (100 thresholds) confirmed and extended the observations above, and fixed the six parameters in the model, which fitted the data well. With no adjustment of parameters, the model described performance in a further experiment where mask and test were presented to both eyes. Moreover, in both model and data, binocular summation was greater than a factor of v2 at detection threshold. We conclude that this two-stage nonlinear model, with interocular suppression, gives a good account of early binocular processes in the perception of contrast. [Supported by EPSRC Grant Reference: GR/S74515/01]

Anisotropy for spatial summation of elongated patches of grating:A tale of two tails

Studies of spatial summation often use sinusoidal gratings with blurred edges. When the envelope is elongated (i) along the grating stripes and (ii) at right angles to the grating stripes, we refer to the stimuli as skunk-tails and tiger-tails respectively. Previous work [Polat & Tyler, 1999; Vision Research, 39, 887-895.] has found that sensitivity to skunk-tails is greater than for tiger-tails, but there have been several failures to replicate this result within a subset of the conditions. To address this we measured detection thresholds for skunk-tails, tiger-tails and squares of grating with sides matched to the lengths of the tails. For foveal viewing, we found a contrast sensitivity advantage in the order of 2 dB for skunk-tails over tiger-tails, but only for horizontal gratings. For vertical gratings, sensitivity was very similar for both tail-types. When the stimuli were presented parafoveally (upper right visual field), a small advantage was found for skunk-tails over tiger-tails at both orientations, and spatial summation slopes were close to that of the ideal observer. We did not replicate the findings of Polat & Tyler, but our results are consistent with (i) those of Foley et al. [Foley, J. M., Varadharajan, S., Koh, C. C., & Farias, C. Q. (2007) Vision Research, 47, 85-107.] who used only vertical gratings and (ii) those from modelfest, where only horizontal gratings were used. The small effect of tail-type here suggests an anisotropy in the underlying physiology. © 2007 Elsevier Ltd. All rights reserved.

Size matters, but not for everyone:Individual differences for contrast discrimination

It is very well known that contrast detection thresholds improve with the size of a grating-type stimulus, but it is thought that the benefit of size is abolished for contrast discriminations well above threshold (e.g., Legge, G. E., & Foley, J. M. (1980)]. Here we challenge the generality of this view. We performed contrast detection and contrast discrimination for circular patches of sine wave grating as a function of stimulus size. We confirm that sensitivity improves with approximately the fourth-root of stimulus area at detection threshold (a log-log slope of -0.25) but find individual differences (IDs) for the suprathreshold discrimination task. For several observers, performance was largely unaffected by area, but for others performance first improved (by as much as a log-log slope of -0.5) and then reached a plateau. We replicated these different results several times on the same observers. All of these results were described in the context of a recent gain control model of area summation [Meese, T. S. (2004)], extended to accommodate the multiple stimulus sizes used here. In this model, (i) excitation increased with the fourth-root of stimulus area for all observers, and (ii) IDs in the discrimination data were described by IDs in the relation between suppression and area. This means that empirical summation in the contrast discrimination task can be attributed to growth in suppression with stimulus size that does not keep pace with the growth in excitation. © 2005 ARVO.

Grating and plaid masks indicate linear summation in a contrast gain pool

In human vision, the response to luminance contrast at each small region in the image is controlled by a more global process where suppressive signals are pooled over spatial frequency and orientation bands. But what rules govern summation among stimulus components within the suppressive pool? We addressed this question by extending a pedestal plus pattern mask paradigm to use a stimulus with up to three mask components: a vertical 1 c/deg pedestal, plus pattern masks made from either a grating (orientation = -45°) or a plaid (orientation = ±45°), with component spatial frequency of 3 c/deg. The overall contrast of both types of pattern mask was fixed at 20% (i.e., plaid component contrasts were 10%). We found that both of these masks transformed conventional dipper functions (threshold vs. pedestal contrast with no pattern mask) in exactly the same way: The dipper region was raised and shifted to the right, but the dipper handles superimposed. This equivalence of the two pattern masks indicates that contrast summation between the plaid components was perfectly linear prior to the masking stage. Furthermore, the pattern masks did not drive the detecting mechanism above its detection threshold because they did not abolish facilitation by the pedestal (Foley, 1994). Therefore, the pattern masking could not be attributed to within-channel masking, suggesting that linear summation of contrast signals takes place within a suppressive contrast gain pool. We present a quantitative model of the effects and discuss the implications for neurophysiological models of the process. © 2004 ARVO.

Low spatial frequencies are suppressively masked across spatial scale, orientation, field position, and eye of origin

Masking is said to occur when a mask stimulus interferes with the visibility of a target (test) stimulus. One widely held view of this process supposes interactions between mask and test mechanisms (cross-channel masking), and explicit models (e.g., J. M. Foley, 1994) have proposed that the interactions are inhibitory. Unlike a within-channel model, where masking involves the combination of mask and test stimulus within a single mechanism, this cross-channel inhibitory model predicts that the mask should attenuate the perceived contrast of a test stimulus. Another possibility is that masking is due to an increase in noise, in which case, perception of contrast should be unaffected once the signal exceeds detection threshold. We use circular patches and annuli of sine-wave grating in contrast detection and contrast matching experiments to test these hypotheses and investigate interactions across spatial frequency, orientation, field position, and eye of origin. In both types of experiments we found substantial effects of masking that can occur over a factor of 3 in spatial frequency, 45° in orientation, across different field positions and between different eyes. We found the effects to be greatest at the lowest test spatial frequency we used (0.46 c/deg), and when the mask and test differed in all four dimensions simultaneously. This is surprising in light of previous work where it was concluded that suppression from the surround was strictly monocular (C. Chubb, G. Sperling, & J. A. Solomon, 1989). The results confirm that above detection threshold, cross-channel masking involves contrast suppression and not (purely) mask-induced noise. We conclude that cross-channel masking can be a powerful phenomenon, particularly at low test spatial frequencies and when mask and test are presented to different eyes. © 2004 ARVO.

Area summation and masking

At detection threshold, sensitivity improves as the area of a test grating increases, but not when the test is placed on a pedestal and the task becomes contrast discrimination (G. E. Legge, & J. M. Foley, 1980). This study asks whether the abolition of area summation is specific to the situation where mask and test stimuli have the same spatial frequency and orientation ("within-channel" masking) or is more general, also occurring when mask and test stimuli are very different ("cross-channel" masking). Threshold versus contrast masking functions were measured where the test and mask were either both small (SS), both large (LL), or small and large, respectively (SL). For within-channel masking, facilitation and area summation were found at low mask contrasts, but the results for SS and LL converged at intermediate contrasts and above, replicating Legge and Foley (1980). For all three observers, less facilitation was found for SL than for SS. For cross-channel masking, area summation occurred across the entire masking function and results for SS and SL were identical. The results for the entire data set were well fit by an extended version of a contrast masking model (J. M. Foley, 1994) in which the weights of excitatory and suppressive surround terms were free parameters. I conclude that (i) there is no empirical abolition of area summation for cross-channel masking, (ii) within-channel area summation can be abolished empirically without being disabled in the model, (iii) observers are able to restrict the area of spatial integration, but not suppression, (iv) extending a cross-channel mask to the surround has no effect on contrast detection, and (v) there is a formal similarity between area summation and contrast adaptation. © 2004 ARVO.

Adaptation and gain pool summation:Alternative models and masking data

Foley [J. Opt. Soc. Am. A 11 (1994) 1710] has proposed an influential psychophysical model of masking in which mask components in a contrast gain pool are raised to an exponent before summation and divisive inhibition. We tested this summation rule in experiments in which contrast detection thresholds were measured for a vertical 1 c/deg (or 2 c/deg) sine-wave component in the presence of a 3 c/deg (or 6 c/deg) mask that had either a single component oriented at -45° or a pair of components oriented at ±45°. Contrary to the predictions of Foley's model 3, we found that for masks of moderate contrast and above, threshold elevation was predicted by linear summation of the mask components in the inhibitory stage of the contrast gain pool. We built this feature into two new models, referred to as the early adaptation model and the hybrid model. In the early adaptation model, contrast adaptation controls a threshold-like nonlinearity on the output of otherwise linear pathways that provide the excitatory and inhibitory inputs to a gain control stage. The hybrid model involves nonlinear and nonadaptable routes to excitatory and inhibitory stages as well as an adaptable linear route. With only six free parameters, both models provide excellent fits to the masking and adaptation data of Foley and Chen [Vision Res. 37 (1997) 2779] but unlike Foley and Chen's model, are able to do so with only one adaptation parameter. However, only the hybrid model is able to capture the features of Foley's (1994) pedestal plus orthogonal fixed mask data. We conclude that (1) linear summation of inhibitory components is a feature of contrast masking, and (2) that the main aftereffect of spatial adaptation on contrast increment thresholds can be assigned to a single site. © 2002 Elsevier Science Ltd. All rights reserved.

Cognitive neuroscience and (very) high level vision

THE PURPOSE OF THIS ARTICLE is two-fold, first to provide a general overview of two of the main cognitive neuroscientific techniques available, specifically functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS); and secondly to apply these techniques to elaborate a discussion of an aspect of higher level vision, namely implied motion, that is the perception of movement from a static image.