Integration of shading and texture cues: testing the linear model

One of the first attempts to develop a formal model of depth cue integration is to be found in Maloney and Landy's (1989) "human depth combination rule". They advocate that the combination of depth cues by the visual sysetem is best described by a weighted linear model. The present experiments tested whether the linear combination rule applies to the integration of texture and shading. As would be predicted by a linear combination rule, the weight assigned to the shading cue did vary as a function of its curvature value. However, the weight assigned to the texture cue varied systematically as a function of the curvature value of both cues. Here we descrive a non-linear model which provides a better fit to the data. Redescribing the stimuli in terms of depth rather than curvature reduced the goodness of fit for all models tested. These results support the hypothesis that the locus of cue integration is a curvature map, rather than a depth map. We conclude that the linear comination rule does not generalize to the integration of shading and texture, and that for these cues it is likely that integration occurs after the recovery of surface curvature.

The Effect of Illuminant Position on Perceived Curvature

In shaded scenes surface features can appear either concave or convex, depending upon the viewers judment about the direction of the prevailing illuminant. If other curvature cues are added to the image this ambiguity can be removed. However, it is not clear to what extent, if any, illuminant positin exerts an influence on the perceived magnitude of surface curvature. Subjects were presented with pairs of spherical surface patches in a curavture matching task. The patches were defined by shading and texture cues. The percevied curvature of a standard patch was measured as a function of light source position. We found a clear effect of light source position on apparent curvature. Perceived curvature decreased as light source tilt increased and as light source slant decreased. We also found that the strength of this effect is determined partly by a surface's reflectance function and partly by the relative weight of the texture cue. When a specular component was added to the stimuli, the effect of light source orientation was weakened. The weight of the texture cue was manipulated by disrupting the regular distribution of texture elements. We found an inverse relationship between the strength of the effecct and the weight of the texture cue: lowering the texture cue weight resulted in an enhancement of the illuminant position effect.

Investigating shape-from-shading illusions using solid objects

Recent growth in the shape-from-shading psychophysics literature has been paralled by an increasing availability of computer graphics hardware and software, to the extent that most psychophysical studies in this area now employ computer lighting algorithms. The most widely used of algorithms is shape-from-shading psychophysics is the Phong lighting model. This model, and other shading models of its genre, produce readily ineterpretable imiages of three-dimensional scenes. However, such algorithms are only approximations of how light interacts with real objects in the natural environment. Nevertheless, the results from psychophysical experiments using these techniques have been used to infer the processes underlying the perception of shape-from-shading in natural environments. It is important to establish whether this substitution is ever valid. We report a series of experiments investigating whether two recently reported illusions seen computer-generated, Phond shaded images occur for solid objects under real illuminants. The two illusions investigated are three-dimensional curvature contrast and the illuminant-position effect on perceived curvature. We show that both effects do occur for solid objects, and that the magnitude of these effects are equivalent regardless of whether subjects are presented with ray traced or solid objects.

3D Curvature Contrast - a geometric or brightness illusion?

Simultaneous contrast effects have been found across a wide range of visual dimensions. We describe a simultaneous contrast effect - three-dimensional curvature contrast - in which the apparent curvature of a surface defined by shading and texture information is influenced by the curvature of a surrounding surface. The effect is strong and easily measurable. We asked whether the effect depends upon the presence of contrast at the level of the internal representation of surface curvature or whether it could be better explained in terms of local changes in the apparent brightness of regions within the test patches induced by luminance transition at the borders. The experimental results suggest that, whicle these luminance-contrast-induced effects do contribute to the observed changes in perceived curvature, there are additional influences. In particular changes in perceived curvature induced by a pattern of curved patches were eliminated or considerably weakened when the inducing pattern was transformed into a photographic negative, a procedure which disrupts the apparent three-dimensional structure of the surface patches without changing their brightness contrast. This suggests a component of the illusion involves comparisons at the level of representation of surface curvature. The observation that three-dimensional curvature contrast presists when the inducing surfaces are spatially separate from the test surface suggests that shape perception involves global, as well as local, operations.