How are Three-Deminsional Objects Represented in the Brain?

We discuss a variety of object recognition experiments in which human subjects were presented with realistically rendered images of computer-generated three-dimensional objects, with tight control over stimulus shape, surface properties, illumination, and viewpoint, as well as subjects' prior exposure to the stimulus objects. In all experiments recognition performance was: (1) consistently viewpoint dependent; (2) only partially aided by binocular stereo and other depth information, (3) specific to viewpoints that were familiar; (4) systematically disrupted by rotation in depth more than by deforming the two-dimensional images of the stimuli. These results are consistent with recently advanced computational theories of recognition based on view interpolation.

Bilayer segmentation of live video in uncontrolled environments for background substitution: an overview and main challenges

Bilayer segmentation of live video in uncontrolled environments is an essential task for home applications in which the original background of the scene must be replaced, as in videochats or traditional videoconference. The main challenge in such conditions is overcome all difficulties in problem-situations (e. g., illumination change, distract events such as element moving in the background and camera shake) that may occur while the video is being captured. This paper presents a survey of segmentation methods for background substitution applications, describes the main concepts and identifies events that may cause errors. Our analysis shows that although robust methods rely on specific devices (multiple cameras or sensors to generate depth maps) which aid the process. In order to achieve the same results using conventional devices (monocular video cameras), most current research relies on energy minimization frameworks, in which temporal and spacial information are probabilistically combined with those of color and contrast.

Estudo comparativo da estereopsia: testando a aplicação digital Stereo TAB em estudantes do ensino superior

A estereopsia é o 3º grau da visão binocular. Define-se pela perceção de profundidade e baseia-se na disparidade retiniana. Estereopsia global – estereograma de pontos aleatórios (perceção necessita de disparidade retiniana). Estereopsia local – estereogramas com contornos percebidos monocularmente (processo de fusão facilitado). Objectivos do estudo: 1) comparar valores de estereopsia obtidos em cada teste e analisar valores de estereopsia local e global; 2) estudar a correlação de valores de estereopsia nos testes (TNO goldstandard); 3) estudar a associação entre o resultado dos testes; 4) comparar exatidão entre FlyTeste StereoTAB; 5) estudar a sensibilidade e a especificidade do FlyTeste StereoTAB; 6) averiguar a aplicabilidade do SteroTABna prática clínica.

Stereo and motion parallax cues in human 3D vision: can they vanish without a trace?

In an immersive virtual reality environment, subjects fail to notice when a scene expands or contracts around them, despite correct and consistent information from binocular stereopsis and motion parallax, resulting in gross failures of size constancy (A. Glennerster, L. Tcheang, S. J. Gilson, A. W. Fitzgibbon, & A. J. Parker, 2006). We determined whether the integration of stereopsis/motion parallax cues with texture-based cues could be modified through feedback. Subjects compared the size of two objects, each visible when the room was of a different size. As the subject walked, the room expanded or contracted, although subjects failed to notice any change. Subjects were given feedback about the accuracy of their size judgments, where the “correct” size setting was defined either by texture-based cues or (in a separate experiment) by stereo/motion parallax cues. Because of feedback, observers were able to adjust responses such that fewer errors were made. For texture-based feedback, the pattern of responses was consistent with observers weighting texture cues more heavily. However, for stereo/motion parallax feedback, performance in many conditions became worse such that, paradoxically, biases moved away from the point reinforced by the feedback. This can be explained by assuming that subjects remap the relationship between stereo/motion parallax cues and perceived size or that they develop strategies to change their criterion for a size match on different trials. In either case, subjects appear not to have direct access to stereo/motion parallax cues.

Humans ignore motion and stereo cues in favor of a fictional stable world

As we move through the world, our eyes acquire a sequence of images. The information from this sequence is sufficient to determine the structure of a three-dimensional scene, up to a scale factor determined by the distance that the eyes have moved [1, 2]. Previous evidence shows that the human visual system accounts for the distance the observer has walked [3,4] and the separation of the eyes [5-8] when judging the scale, shape, and distance of objects. However, in an immersive virtual-reality environment, observers failed to notice when a scene expanded or contracted, despite having consistent information about scale from both distance walked and binocular vision. This failure led to large errors in judging the size of objects. The pattern of errors cannot be explained by assuming a visual reconstruction of the scene with an incorrect estimate of interocular separation or distance walked. Instead, it is consistent with a Bayesian model of cue integration in which the efficacy of motion and disparity cues is greater at near viewing distances. Our results imply that observers are more willing to adjust their estimate of interocular separation or distance walked than to accept that the scene has changed in size.

Análise do comportamento de técnicas de correspondência binocular para imagens em alta definição

This work presents an analysis of the behavior of some algorithms usually available in stereo correspondence literature, with full HD images (1920x1080 pixels) to establish, within the precision dilemma versus runtime applications which these methods can be better used. The images are obtained by a system composed of a stereo camera coupled to a computer via a capture board. The OpenCV library is used for computer vision operations and processing images involved. The algorithms discussed are an overall method of search for matching blocks with the Sum of the Absolute Value of the difference (Sum of Absolute Differences - SAD), a global technique based on cutting energy graph cuts, and a so-called matching technique semi -global. The criteria for analysis are processing time, the consumption of heap memory and the mean absolute error of disparity maps generated.

Estudo comparativo da estereopsia com três testes diferentes: TNO®, Fly Stereo Acuity Test® e StereoTAB® em estudantes do ensino superior

Estereopsia define-se como a perceção de profundidade baseada na disparidade retiniana. A estereopsia global depende do processamento de estímulos de pontos aleatórios e a estereopsia local depende da perceção de contornos. O objetivo deste estudo é correlacionar três testes de estereopsia: TNO®, StereoTAB® e Fly Stereo Acuity Test® e verificar a sensibilidade e correlação entre eles, tendo o TNO® como gold standard. Incluíram-se 49 estudantes da Escola Superior de Tecnologia da Saúde de Lisboa (ESTeSL) entre os 18 e 26 anos. As variáveis ponto próximo de convergência (ppc), vergências, sintomatologia e correção ótica foram correlacionadas com os três testes. Os valores médios (desvios-padrão) de estereopsia foram: TNO® = 87,04’’ ±84,09’’; FlyTest® = 38,18’’ ±34,59’’; StereoTAB® = 124,89’’ ±137,38’’. Coeficiente de determinação: TNO® e StereoTAB® com R2=0,6 e TNO® e FlyTest® com R2=0,2. O coeficiente de correlação de Pearson mostra uma correlação positiva de entre o TNO® e o StereoTAB® (r=0,784 com α=0,01). O coeficiente de associação de Phi mostrou uma relação positiva forte entre o TNO® e StereoTAB® (Φ=0,848 com α=0,01). Na curva ROC, o StereoTAB® possui uma área sob a curva maior que o FlyTest®, apresentando valor de sensibilidade de 92,3% para uma especificidade de 94,4%, tornando-o num teste sensível e com bom poder discriminativo.

Binocular functional architecture for detection of contrast-modulated gratings

Combination of signals from the two eyes is the gateway to stereo vision. To gain insight into binocular signal processing, we studied binocular summation for luminance-modulated gratings (L or LM) and contrast-modulated gratings (CM). We measured 2AFC detection thresholds for a signal grating (0.75 c/deg, 216msec) shown to one eye, both eyes, or both eyes out-of-phase. For LM and CM, the carrier noise was in both eyes, even when the signal was monocular. Mean binocular thresholds for luminance gratings (L) were 5.4dB better than monocular thresholds - close to perfect linear summation (6dB). For LM and CM the binocular advantage was again 5-6dB, even when the carrier noise was uncorrelated, anti-correlated, or at orthogonal orientations in the two eyes. Binocular combination for CM probably arises from summation of envelope responses, and not from summation of these conflicting carrier patterns. Antiphase signals produced no binocular advantage, but thresholds were about 1-3dB higher than monocular ones. This is not consistent with simple linear summation, which should give complete cancellation and unmeasurably high thresholds. We propose a three-channel model in which noisy monocular responses to the envelope are binocularly combined in a contrast-weighted sum, but also remain separately available to perception via a max operator. Vision selects the largest of the three responses. With in-phase gratings the binocular channel dominates, but antiphase gratings cancel in the binocular channel and the monocular channels mediate detection. The small antiphase disadvantage might be explained by a subtle influence of background responses on binocular and monocular detection.

Visual suppression in intermittent exotropia during binocular alignment.

PURPOSE To investigate the cortical mechanisms that prevent diplopia in intermittent exotropia (X(T)) during binocular alignment (orthotropia). METHODS The authors studied 12 X(T) patients aged 5 to 22 years. Seventy-five percent had functional stereo vision with stereoacuity similar to that of 12 age-matched controls (0.2-3.7 min arc). Identical face images were presented to the two eyes for 400 ms. In one eye, the face was presented at the fovea; in the other, offset along the horizontal axis with up to 12° eccentricity. The task was to indicate whether one or two faces were perceived. RESULTS All X(T) patients showed normal diplopia when the nonfoveal face was presented to nasal hemiretina, though with a slightly larger fusional range than age-matched controls. However, 10 of 12 patients never experienced diplopia when the nonfoveal face was presented to temporal hemiretina (i.e., when the stimulus simulated exodeviation). Patients showed considerable variability when the single image was perceived. Some patients suppressed the temporal stimulus regardless of which eye viewed it, whereas others suppressed a particular eye even when it viewed the foveal stimulus. In two patients, the simulated exodeviation might have triggered a shift from normal to anomalous retinal correspondence. CONCLUSIONS Antidiplopic mechanisms in X(T) can be reliably triggered by purely retinal information during orthotropia, but the nature of these mechanisms varies between patients.

Neurogeometry of stereo vision

This work aims to develop a neurogeometric model of stereo vision, based on cortical architectures involved in the problem of 3D perception and neural mechanisms generated by retinal disparities. First, we provide a sub-Riemannian geometry for stereo vision, inspired by the work on the stereo problem by Zucker (2006), and using sub-Riemannian tools introduced by Citti-Sarti (2006) for monocular vision. We present a mathematical interpretation of the neural mechanisms underlying the behavior of binocular cells, that integrate monocular inputs. The natural compatibility between stereo geometry and neurophysiological models shows that these binocular cells are sensitive to position and orientation. Therefore, we model their action in the space R3xS2 equipped with a sub-Riemannian metric. Integral curves of the sub-Riemannian structure model neural connectivity and can be related to the 3D analog of the psychophysical association fields for the 3D process of regular contour formation. Then, we identify 3D perceptual units in the visual scene: they emerge as a consequence of the random cortico-cortical connection of binocular cells. Considering an opportune stochastic version of the integral curves, we generate a family of kernels. These kernels represent the probability of interaction between binocular cells, and they are implemented as facilitation patterns to define the evolution in time of neural population activity at a point. This activity is usually modeled through a mean field equation: steady stable solutions lead to consider the associated eigenvalue problem. We show that three-dimensional perceptual units naturally arise from the discrete version of the eigenvalue problem associated to the integro-differential equation of the population activity.

Cirurgia de catarata: características e opiniões de pacientes com visão mono versus binocular

OBJETIVO: Verificar em dois grupos de pacientes com visão monocular (grupo 1) e com visão binocular (grupo 2), a serem submetidos à cirurgia de catarata num hospital universitário, opiniões em relação ao problema ocular, à qualidade da visão e à cirurgia de catarata. MÉTODOS: Foi realizado estudo transversal e comparativo, de forma consecutiva, por meio de questionário estruturado, aplicado por entrevista a pacientes, elaborado a partir de estudo exploratório e medidas acuidade visual e causa da perda visual. RESULTADOS: A amostra foi constituída por 96 indivíduos do grupo 1 (50,0% homens; 50,0% mulheres, com idade entre 41 e 91 anos, média 69,3 anos ± 10,4 anos) e 110, do grupo 2 (40,9% homens; 59,1% mulheres, com idade entre 40 e 89 anos, média 68,2 anos ± 10,2 anos). A maioria dos indivíduos de ambos os grupos apresentava baixa escolaridade. Não houve diferença estatisticamente significante entre os grupos em relação ao sexo (p=0,191), à idade (p=0,702) e à escolaridade (p=0,245). Não exerciam atividade laboral 95,8% dos indivíduos do grupo 1 e 83,6%, do grupo 2 (p=0,005) e 30,4% do grupo 1 mencionaram não ter possibilidade de trabalhar por causa da deficiência visual. Observou-se acuidade visual do olho a ser operado menor que 0,05 em 40,6% (grupo 1) e 33,6% (grupo 2), entre 0,25 e 0,05. Quase a totalidade dos indivíduos de ambos os grupos afirmou ter dificuldade para realização das atividades de vida diária e qualificou como insuficiente a respectiva acuidade visual; 71,9% dos entrevistados do grupo 1 e 71,6%, do grupo 2 mencionaram saber a causa da visão fraca; desses, 87,1% do grupo 1 e 83,3% do grupo 2 referiram a catarata como causa da baixa acuidade visual. CONCLUSÃO: Os indivíduos de ambos os grupos tiveram acesso à cirurgia de catarata com acuidade visual menor do que a idealmente indicada; os pacientes com visão monocular apresentaram acuidade visual significativamente menor em relação aos com visão binocular; a maioria dos entrevistados de ambos os grupos referiu dificuldades para realizar atividades cotidianas como consequência da baixa visão; muitos indivíduos de ambos os grupos desconheciam a causa da dificuldade visual ou a atribuíram a outra causa que não a catarata.

'Tetol': a stereo-rigid four-strand motif for alkali and alkaline earth metal ion coordination

The tetraalcohol 2,3,5,6-endo,endo,endo,endo-tetrakis(hydroxymethyl]bicyclo[2.2.1]heptane (tetol, 1) has been prepared and crystallises readily as the lithium(I) complex [Li(1)(2)]Cl, forming an oligomeric multi-chain structure in which pairs of alcohols from two crystallographically independent tetol molecules bind lithium ions tetrahedrally. However, formation of monomeric structures in solution is inferred from electrospray mass spectroscopy, which has also shown evidence of exchange of lithium ion in the complexed species by added alkaline earth ions. (C) 2000 Elsevier Science S.A. All rights reserved.

How configurations of binocular disparity determine whether stereoscopic slant or stereoscopic occlusion is seen

A partially occluded contour and a slanted contour may generate identical binocular horizontal disparities. We investigated conditions promoting an occlusion resolution indicated by an illusory contour in depth along the aligned ends of horizontally disparate line sets. For a set of identical oblique lines with a constant width added to one eye's view, strength, depth, and stability of the illusory contour were poor, whereas for oblique lines of alternating orientations the illusory contours were strong, indicating a reliance on vertical size disparities rather than vertical positional disparities in generating perceived occlusion. For horizontal lines, occlusion was seen when the lines were of different lengths and absolute width disparity was invariant across the set. In all line configurations, when the additional length was on the wrong eye to be attributed to differential occlusion, lines appeared slanted consistent with their individual horizontal disparities. This rules out monocular illusory contours as the determining factor.

Binocular rivalry and the cerebral hemispheres with a note on the correlates and constitution of visual consciousness

In addressing the scientific study of consciousness, Crick and Koch state, "It is probable that at any moment some active neuronal processes in your head correlate with consciousness, while others do not: what is the difference between them?" (1998, p. 97). Evidence from electrophysiological and brain-imaging studies of binocular rivalry supports the premise of this statement and answers to some extent, the question posed. I discuss these recent developments and outline the rationale and experimental evidence for the interhemispheric switch hypothesis of perceptual rivalry. According to this model, the perceptual alternations of rivalry reflect hemispheric alternations, suggesting that visual consciousness of rivalling stimuli may be unihemispheric at any one time (Miller et al., 2000). However, in this paper, I suggest that interhemispheric switching could involve alternating unihemispheric attentional selection of neuronal processes for access to visual consciousness. On this view, visual consciousness during rivalry could be bihemispheric because the processes constitutive of attentional selection may be distinct from those constitutive of visual consciousness. This is a special case of the important distinction between the neuronal correlates and constitution of visual consciousness.

Monocular and binocular distance cues: insights from visual form agnosia I (of III)

The human nervous system constructs a Euclidean representation of near (personal) space by combining multiple sources of information (cues). We investigated the cues used for the representation of personal space in a patient with visual form agnosia (DF). Our results indicated that DF relies predominantly on binocular vergence information when determining the distance of a target despite the presence of other (retinal) cues. Notably, DF was able to construct an Euclidean representation of personal space from vergence alone. This finding supports previous assertions that vergence provides the nervous system with veridical information for the construction of personal space. The results from the current study, together with those of others, suggest that: (i) the ventral stream is responsible for extracting depth and distance information from monocular retinal cues (i.e. from shading, texture, perspective) and (ii) the dorsal stream has access to binocular information (from horizontal image disparities and vergence). These results also indicate that DF was not able to use size information to gauge target distance, suggesting that intact temporal cortex is necessary for learned size to influence distance processing. Our findings further suggest that in neurologically intact humans, object information extracted in the ventral pathway is combined with the products of dorsal stream processing for guiding prehension. Finally, we studied the size-distance paradox in visual form agnosia in order to explore the cognitive use of size information. The results of this experiment were consistent with a previous suggestion that the paradox is a cognitive phenomenon.