Frame-rate stereopsis using non-parametric transforms and programmable logic

A frame-rate stereo vision system, based on non-parametric matching metrics, is described. Traditional metrics, such as normalized cross-correlation, are expensive in terms of logic. Non-parametric measures require only simple, parallelizable, functions such as comparators, counters and exclusive-or, and are thus very well suited to implementation in reprogrammable logic.

Surface reconstruction from disparate shading: an integration of shape-from-shading and stereopsis

A cooperative integration of stereopsis and shape-from-shading is presented. The integration makes the process of D surface reconstruction better constrained and more reliable. It also obviates the need for surface boundary conditions, and explicit information about the surface albedo and the light source direction, which can now be estimated in an iterative manner

Neural mechanisms underlying binocular fusion and stereopsis: Position vs. phase

The visual system utilizes binocular disparity to discriminate the relative depth of objects in space. Since the striate cortex is the first site along the central visual pathways at which signals from the left and right eyes converge onto a single neuron, encoding of binocular disparity is thought to begin in this region. There are two possible mechanisms for encoding binocular disparity through simple cells in the striate cortex: a difference in receptive field (RF) position between the two eyes (RF position disparity) and a difference in RF profile between the two eyes (RF phase disparity). Although there have been studies supporting each of the two encoding mechanisms, both mechanisms have not been examined in a single study. Therefore, the relative roles of the two mechanisms have not been determined. To address this issue, we have mapped left and right eye RFs of simple cells in the cat’s striate cortex using binary m-sequence noise, and then we have estimated RF position and phase disparities. We find that RF position disparities are generally limited to small values that are not sufficient to encode large binocular disparities. In contrast, RF phase disparities cover a wide range of binocular disparities and exhibit dependencies on orientation and spatial frequency in a manner expected for a mechanism that encodes binocular disparity. These results indicate that binocular disparity is mainly encoded through RF phase disparity. However, RF position disparity may play a significant role for cells with high spatial frequency selectivity, which are constrained to small RF phase disparities.

Amodal completion with background determines depth from monocular gap stereopsis

Grove, Gillam, and Ono [Grove, P. M., Gillam, B. J., & Ono, H. (2002). Content and context. of monocular regions determine perceived depth in random dot, unpaired background and phantom stereograms. Vision Research, 42, 1859-1870] reported that perceived depth in monocular gap stereograms [Gillam, B. J., Blackburn, S., & Nakayama, K. (1999). Stereopsis based on monocular gaps: Metrical encoding of depth and slant without matching contours. Vision Research, 39, 493-502] was attenuated when the color/texture in the monocular gap did not match the background. It appears that continuation of the gap with the background constitutes an important component of the stimulus conditions that allow a monocular gap in an otherwise binocular surface to be responded to as a depth step. In this report we tested this view using the conventional monocular gap stimulus of two identical grey rectangles separated by a gap in one eye but abutting to form a solid grey rectangle in the other. We compared depth seen at the gap for this stimulus with stimuli that were identical except for two additional small black squares placed at the ends of the gap. If the squares were placed stereoscopically behind the rectangle/gap configuration (appearing on the background) they interfered with the perceived depth at the gap. However when they were placed in front of the configuration this attenuation disappeared. The gap and the background were able under these conditions to complete amodally. (c) 2006 Elsevier Ltd. All rights reserved.

Induced vertical disparity effects on local and global stereopsis

Purpose: Although significant amounts of vertical misalignment could have a noticeable effect on visual performance, there is no conclusive evidence about the effect of very small amount of vertical disparity on stereopsis and binocular vision. Hence, the aim of this study was to investigate the effects of induced vertical disparity on local and global stereopsis at near. Materials and Methods: Ninety participants wearing best-corrected refraction had local and global stereopsis tested with 0.5 and 1.0 prism diopter (Δ) vertical prism in front of their dominant and non-dominant eye in turn. This was compared to local and global stereopsis in the same subjects without vertical prism. Data were analyzed in SPSS.17 software using the independent samples T and the repeated measures ANOVA tests. Results: Induced vertical disparity decreases local and global stereopsis. This reduction is greater when vertical disparity is induced in front of the non-dominant eye and affects global more than local stereopsis. Repeated measures ANOVA showed differences in the mean stereopsis between the different measured states for local and global values. Local stereopsis thresholds were reduced by 10s of arc or less on average with 1.0Δ of induced vertical prism in front of either eye. However, global stereopsis thresholds were reduced by over 100s of arc by the same 1.0Δ of induced vertical prism. Conclusion: Induced vertical disparity affects global stereopsis thresholds by an order of magnitude (or a factor of 10) more than local stereopsis. Hence, using a test that measures global stereopsis such as the TNO is more sensitive to vertical misalignment than a test such as the Stereofly that measures local stereopsis. © 2014 Informa Healthcare USA, Inc. All rights reserved: reproduction in whole or part not permitted.

Large scale multi-view stereopsis evaluation

The seminal multiple view stereo benchmark evaluations from Middlebury and by Strecha et al. have played a major role in propelling the development of multi-view stereopsis methodology. Although seminal, these benchmark datasets are limited in scope with few reference scenes. Here, we try to take these works a step further by proposing a new multi-view stereo dataset, which is an order of magnitude larger in number of scenes and with a significant increase in diversity. Specifically, we propose a dataset containing 80 scenes of large variability. Each scene consists of 49 or 64 accurate camera positions and reference structured light scans, all acquired by a 6-axis industrial robot. To apply this dataset we propose an extension of the evaluation protocol from the Middlebury evaluation, reflecting the more complex geometry of some of our scenes. The proposed dataset is used to evaluate the state of the art multiview stereo algorithms of Tola et al., Campbell et al. and Furukawa et al. Hereby we demonstrate the usability of the dataset as well as gain insight into the workings and challenges of multi-view stereopsis. Through these experiments we empirically validate some of the central hypotheses of multi-view stereopsis, as well as determining and reaffirming some of the central challenges.

Large-scale data for multiple-view stereopsis

The seminal multiple-view stereo benchmark evaluations from Middlebury and by Strecha et al. have played a major role in propelling the development of multi-view stereopsis (MVS) methodology. The somewhat small size and variability of these data sets, however, limit their scope and the conclusions that can be derived from them. To facilitate further development within MVS, we here present a new and varied data set consisting of 80 scenes, seen from 49 or 64 accurate camera positions. This is accompanied by accurate structured light scans for reference and evaluation. In addition all images are taken under seven different lighting conditions. As a benchmark and to validate the use of our data set for obtaining reasonable and statistically significant findings about MVS, we have applied the three state-of-the-art MVS algorithms by Campbell et al., Furukawa et al., and Tola et al. to the data set. To do this we have extended the evaluation protocol from the Middlebury evaluation, necessitated by the more complex geometry of some of our scenes. The data set and accompanying evaluation framework are made freely available online. Based on this evaluation, we are able to observe several characteristics of state-of-the-art MVS, e.g. that there is a tradeoff between the quality of the reconstructed 3D points (accuracy) and how much of an object’s surface is captured (completeness). Also, several issues that we hypothesized would challenge MVS, such as specularities and changing lighting conditions did not pose serious problems. Our study finds that the two most pressing issues for MVS are lack of texture and meshing (forming 3D points into closed triangulated surfaces).

Comparative study of stereopsis with three different tests: TNO®, Stereo Acuity Test Fly® and StereoTAB® in students in higher school

Purpose: Stereopsis is the perception of depth based on retinal disparity. Global stereopsis depends on the process of random dot stimuli and local stereopsis depends on contour perception. The aim of this study was to correlate 3 stereopsis tests: TNO®, StereoTA B®, and Fly Stereo Acuity Test® and to study the sensitivity and correlation between them, using TNO® as the gold standard. Other variables as near convergence point, vergences, symptoms and optical correction were correlated with the 3 tests. Materials and Methods: Forty-nine students from Escola Superior de Tecnologia da Saúde de Lisboa (ESTeSL), aged 18-26 years old were included. Results: The stereopsis mean (standard-deviation-SD) values in each test were: TNO® = 87.04” ±84.09”; FlyTest® = 38.18” ±34.59”; StereoTA B® = 124.89’’ ±137.38’’. About the coefficient of determination: TNO® and StereoTA B® with R2 = 0.6 e TNO® and FlyTest® with R2 =0.2. Pearson correlation coefficient shows a positive correlation between TNO® and StereoTA B® (r = 0.784 with α = 0.01). Phi coefficient shows a strong and positive association between TNO® and StereoTA B® (Φ = 0.848 with α = 0.01). In the ROC Curve, the StereoTA B® has an area under the curve bigger than the FlyTest® with a sensivity of 92.3% for 94.4% of specificity, so it means that the test is sensitive with a good discriminative power. Conclusion: We conclude that the use of Stereopsis tests to study global Stereopsis are an asset for clinical use. This type of test is more sensitive, revealing changes in Stereopsis when it is actually changed, unlike the test Stereopsis, which often indicates normal Stereopsis, camouflaging a Stereopsis change. We noted also that the StereoTA B ® is very sensitive and despite being a digital application, possessed good correlation with the TNO®.

The effect of Amblyopia on motor and psychosocial skills in children

Background/Aims: In an investigation of the functional impact of amblyopia on children, the fine motor skills, perceived self-esteem and eye movements of amblyopic children were compared with that of age-matched controls. The influence of amblyogenic condition or treatment factors that might predict any decrement in outcome measures was investigated. The relationship between indirect measures of eye movements that are used clinically and eye movement characteristics recorded during reading was examined and the relevance of proficiency in fine motor skills to performance on standardised educational tests was explored in a sub-group of the control children. Methods: Children with amblyopia (n=82; age 8.2 ± 1.3 years) from differing causes (infantile esotropia n=17, acquired strabismus n=28, anisometropia n=15, mixed n=13 and deprivation n=9), and a control group of children (n=106; age 9.5 ± 1.2 years) participated in this study. Measures of visual function included monocular logMAR visual acuity (VA) and stereopsis assessed with the Randot Preschool Stereoacuity test, while fine motor skills were measured using the Visual-Motor Control (VMC) and Upper Limb Speed and Dexterity (ULSD) subtests of the Brunicks-Oseretsky Test of Motor Proficiency. Perceived self esteem was assessed for those children from grade 3 school level with the Harter Self Perception Profile for Children and for those in younger grades (preschool to grade 2) with the Pictorial Scale of Perceived Competence and Acceptance for Young Children. A clinical measure of eye movements was made with the Developmental Eye Movement (DEM) test for those children aged eight years and above. For appropriate case-control comparison of data, the results from amblyopic children were compared with age-matched sub-samples drawn from the group of children with normal vision who completed the tests. Eye movements during reading for comprehension were recorded by the Visagraph infra-red recording system and results of standardised tests of educational performance were also obtained for a sub-set of the control group. Results Amblyopic children (n=82; age 8.2 ± 1.7 years) performed significantly poorer than age-matched control children (n=37; age 8.3 ± 1.3 years) on 9 of 16 fine motor skills sub-items and for the overall age-standardised scores for both VMC and ULSD items (p<0.05); differences were most evident on timed manual dexterity tasks. The underlying aetiology of amblyopia and level of stereoacuity significantly affected fine motor skill performance on both items. However, when examined in a multiple regression model that took into account the inter-correlation between visual characteristics, poorer fine motor skills performance was only associated with strabismus (F1,75 = 5.428; p =0. 022), and not with the level of stereoacuity, refractive error or visual acuity in either eye. Amblyopic children from grade 3 school level and above (n=47; age 9.2 ± 1.3 years), particularly those with acquired strabismus, had significantly lower social acceptance scores than age-matched control children (n=52; age 9.4 ± 0.5 years) (F(5,93) = 3.14; p = 0.012). However, the scores of the amblyopic children were not significantly different to controls for other areas related to self-esteem, including scholastic competence, physical appearance, athletic competence, behavioural conduct and global self worth. A lower social acceptance score was independently associated with a history of treatment with patching but not with a history of strabismus or wearing glasses. Amblyopic children from pre-school to grade 2 school level (n=29; age = 6.6 ± 0.6 years) had similar self-perception scores to their age-matched peers (n=20; age = 6.4 ± 0.5 years). There were no significant differences between the amblyopic (n=39; age 9.1 ± 0.9 years) and age-matched control (n = 42; age = 9.3 ± 0.38 years) groups for any of the DEM outcome measures (Vertical Time, Horizontal Time, Number of Errors and Ratio (Horizontal time/Vertical time)). Performance on the DEM did not significantly relate to measures of VA in either eye, level of binocular function, history of strabismus or refractive error. Developmental Eye Movement test outcome measures Horizontal Time and Vertical Time were significantly correlated with reading rates measured by the Visagraph for both reading for comprehension and naming numbers (r>0.5). Some moderate correlations were also seen between the DEM Ratio and word reading rates as recorded by Visagraph (r=0.37). In children with normal vision, academic scores in mathematics, spelling and reading were associated with measures of fine motor skills. Strongest effect sizes were seen with the timed manual dexterity domain, Upper Limb Speed and Dexterity. Conclusions Amblyopia may have a negative impact on a child’s fine motor skills and an older child’s sense of acceptance by their peers may be influenced by treatment that includes eye patching. Clinical measures of eye movements were not affected in amblyopic children. A number of the outcome measures of the DEM are associated with objective recordings of reading rates, supporting its clinical use for identification of children with slower reading rates. In children with normal vision, proficiency on clinical measures of fine motor skill are associated with outcomes on standardised measures of educational performance. Scores on timed manual dexterity tasks had the strongest association with educational performance. Collectively, the results of this study indicate that, in addition to the reduction in visual acuity and binocular function that define the condition, amblyopes have functional impairment in childhood development skills that underlie proficiency in everyday activities. The study provides support for strategies aimed at early identification and remediation of amblyopia and the co-morbidities that arise from abnormal visual neurodevelopment.

The impact of cataract surgery on vision-related quality of life for bilateral cataract patients in Ho Chi Minh City, Vietnam : a prospective study

Background To determine the impact of cataract surgery on vision-related quality of life (VRQOL) and examine the association between objective visual measures and change in VRQOL after surgery among bilateral cataract patients in Ho Chi Minh City, Vietnam. Methods A cohort of older patients with bilateral cataract was assessed one week before and one to three months after first eye or both eye cataract surgery. Visual measures including visual acuity, contrast sensitivity and stereopsis were obtained. Vision-related quality of life was assessed using the NEI VFQ-25. Descriptive analyses and a generalized linear estimating equation (GEE) analysis were undertaken to measure change in VRQOL after surgery. Results Four hundred and thirteen patients were assessed before cataract surgery and 247 completed the follow-up assessment one to three months after first or both eye cataract surgery. Overall, VRQOL significantly improved after cataract surgery (p < 0.001) particularly after both eye surgeries. Binocular contrast sensitivity (p < 0.001) and stereopsis (p < 0.001) were also associated with change in VRQOL after cataract surgery. Visual acuity was not associated with VRQOL. Conclusions Cataract surgery significantly improved VRQOL among bilateral cataract patients in Vietnam. Contrast sensitivity as well as stereopsis, rather than visual acuity significantly affected VRQOL after cataract surgery.