Wide-baseline keypoint detection and matching with wide-angle images for vision based localisation

This thesis addresses the problem of detecting and describing the same scene points in different wide-angle images taken by the same camera at different viewpoints. This is a core competency of many vision-based localisation tasks including visual odometry and visual place recognition. Wide-angle cameras have a large field of view that can exceed a full hemisphere, and the images they produce contain severe radial distortion. When compared to traditional narrow field of view perspective cameras, more accurate estimates of camera egomotion can be found using the images obtained with wide-angle cameras. The ability to accurately estimate camera egomotion is a fundamental primitive of visual odometry, and this is one of the reasons for the increased popularity in the use of wide-angle cameras for this task. Their large field of view also enables them to capture images of the same regions in a scene taken at very different viewpoints, and this makes them suited for visual place recognition. However, the ability to estimate the camera egomotion and recognise the same scene in two different images is dependent on the ability to reliably detect and describe the same scene points, or ‘keypoints’, in the images. Most algorithms used for this purpose are designed almost exclusively for perspective images. Applying algorithms designed for perspective images directly to wide-angle images is problematic as no account is made for the image distortion. The primary contribution of this thesis is the development of two novel keypoint detectors, and a method of keypoint description, designed for wide-angle images. Both reformulate the Scale- Invariant Feature Transform (SIFT) as an image processing operation on the sphere. As the image captured by any central projection wide-angle camera can be mapped to the sphere, applying these variants to an image on the sphere enables keypoints to be detected in a manner that is invariant to image distortion. Each of the variants is required to find the scale-space representation of an image on the sphere, and they differ in the approaches they used to do this. Extensive experiments using real and synthetically generated wide-angle images are used to validate the two new keypoint detectors and the method of keypoint description. The best of these two new keypoint detectors is applied to vision based localisation tasks including visual odometry and visual place recognition using outdoor wide-angle image sequences. As part of this work, the effect of keypoint coordinate selection on the accuracy of egomotion estimates using the Direct Linear Transform (DLT) is investigated, and a simple weighting scheme is proposed which attempts to account for the uncertainty of keypoint positions during detection. A word reliability metric is also developed for use within a visual ‘bag of words’ approach to place recognition.

Vision based control for fixed wing UAVs inspecting locally linear infrastructure using skid-to-turn maneuvers

The following paper proposes a novel application of Skid-to-Turn maneuvers for fixed wing Unmanned Aerial Vehicles (UAVs) inspecting locally linear infrastructure. Fixed wing UAVs, following the design of manned aircraft, commonly employ Bank-to-Turn ma- neuvers to change heading and thus direction of travel. Whilst effective, banking an aircraft during the inspection of ground based features hinders data collection, with body fixed sen- sors angled away from the direction of turn and a panning motion induced through roll rate that can reduce data quality. By adopting Skid-to-Turn maneuvers, the aircraft can change heading whilst maintaining wings level flight, thus allowing body fixed sensors to main- tain a downward facing orientation. An Image-Based Visual Servo controller is developed to directly control the position of features as captured by onboard inspection sensors. This improves on the indirect approach taken by other tracking controllers where a course over ground directly above the feature is assumed to capture it centered in the field of view. Performance of the proposed controller is compared against that of a Bank-to-Turn tracking controller driven by GPS derived cross track error in a simulation environment developed to replicate the field of view of a body fixed camera.

Towards the implementation of vision-based UAS sense-and-avoid

Machine vision represents a particularly attractive solution for sensing and detecting potential collision-course targets due to the relatively low cost, size, weight, and power requirements of the sensors involved. This paper describes the development of detection algorithms and the evaluation of a real-time flight ready hardware implementation of a vision-based collision detection system suitable for fixed-wing small/medium size UAS. In particular, this paper demonstrates the use of Hidden Markov filter to track and estimate the elevation (β) and bearing (α) of the target, compares several candidate graphic processing hardware choices, and proposes an image based visual servoing approach to achieve collision avoidance

A vision of the past : The Mill Albion

This paper examines The Mill Albion community history project, a diverse, multi-layered public history/art program that captures the social heritage of The Albion Flour Mill, as told through images produced as part of a research consultancy undertaken by QUT for FKP Property Group. The Albion Flour Mill was built in 1930 and continued operations for more than 72 years. After ceasing operation in 2005 the site was left to deteriorate. The FKP Property Group purchased the land to undertake a new urban redevelopment project. This paper reflects on the project and showcases some of the culturally creative ways this community’s history was told, using images.

Mild systemic hypoxia and photopic visual field sensitivity

Purpose: Flickering stimuli increase the metabolic demand of the retina,making it a sensitive perimetric stimulus to the early onset of retinal disease. We determine whether flickering stimuli are a sensitive indicator of vision deficits resulting from to acute, mild systemic hypoxia when compared to standard static perimetry. Methods: Static and flicker visual perimetry were performed in 14 healthy young participants while breathing 12% oxygen (hypoxia) under photopic illumination. The hypoxia visual field data were compared with the field data measured during normoxia. Absolute sensitivities (in dB) were analysed in seven concentric rings at 1°, 3°, 6°, 10°, 15°, 22° and 30° eccentricities as well as mean defect (MD) and pattern defect (PD) were calculated. Preliminary data are reported for mesopic light levels. Results: Under photopic illumination, flicker and static visual field sensitivities at all eccentricities were not significantly different between hypoxia and normoxia conditions. The mean defect and pattern defect were not significantly different for either test between the two oxygenation conditions. Conclusion: Although flicker stimulation increases cellular metabolism, flicker photopic visual field impairment is not detected during mild hypoxia. These findings contrast with electrophysiological flicker tests in young participants that show impairment at photopic illumination during the same levels of mild hypoxia. Potential mechanisms contributing to the difference between the visual fields and electrophysiological flicker tests including variability in perimetric data, neuronal adaptation and vascular autoregulation, are considered. The data have implications for the use of visual perimetry in the detection of ischaemic/hypoxic retinal disorders under photopic and mesopic light levels.

The effect of presbyiopic vision corrections on nighttime driving performance

Purpose. To investigate the effect of various presbyopic vision corrections on nighttime driving performance on a closed-road driving circuit. Methods. Participants were 11 presbyopes (mean age, 57.3 ± 5.8 years), with a mean best sphere distance refractive error of R+0.23±1.53 DS and L+0.20±1.50 DS, whose only experience of wearing presbyopic vision correction was reading spectacles. The study involved a repeated-measures design by which a participant's nighttime driving performance was assessed on a closed-road circuit while wearing each of four power-matched vision corrections. These included single-vision distance lenses (SV), progressive-addition spectacle lenses (PAL), monovision contact lenses (MV), and multifocal contact lenses (MTF CL) worn in a randomized order. Measures included low-contrast road hazard detection and avoidance, road sign and near target recognition, lane-keeping, driving time, and legibility distance for street signs. Eye movement data (fixation duration and number of fixations) were also recorded. Results. Street sign legibility distances were shorter when wearing MV and MTF CL than SV and PAL (P < 0.001), and participants drove more slowly with MTF CL than with PALs (P = 0.048). Wearing SV resulted in more errors (P < 0.001) and in more (P = 0.002) and longer (P < 0.001) fixations when responding to near targets. Fixation duration was also longer when viewing distant signs with MTF CL than with PAL (P = 0.031). Conclusions. Presbyopic vision corrections worn by naive, unadapted wearers affected nighttime driving. Overall, spectacle corrections (PAL and SV) performed well for distance driving tasks, but SV negatively affected viewing near dashboard targets. MTF CL resulted in the shortest legibility distance for street signs and longer fixation times.

Functional status, postural stability and falls among older adults with glaucoma

Visual impairment is an important contributing factor in falls among older adults, which is one of the leading causes of injury and injury-related death in this population. Visual impairment is also associated with greater disability among older adults, including poorer health-related quality of life, increased frailty and reduced postural stability. The majority of this evidence, however, is based on measures of central visual function, rather than peripheral visual function. As such, there is comparatively limited research on the associations between peripheral visual function, disability and falls, and even fewer studies involving older adults with specific diseases which affect peripheral visual function, the most common of which is glaucoma. Glaucoma is one of the leading causes of irreversible vision loss among older adults, affecting around 3 per cent of adults aged over 60 years. The condition is characterised by retinal nerve fibre loss, primarily affecting peripheral visual function. Importantly, the number of older adults with glaucomatous visual impairment is projected to increase as the ageing population grows. The first component of the thesis examined the cross-sectional association between glaucomatous visual impairment and health-related quality of life (Study 1a), functional status (Study 1b) and postural stability (Study 1c) among older adults. A cohort of 74 community-dwelling adults with glaucoma (mean age 74.2 ± 5.9 years) was recruited and completed a baseline assessment. A number of visual function measures was assessed, including central visual function (visual acuity and contrast sensitivity), motion sensitivity, retinal nerve fibre analysis and monocular and binocular visual field measures (monocular 24-2 and binocular integrated visual fields (IVF): IVF-60 and IVF-120). The analyses focused on the associations between the outcomes measures and severity and location of visual field loss, as this is the primary visual function affected by glaucoma. In Study 1a, we examined the association between visual field loss and health-related quality of life, measured by the Short Form 36-item Health Survey (SF-36). Greater binocular visual field loss, on both IVF measures, was associated with lower SF-36 physical component scores, adjusted for age and gender (Pearson's r =|0.32| to |0.36|, p<0.001). Furthermore, inferior visual field loss was more strongly associated with the SF-36 physical component than superior field loss. No association was found between visual field loss and SF-36 mental component scores. The association between visual field loss and functional status was examined in Study 1b. Functional status outcomes measures included a physical activity questionnaire (Physical Activity Scale for the Elderly, PASE), performance tests (six-minute walk test, timed up and go test and lower leg strength) and an overall functional status score. Significant, but weak, correlations were found between binocular visual field loss and PASE and overall functional status scores, adjusted for age and gender (Pearson's r =|0.24| to |0.33|, p<0.05). Greater inferior visual field loss, independent of superior visual field loss, was significantly associated with poorer physical performance results and lower overall functional status scores. In Study 1c, we examined the association between visual field loss and postural stability, using a swaymeter device which recorded body movement during four conditions: eyes open and closed, on a firm and foam surface. Greater binocular visual field loss was associated with increased postural sway, both on firm and foam surfaces, independent of age and gender (Pearson’s r =|0.44| to |0.46|, p <0.001). Furthermore, inferior visual field was a stronger contributor to postural stability, more so than the superior visual field, particularly on the foam condition with the eyes open. Greater visual field loss was associated with a reduction in the visual contribution to postural sway, which underlies the observed association with postural sway. The second component of the thesis examined the association between severity and location of visual field loss and falls during a 12-month longitudinal follow-up. The number of falls was assessed prospectively using monthly fall calendars. Of the 71 participants who successfully completed the follow up (mean age 73.9 ± 5.7 years), 44% reported one or more falls, and around 20% reported two or more falls. After adjusting for age and gender, every 10 points missed on the IVF-120 increased the rate of falls by 25% (rate ratio 1.25, 95% confidence interval 1.08 - 1.44) or every 5dB reduction in IVF-60 increased the rate of falls by 47% (rate ratio 1.47, 95% confidence interval 1.16 - 1.87). Inferior visual field loss was a significant predictor of falls, more so than superior field loss, highlighting the importance of the inferior visual field area in safe and efficient navigation. Further analyses indicated that postural stability, more so than functional status, may be a potential mediating factor in the relationship between visual field loss and falls. Future research is required to confirm this causal pathway. In addition, the use of topical beta-blocker medications was not associated with an increased rate of falls in this cohort, compared with the use of other topical anti-glaucoma medications. In summary, greater binocular visual field loss among older adults with glaucoma was associated with poorer health-related quality of life in the physical domain, reduced functional status, greater postural instability and higher rates of falling. When the location of visual field loss was examined, inferior visual field loss was consistently more strongly associated with these outcomes than superior visual field loss. Insights gained from this research improve our understanding of the association between glaucomatous visual field loss and disability, and its link with falls among older adults. The clinical implications of this research include the need to include visual field screening in falls risk assessments among older adults and to raise awareness of these findings to eye care practitioners and adults with glaucoma. The findings also assist in developing further research to examine strategies to reduce disability and prevent falls among older adults with glaucoma to promote healthy ageing and independence for these individuals.

The development and validation of two complementary measures of drivers' hazard perception ability

Hazard perception in driving involves a number of different processes. This paper reports the development of two measures designed to separate these processes. A Hazard Perception Test was developed to measure how quickly drivers could anticipate hazards overall, incorporating detection, trajectory prediction, and hazard classification judgements. A Hazard Change Detection Task was developed to measure how quickly drivers can detect a hazard in a static image regardless of whether they consider it hazardous or not. For the Hazard Perception Test, young novices were slower than mid-age experienced drivers, consistent with differences in crash risk, and test performance correlated with scores in pre-existing Hazard Perception Tests. For drivers aged 65 and over, scores on the Hazard Perception Test declined with age and correlated with both contrast sensitivity and a Useful Field of View measure. For the Hazard Change Detection Task, novices responded quicker than the experienced drivers, contrary to crash risk trends, and test performance did not correlate with measures of overall hazard perception. However for drivers aged 65 and over, test performance declined with age and correlated with both hazard perception and Useful Field of View. Overall we concluded that there was support for the validity of the Hazard Perception Test for all ages but the Hazard Change Detection Task might only be appropriate for use with older drivers.

Corneal confocal microscopy : a novel noninvasive test to diagnose and stratify the severity of human diabetic neuropathy

OBJECTIVE: The accurate quantification of human diabetic neuropathy is important to define at-risk patients, anticipate deterioration, and assess new therapies. ---------- RESEARCH DESIGN AND METHODS: A total of 101 diabetic patients and 17 age-matched control subjects underwent neurological evaluation, neurophysiology tests, quantitative sensory testing, and evaluation of corneal sensation and corneal nerve morphology using corneal confocal microscopy (CCM). ---------- RESULTS: Corneal sensation decreased significantly (P = 0.0001) with increasing neuropathic severity and correlated with the neuropathy disability score (NDS) (r = 0.441, P < 0.0001). Corneal nerve fiber density (NFD) (P < 0.0001), nerve fiber length (NFL), (P < 0.0001), and nerve branch density (NBD) (P < 0.0001) decreased significantly with increasing neuropathic severity and correlated with NDS (NFD r = −0.475, P < 0.0001; NBD r = −0.511, P < 0.0001; and NFL r = −0.581, P < 0.0001). NBD and NFL demonstrated a significant and progressive reduction with worsening heat pain thresholds (P = 0.01). Receiver operating characteristic curve analysis for the diagnosis of neuropathy (NDS >3) defined an NFD of <27.8/mm2 with a sensitivity of 0.82 (95% CI 0.68–0.92) and specificity of 0.52 (0.40–0.64) and for detecting patients at risk of foot ulceration (NDS >6) defined a NFD cutoff of <20.8/mm2 with a sensitivity of 0.71 (0.42–0.92) and specificity of 0.64 (0.54–0.74). ---------- CONCLUSIONS: CCM is a noninvasive clinical technique that may be used to detect early nerve damage and stratify diabetic patients with increasing neuropathic severity. Established diabetic neuropathy leads to pain and foot ulceration. Detecting neuropathy early may allow intervention with treatments to slow or reverse this condition (1). Recent studies suggested that small unmyelinated C-fibers are damaged early in diabetic neuropathy (2–4) but can only be detected using invasive procedures such as sural nerve biopsy (4,5) or skin-punch biopsy (6–8). Our studies have shown that corneal confocal microscopy (CCM) can identify early small nerve fiber damage and accurately quantify the severity of diabetic neuropathy (9–11). We have also shown that CCM relates to intraepidermal nerve fiber loss (12) and a reduction in corneal sensitivity (13) and detects early nerve fiber regeneration after pancreas transplantation (14). Recently we have also shown that CCM detects nerve fiber damage in patients with Fabry disease (15) and idiopathic small fiber neuropathy (16) when results of electrophysiology tests and quantitative sensory testing (QST) are normal. In this study we assessed corneal sensitivity and corneal nerve morphology using CCM in diabetic patients stratified for the severity of diabetic neuropathy using neurological evaluation, electrophysiology tests, and QST. This enabled us to compare CCM and corneal esthesiometry with established tests of diabetic neuropathy and define their sensitivity and specificity to detect diabetic patients with early neuropathy and those at risk of foot ulceration.

In vivo performance of melimine as an antimicrobial coating for contact lenses in models of CLARE and CLPU

Purpose: One strategy to minimize bacteria-associated adverse responses such as microbial keratitis, contact lens–induced acute red eye (CLARE), and contact lens induced peripheral ulcers (CLPUs) that occur with contact lens wear is the development of an antimicrobial or antiadhesive contact lens. Cationic peptides represent a novel approach for the development of antimicrobial lenses.---------- Methods: A novel cationic peptide, melimine, was covalently incorporated into silicone hydrogel lenses. Confirmation tests to determine the presence of peptide and anti-microbial activity were performed. Cationic lenses were then tested for their ability to prevent CLPU in the Staphylococcus aureus rabbit model and CLARE in the Pseudomonas aeruginosa guinea pig model. ---------- Results: In the rabbit model of CLPU, melimine-coated lenses resulted in significant reductions in ocular symptom scores and in the extent of corneal infiltration (P < 0.05). Evaluation of the performance of melimine lenses in the CLARE model showed significant improvement in all ocular response parameters measured, including the percentage of eyes with corneal infiltrates, compared with those observed in the eyes fitted with the control lens (P ≤ 0.05). ---------- Conclusions: Cationic coating of contact lenses with the peptide melimine may represent a novel method of prevention of bacterial growth on contact lenses and consequently result in reduction of the incidence and severity of adverse responses due to Gram-positive and -negative bacteria during lens wear.

Predictors of future falls in Parkinson disease

Background: Falls are a major health and injury problem for people with Parkinson disease (PD). Despite the severe consequences of falls, a major unresolved issue is the identification of factors that predict the risk of falls in individual patients with PD. The primary aim of this study was to prospectively determine an optimal combination of functional and disease-specific tests to predict falls in individuals with PD. ----- ----- Methods: A total of 101 people with early-stage PD undertook a battery of neurologic and functional tests in their optimally medicated state. The tests included Tinetti, Berg, Timed Up and Go, Functional Reach, and the Physiological Profile Assessment of Falls Risk; the latter assessment includes physiologic tests of visual function, proprioception, strength, cutaneous sensitivity, reaction time, and postural sway. Falls were recorded prospectively over 6 months. ----- ----- Results: Forty-eight percent of participants reported a fall and 24% more than 1 fall. In the multivariate model, a combination of the Unified Parkinson's Disease Rating Scale (UPDRS) total score, total freezing of gait score, occurrence of symptomatic postural orthostasis, Tinetti total score, and extent of postural sway in the anterior-posterior direction produced the best sensitivity (78%) and specificity (84%) for predicting falls. From the UPDRS items, only the rapid alternating task category was an independent predictor of falls. Reduced peripheral sensation and knee extension strength in fallers contributed to increased postural instability. ----- ----- Conclusions: Falls are a significant problem in optimally medicated early-stage PD. A combination of both disease-specific and balance- and mobility-related measures can accurately predict falls in individuals with PD.

Simulated cataract and low contrast stimuli impair cognitive performance in older adults : implications for neuropsychological assessment and everyday function

Objective: To investigate how age-related declines in vision (particularly contrast sensitivity), simulated using cataract-goggles and low-contrast stimuli, influence the accuracy and speed of cognitive test performance in older adults. An additional aim was to investigate whether declines in vision differentially affect secondary more than primary memory. Method: Using a fully within-subjects design, 50 older drivers aged 66-87 years completed two tests of cognitive performance - letter matching (perceptual speed) and symbol recall (short-term memory) - under different viewing conditions that degraded visual input (low-contrast stimuli, cataract-goggles, and low-contrast stimuli combined with cataract-goggles, compared with normal viewing). However, presentation time was also manipulated for letter matching. Visual function, as measured using standard charts, was taken into account in statistical analyses. Results: Accuracy and speed for cognitive tasks were significantly impaired when visual input was degraded. Furthermore, cognitive performance was positively associated with contrast sensitivity. Presentation time did not influence cognitive performance, and visual gradation did not differentially influence primary and secondary memory. Conclusion: Age-related declines in visual function can impact on the accuracy and speed of cognitive performance, and therefore the cognitive abilities of older adults may be underestimated in neuropsychological testing. It is thus critical that visual function be assessed prior to testing, and that stimuli be adapted to older adults' sensory capabilities (e.g., by maximising stimuli contrast).

Simulated visual impairment leads to cognitive slowing in older adults

PURPOSE: To investigate the impact of different levels of simulated visual impairment on the cognitive test performance of older adults and to compare this with previous findings in younger adults. METHODS.: Cognitive performance was assessed in 30 visually normal, community-dwelling older adults (mean = 70.2 ± 3.9 years). Four standard cognitive tests were used including the Digit Symbol Substitution Test, Trail Making Tests A and B, and the Stroop Color Word Test under three visual conditions: normal baseline vision and two levels of cataract simulating filters (Vistech), which were administered in a random order. Distance high-contrast visual acuity and Pelli-Robson letter contrast sensitivity were also assessed for all three visual conditions. RESULTS.: Simulated cataract significantly impaired performance across all cognitive test performance measures. In addition, the impact of simulated cataract was significantly greater in this older cohort than in a younger cohort previously investigated. Individual differences in contrast sensitivity better predicted cognitive test performance than did visual acuity. CONCLUSIONS.: Visual impairment can lead to slowing of cognitive performance in older adults; these effects are greater than those observed in younger participants. This has important implications for neuropsychological testing of older populations who have a high prevalence of cataract.

'Radiant with possibility': involving young people in creating a vision for the future of their community

This paper argues that young people need to be given the opportunity to recognise the interaction between their own understandings of the world as it is now and the vision of what it might become. To support this argument, we discuss an urban planning project, known as the Lower Mill Site Project, which involved active participation of high school students from the local community. The outcomes of this project demonstrate the positive contributions young people can make to the process of urban redevelopment, the advantages of using a participatory design approach, and the utopian possibilities that can emerge when young people are invited to be part of an intergenerational community project.

Unaided stereo vision based pose estimation

This paper presents the development of a low-cost sensor platform for use in ground-based visual pose estimation and scene mapping tasks. We seek to develop a technical solution using low-cost vision hardware that allows us to accurately estimate robot position for SLAM tasks. We present results from the application of a vision based pose estimation technique to simultaneously determine camera poses and scene structure. The results are generated from a dataset gathered traversing a local road at the St Lucia Campus of the University of Queensland. We show the accuracy of the pose estimation over a 1.6km trajectory in relation to GPS ground truth.