Wide-baseline keypoint detection and matching with wide-angle images for vision based localisation

This thesis addresses the problem of detecting and describing the same scene points in different wide-angle images taken by the same camera at different viewpoints. This is a core competency of many vision-based localisation tasks including visual odometry and visual place recognition. Wide-angle cameras have a large field of view that can exceed a full hemisphere, and the images they produce contain severe radial distortion. When compared to traditional narrow field of view perspective cameras, more accurate estimates of camera egomotion can be found using the images obtained with wide-angle cameras. The ability to accurately estimate camera egomotion is a fundamental primitive of visual odometry, and this is one of the reasons for the increased popularity in the use of wide-angle cameras for this task. Their large field of view also enables them to capture images of the same regions in a scene taken at very different viewpoints, and this makes them suited for visual place recognition. However, the ability to estimate the camera egomotion and recognise the same scene in two different images is dependent on the ability to reliably detect and describe the same scene points, or ‘keypoints’, in the images. Most algorithms used for this purpose are designed almost exclusively for perspective images. Applying algorithms designed for perspective images directly to wide-angle images is problematic as no account is made for the image distortion. The primary contribution of this thesis is the development of two novel keypoint detectors, and a method of keypoint description, designed for wide-angle images. Both reformulate the Scale- Invariant Feature Transform (SIFT) as an image processing operation on the sphere. As the image captured by any central projection wide-angle camera can be mapped to the sphere, applying these variants to an image on the sphere enables keypoints to be detected in a manner that is invariant to image distortion. Each of the variants is required to find the scale-space representation of an image on the sphere, and they differ in the approaches they used to do this. Extensive experiments using real and synthetically generated wide-angle images are used to validate the two new keypoint detectors and the method of keypoint description. The best of these two new keypoint detectors is applied to vision based localisation tasks including visual odometry and visual place recognition using outdoor wide-angle image sequences. As part of this work, the effect of keypoint coordinate selection on the accuracy of egomotion estimates using the Direct Linear Transform (DLT) is investigated, and a simple weighting scheme is proposed which attempts to account for the uncertainty of keypoint positions during detection. A word reliability metric is also developed for use within a visual ‘bag of words’ approach to place recognition.

Multiple camera management using wide baseline matching

Camera calibration information is required in order for multiple camera networks to deliver more than the sum of many single camera systems. Methods exist for manually calibrating cameras with high accuracy. Manually calibrating networks with many cameras is, however, time consuming, expensive and impractical for networks that undergo frequent change. For this reason, automatic calibration techniques have been vigorously researched in recent years. Fully automatic calibration methods depend on the ability to automatically find point correspondences between overlapping views. In typical camera networks, cameras are placed far apart to maximise coverage. This is referred to as a wide base-line scenario. Finding sufficient correspondences for camera calibration in wide base-line scenarios presents a significant challenge. This thesis focuses on developing more effective and efficient techniques for finding correspondences in uncalibrated, wide baseline, multiple-camera scenarios. The project consists of two major areas of work. The first is the development of more effective and efficient view covariant local feature extractors. The second area involves finding methods to extract scene information using the information contained in a limited set of matched affine features. Several novel affine adaptation techniques for salient features have been developed. A method is presented for efficiently computing the discrete scale space primal sketch of local image features. A scale selection method was implemented that makes use of the primal sketch. The primal sketch-based scale selection method has several advantages over the existing methods. It allows greater freedom in how the scale space is sampled, enables more accurate scale selection, is more effective at combining different functions for spatial position and scale selection, and leads to greater computational efficiency. Existing affine adaptation methods make use of the second moment matrix to estimate the local affine shape of local image features. In this thesis, it is shown that the Hessian matrix can be used in a similar way to estimate local feature shape. The Hessian matrix is effective for estimating the shape of blob-like structures, but is less effective for corner structures. It is simpler to compute than the second moment matrix, leading to a significant reduction in computational cost. A wide baseline dense correspondence extraction system, called WiDense, is presented in this thesis. It allows the extraction of large numbers of additional accurate correspondences, given only a few initial putative correspondences. It consists of the following algorithms: An affine region alignment algorithm that ensures accurate alignment between matched features; A method for extracting more matches in the vicinity of a matched pair of affine features, using the alignment information contained in the match; An algorithm for extracting large numbers of highly accurate point correspondences from an aligned pair of feature regions. Experiments show that the correspondences generated by the WiDense system improves the success rate of computing the epipolar geometry of very widely separated views. This new method is successful in many cases where the features produced by the best wide baseline matching algorithms are insufficient for computing the scene geometry.

Vulnerability factors for disaster-induced child post-traumatic stress disorder : the case for low family resilience and previous mental illness

Objective: The aim of the present study was to investigate whether parent report of family resilience predicted children’s disaster-induced post-traumatic stress disorder (PTSD) and general emotional symptoms, independent of a broad range of variables including event-related factors, previous child mental illness and social connectedness. ---------- Methods: A total of 568 children (mean age = 10.2 years, SD = 1.3) who attended public primary schools, were screened 3 months after Cyclone Larry devastated the Innisfail region of North Queensland. Measures included parent report on the Family Resilience Measure and Strengths and Difficulties Questionnaire (SDQ)–emotional subscale and child report on the PTSD Reaction Index, measures of event exposure and social connectedness. ---------- Results: Sixty-four students (11.3%) were in the severe–very severe PTSD category and 53 families (28.6%) scored in the poor family resilience range. A lower family resilience score was associated with child emotional problems on the SDQ and longer duration of previous child mental health difficulties, but not disaster-induced child PTSD or child threat perception on either bivariate analysis, or as a main or moderator variable on multivariate analysis (main effect: adjusted odds ratio (ORadj) = 0.57, 95% confidence interval (CI) = 0.13–2.44). Similarly, previous mental illness was not a significant predictor of child PTSD in the multivariate model (ORadj = 0.75, 95%CI = 0.16–3.61). ---------- Conclusion: In this post-disaster sample children with existing mental health problems and those of low-resilience families were not at elevated risk of PTSD. The possibility that the aetiological model of disaster-induced child PTSD may differ from usual child and adolescent conceptualizations is discussed.

Response of cells on surface-induced nanopatterns: Fibroblasts and mesenchymal progenitor cells

Ultrathin films of a poly(styrene)-block-poly(2-vinylpyrindine) diblock copolymer (PS-b-P2VP) and poly(styrene)-block-poly(4-vinylpyrindine) diblock copolymer (PS-b-P4VP) were used to form surface-induced nanopattern (SINPAT) on mica. Surface interaction controlled microphase separation led to the formation of chemically heterogeneous surface nanopatterns on dry ultrathin films. Two distinct nanopatterned surfaces, namely, wormlike and dotlike patterns, were used to investigate the influence of topography in the nanometer range on cell adhesion, proliferation, and migration. Atomic force microscopy was used to confirm that SINPAT was stable under cell culture conditions. Fibroblasts and mesenchymal progenitor cells were cultured on the nanopatterned surfaces. Phase contrast and confocal laser microscopy showed that fibroblasts and mesenchymal progenitor cells preferred the densely spaced wormlike patterns. Atomic force microscopy showed that the cells remodelled the extracellular matrix differently as they migrate over the two distinctly different nanopatterns

Investigation on parameters used in warning systems for rain-induced embankment instability

A number of instrumented laboratory-scale soil embankment slopes were subjected to artificial rainfall until they failed. The factor of safety of the slope based on real-time measurements of pore-water pressure (suction) and laboratory measured soil properties were calculated as the rainfall progressed. Based on the experiment measurements and slope stability analysis, it was observed that slope displacement measurements can be used to warn the slope failure more accurately. Further, moisture content/pore-water pressure measurements near the toe of the slope and the real-time factor of safety can also be used for prediction of rainfall-induced embankment failures with adequate accuracy.

Cystine-mediated oxidative defence in Lactobacillus reuteri BR11

Lactobacillus reuteri BR11 possesses an abundant cystine uptake (Cyu) ABC-transporter that was previously found to be involved in a novel mechanism of oxidative defence mediated by cystine. The current study aimed to elucidate this mechanism with a focus on the role of the co-transcribed cystathionine ã-lyase (Cgl). Growth studies of wild-type L. reuteri BR11 and mutants inactivated in cgl and the cystine-binding protein encoding gene cyuC showed that in contrast to the Cyu transporter, whose inactivation led to growth arrest in aerated cultures, Cgl is not crucial for oxidative defence. However, the role of Cgl in oxidative defence became apparent in the presence of severe oxidative damage and cysteine deprivation. Cysteine was found to be protective against oxidative stress, and the action of Cgl in both cysteine biosynthesis and degradation poses a seemingly futile pathway that deprives the intracellular cysteine pool. To further characterise the relationship between Cgl activity and cysteine and their roles in oxidative defence, enzymatic assays were performed on purified Cgl, and intracellular concentrations of cysteine, cystathionine and methionine were determined. Cgl was highly active towards cystine and cystathionine and less active towards cysteine in vitro, suggesting the main function of Cgl to be cysteine biosynthesis. Cysteine was found at high concentrations in the cell, but the levels were not significantly affected by inactivation of cgl or growth under aerobic conditions. It was concluded that both anabolic and catabolic activities of Cgl towards cysteine contribute to oxidative defence, the former by maintaining an intracellular reservoir of thiol analogous to glutathione, and the latter by producing H2S which is readily secreted, thus creating a reducing extracellular environment. The significance of the Cyu transporter to the physiology of L. reuteri BR11 prompted a phylogenetic study to determine its presence in bacteria. Orthologs of the Cyu transporter that are closest matches to the Cyu transporter are only limited to several species of Lactobacillus and Leuconostoc. Outside the Lactobacillales order, the closest matching orthologs belong to Proteobacteria, and there are more orthologs in Proteobacteria than non-Lactobacillales Firmicutes, suggesting that the Cyu transporter locus was present in the ancestor of the Proteobacteria and Firmicutes, and over evolutionary time has been lost or diverged in many Firmicutes. The clustering of the Cyu transporter locus with a gene encoding a Cgl family protein is even rarer. It was only found in L. reuteri, Lactobacillus vaginalis, Weissella paramesenteroides, the Lactobacillus casei group, and several Campylobacter sp. An accompanying phylogenetic study of L. reuteri BR11 using multi-locus sequence analysis showed that L. reuteri BR11 had diverged from more than 100 strains of L. reuteri isolated from various hosts and geographical locations. However, comparison with other Lactobacillus species supported the current classification of BR11 as L. reuteri. The most closely related species to L. reuteri is L. vaginalis or Lactobacillus antri, depending on the housekeeping gene used for analysis. The close evolutionary relationship of L. vaginalis to L. reuteri and the high degree of sequence identity between the cgl-cyuABC loci in both species suggest that the Cyu system is highly likely to perform similar functions in L. vaginalis. In search of other genes that function in oxidative defence, a number of mutants which were inactivated in genes that confer increased resistance to oxidative stress in other bacteria were constructed. The genes targeted were ahpC (peroxidase component of the alkyl hydroperoxide reductase system), tpx (thiol peroxidase), osmC (osmotically induced protein C), mntH (Mn2+/Fe2+ transporter), gshA (ã-glutamylcysteine synthetase) and msrA (methionine sulfoxide reductase). The ahpC and mntH mutants had slightly lower minimum inhibitory concentrations of organic peroxides, suggesting these genes might be involved in resistance to organic peroxides in L. reuteri. However, none of the mutants exhibited growth defects in aerated cultures, in stark contrast to the cyuC mutant. This may be due to compensatory functions of other genes, a hypothesis which cannot be tested until a robust protocol for constructing markerless multiple gene deletion mutants in L. reuteri is developed. These results highlight the importance of the Cyu transporter in oxidative defence and provide a foundation for extending the research of this system in other bacteria.

Improving matching process in social network

Online dating networks, a type of social network, are gaining popularity. With many people joining and being available in the network, users are overwhelmed with choices when choosing their ideal partners. This problem can be overcome by utilizing recommendation methods. However, traditional recommendation methods are ineffective and inefficient for online dating networks where the dataset is sparse and/or large and two-way matching is required. We propose a methodology by using clustering, SimRank to recommend matching candidates to users in an online dating network. Data from a live online dating network is used in evaluation. The success rate of recommendation obtained using the proposed method is compared with baseline success rate of the network and the performance is improved by double.

A social matching system for an online dating network : a preliminary study

Due to the change in attitudes and lifestyles, people expect to find new partners and friends via various ways now-a-days. Online dating networks create a network for people to meet each other and allow making contact with different objectives of developing a personal, romantic or sexual relationship. Due to the higher expectation of users, online matching companies are trying to adopt recommender systems. However, the existing recommendation techniques such as content-based, collaborative filtering or hybrid techniques focus on users explicit contact behaviors but ignore the implicit relationship among users in the network. This paper proposes a social matching system that uses past relations and user similarities in finding potential matches. The proposed system is evaluated on the dataset collected from an online dating network. Empirical analysis shows that the recommendation success rate has increased to 31% as compared to the baseline success rate of 19%.

A Taxonomy of image matching techniques for stereo vision

Stereo vision is a method of depth perception, in which depth information is inferred from two (or more) images of a scene, taken from different perspectives. Applications of stereo vision include aerial photogrammetry, autonomous vehicle guidance, robotics, industrial automation and stereomicroscopy. A key issue in stereo vision is that of image matching, or identifying corresponding points in a stereo pair. The difference in the positions of corresponding points in image coordinates is termed the parallax or disparity. When the orientation of the two cameras is known, corresponding points may be projected back to find the location of the original object point in world coordinates. Matching techniques are typically categorised according to the nature of the matching primitives they use and the matching strategy they employ. This report provides a detailed taxonomy of image matching techniques, including area based, transform based, feature based, phase based, hybrid, relaxation based, dynamic programming and object space methods. A number of area based matching metrics as well as the rank and census transforms were implemented, in order to investigate their suitability for a real-time stereo sensor for mining automation applications. The requirements of this sensor were speed, robustness, and the ability to produce a dense depth map. The Sum of Absolute Differences matching metric was the least computationally expensive; however, this metric was the most sensitive to radiometric distortion. Metrics such as the Zero Mean Sum of Absolute Differences and Normalised Cross Correlation were the most robust to this type of distortion but introduced additional computational complexity. The rank and census transforms were found to be robust to radiometric distortion, in addition to having low computational complexity. They are therefore prime candidates for a matching algorithm for a stereo sensor for real-time mining applications. A number of issues came to light during this investigation which may merit further work. These include devising a means to evaluate and compare disparity results of different matching algorithms, and finding a method of assigning a level of confidence to a match. Another issue of interest is the possibility of statistically combining the results of different matching algorithms, in order to improve robustness.

Matching cognitive styles to computer-based instruction : an approach for enhanced learning in electrical engineering

An approach aimed at enhancing learning by matching individual students' preferred cognitive styles to computer-based instructional (CBI) material is presented. This approach was used in teaching some components of a third-year unit in an electrical engineering course at the Queensland University of Technology. Cognitive style characteristics of perceiving and processing information were considered. The bimodal nature of cognitive styles (analytic/imager, analytic/verbalizer, wholist/imager and wholist/verbalizer) was examined in order to assess the full ramification of cognitive styles on learning. In a quasi-experimental format, students' cognitive styles were analysed by cognitive style analysis (CSA) software. On the basis of the CSA results the system defaulted students to either matched or mismatched CBI material. The consistently better performance by the matched group suggests potential for further investigations where the limitations cited in this paper are eliminated. Analysing the differences between cognitive styles on individual test tasks also suggests that certain test tasks may better suit certain cognitive styles.

Insulin-like growth factor-i : vitronectin complex-induced changes in gene expression effect breast cell survival and migration

Recent studies have demonstrated that IGF-I associates with VN through IGF-binding proteins (IGFBP) which in turn modulate IGF-stimulated biological functions such as cell proliferation, attachment and migration. Since IGFs play important roles in transformation and progression of breast tumours, we aimed to describe the effects of IGF-I:IGFBP:VN complexes on breast cell function and to dissect mechanisms underlying these responses. In this study we demonstrate that substrate-bound IGF-I:IGFBP:VN complexes are potent stimulators of MCF-7 breast cell survival, which is mediated by a transient activation of ERK/MAPK and sustained activation of PI3-K/AKT pathways. Furthermore, use of pharmacological inhibitors of the MAPK and PI3-K pathways confirms that both pathways are involved in IGF-I:IGFBP:VN complex-mediated increased cell survival. Microarray analysis of cells stimulated to migrate in response to IGF-I:IGFBP:VN complexes identified differential expression of genes with previously reported roles in migration, invasion and survival (Ephrin-B2, Sharp-2, Tissue-factor, Stratifin, PAI-1, IRS-1). These changes were not detected when the IGF-I analogue (\[L24]\[A31]-IGF-I), which fails to bind to the IGF-I receptor, was substituted; confirming the IGF-I-dependent differential expression of genes associated with enhanced cell migration. Taken together, these studies have established that IGF-I:IGFBP:VN complexes enhance breast cell migration and survival, processes central to facilitating metastasis. This study highlights the interdependence of ECM and growth factor interactions in biological functions critical for metastasis and identifies potential novel therapeutic targets directed at preventing breast cancer progression.

Apoptosis is induced in Chlamydia trachomatis infected HEp-2 cells by the addition of a combination innate immune activation compounds and the inhibitor wedelolactone

Problem: Innate immune activation of human cells, for some intracellular pathogens, is advantageous for vacuole morphology and pathogenic viability. It is unknown whether innate immune activation is advantageous to Chlamydia trachomatis viability. ----- ----- Method of study: Innate immune activation of HEp-2 cells during Chlamydia infection was conducted using lipopolysaccharide (LPS), polyI:C, and wedelolactone (innate immune inhibitor) to investigate the impact of these conditions on viability of Chlamydia. ----- ----- Results: The addition of LPS and polyI:C to stimulate activation of the two distinct innate immune pathways (nuclear factor kappa beta and interferon regulatory factor) had no impact on the viability of Chlamydia. However, when compounds targeting either pathway were added in combination with the specific innate immune inhibitor (wedelolactone) a major impact on Chlamydia viability was observed. This impact was found to be due to the induction of apoptosis of the HEp-2 cells under these conditions. ----- ----- Conclusion: This is the first time that induction of apoptosis has been reported in C. trachomatis-infected cells when treated with a combination of innate immune activators and wedelolactone.

Involvement of Exo1b in DNA damage-induced apoptosis

Apoptosis is essential for the maintenance of inherited genomic integrity. During DNA damage-induced apoptosis, mechanisms of cell survival, such as DNA repair are inactivated to allow cell death to proceed. Here, we describe a role for the mammalian DNA repair enzyme Exonuclease 1 (Exo1) in DNA damage-induced apoptosis. Depletion of Exo1 in human fibroblasts, or mouse embryonic fibroblasts led to a delay in DNA damage-induced apoptosis. Furthermore, we show that Exo1 acts upstream of caspase-3, DNA fragmentation and cytochrome c release. In addition, induction of apoptosis with DNA-damaging agents led to cleavage of both isoforms of Exo1. The cleavage of Exo1 was mapped to Asp514, and shown to be mediated by caspase-3. Expression of a caspase-3 cleavage site mutant form of Exo1, Asp514Ala, prevented formation of the previously observed fragment without any affect on the onset of apoptosis. We conclude that Exo1 has a role in the timely induction of apoptosis and that it is subsequently cleaved and degraded during apoptosis, potentially inhibiting DNA damage repair.