Towards automatic object segmentation with sequential multiple views

Object segmentation is one of the fundamental steps for a number of robotic applications such as manipulation, object detection, and obstacle avoidance. This paper proposes a visual method for incorporating colour and depth information from sequential multiview stereo images to segment objects of interest from complex and cluttered environments. Rather than segmenting objects using information from a single frame in the sequence, we incorporate information from neighbouring views to increase the reliability of the information and improve the overall segmentation result. Specifically, dense depth information of a scene is computed using multiple view stereo. Depths from neighbouring views are reprojected into the reference frame to be segmented compensating for imperfect depth computations for individual frames. The multiple depth layers are then combined with color information from the reference frame to create a Markov random field to model the segmentation problem. Finally, graphcut optimisation is employed to infer pixels belonging to the object to be segmented. The segmentation accuracy is evaluated over images from an outdoor video sequence demonstrating the viability for automatic object segmentation for mobile robots using monocular cameras as a primary sensor.

Chlamydia

Chlamydial infections of humans can cause blindness and infertility as a result of diseases such as keratoconjunctivitis (trachoma), urethritis and cervicitis. However, in greater than half of all chlamydial diseases in males and females there are no signs or symptoms of infection. Chlamydia trachomatis is the causative bacterial organism responsible for the global estimate of 40.6 million people currently suffering with active trachoma and for the five million new cases of sexually transmitted infections each year in the United States of America. Even though antibiotics are available to treat Chlamydia, the incidence of each of these primarily asymptomatic infections continues to increase. In this Chapter we review the current knowledge of C.trachomatis including clinicial diseases and sequelae, the chlamydial developmental cycle in vivo, immunobiology and immune responses to infections, chlamydial genomics and vaccine development.

Graph rigidity for near-coplanar structure from motion

Recent algorithms for monocular motion capture (MoCap) estimate weak-perspective camera matrices between images using a small subset of approximately-rigid points on the human body (i.e. the torso and hip). A problem with this approach, however, is that these points are often close to coplanar, causing canonical linear factorisation algorithms for rigid structure from motion (SFM) to become extremely sensitive to noise. In this paper, we propose an alternative solution to weak-perspective SFM based on a convex relaxation of graph rigidity. We demonstrate the success of our algorithm on both synthetic and real world data, allowing for much improved solutions to marker less MoCap problems on human bodies. Finally, we propose an approach to solve the two-fold ambiguity over bone direction using a k-nearest neighbour kernel density estimator.

Learning informative features for indoor traversability

This paper presents a method for automatic terrain classification, using a cheap monocular camera in conjunction with a robot’s stall sensor. A first step is to have the robot generate a training set of labelled images. Several techniques are then evaluated for preprocessing the images, reducing their dimensionality, and building a classifier. Finally, the classifier is implemented and used online by an indoor robot. Results are presented, demonstrating an increased level of autonomy.

Development of novel vaccine strategies to prevent genital tract chlamydial infections

Chlamydia trachomatis is the most prevalent bacterial sexually transmitted infection in the developed world and the leading cause of preventable blindness worldwide. As reported by the World Health Organization in 2001, there are approximately 92 million new infections detected annually, costing health systems billions of dollars to treat not only the acute infection, but also to treat infection-associated sequelae. The majority of genital infections are asymptomatic, with 50-70% going undetected. Genital tract infections can be easily treated with antibiotics when detected. Lack of treatment can lead to the development of pelvic inflammatory disease, ectopic pregnancies and tubal factor infertility in women and epididymitis and prostatitis in men. With infection rates on the continual rise and the large number of infections going undetected, there is a need to develop an efficacious vaccine which prevents not only infection, but also the development of infection-associated pathology. Before a vaccine can be developed and administered, the pathogenesis of chlamydial infections needs to be fully understood. This includes the kinetics of ascending infection and the effects of inoculating dose on ascension and development of pathology. The first aim in this study was to examine these factors in a murine model. Female BALB/c mice were infected intravaginally with varying doses of C. muridarum, the mouse variant of human C. trachomatis, and the ascension of infection along the reproductive tract and the time-course of infection-associated pathology development, including inflammatory cell infiltration, pyosalpinx and hydrosalpinx, were determined. It was found that while the inoculating dose did affect the rate and degree of infection, it did not affect any of the pathological parameters examined. This highlighted that the sexual transmission dose may have minimal effect on the development of reproductive sequelae. The results of the first section enabled further studies presented here to use an optimal inoculating dose that would ascend the reproductive tract and cause pathology development, so that vaccine efficacy could be determined. There has been a large amount of research into the development of an efficacious vaccine against genital tract chlamydial infections, with little success. However, there have been no studies examining the effects of the timing of vaccination, including the effects of vaccination during an active genital infection, or after clearance of a previous infection. These are important factors that need to be examined, as it is not yet known whether immunization will enhance not only the individual's immune response, but also pathology development. It is also unknown whether any enhancement of the immune responses will cause the Chlamydia to enter a dormant, persistent state, and possibly further enhance any pathology development. The second section of this study aimed to determine if vaccination during an active genital tract infection, or after clearance of a primary infection, enhanced the murine immune responses and whether any enhanced or reduced pathology occurred. Naïve, actively infected, or previously infected animals were immunized intranasally or transcutaneously with the adjuvants cholera toxin and CpG-ODN in combination with either the major outer membrane protein (MOMP) of C. muridarum, or MOMP and ribonucleotide reductase small chain protein (NrdB) of C. muridarum. It was found that the systemic immune responses in actively or previously infected mice were altered in comparison to animals immunized naïve with the same combinations, however mucosal antibodies were not enhanced. It was also found that there was no difference in pathology development between any of the groups. This suggests that immunization of individuals who may have an asymptomatic infection, or may have been previously exposed to a genital infection, may not benefit from vaccination in terms of enhanced immune responses against re-exposure. The final section of this study aimed to determine if the vaccination regimes mentioned above caused in vivo persistence of C. muridarum in the upper reproductive tracts of mice. As there has been no characterization of C. muridarum persistence in vitro, either ultrastructurally or via transcriptome analysis, this was the first aim of this section. Once it had been shown that C. muridarum could be induced into a persistent state, the gene transcriptional profiles of the selected persistent marker genes were used to determine if persistent infections were indeed present in the upper reproductive tracts of the mice. We found that intranasal immunization during an active infection induced persistent infections in the oviducts, but not the uterine horns, and that intranasal immunization after clearance of infection, caused persistent infections in both the uterine horns and the oviducts of the mice. This is a significant finding, not only because it is the first time that C. muridarum persistence has been characterized in vitro, but also due to the fact that there is minimal characterization of in vivo persistence of any chlamydial species. It is possible that the induction of persistent infections in the reproductive tract might enhance the development of pathology and thereby enhance the risk of infertility, factors that need to be prevented by vaccination, not enhanced. Overall, this study has shown that the inoculating dose does not affect pathology development in the female reproductive tract of infected mice, but does alter the degree and rate of ascending infection. It has also been shown that intranasal immunization during an active genital infection, or after clearance of one, induces persistent infections in the uterine horns and oviducts of mice. This suggests that potential vaccine candidates will need to have these factors closely examined before progressing to clinical trials. This is significant, because if the same situation occurs in humans, a vaccine administered to an asymptomatic, or previously exposed individual may not afford any extra protection and may in fact enhance the risk of development of infection-associated sequelae. This suggests that a vaccine may serve the community better if administered before the commencement of sexual activity.

MRI study of the changes in crystalline lens shape with accommodation and ageing in humans

Magnetic Resonance Imaging was used to study changes in the crystalline lens and ciliary body with accommodation and aging. Monocular images were obtained in 15 young (19-29 years) and 15 older (60-70 years) emmetropes when viewing at far (6m) and at individual near points (14.5 to 20.9 cm) in the younger group. With accommodation, lens thickness increased (mean±95% CI: 0.33±0.06mm) by a similar magnitude to the decrease in anterior chamber depth (0.31±0.07mm) and equatorial diameter (0.32±0.04mm) with a decrease in the radius of curvature of the posterior lens surface (0.58±0.30mm). Anterior lens surface shape could not be determined due to the overlapping region with the iris. Ciliary ring diameter decreased (0.44±0.17mm) with no decrease in circumlental space or forward ciliary body movement. With aging, lens thickness increased (mean±95% CI: 0.97±0.24mm) similar in magnitude to the sum of the decrease in anterior chamber depth (0.45±0.21mm) and increase in anterior segment depth (0.52±0.23mm). Equatorial lens diameter increased (0.28±0.23mm) with no change in the posterior lens surface radius of curvature. Ciliary ring diameter decreased (0.57±0.41mm) with reduced circumlental space (0.43±0.15mm) and no forward ciliary body movement. Accommodative changes support the Helmholtz theory of accommodation including an increase in posterior lens surface curvature. Certain aspects of aging changes mimic accommodation.

Binocular summation improves performance to defocus-induced blur

PURPOSE. To assess whether there are any advantages of binocular over monocular vision under blur conditions. METHODS. We measured the effect of defocus, induced by positive lenses, on the pattern reversal Visual Evoked Potential (VEP) and on visual acuity (VA). Monocular (dominant eye) and binocular VEPs were recorded from thirteen volunteers (average age: 28±5 years, average spherical equivalent: -0.25±0.73 D) for defocus up to 2.00 D using positive powered lenses. VEPs were elicited using reversing 10 arcmin checks at a rate of 4 reversals/second. The stimulus subtended a circular field of 7 degrees with 100% contrast and mean luminance 30 cd/m2. VA was measured under the same conditions using ETDRS charts. All measurements were performed at 1m viewing distance with best spectacle sphero-cylindrical correction and natural pupils. RESULTS. With binocular stimulation, amplitudes and implicit times of the P100 component of the VEPs were greater and shorter, respectively, in all cases than for monocular stimulation. Mean binocular enhancement ratio in the P100 amplitude was 2.1 in-focus, increasing linearly with defocus to be 3.1 at +2.00 D defocus. Mean peak latency was 2.9 ms shorter in-focus with binocular than for monocular stimulation, with the difference increasing with defocus to 8.8 ms at +2.00 D. As for the VEP amplitude, VA was always better with binocular than with monocular vision, with the difference being greater for higher retinal blur. CONCLUSIONS. Both subjective and electrophysiological results show that binocular vision ameliorates the effect of defocus. The increased binocular facilitation observed with retinal blur may be due to the activation of a larger population of neurons at close-to-threshold detection under binocular stimulation.

Integrated vision-based attitude estimation

For many years, computer vision has lured researchers with promises of a low-cost, passive, lightweight and information-rich sensor suitable for navigation purposes. The prime difficulty in vision-based navigation is that the navigation solution will continually drift with time unless external information is available, whether it be cues from the appearance of the scene, a map of features (whether built online or known a priori), or from an externally-referenced sensor. It is not merely position that is of interest in the navigation problem. Attitude (i.e. the angular orientation of a body with respect to a reference frame) is integral to a visionbased navigation solution and is often of interest in its own right (e.g. flight control). This thesis examines vision-based attitude estimation in an aerospace environment, and two methods are proposed for constraining drift in the attitude solution; one through a novel integration of optical flow and the detection of the sky horizon, and the other through a loosely-coupled integration of Visual Odometry and GPS position measurements. In the first method, roll angle, pitch angle and the three aircraft body rates are recovered though a novel method of tracking the horizon over time and integrating the horizonderived attitude information with optical flow. An image processing front-end is used to select several candidate lines in a image that may or may not correspond to the true horizon, and the optical flow is calculated for each candidate line. Using an Extended Kalman Filter (EKF), the previously estimated aircraft state is propagated using a motion model and a candidate horizon line is associated using a statistical test based on the optical flow measurements and location of the horizon in the image. Once associated, the selected horizon line, along with the associated optical flow, is used as a measurement to the EKF. To evaluate the accuracy of the algorithm, two flights were conducted, one using a highly dynamic Uninhabited Airborne Vehicle (UAV) in clear flight conditions and the other in a human-piloted Cessna 172 in conditions where the horizon was partially obscured by terrain, haze and smoke. The UAV flight resulted in pitch and roll error standard deviations of 0.42° and 0.71° respectively when compared with a truth attitude source. The Cessna 172 flight resulted in pitch and roll error standard deviations of 1.79° and 1.75° respectively. In the second method for estimating attitude, a novel integrated GPS/Visual Odometry (GPS/VO) navigation filter is proposed, using a structure similar to a classic looselycoupled GPS/INS error-state navigation filter. Under such an arrangement, the error dynamics of the system are derived and a Kalman Filter is developed for estimating the errors in position and attitude. Through similar analysis to the GPS/INS problem, it is shown that the proposed filter is capable of recovering the complete attitude (i.e. pitch, roll and yaw) of the platform when subjected to acceleration not parallel to velocity for both the monocular and stereo variants of the filter. Furthermore, it is shown that under general straight line motion (e.g. constant velocity), only the component of attitude in the direction of motion is unobservable. Numerical simulations are performed to demonstrate the observability properties of the GPS/VO filter in both the monocular and stereo camera configurations. Furthermore, the proposed filter is tested on imagery collected using a Cessna 172 to demonstrate the observability properties on real-world data. The proposed GPS/VO filter does not require additional restrictions or assumptions such as platform-specific dynamics, map-matching, feature-tracking, visual loop-closing, gravity vector or additional sensors such as an IMU or magnetic compass. Since no platformspecific dynamics are required, the proposed filter is not limited to the aerospace domain and has the potential to be deployed in other platforms such as ground robots or mobile phones.

Experimental comparison of odometry approaches

Odometry is an important input to robot navigation systems, and we are interested in the performance of vision-only techniques. In this paper we experimentally evaluate and compare the performance of wheel odometry, monocular feature-based visual odometry, monocular patch-based visual odometry, and a technique that fuses wheel odometry and visual odometry, on a mobile robot operating in a typical indoor environment.

Diabetes foot disease : the Cinderella of Australian diabetes management?

Diabetes is one of the greatest public health challenges to face Australia. It is already Australia’s leading cause of kidney failure, blindness (in those under 60 years) and lower limb amputation, and causes significant cardiovascular disease. Australia’s diabetes amputation rate is one of the worst in the developed world, and appears to have significantly increased in the last decade, whereas some other diabetes complication rates appear to have decreased. This paper aims to compare the national burden of disease for the four major diabetes-related complications and the availability of government funding to combat these complications, in order to determine where diabetes foot disease ranks in Australia. Our review of relevant national literature indicates foot disease ranks second overall in burden of disease and last in evidenced-based government funding to combat these diabetes complications. This suggests public funding to address foot disease in Australia is disproportionately low when compared to funding dedicated to other diabetes complications. There is ample evidence that appropriate government funding of evidence-based care improves all diabetes complication outcomes and reduces overall costs. Numerous diverse Australian peak bodies have now recommended similar diabetes foot evidence-based strategies that have reduced diabetes amputation rates and associated costs in other developed nations. It would seem intuitive that “it’s time” to fund these evidence-based strategies for diabetes foot disease in Australia as well.

Vaccination to protect against infection of the female reproductive tract

Infection of the female genital tract can result in serious morbidities and mortalities from reproductive disability, pelvic inflammatory disease and cancer, to impacts on the fetus, such as infant blindness. While therapeutic agents are available, frequent testing and treatment is required to prevent the occurrence of the severe disease sequelae. Hence, sexually transmitted infections remain a major public health burden with ongoing social and economic barriers to prevention and treatment. Unfortunately, while there are two success stories in the development of vaccines to protect against HPV infection of the female reproductive tract, many serious infectious agents impacting on the female reproductive tract still have no vaccines available. Vaccination to prevent infection of the female reproductive tract is an inherently difficult target, with many impacting factors, such as appropriate vaccination strategies/mechanisms to induce a suitable protective response locally in the genital tract, variation in the local immune responses due to the hormonal cycle, selection of vaccine antigen(s) that confers effective protection against multiple variants of a single pathogen (e.g., the different serovars of Chlamydia trachomatis) and timing of the vaccine administration prior to infection exposure. Despite these difficulties, there are numerous ongoing efforts to develop effective vaccines against these infectious agents and it is likely that this important human health field will see further major developments in the next 5 years.

OpenRatSLAM : an open source brain-based SLAM system

RatSLAM is a navigation system based on the neural processes underlying navigation in the rodent brain, capable of operating with low resolution monocular image data. Seminal experiments using RatSLAM include mapping an entire suburb with a web camera and a long term robot delivery trial. This paper describes OpenRatSLAM, an open-source version of RatSLAM with bindings to the Robot Operating System framework to leverage advantages such as robot and sensor abstraction, networking, data playback, and visualization. OpenRatSLAM comprises connected ROS nodes to represent RatSLAM’s pose cells, experience map, and local view cells, as well as a fourth node that provides visual odometry estimates. The nodes are described with reference to the RatSLAM model and salient details of the ROS implementation such as topics, messages, parameters, class diagrams, sequence diagrams, and parameter tuning strategies. The performance of the system is demonstrated on three publicly available open-source datasets.

Airborne collision scenario flight tests : impact of angle measurement errors on reactive vision-based avoidance control

The future emergence of many types of airborne vehicles and unpiloted aircraft in the national airspace means collision avoidance is of primary concern in an uncooperative airspace environment. The ability to replicate a pilot’s see and avoid capability using cameras coupled with vision based avoidance control is an important part of an overall collision avoidance strategy. But unfortunately without range collision avoidance has no direct way to guarantee a level of safety. Collision scenario flight tests with two aircraft and a monocular camera threat detection and tracking system were used to study the accuracy of image-derived angle measurements. The effect of image-derived angle errors on reactive vision-based avoidance performance was then studied by simulation. The results show that whilst large angle measurement errors can significantly affect minimum ranging characteristics across a variety of initial conditions and closing speeds, the minimum range is always bounded and a collision never occurs.

Eyes on 3D-Current 3D biomimetic disease concept models and potential applications in age-related macular degeneration

Three dimensional cellular models that mimic disease are being increasingly investigated and have opened an exciting new research area into understanding pathomechanisms. The advantage of 3D in vitro disease models is that they allow systematic and in-depth studies of physiological and pathophysiological processes with less costs and ethical concerns that have arisen with animal models. The purpose of the 3D approach is to allow crosstalk between cells and microenvironment, and with cues from the microenvironment, cells can assemble their niche similar to in vivo conditions. The use of 3D models for mimicking disease processes such as cancer, osteoarthritis etc., is only emerging and allows multidisciplinary teams consisting of tissue engineers, biologist biomaterial scientists and clinicians to work closely together. While in vitro systems require rigorous testing before they can be considered as replicates of the in vivo model, major steps have been made, suggesting that they will become powerful tools for studying physiological and pathophysiological processes. This paper aims to summarize some of the existing 3D models and proposes a novel 3D model of the eye structures that are involved in the most common cause of blindness in the Western World, namely age-related macular degeneration (AMD).

Binocular rivalry and visuospatial ability in individuals with schizophrenia

Visual abnormalities, both at the sensory input and the higher interpretive levels, have been associated with many of the symptoms of schizophrenia. Individuals with schizophrenia typically experience distortions of sensory perception, resulting in perceptual hallucinations and delusions that are related to the observed visual deficits. Disorganised speech, thinking and behaviour are commonly experienced by sufferers of the disorder, and have also been attributed to perceptual disturbances associated with anomalies in visual processing. Compounding these issues are marked deficits in cognitive functioning that are observed in approximately 80% of those with schizophrenia. Cognitive impairments associated with schizophrenia include: difficulty with concentration and memory (i.e. working, visual and verbal), an impaired ability to process complex information, response inhibition and deficits in speed of processing, visual and verbal learning. Deficits in sustained attention or vigilance, poor executive functioning such as poor reasoning, problem solving, and social cognition, are all influenced by impaired visual processing. These symptoms impact on the internal perceptual world of those with schizophrenia, and hamper their ability to navigate their external environment. Visual processing abnormalities in schizophrenia are likely to worsen personal, social and occupational functioning. Binocular rivalry provides a unique opportunity to investigate the processes involved in visual awareness and visual perception. Binocular rivalry is the alternation of perceptual images that occurs when conflicting visual stimuli are presented to each eye in the same retinal location. The observer perceives the opposing images in an alternating fashion, despite the sensory input to each eye remaining constant. Binocular rivalry tasks have been developed to investigate specific parts of the visual system. The research presented in this Thesis provides an explorative investigation into binocular rivalry in schizophrenia, using the method of Pettigrew and Miller (1998) and comparing individuals with schizophrenia to healthy controls. This method allows manipulations to the spatial and temporal frequency, luminance contrast and chromaticity of the visual stimuli. Manipulations to the rival stimuli affect the rate of binocular rivalry alternations and the time spent perceiving each image (dominance duration). Binocular rivalry rate and dominance durations provide useful measures to investigate aspects of visual neural processing that lead to the perceptual disturbances and cognitive dysfunction attributed to schizophrenia. However, despite this promise the binocular rivalry phenomenon has not been extensively explored in schizophrenia to date. Following a review of the literature, the research in this Thesis examined individual variation in binocular rivalry. The initial study (Chapter 2) explored the effect of systematically altering the properties of the stimuli (i.e. spatial and temporal frequency, luminance contrast and chromaticity) on binocular rivalry rate and dominance durations in healthy individuals (n=20). The findings showed that altering the stimuli with respect to temporal frequency and luminance contrast significantly affected rate. This is significant as processing of temporal frequency and luminance contrast have consistently been demonstrated to be abnormal in schizophrenia. The current research then explored binocular rivalry in schizophrenia. The primary research question was, "Are binocular rivalry rates and dominance durations recorded in participants with schizophrenia different to those of the controls?" In this second study binocular rivalry data that were collected using low- and highstrength binocular rivalry were compared to alternations recorded during a monocular rivalry task, the Necker Cube task to replicate and advance the work of Miller et al., (2003). Participants with schizophrenia (n=20) recorded fewer alternations (i.e. slower alternation rates) than control participants (n=20) on both binocular rivalry tasks, however no difference was observed between the groups on the Necker cube task. Magnocellular and parvocellular visual pathways, thought to be abnormal in schizophrenia, were also investigated in binocular rivalry. The binocular rivalry stimuli used in this third study (Chapter 4) were altered to bias the task for one of these two pathways. Participants with schizophrenia recorded slower binocular rivalry rates than controls in both binocular rivalry tasks. Using a ‘within subject design’, binocular rivalry data were compared to data collected from a backwardmasking task widely accepted to bias both these pathways. Based on these data, a model of binocular rivalry, based on the magnocellular and parvocellular pathways that contribute to the dorsal and ventral visual streams, was developed. Binocular rivalry rates were compared with performance on the Benton’s Judgment of Line Orientation task, in individuals with schizophrenia compared to healthy controls (Chapter 5). The Benton’s Judgment of Line Orientation task is widely accepted to be processed within the right cerebral hemisphere, making it an appropriate task to investigate the role of the cerebral hemispheres in binocular rivalry, and to investigate the inter-hemispheric switching hypothesis of binocular rivalry proposed by Pettigrew and Miller (1998, 2003). The data were suggestive of intra-hemispheric rather than an inter-hemispheric visual processing in binocular rivalry. Neurotransmitter involvement in binocular rivalry, backward masking and Judgment of Line Orientation in schizophrenia were investigated using a genetic indicator of dopamine receptor distribution and functioning; the presence of the Taq1 allele of the dopamine D2 receptor (DRD2) receptor gene. This final study (Chapter 6) explored whether the presence of the Taq1 allele of the DRD2 receptor gene, and thus, by inference the distribution of dopamine receptors and dopamine function, accounted for the large individual variation in binocular rivalry. The presence of the Taq1 allele was associated with slower binocular rivalry rates or poorer performance in the backward masking and Judgment of Line Orientation tasks seen in the group with schizophrenia. This Thesis has contributed to what is known about binocular rivalry in schizophrenia. Consistently slower binocular rivalry rates were observed in participants with schizophrenia, indicating abnormally-slow visual processing in this group. These data support previous studies reporting visual processing abnormalities in schizophrenia and suggest that a slow binocular rivalry rate is not a feature specific to bipolar disorder, but may be a feature of disorders with psychotic features generally. The contributions of the magnocellular or dorsal pathways and parvocellular or ventral pathways to binocular rivalry, and therefore to perceptual awareness, were investigated. The data presented supported the view that the magnocellular system initiates perceptual awareness of an image and the parvocellular system maintains the perception of the image, making it available to higher level processing occurring within the cortical hemispheres. Abnormal magnocellular and parvocellular processing may both contribute to perceptual disturbances that ultimately contribute to the cognitive dysfunction associated with schizophrenia. An alternative model of binocular rivalry based on these observations was proposed.