A global vision system for a robot soccer team

This paper describes the real time global vision system for the robot soccer team the RoboRoos. It has a highly optimised pipeline that includes thresholding, segmenting, colour normalising, object recognition and perspective and lens correction. It has a fast ‘paint’ colour calibration system that can calibrate in any face of the YUV or HSI cube. It also autonomously selects both an appropriate camera gain and colour gains robot regions across the field to achieve colour uniformity. Camera geometry calibration is performed automatically from selection of keypoints on the field. The system acheives a position accuracy of better than 15mm over a 4m × 5.5m field, and orientation accuracy to within 1°. It processes 614 × 480 pixels at 60Hz on a 2.0GHz Pentium 4 microprocessor.

Helicopter automation using a low-cost sensing system

This paper details the design of an autonomous helicopter control system using a low cost sensor suite. Control is maintained using simple nested PID loops. Aircraft attitude, velocity, and height is estimated using an in-house designed IMU and vision system. Information is combined using complimentary filtering. The aircraft is shown to be stabilised and responding to high level demands on all axes, including heading, height, lateral velocity and longitudinal velocity.

Photoreceptor projection and termination pattern in the lamina of gonodactyloid stomatopods (mantis shrimp)

The apposition compound eyes of gonodactyloid stomatopods are divided into a ventral and a dorsal hemisphere by six equatorial rows of enlarged ommatidia, the mid-band (MB). Whereas the hemispheres are specialized for spatial vision, the MB consists of four dorsal rows of ommatidia specialized for colour vision and two ventral rows specialized for polarization vision. The eight retinula cell axons (RCAs) from each ommatidium project retinotopically onto one corresponding lamina cartridge, so that the three retinal data streams (spatial, colour and polarization) remain anatomically separated. This study investigates whether the retinal specializations are reflected in differences in the RCA arrangement within the corresponding lamina cartridges. We have found that, in all three eye regions, the seven short visual fibres (svfs) formed by retinula cells 1-7 (R1-R7) terminate at two distinct lamina levels, geometrically separating the terminals of photoreceptors sensitive to either orthogonal e-vector directions or different wavelengths of light. This arrangement is required for the establishment of spectral and polarization opponency mechanisms. The long visual fibres (lvfs) of the eighth retinula cells (R8) pass through the lamina and project retinotopically to the distal medulla externa. Differences between the three eye regions exist in the packing of svf terminals and in the branching patterns of the lvfs within the lamina. We hypothesize that the R8 cells of MB rows 1-4 are incorporated into the colour vision system formed by R1-R7, whereas the R8 cells of MB rows 5 and 6 form a separate neural channel from R1 to R7 for polarization processing.

Experiments in outdoor operation of RatSLAM

This paper shows initial results in deploying the biologically inspired Simultaneous Localisation and Mapping system, RatSLAM, in an outdoor environment. RatSLAM has been widely tested in indoor environments on the task of producing topologically coherent maps based on a fusion of odometric and visual information. This paper details the changes required to deploy RatSLAM on a small tractor equipped with odometry and an omnidirectional camera. The principal changes relate to the vision system, with others required for RatSLAM to use omnidirectional visual data. The initial results from mapping around a 500 m loop are promising, with many improvements still to be made.

Low-cost real-time gesture recognition

A major impediment to developing real-time computer vision systems has been the computational power and level of skill required to process video streams in real-time. This has meant that many researchers have either analysed video streams off-line or used expensive dedicated hardware acceleration techniques. Recent software and hardware developments have greatly eased the development burden of realtime image analysis leading to the development of portable systems using cheap PC hardware and software exploiting the Multimedia Extension (MMX) instruction set of the Intel Pentium chip. This paper describes the implementation of a computationally efficient computer vision system for recognizing hand gestures using efficient coding and MMX-acceleration to achieve real-time performance on low cost hardware.

UQ RoboRoos: Achieving power and agility in a small size robot

The UQ RoboRoos have been developed to participate in the RoboCup robot soccer small size league over several years. RoboCup 2001 saw a focus on the mechanical design of the RoboRoos, with the introduction of an omni-directional drive system and a high power kicker. The change in mechanical design had implications for the rest of the system particularly navigation and multi-robot planning. In addition, the overhead vision system was upgraded to improve reliability and robustness.

Probabilistic visual recognition of artificial landmarks for simultaneous localization and mapping

Probabilistic robotics most often applied to the problem of simultaneous localisation and mapping (SLAM), requires measures of uncertainty to accompany observations of the environment. This paper describes how uncertainty can be characterised for a vision system that locates coloured landmarks in a typical laboratory environment. The paper describes a model of the uncertainty in segmentation, the internal cameral model and the mounting of the camera on the robot. It explains the implementation of the system on a laboratory robot, and provides experimental results that show the coherence of the uncertainty model.

Ancient colour vision: Multiple opsin genes in the ancestral vertebrates

Molecular investigation of the origin of colour vision has discovered five visual pigment (opsin) genes, all of which are expressed in an agnathan (jawless) fish, the lamprey Geotria australis. Lampreys are extant representatives of an ancient group of vertebrates whose origins are thought to date back to at least the early Cambrian, approximately 540 million years ago [1.]. Phylogenetic analysis has identified the visual pigment opsin genes of G. australis as orthologues of the major classes of vertebrate opsin genes. Therefore, multiple opsin genes must have originated very early in vertebrate evolution, prior to the separation of the jawed and jawless vertebrate lineages, and thereby provided the genetic basis for colour vision in all vertebrate species. The southern hemisphere lamprey Geotria australis (Figure 1A,B) possesses a predominantly cone-based visual system designed for photopic (bright light) vision [2. S.P. Collin, I.C. Potter and C.R. Braekevelt, The ocular morphology of the southern hemisphere lamprey Geotria australis Gray, with special reference to optical specializations and the characterisation and phylogeny of photoreceptor types. Brain Behav. Evol. 54 (1999), pp. 96–111.2. and 3.]. Previous work identified multiple cone types suggesting that the potential for colour vision may have been present in the earliest members of this group. In order to trace the molecular evolution and origins of vertebrate colour vision, we have examined the genetic complement of visual pigment opsins in G. australis.

Warm eyes provide superior vision in swordfishes

Large and powerful ocean predators such as swordfishes, some tunas, and several shark species are unique among fishes in that they are capable of maintaining elevated body temperatures (endothermy) when hunting for prey in deep and cold water [1-3]. In these animals, warming the central nervous system and the eyes is the one common feature of this energetically costly adaptation [4]. In the swordfish (Xiphias gladius), a highly specialized heating system located in an extraocular muscle specifically warms the eyes and brain up to 10degreesC-15degreesC above ambient water temperatures [2, 5]. Although the function of neural warming in fishes has been the subject of considerable speculation [1, 6, 7], the biological significance of this unusual ability has until now remained unknown. We show here that warming the retina significantly improves temporal resolution, and hence the detection of rapid motion, in fast-swimming predatory fishes such as the swordfish. Depending on diving depth, temporal resolution can be more than ten times greater in these fishes than in fishes with eyes at the same temperature as the surrounding water. The enhanced temporal resolution allowed by heated eyes provides warm-blooded and highly visual oceanic predators, such as swordfishes, tunas, and sharks, with a crucial advantage over their agile, cold-blooded prey.

Temporal variation in habitat use by nekton in a subtropical estuarine system

Utilisation by fish of different estuarine habitats is known to vary at many different temporal scales, however no study to date has examined how utilisation varies at all the relevant times scales simultaneously. Here, we compare the utilisation by fish of sandy, intertidal foreshore habitats in a subtropical estuary at four temporal scales: between major spawning periods (spring/ summer and winter), among months within spawning periods, between the full and new moon each month, and between night and day within those lunar phases. Comparisons of assemblage composition, abundance of individuals and of fish in seven different,ecological guilds' were used to identify the temporal scales at which fish varied their use of unvegetated sandy habitats in the lower Noosa Estuary, Queensland, Australia. Fish assemblages were sampled with a seine net at three different regions. The most numerically dominant species caught were southern herring (Herklotsichthys castelnaui: Clupeidae), sand whiting (Sillago ciliata: Sillaginidae), weeping toadfish (Torquigener pleurogramma: Tetraodomidae), and silver biddy (Gerres subfasciatus: Gerreidae). Considerable variation at a range of temporal scales from short term (day versus night) to longer term (spawning periods) was detected for all but one of the variables examined. The clearest patterns were observed for diurnal effects, where generally abundance was greater at night than during the day. There were also strong lunar effects, although there were no consistent patterns between full moon and new moon periods. Significant differences among months within spawning periods were more common than differences between the actual spawning periods. The results clearly indicate that utilisation of sandy, unvegetated estuarine habitats is very dynamic and highly variable in space and time. (c) 2006 Elsevier B.V. All rights reserved.

Using machine vision classification to control access of animals to water

Invasive vertebrate pests together with overabundant native species cause significant economic and environmental damage in the Australian rangelands. Access to artificial watering points, created for the pastoral industry, has been a major factor in the spread and survival of these pests. Existing methods of controlling watering points are mechanical and cannot discriminate between target species. This paper describes an intelligent system of controlling watering points based on machine vision technology. Initial test results clearly demonstrate proof of concept for machine vision in this application. These initial experiments were carried out as part of a 3-year project using machine vision software to manage all large vertebrates in the Australian rangelands. Concurrent work is testing the use of automated gates and innovative laneway and enclosure design. The system will have application in any habitat throughout the world where a resource is limited and can be enclosed for the management of livestock or wildlife.