Towards Vision-Based Pose- and Condition-Invariant Place Recognition along Routes

Vision-based place recognition involves recognising familiar places despite changes in environmental conditions or camera viewpoint (pose). Existing training-free methods exhibit excellent invariance to either of these challenges, but not both simultaneously. In this paper, we present a technique for condition-invariant place recognition across large lateral platform pose variance for vehicles or robots travelling along routes. Our approach combines sideways facing cameras with a new multi-scale image comparison technique that generates synthetic views for input into the condition-invariant Sequence Matching Across Route Traversals (SMART) algorithm. We evaluate the system’s performance on multi-lane roads in two different environments across day-night cycles. In the extreme case of day-night place recognition across the entire width of a four-lane-plus-median-strip highway, we demonstrate performance of up to 44% recall at 100% precision, where current state-of-the-art fails.

Towards a spatial language for mobile robots

We present a framework and first set of simulations for evolving a language for communicating about space. The framework comprises two components: (1) An established mobile robot platform, RatSLAM, which has a "brain" architecture based on rodent hippocampus with the ability to integrate visual and odometric cues to create internal maps of its environment. (2) A language learning system based on a neural network architecture that has been designed and implemented with the ability to evolve generalizable languages which can be learned by naive learners. A study using visual scenes and internal maps streamed from the simulated world of the robots to evolve languages is presented. This study investigated the structure of the evolved languages showing that with these inputs, expressive languages can effectively categorize the world. Ongoing studies are extending these investigations to evolve languages that use the full power of the robots representations in populations of agents.

Vision-based operations of a large industrial vehicle : autonomous hot metal carrier

Hot metal carriers (HMCs) are large forklift-type vehicles used to move molten metal in aluminum smelters. This paper reports on field experiments that demonstrate that HMCs can operate autonomously and in particular can use vision as a primary sensor to locate the load of aluminum. We present our complete system but focus on the vision system elements and also detail experiments demonstrating reliable operation of the materials handling task. Two key experiments are described, lasting 2 and 5 h, in which the HMC traveled 15 km in total and handled the load 80 times.

Double star chopper cell converter for battery electric vehicles with inter-module SoC balancing and fault tolerant control

A modularized battery system with Double Star Chopper Cell (DSCC) based modular multilevel converter is proposed for a battery operated electric vehicle (EV). A design concept for the modularized battery micro-packs for DSCC is described. Multidimensional pulse width modulation (MD-PWM) with integrated inter-module SoC balancing and fault tolerant control is proposed and explained. The DSCC can be operated either as an inverter to drive the EV motor or as a synchronous rectifier connected to external three phase power supply equipment for charging the battery micro-packs. The methods of operation as inverter and synchronous rectifier with integrated inter-module SoC balancing and fault tolerant control are discussed. The proposed system operation as inverter and synchronous rectifier are verified through simulations and the results are presented.

Vision-based control for mining automation

The mining industry is highly suitable for the application of robotics and automation technology since the work is both arduous and dangerous. Visual servoing is a means of integrating noncontact visual sensing with machine control to augment or replace operator based control. This article describes two of our current mining automation projects in order to demonstrate some, perhaps unusual, applications of visual servoing, and also to illustrate some very real problems with robust computer vision

Reliable, cloud-based communication for multi-robot systems

In contrast to single robotic agent, multi-robot systems are highly dependent on reliable communication. Robots have to synchronize tasks or to share poses and sensor readings with other agents, especially for co-operative mapping task where local sensor readings are incorporated into a global map. The drawback of existing communication frameworks is that most are based on a central component which has to be constantly within reach. Additionally, they do not prevent data loss between robots if a failure occurs in the communication link. During a distributed mapping task, loss of data is critical because it will corrupt the global map. In this work, we propose a cloud-based publish/subscribe mechanism which enables reliable communication between agents during a cooperative mission using the Data Distribution Service (DDS) as a transport layer. The usability of our approach is verified by several experiments taking into account complete temporary communication loss.

An application of fuzzy DL-Based semantic perception to soil container classification

Semantic perception and object labeling are key requirements for robots interacting with objects on a higher level. Symbolic annotation of objects allows the usage of planning algorithms for object interaction, for instance in a typical fetchand-carry scenario. In current research, perception is usually based on 3D scene reconstruction and geometric model matching, where trained features are matched with a 3D sample point cloud. In this work we propose a semantic perception method which is based on spatio-semantic features. These features are defined in a natural, symbolic way, such as geometry and spatial relation. In contrast to point-based model matching methods, a spatial ontology is used where objects are rather described how they "look like", similar to how a human would described unknown objects to another person. A fuzzy based reasoning approach matches perceivable features with a spatial ontology of the objects. The approach provides a method which is able to deal with senor noise and occlusions. Another advantage is that no training phase is needed in order to learn object features. The use-case of the proposed method is the detection of soil sample containers in an outdoor environment which have to be collected by a mobile robot. The approach is verified using real world experiments.

Learned ultra-wideband RADAR sensor model for augmented LIDAR-based traversability mapping in vegetated environments

In vegetated environments, reliable obstacle detection remains a challenge for state-of-the-art methods, which are usually based on geometrical representations of the environment built from LIDAR and/or visual data. In many cases, in practice field robots could safely traverse through vegetation, thereby avoiding costly detours. However, it is often mistakenly interpreted as an obstacle. Classifying vegetation is insufficient since there might be an obstacle hidden behind or within it. Some Ultra-wide band (UWB) radars can penetrate through vegetation to help distinguish actual obstacles from obstacle-free vegetation. However, these sensors provide noisy and low-accuracy data. Therefore, in this work we address the problem of reliable traversability estimation in vegetation by augmenting LIDAR-based traversability mapping with UWB radar data. A sensor model is learned from experimental data using a support vector machine to convert the radar data into occupancy probabilities. These are then fused with LIDAR-based traversability data. The resulting augmented traversability maps capture the fine resolution of LIDAR-based maps but clear safely traversable foliage from being interpreted as obstacle. We validate the approach experimentally using sensors mounted on two different mobile robots, navigating in two different environments.

Smooth stabilisation of nonholonomic robots subject to disturbances

In this paper, we address the problem of stabilisation of robots subject to nonholonommic constraints and external disturbances using port-Hamiltonian theory and smooth time-invariant control laws. This should be contrasted with the commonly used switched or time-varying laws. We propose a control design that provides asymptotic stability of an manifold (also called relative equilibria)-due to the Brockett condition this is the only type of stabilisation possible using smooth time-invariant control laws. The equilibrium manifold can be shaped to certain extent to satisfy specific control objectives. The proposed control law also incorporates integral action, and thus the closed-loop system is robust to unknown constant disturbances. A key step in the proposed design is a change of coordinates not only in the momentum, but also in the position vector, which differs from coordinate transformations previously proposed in the literature for the control of nonholonomic systems. The theoretical properties of the control law are verified via numerical simulation based on a robotic ground vehicle model with differential traction wheels and non co-axial centre of mass and point of contact.

Microprocessor-based temperature indicator using a thermistor as the sensor

A novel microprocessor-based temperature indicator has been developed and described. This indicator provides a linear performance over a wide dynamic temperature range of 0-100°C with an accuracy of ±0-l°C. The interfacing module reduces computing time required by the microprocessor for solving the thermistor equation. Test results are given to support the theory.

Assessing the sustainability of wheat-based cropping systems using APSIM: Model parameterisation and evaluation

Assessing the sustainability of crop and soil management practices in wheat-based rotations requires a well-tested model with the demonstrated ability to sensibly predict crop productivity and changes in the soil resource. The Agricultural Production Systems Simulator (APSIM) suite of models was parameterised and subsequently used to predict biomass production, yield, crop water and nitrogen (N) use, as well as long-term soil water and organic matter dynamics in wheat/chickpea systems at Tel Hadya, north-western Syria. The model satisfactorily simulated the productivity and water and N use of wheat and chickpea crops grown under different N and/or water supply levels in the 1998-99 and 1999-2000 experimental seasons. Analysis of soil-water dynamics showed that the 2-stage soil evaporation model in APSIM's cascading water-balance module did not sufficiently explain the actual soil drying following crop harvest under conditions where unused water remained in the soil profile. This might have been related to evaporation from soil cracks in the montmorillonitic clay soil, a process not explicitly simulated by APSIM. Soil-water dynamics in wheat-fallow and wheat-chickpea rotations (1987-98) were nevertheless well simulated when the soil water content in 0-0.45 m soil depth was set to 'air dry' at the end of the growing season each year. The model satisfactorily simulated the amounts of NO3-N in the soil, whereas it underestimated the amounts of NH 4-N. Ammonium fixation might be part of the soil mineral-N dynamics at the study site because montmorillonite is the major clay mineral. This process is not simulated by APSIM's nitrogen module. APSIM was capable of predicting long-term trends (1985-98) in soil organic matter in wheat-fallow and wheat-chickpea rotations at Tel Hadya as reported in literature. Overall, results showed that the model is generic and mature enough to be extended to this set of environmental conditions and can therefore be applied to assess the sustainability of wheat-chickpea rotations at Tel Hadya.

Dynamic simulation of activated sludge based wastewater treatment processes: Case studies with Titagarh Sewage Treatment Plant, India

STOAT has been extensively used for the dynamic simulation of an activated sludge based wastewater treatment plant in the Titagarh Sewage Treatment Plant, near Kolkata, India. Some alternative schemes were suggested. Different schemes were compared for the removal of Total Suspended Solids (TSS), b-COD, ammonia, nitrates etc. A combination of IAWQ#1 module with the Takacs module gave best results for the existing scenarios of the Titagarh Sewage Treatment Plant. The modified Bardenpho process was found most effective for reducing the mean b-COD level to as low as 31.4 mg/l, while the mean TSS level was as high as 100.98 mg/l as compared to the mean levels of TSS (92 62 mg/l) and b-COD (92.0 mg/l) in the existing plant. Scheme 2 gave a better scenario for the mean TSS level bringing it down to a mean value of 0.4 mg/l, but a higher mean value for the b-COD level at 54.89 mg/l. The Scheme Final could reduce the mean TSS level to 2.9 mg/l and the mean b-COD level to as low as 38.8 mg/l. The Final Scheme looks to be a technically viable scheme with respect to the overall effluent quality for the plant. (C) 2009 Elsevier B.V. All rights reserved.

Kernel-based spatial-color modeling for fast moving object tracking

Visual tracking has been a challenging problem in computer vision over the decades. The applications of Visual Tracking are far-reaching, ranging from surveillance and monitoring to smart rooms. Mean-shift (MS) tracker, which gained more attention recently, is known for tracking objects in a cluttered environment and its low computational complexity. The major problem encountered in histogram-based MS is its inability to track rapidly moving objects. In order to track fast moving objects, we propose a new robust mean-shift tracker that uses both spatial similarity measure and color histogram-based similarity measure. The inability of MS tracker to handle large displacements is circumvented by the spatial similarity-based tracking module, which lacks robustness to object's appearance change. The performance of the proposed tracker is better than the individual trackers for tracking fast-moving objects with better accuracy.

Mass Spectrometry-Based Systems Approach for Identification of Inhibitors of Plasmodium falciparum Fatty Acid Synthase{triangledown}

The emergence of strains of Plasmodium falciparum resistant to the commonly used antimalarials warrants the development of new antimalarial agents. The discovery of type II fatty acid synthase (FAS) in Plasmodium distinct from the FAS in its human host (type I FAS) opened up new avenues for the development of novel antimalarials. The process of fatty acid synthesis takes place by iterative elongation of butyryl-acyl carrier protein (butyryl-ACP) by two carbon units, with the successive action of four enzymes constituting the elongation module of FAS until the desired acyl length is obtained. The study of the fatty acid synthesis machinery of the parasite inside the red blood cell culture has always been a challenging task. Here, we report the in vitro reconstitution of the elongation module of the FAS of malaria parasite involving all four enzymes, FabB/F (β-ketoacyl-ACP synthase), FabG (β-ketoacyl-ACP reductase), FabZ (β-ketoacyl-ACP dehydratase), and FabI (enoyl-ACP reductase), and its analysis by matrix-assisted laser desorption-time of flight mass spectrometry (MALDI-TOF MS). That this in vitro systems approach completely mimics the in vivo machinery is confirmed by the distribution of acyl products. Using known inhibitors of the enzymes of the elongation module, cerulenin, triclosan, NAS-21/91, and (–)-catechin gallate, we demonstrate that accumulation of intermediates resulting from the inhibition of any of the enzymes can be unambiguously followed by MALDI-TOF MS. Thus, this work not only offers a powerful tool for easier and faster throughput screening of inhibitors but also allows for the study of the biochemical properties of the FAS pathway of the malaria parasite.

Mass Spectrometry-Based Systems Approach for Identification of Inhibitors of Plasmodium falciparum Fatty Acid Synthase{triangledown}

The emergence of strains of Plasmodium falciparum resistant to the commonly used antimalarials warrants the development of new antimalarial agents. The discovery of type II fatty acid synthase (FAS) in Plasmodium distinct from the FAS in its human host (type I FAS) opened up new avenues for the development of novel antimalarials. The process of fatty acid synthesis takes place by iterative elongation of butyryl-acyl carrier protein (butyryl-ACP) by two carbon units, with the successive action of four enzymes constituting the elongation module of FAS until the desired acyl length is obtained. The study of the fatty acid synthesis machinery of the parasite inside the red blood cell culture has always been a challenging task. Here, we report the in vitro reconstitution of the elongation module of the FAS of malaria parasite involving all four enzymes, FabB/F (β-ketoacyl-ACP synthase), FabG (β-ketoacyl-ACP reductase), FabZ (β-ketoacyl-ACP dehydratase), and FabI (enoyl-ACP reductase), and its analysis by matrix-assisted laser desorption-time of flight mass spectrometry (MALDI-TOF MS). That this in vitro systems approach completely mimics the in vivo machinery is confirmed by the distribution of acyl products. Using known inhibitors of the enzymes of the elongation module, cerulenin, triclosan, NAS-21/91, and (–)-catechin gallate, we demonstrate that accumulation of intermediates resulting from the inhibition of any of the enzymes can be unambiguously followed by MALDI-TOF MS. Thus, this work not only offers a powerful tool for easier and faster throughput screening of inhibitors but also allows for the study of the biochemical properties of the FAS pathway of the malaria parasite.