Development of a hemispherical compound Eye for egomotion estimation

Biological inspiration has produced some successful solutions for estimation of self motion from visual information. In this paper we present the construction of a unique new camera, inspired by the compound eye of insects. The hemispherical nature of the compound eye has some intrinsically valuable properties in producing optical flow fields that are suitable for egomotion estimation in six degrees of freedom. The camera that we present has the added advantage of being lightweight and low cost, making it suitable for a range of mobile robot applications. We present some initial results that show the effectiveness of our egomotion estimation algorithm and the image capture capability of the hemispherical camera.

An introduction to inertial and visual sensing

In this paper we present a tutorial introduction to two important senses for biological and robotic systems — inertial and visual perception. We discuss the fundamentals of these two sensing modalities from a biological and an engineering perspective. Digital camera chips and micro-machined accelerometers and gyroscopes are now commodities, and when combined with today's available computing can provide robust estimates of self-motion as well 3D scene structure, without external infrastructure. We discuss the complementarity of these sensors, describe some fundamental approaches to fusing their outputs and survey the field.

Effects of reduced contrast on the perception and control of speed when driving

Misperception of speed under low-contrast conditions has been identified as a possible contributor to motor vehicle crashes in fog. To test this hypothesis, we investigated the effects of reduced contrast on drivers’ perception and control of speed while driving under real-world conditions. Fourteen participants drove around a 2.85 km closed road course under three visual conditions: clear view and with two levels of reduced contrast created by diffusing filters on the windscreen and side windows. Three dependent measures were obtained, without view of the speedometer, on separate laps around the road course: verbal estimates of speed; adjustment of speed to instructed levels (25 to 70 km h-1); and estimation of minimum stopping distance. The results showed that drivers traveled more slowly under low-contrast conditions. Reduced contrast had little or no effect on either verbal judgments of speed or estimates of minimum stopping distance. Speed adjustments were significantly slower under low-contrast than clear conditions, indicating that, contrary to studies of object motion, drivers perceived themselves to be traveling faster under conditions of reduced contrast. Under real-world driving conditions, drivers’ ability to perceive and control their speed was not adversely affected by large variations in the contrast of their surroundings. These findings suggest that perceptions of self-motion and object motion involve neural processes that are differentially affected by variations in stimulus contrast as encountered in fog.

Driving speed is altered by monocular Neutral Density filters : the Enright phenomenon

Introduction: An observer, looking sideways from a moving vehicle, while wearing a neutral density filter over one eye, can have a distorted perception of speed, known as the Enright phenomenon. The purpose of this study was to determine how the Enright phenomenon influences driving behaviour. Methods: A geometric model of the Enright phenomenon was developed. Ten young, visually normal, participants (mean age = 25.4 years) were tested on a straight section of a closed driving circuit and instructed to look out of the right side of the vehicle and drive at either 40 Km/h or 60 Km/h under the following binocular viewing conditions: with a 0.9 ND filter over the left eye (leading eye); 0.9 ND filter over the right eye (trailing eye); 0.9 ND filters over both eyes, and with no filters over either eye. The order of filter conditions was randomised and the speed driven recorded for each condition. Results: Speed judgments did not differ significantly between the two baseline conditions (no filters and both eyes filtered) for either speed tested. For the baseline conditions, when subjects were asked to drive at 60 Km/h they matched this speed well (61 ± 10.2 Km/h) but drove significantly faster than requested (51.6 ± 9.4 Km/h) when asked to drive at 40 Km/h. Subjects significantly exceeded baseline speeds by 8.7± 5.0 Km/h, when the trailing eye was filtered and travelled slower than baseline speeds by 3.7± 4.6 Km/h when the leading eye was filtered. Conclusions: This is the first quantitative study demonstrating how the Enright effect can influence perceptions of driving speed, and demonstrates that monocular filtering of an eye can significantly impact driving speeds, albeit to a lesser extent than predicted by geometric models of the phenomenon.

The RatSLAM project : robot spatial navigation

Rats are superior to the most advanced robots when it comes to creating and exploiting spatial representations. A wild rat can have a foraging range of hundreds of meters, possibly kilometers, and yet the rodent can unerringly return to its home after each foraging mission, and return to profitable foraging locations at a later date (Davis, et al., 1948). The rat runs through undergrowth and pipes with few distal landmarks, along paths where the visual, textural, and olfactory appearance constantly change (Hardy and Taylor, 1980; Recht, 1988). Despite these challenges the rat builds, maintains, and exploits internal representations of large areas of the real world throughout its two to three year lifetime. While algorithms exist that allow robots to build maps, the questions of how to maintain those maps and how to handle change in appearance over time remain open. The robotic approach to map building has been dominated by algorithms that optimise the geometry of the map based on measurements of distances to features. In a robotic approach, measurements of distance to features are taken with range-measuring devices such as laser range finders or ultrasound sensors, and in some cases estimates of depth from visual information. The features are incorporated into the map based on previous readings of other features in view and estimates of self-motion. The algorithms explicitly model the uncertainty in measurements of range and the measurement of self-motion, and use probability theory to find optimal solutions for the geometric configuration of the map features (Dissanayake, et al., 2001; Thrun and Leonard, 2008). Some of the results from the application of these algorithms have been impressive, ranging from three-dimensional maps of large urban strucutures (Thrun and Montemerlo, 2006) to natural environments (Montemerlo, et al., 2003).

Robots move : bootstrapping the development of object representations using sensorimotor coordination

This paper is concerned with the unsupervised learning of object representations by fusing visual and motor information. The problem is posed for a mobile robot that develops its representations as it incrementally gathers data. The scenario is problematic as the robot only has limited information at each time step with which it must generate and update its representations. Object representations are refined as multiple instances of sensory data are presented; however, it is uncertain whether two data instances are synonymous with the same object. This process can easily diverge from stability. The premise of the presented work is that a robot's motor information instigates successful generation of visual representations. An understanding of self-motion enables a prediction to be made before performing an action, resulting in a stronger belief of data association. The system is implemented as a data-driven partially observable semi-Markov decision process. Object representations are formed as the process's hidden states and are coordinated with motor commands through state transitions. Experiments show the prediction process is essential in enabling the unsupervised learning method to converge to a solution - improving precision and recall over using sensory data alone.

Autonomous multisensor calibration and closed-loop fusion for SLAM

The vast majority of current robot mapping and navigation systems require specific well-characterized sensors that may require human-supervised calibration and are applicable only in one type of environment. Furthermore, if a sensor degrades in performance, either through damage to itself or changes in environmental conditions, the effect on the mapping system is usually catastrophic. In contrast, the natural world presents robust, reasonably well-characterized solutions to these problems. Using simple movement behaviors and neural learning mechanisms, rats calibrate their sensors for mapping and navigation in an incredibly diverse range of environments and then go on to adapt to sensor damage and changes in the environment over the course of their lifetimes. In this paper, we introduce similar movement-based autonomous calibration techniques that calibrate place recognition and self-motion processes as well as methods for online multisensor weighting and fusion. We present calibration and mapping results from multiple robot platforms and multisensory configurations in an office building, university campus, and forest. With moderate assumptions and almost no prior knowledge of the robot, sensor suite, or environment, the methods enable the bio-inspired RatSLAM system to generate topologically correct maps in the majority of experiments.

Medial temporal lobe roles in human path integration

Path integration is a process in which observers derive their location by integrating self-motion signals along their locomotion trajectory. Although the medial temporal lobe (MTL) is thought to take part in path integration, the scope of its role for path integration remains unclear. To address this issue, we administered a variety of tasks involving path integration and other related processes to a group of neurosurgical patients whose MTL was unilaterally resected as therapy for epilepsy. These patients were unimpaired relative to neurologically intact controls in many tasks that required integration of various kinds of sensory self-motion information. However, the same patients (especially those who had lesions in the right hemisphere) walked farther than the controls when attempting to walk without vision to a previewed target. Importantly, this task was unique in our test battery in that it allowed participants to form a mental representation of the target location and anticipate their upcoming walking trajectory before they began moving. Thus, these results put forth a new idea that the role of MTL structures for human path integration may stem from their participation in predicting the consequences of one's locomotor actions. The strengths of this new theoretical viewpoint are discussed.

Homing by path integration when a locomotion trajectory crosses itself

Path integration is a process with which navigators derive their current position and orientation by integrating self-motion signals along a locomotion trajectory. It has been suggested that path integration becomes disproportionately erroneous when the trajectory crosses itself. However, there is a possibility that this previous finding was confounded by effects of the length of a traveled path and the amount of turns experienced along the path, two factors that are known to affect path integration performance. The present study was designed to investigate whether the crossover of a locomotion trajectory truly increases errors of path integration. In an experiment, blindfolded human navigators were guided along four paths that varied in their lengths and turns, and attempted to walk directly back to the beginning of the paths. Only one of the four paths contained a crossover. Results showed that errors yielded from the path containing the crossover were not always larger than those observed in other paths, and the errors were attributed solely to the effects of longer path lengths or greater degrees of turns. These results demonstrated that path crossover does not always cause significant disruption in path integration processes. Implications of the present findings for models of path integration are discussed.

Ion conductance in electrolyte solutions

We develop a new theoretical formulation to study ion conductance in electrolyte solutions, based on a mode coupling theory treatment of the electrolyte friction. The new theory provides expressions for both the ion atmosphere relaxation and electrophoretic contributions to the total electrolyte friction that acts on a moving ion. While the ion atmosphere relaxation term arises from the time-dependent microscopic interaction of the moving ion with the surrounding ions in the solution, the electrophoretic term originates from the coupling of the ion's velocity to the collective current mode of the ion atmosphere. Mode coupling theory, combined with time-dependent density functional theory of ion atmosphere fluctuations, leads to self-consistent expressions for these two terms which also include the effects of self-motion of the ion under consideration. These expressions have been solved for the concentration dependence of electrolyte friction and ion conductance. It is shown that in the limit of very low ion concentration, the present theory correctly reduces to the well-known Debye-Huckel-Onsager limiting law which predicts a linear dependence of conductance on the square root of ion concentration (c). At moderate and high concentrations, the present theory predicts a significant nonlinear and weaker dependence on root c which is in very good agreement with experimental results. The present theory is self-contained and does not involve any adjustable parameter.

Solvation dynamics, energy distribution and trapping of a light solute ion

In the theoretical treatments of the dynamics of solvation of a newly created ion in a dipolar solvent, the self-motion of the solute is usually ignored. Recently, it has been shown that for a light ion the translational motion of the ion can significantly enhance its own rate of solvation. Therefore, solvation itself may not be the rate determining step in the equilibration. Instead, the rate determining step is the search of the low energy configuration which serves to localize the light ion. In this article a microscopic calculation of the probability distribution of the interaction energy of the nascent charge with the dipolar solvent molecules is presented in order to address this problem of solute trapping. It is found that to a good approximation, this distribution is Gaussian and the second moment of this distribution is exactly equal to the half of its own solvation energy. It is shown that this is in excellent agreement with the simulation results that are available for the model Brownian dipolar lattice and for liquid acetonitrile. If the distortion of the solvent by the ion is negligible then the same relation gives the energy distribution for the solvated ion, with the average centered at the final equilibrium solvation energy. These results are expected to be useful in understanding various chemical processes in dipolar liquids. Another interesting outcome of the present study is a simple dynamic argument that supports Onsager's ''inverse snow-ball'' conjecture of solvation of a light ion. A simple derivation of the semi-phenomenological relation between the solvation time correlation function and the single particle orientation, reported recently by Maroncelli et al. (J. Phys. Chem. 97 (1993) 13), is also presented.

一种7DOF冗余手臂构形的运动学与动力学特性研究

冗余度机构具有高度的灵活性和避障能力,利用冗余自由度可以改善仿人机器人手臂的运动性能。以实现人体手臂的运动特性和操作灵活性为目标,研制了一种7DOF冗余仿人机器人手臂,根据冗余手臂的机构学特点,研究了手臂的运动学和动力学性能,并在工作空间、肘部关节的自运动能力以及手臂自重引起的关节重力矩等方面与其它两种典型的冗余手臂构形进行了比较分析。

A Neural Model of Visually Guided Steering, Obstacle Avoidance, and Route Selection

A neural model is developed to explain how humans can approach a goal object on foot while steering around obstacles to avoid collisions in a cluttered environment. The model uses optic flow from a 3D virtual reality environment to determine the position of objects based on motion discotinuities, and computes heading direction, or the direction of self-motion, from global optic flow. The cortical representation of heading interacts with the representations of a goal and obstacles such that the goal acts as an attractor of heading, while obstacles act as repellers. In addition the model maintains fixation on the goal object by generating smooth pursuit eye movements. Eye rotations can distort the optic flow field, complicating heading perception, and the model uses extraretinal signals to correct for this distortion and accurately represent heading. The model explains how motion processing mechanisms in cortical areas MT, MST, and VIP can be used to guide steering. The model quantitatively simulates human psychophysical data about visually-guided steering, obstacle avoidance, and route selection.

A Neural Model of Visually Guided Steering, Obstacle Avoidance, and Route Selection

A neural model is developed to explain how humans can approach a goal object on foot while steering around obstacles to avoid collisions in a cluttered environment. The model uses optic flow from a 3D virtual reality environment to determine the position of objects based on motion discontinuities, and computes heading direction, or the direction of self-motion, from global optic flow. The cortical representation of heading interacts with the representations of a goal and obstacles such that the goal acts as an attractor of heading, while obstacles act as repellers. In addition the model maintains fixation on the goal object by generating smooth pursuit eye movements. Eye rotations can distort the optic flow field, complicating heading perception, and the model uses extraretinal signals to correct for this distortion and accurately represent heading. The model explains how motion processing mechanisms in cortical areas MT, MST, and posterior parietal cortex can be used to guide steering. The model quantitatively simulates human psychophysical data about visually-guided steering, obstacle avoidance, and route selection.

Type Synthesis of 3-DOF Multi-Mode Translational/Spherical Parallel Mechanisms with Lockable Joints

A 3-DOF (degrees-of-freedom) multi-mode translational/spherical PM (parallel mechanism) with lockable joints is a novel reconfigurable PM. It has both 3-DOF spatial translational operation mode and 3-DOF spherical operation mode. This paper presents an approach to the type synthesis of translational/spherical PMs with lockable joints. Using the proposed approach, several 3-DOF translational/spherical PMs are obtained. It is found that these translational/spherical PMs do not encounter constraint singular configurations and self-motion of sub-chain of a leg during reconfiguration. The approach can also be used for synthesizing other classes of multi-mode PMs with lockable joints, multi-mode PMs with variable kinematic joints, partially decoupled PMs, and reconfigurable PMs with a reconfigurable platform.