Mapping of indoor environments by robots using low-cost vision sensors

For robots to operate in human environments they must be able to make their own maps because it is unrealistic to expect a user to enter a map into the robot’s memory; existing floorplans are often incorrect; and human environments tend to change. Traditionally robots have used sonar, infra-red or laser range finders to perform the mapping task. Digital cameras have become very cheap in recent years and they have opened up new possibilities as a sensor for robot perception. Any robot that must interact with humans can reasonably be expected to have a camera for tasks such as face recognition, so it makes sense to also use the camera for navigation. Cameras have advantages over other sensors such as colour information (not available with any other sensor), better immunity to noise (compared to sonar), and not being restricted to operating in a plane (like laser range finders). However, there are disadvantages too, with the principal one being the effect of perspective. This research investigated ways to use a single colour camera as a range sensor to guide an autonomous robot and allow it to build a map of its environment, a process referred to as Simultaneous Localization and Mapping (SLAM). An experimental system was built using a robot controlled via a wireless network connection. Using the on-board camera as the only sensor, the robot successfully explored and mapped indoor office environments. The quality of the resulting maps is comparable to those that have been reported in the literature for sonar or infra-red sensors. Although the maps are not as accurate as ones created with a laser range finder, the solution using a camera is significantly cheaper and is more appropriate for toys and early domestic robots.

Topological SLAM using neighbourhood information of places

Perceptual aliasing makes topological navigation a difficult task. In this paper we present a general approach for topological SLAM~(simultaneous localisation and mapping) which does not require motion or odometry information but only a sequence of noisy measurements from visited places. We propose a particle filtering technique for topological SLAM which relies on a method for disambiguating places which appear indistinguishable using neighbourhood information extracted from the sequence of observations. The algorithm aims to induce a small topological map which is consistent with the observations and simultaneously estimate the location of the robot. The proposed approach is evaluated using a data set of sonar measurements from an indoor environment which contains several similar places. It is demonstrated that our approach is capable of dealing with severe ambiguities and, and that it infers a small map in terms of vertices which is consistent with the sequence of observations.

Robot navigation in sensor space

This thesis investigates the problem of robot navigation using only landmark bearings. The proposed system allows a robot to move to a ground target location specified by the sensor values observed at this ground target posi- tion. The control actions are computed based on the difference between the current landmark bearings and the target landmark bearings. No Cartesian coordinates with respect to the ground are computed by the control system. The robot navigates using solely information from the bearing sensor space. Most existing robot navigation systems require a ground frame (2D Cartesian coordinate system) in order to navigate from a ground point A to a ground point B. The commonly used sensors such as laser range scanner, sonar, infrared, and vision do not directly provide the 2D ground coordi- nates of the robot. The existing systems use the sensor measurements to localise the robot with respect to a map, a set of 2D coordinates of the objects of interest. It is more natural to navigate between the points in the sensor space corresponding to A and B without requiring the Cartesian map and the localisation process. Research on animals has revealed how insects are able to exploit very limited computational and memory resources to successfully navigate to a desired destination without computing Cartesian positions. For example, a honeybee balances the left and right optical flows to navigate in a nar- row corridor. Unlike many other ants, Cataglyphis bicolor does not secrete pheromone trails in order to find its way home but instead uses the sun as a compass to keep track of its home direction vector. The home vector can be inaccurate, so the ant also uses landmark recognition. More precisely, it takes snapshots and compass headings of some landmarks. To return home, the ant tries to line up the landmarks exactly as they were before it started wandering. This thesis introduces a navigation method based on reflex actions in sensor space. The sensor vector is made of the bearings of some landmarks, and the reflex action is a gradient descent with respect to the distance in sensor space between the current sensor vector and the target sensor vec- tor. Our theoretical analysis shows that except for some fully characterized pathological cases, any point is reachable from any other point by reflex action in the bearing sensor space provided the environment contains three landmarks and is free of obstacles. The trajectories of a robot using reflex navigation, like other image- based visual control strategies, do not correspond necessarily to the shortest paths on the ground, because the sensor error is minimized, not the moving distance on the ground. However, we show that the use of a sequence of waypoints in sensor space can address this problem. In order to identify relevant waypoints, we train a Self Organising Map (SOM) from a set of observations uniformly distributed with respect to the ground. This SOM provides a sense of location to the robot, and allows a form of path planning in sensor space. The navigation proposed system is analysed theoretically, and evaluated both in simulation and with experiments on a real robot.

Visual motion estimation for an autonomous underwater reef monitoring robot

Performing reliable localisation and navigation within highly unstructured underwater coral reef environments is a difficult task at the best of times. Typical research and commercial underwater vehicles use expensive acoustic positioning and sonar systems which require significant external infrastructure to operate effectively. This paper is focused on the development of a robust vision-based motion estimation technique using low-cost sensors for performing real-time autonomous and untethered environmental monitoring tasks in the Great Barrier Reef without the use of acoustic positioning. The technique is experimentally shown to provide accurate odometry and terrain profile information suitable for input into the vehicle controller to perform a range of environmental monitoring tasks.

Visual motion estimation for an autonomous underwater reef monitoring robot

Performing reliable localisation and navigation within highly unstructured underwater coral reef environments is a difficult task at the best of times. Typical research and commercial underwater vehicles use expensive acoustic positioning and sonar systems which require significant external infrastructure to operate effectively. This paper is focused on the development of a robust vision-based motion estimation technique using low-cost sensors for performing real-time autonomous and untethered environmental monitoring tasks in the Great Barrier Reef without the use of acoustic positioning. The technique is experimentally shown to provide accurate odometry and terrain profile information suitable for input into the vehicle controller to perform a range of environmental monitoring tasks.

Topological map induction using neighbourhood information of places

In topological mapping, perceptual aliasing can cause different places to appear indistinguishable to the robot. In case of severely corrupted or non-available odometry information, topological mapping is difficult as the robot is challenged with the loop-closing problem; that is to determine whether it has visited a particular place before. In this article we propose to use neighbourhood information to disambiguate otherwise indistinguishable places. Using neighbourhood information for place disambiguation is an approach that neither depends on a specific choice of sensors nor requires geometric information such as odometry. Local neighbourhood information is extracted from a sequence of observations of visited places. In experiments using either sonar or visual observations from an indoor environment the benefits of using neighbourhood clues for the disambiguation of otherwise identical vertices are demonstrated. Over 90% of the maps we obtain are isomorphic with the ground truth. The choice of the robot’s sensors does not impact the results of the experiments much.

Nanomorphology influence on the light conversion mechanisms in highly efficient diketopyrrolopyrrole based organic solar cells

In this work, diketopyrrolopyrrole-based polymer bulk heterojunction solar cells with inverted and regular architecture have been investigated. The influence of the polymer:fullerene ratio on the photoactive film nanomorphology has been studied in detail. Transmission Electron Microscopy and Atomic Force Microscopy reveal that the resulting film morphology strongly depends on the fullerene ratio. This fact determines the photocurrent generation and governs the transport of free charge carriers. Slight variations on the PCBM ratio respect to the polymer show great differences on the electrical behavior of the solar cell. Once the polymer:fullerene ratio is accurately adjusted, power conversion efficiencies of 4.7% and 4.9% are obtained for inverted and regular architectures respectively. Furthermore, by correlating the optical and morphological characterization of the polymer:fullerene films and the electrical behavior of solar cells, an ad hoc interpretation is proposed to explain the photovoltaic performance as a function of this polymer:blend composition.

ZnO layers for opto-electronic applications from solution-based and low-temperature processing of an organometallic precursor

As printed and flexible plastic electronic gadgets become increasingly viable today, there is a need to develop materials that suit the fabrication processes involved. Two desirable requirements are solution-processable active materials or precursors and low-temperature processability. In this article, we describe a straightforward method of depositing ZnO films by simple spin coating of an organometallic diethylzinc precursor solution and annealing the resulting film at low temperatures (≤200 °C) without involving any synthetic steps. By controlling the humidity in which annealing is conducted, we are able to adjust the intrinsic doping level and carrier concentration in diethylzinc-derived ZnO. Doped or conducting transport layers are greatly preferable to undoped layers as they enable low-resistance contacts and minimize the potential drops. This ability to controllably realize doped ZnO is a key feature of the fabrication process that we describe in this article. We employ field-effect measurements as a diagnostic tool to measure doping levels and mobilities in ZnO and demonstrate that doped ZnO with high charge carrier concentration is ideal for solar cell applications. Respectable power conversion efficiencies (up to 4.5%) are achieved in inverted solar cells that incorporate diethylzinc-derived ZnO films as the electron transport layer and organic blends as the active material. Extensions of this approach to grow ternary and quaternary films with organometallic precursor chemicals will enable solution based growth of a number of semiconductor films as well as a method to dope them.

Field-effect transistors based on self-organized molecular nanostripes

Charge transport properties in organic semiconductors depend strongly on molecular order. Here we demonstrate field-effect transistors where drain current flows through a precisely defined array of nanostripes made of crystalline and highly ordered molecules. The molecular stripes are fabricated across the channel of the transistor by a stamp-assisted deposition of the molecular semiconductors from a solution. As the solvent evaporates, the capillary forces drive the solution to form menisci under the stamp protrusions. The solute precipitates only in the regions where the solution is confined by the menisci once the critical concentration is reached and self-organizes into molecularly ordered stripes 100-200 nm wide and a few monolayers high. The charge mobility measured along the stripes is 2 orders of magnitude larger than the values measured for spin-coated thin films.

Cubic silsesquioxanes for use in solution processable organic light emitting diodes (OLED)

Commercial products using organic light emitting diode (OLED) display technology have begun to appear in cell phones, mp3 players and even televisions. One key area that has allowed and will allow for this technology to continue its ascension into the flat panel display and lighting markets is materials R and D. From this perspective, recent progress in cubic silsesquioxane (SSQ) based materials may provide some new advantageous properties well suited for OLEDs. In this feature article we provide an overview of recent progress in the synthesis, characterization and implementation of SSQ-based materials with properties well suited for application in solution processable organic/polymer electronics, specifically OLEDs.

Logic-gate devices based on printed polymer semiconducting nanostripes

The applications of organic semiconductors in complex circuitry such as printed CMOS-like logic circuits demand miniaturization of the active structures to the submicrometric and nanoscale level while enhancing or at least preserving the charge transport properties upon processing. Here, we addressed this issue by using a wet lithographic technique, which exploits and enhances the molecular order in polymers by spatial confinement, to fabricate ambipolar organic field effect transistors and inverter circuits based on nanostructured single component ambipolar polymeric semiconductor. In our devices, the current flows through a precisely defined array of nanostripes made of a highly ordered diketopyrrolopyrrole-benzothiadiazole copolymer with high charge carrier mobility (1.45 cm2 V-1 s-1 for electrons and 0.70 cm2 V-1 s-1 for holes). Finally, we demonstrated the functionality of the ambipolar nanostripe transistors by assembling them into an inverter circuit that exhibits a gain (105) comparable to inverters based on single crystal semiconductors.

Band gap tunable N-type molecules for organic field effect transistors

A series of four novel n-type molecules has been synthesized. Unlike previous approaches, the end group of these molecules was fixed and the molecular core was varied. The resulting materials were thoroughly analyzed. Electronic properties were derived from photoemission spectroscopy, optical properties were derived with the help of optical spectroscopy, and the structure of thin films on Au(111) was derived by scanning tunneling microscopy (STM). In addition, prototypical organic field-effect transistors (OFETs) (forming n-channels in OFETs) have been fabricated and tested. The correlation between the device performance of the respective OFETs (i.e., electron mobility) and their electronic as well as structural properties was investigated. It turned out that a combination of beneficial electronic and structural properties provides the best results. These findings are important for the design of new materials for future device applications.

Charge transport and density of trap states in balanced high mobility ambipolar organic thin-film transistors

We report on charge transport and density of trap states (trap DOS) in ambipolar diketopyrrolopyrrole-benzothiadiazole copolymer thin-film transistors. This semiconductor possesses high electron and hole field-effect mobilities of up to 0.6 cm 2/V-s. Temperature and gate-bias dependent field-effect mobility measurements are employed to extract the activation energies and trap DOS to understand its unique high mobility balanced ambipolar charge transport properties. The symmetry between the electron and hole transport characteristics, parameters and activation energies is remarkable. We believe that our work is the first charge transport study of an ambipolar organic/polymer based field-effect transistor with room temperature mobility higher than 0.1 cm 2/V-s in both electrons and holes.

High mobility top-gate and dual-gate polymer thin-film transistors based on diketopyrrolopyrrole-naphthalene copolymer

In this letter, the performance characteristics of top-gate and dual-gate thin-film transistors (TFTs) with active semiconductor layers consisting of diketopyrrolopyrrole-naphthalene copolymer are described. Optimized top-gate TFTs possess mobilities of up to 1 cm 2 /V s with low contact resistance and reduced hysteresis in air. Dual-gate devices possess higher drive currents as well as improved subthreshold and above threshold characteristics compared to single-gate devices. We also describe the reasons that dual-gate devices result in improved performance. The good stability of this polymer combined with their promising electrical properties make this material a very promising semiconductor for printable electronics.

Charge carrier velocity distributions in high mobility polymer field-effect transistors

In this letter, the velocity distributions of charge carriers in high-mobility polymer thin-film transistors (TFTs) with a diketopyrrolopyrrole- naphthalene copolymer (PDPP-TNT) semiconductor active layer are reported. The velocity distributions are found to be strongly dependent on measurement temperatures as well as annealing conditions. Considerable inhomogeneity is evident at low measurement temperatures and for low annealing temperatures. Such transient transport measurements can provide additional information about charge carrier transport in TFTs which are unavailable using steady-state transport measurements.