Wide-angle visual feature matching for outdoor localization

Wide-angle images exhibit significant distortion for which existing scale-space detectors such as the scale-invariant feature transform (SIFT) are inappropriate. The required scale-space images for feature detection are correctly obtained through the convolution of the image, mapped to the sphere, with the spherical Gaussian. A new visual key-point detector, based on this principle, is developed and several computational approaches to the convolution are investigated in both the spatial and frequency domain. In particular, a close approximation is developed that has comparable computation time to conventional SIFT but with improved matching performance. Results are presented for monocular wide-angle outdoor image sequences obtained using fisheye and equiangular catadioptric cameras. We evaluate the overall matching performance (recall versus 1-precision) of these methods compared to conventional SIFT. We also demonstrate the use of the technique for variable frame-rate visual odometry and its application to place recognition.

Wide-baseline keypoint detection and matching with wide-angle images for vision based localisation

This thesis addresses the problem of detecting and describing the same scene points in different wide-angle images taken by the same camera at different viewpoints. This is a core competency of many vision-based localisation tasks including visual odometry and visual place recognition. Wide-angle cameras have a large field of view that can exceed a full hemisphere, and the images they produce contain severe radial distortion. When compared to traditional narrow field of view perspective cameras, more accurate estimates of camera egomotion can be found using the images obtained with wide-angle cameras. The ability to accurately estimate camera egomotion is a fundamental primitive of visual odometry, and this is one of the reasons for the increased popularity in the use of wide-angle cameras for this task. Their large field of view also enables them to capture images of the same regions in a scene taken at very different viewpoints, and this makes them suited for visual place recognition. However, the ability to estimate the camera egomotion and recognise the same scene in two different images is dependent on the ability to reliably detect and describe the same scene points, or ‘keypoints’, in the images. Most algorithms used for this purpose are designed almost exclusively for perspective images. Applying algorithms designed for perspective images directly to wide-angle images is problematic as no account is made for the image distortion. The primary contribution of this thesis is the development of two novel keypoint detectors, and a method of keypoint description, designed for wide-angle images. Both reformulate the Scale- Invariant Feature Transform (SIFT) as an image processing operation on the sphere. As the image captured by any central projection wide-angle camera can be mapped to the sphere, applying these variants to an image on the sphere enables keypoints to be detected in a manner that is invariant to image distortion. Each of the variants is required to find the scale-space representation of an image on the sphere, and they differ in the approaches they used to do this. Extensive experiments using real and synthetically generated wide-angle images are used to validate the two new keypoint detectors and the method of keypoint description. The best of these two new keypoint detectors is applied to vision based localisation tasks including visual odometry and visual place recognition using outdoor wide-angle image sequences. As part of this work, the effect of keypoint coordinate selection on the accuracy of egomotion estimates using the Direct Linear Transform (DLT) is investigated, and a simple weighting scheme is proposed which attempts to account for the uncertainty of keypoint positions during detection. A word reliability metric is also developed for use within a visual ‘bag of words’ approach to place recognition.

Virtual force feedback teleoperation of the InsectBot using optical flow

This paper proposes the use of optical flow from a moving robot to provide force feedback to an operator’s joystick to facilitate collision free teleoperation. Optical flow is measured by a pair of wide angle cameras on board the vehicle and used to generate a virtual environmental force that is reflected to the user through the joystick, as well as feeding back into the control of the vehicle. We show that the proposed control is dissipative and prevents the vehicle colliding with the environment as well as providing the operator with a natural feel for the remote environment. Experimental results are provided on the InsectBot holonomic vehicle platform.

A new framework for force feedback teleoperation of robotic vehicles based on optical flow

This paper proposes the use of optical flow from a moving robot to provide force feedback to an operator's joystick to facilitate collision free teleoperation. Optic flow is measured by wide angle cameras on board the vehicle and used to generate a virtual environmental force that is reflected to the user through the joystick, as well as feeding back into the control of the vehicle. The coupling between optical flow (velocity) and force is modelled as an impedance - in this case an optical impedance. We show that the proposed control is dissipative and prevents the vehicle colliding with the environment as well as providing the operator with a natural feel for the remote environment. The paper focuses on applications to aerial robotics vehicles, however, the ideas apply directly to other force actuated vehicles such as submersibles or space vehicles, and the authors believe the approach has potential for control of terrestrial vehicles and even teleoperation of manipulators. Experimental results are provided for a simulated aerial robot in a virtual environment controlled by a haptic joystick.

Beam steering with high front-to-back ratio and high directivity on small platforms using decoupled antenna pairs

Beam steering with high front-to-back ratio and high directivity on a small platform is proposed. Two closely spaced antenna pairs with eigenmode port decoupling are used as the basic radiating elements. Two orthogonal radiation patterns are obtained for each antenna pair. High front-to-back ratio and high directivity are achieved by combining the two orthogonal radiation patterns. With an infinite groundplane, a front-to-back ratio of 21 dB with a directivity of 9.8 dB can be achieved. Beam steering, at the expense of a slight decrease in directivity, is achieved by placing the two antenna pairs 0.5λ apart. The simulated half power beamwidth is 58°. A prototype was designed and the 2-D radiation patterns were measured. The prototype supports three directions of beam steering. The half power beamwidth was measured as 46°, 48°, and 50° for the three respective beam directions. The measured front-to-back ratio in azimuth plane is 8.5 dB, 8.0 dB and 7.6 dB, respectively.

China media research : the trans-disciplinary challenge

This paper addresses the permeability of the field of China media research, its openness to new ideas; it argues that we need to adopt a wide angle view on research opportunities. Expansion of China’s media during the past decade has opened up possibilities for broadening of the field. The discussion first identifies boundary tensions as the field responds to transdisciplinary knowledge; in the second part the paper addresses challenges faced by Chinese researchers or visiting scholars in ‘Western’ media environments. Finally the paper addresses what a wide angle perspective might include.

Carrying capacity dashboard analyses : Australian case studies of populations scaled to place

In a globalised world, it makes sense to examine our demands on the landscape through the wide-angle lens of ecological footprint analysis. However, the important impetus towards a more localised societal system suggests a review of this approach and a return to its origins in carrying capacity assessment. The determination of whether we live within or beyond our carrying capacity is entirely scalar, with national, regional and local assessments dependent not only on the choices of the population but the capability of a landscape - at scale. The Carrying Capacity Dashboard, an openly accessible online modelling interface, has been developed for Australian conditions, facilitating analysis at various scales. Like ecological footprint analysis it allows users to test a variety of societal behaviours such as diet, consumption patterns, farming systems and ecological protection practices; but unlike the footprint approach, the results are uniquely tailored to place. This paper examines population estimates generated by the Carrying Capacity Dashboard. It compares results in various scales of analysis, from national to local. It examines the key behavioural choices influencing Australian carrying capacity estimates. For instance, the assumption that the consumption of red meat automatically lowers carrying capacity is examined and in some cases, debunked. Lastly, it examines the implications of implementing carrying capacity assessment globally, but not through a wide angle lens; rather, by examining the landscape one locality at a time.

Active text perception for mobile robots

Our everyday environment is full of text but this rich source of information remains largely inaccessible to mobile robots. In this paper we describe an active text spotting system that uses a small number of wide angle views to locate putative text in the environment and then foveates and zooms onto that text in order to improve the reliability of text recognition. We present extensive experimental results obtained with a pan/tilt/zoom camera and a ROS-based mobile robot operating in an indoor environment.

Image-based visual navigation for mobile robots

We introduce a new image-based visual navigation algorithm that allows the Cartesian velocity of a robot to be defined with respect to a set of visually observed features corresponding to previously unseen and unmapped world points. The technique is well suited to mobile robot tasks such as moving along a road or flying over the ground. We describe the algorithm in general form and present detailed simulation results for an aerial robot scenario using a spherical camera and a wide angle perspective camera, and present experimental results for a mobile ground robot.

Measurement of a PAGAT gel dosimeter by ultrasound computed tomography

In this work we used a 3D quantitative CT ultrasound imaging system to characterise polymer gel dosimeters. The system comprised of two identical 5 MHz 128 element phased-array ultrasound transducers co-axially aligned and submerged in water as a coupling agent. Rotational and translational movement of the gel dosimeter sample between the transducers were performed using a robotic arm. Ultrasound signals were generated and received using an Olympus Omniscan unit. Dose sensitivity of attenuation and time of flight ultrasonic parameters were assessed using this system.

Photophysical characterization of light-emitting poly(indenofluorene)s

Time-resolved photoluminescence spectroscopy experiments of three poly(2,8-indenofluorene) derivatives bearing different pendant groups are presented. A comparison of the photophysical properties of dilute solutions and thin films provides information on the chemical purity of the materials. The photophysical properties of poly(2,8-indenofluorene)s are correlated with the morphological characteristics of their corresponding films. Wide-angle X-ray scattering experiments reveal the order in these materials at the molecular level. The spectroscopic results confirm the positive impact of a new synthetic approach on the spectral purity of the poly(indenofluorene)s. It is concluded that complete side-chain substitution of the bridgehead carbon atoms C-6 and C-12 in the indenofluorene unit, prior to indenofluorene ring formation, reduces the probability of keto formation. Due to the intrinsic chemical purity of the arylated derivative, identification of a long-delayed spectral feature, other than the known keto band, is possible in the case of thin films. Controlled doping experiments on the arylated derivative with trace amounts of an indenofluorene-monoketone provide quantitative information on the rates of two major photophysical processes, namely, singlet photoluminescence emission and singlet photoluminescence quenching. These results allow the determination of the minimum keto concentration that can affect the intrinsic photophysical properties of this polymer. The data suggest that photoluminescence quenching operates in the doped films according to the Stern-Volmer formalism.

One-step macroscopic alignment of conjugated polymer systems by epitaxial crystallization during spin-coating

The one-step preparation of highly anisotropic polymer semiconductor thin films directly from solution is demonstrated. The conjugated polymer poly(3-hexylthiophene) (P3HT) as well as P3HT:fullerene bulk-heterojunction blends can be spin-coated from a mixture of the crystallizable solvent 1,3,5-trichlorobenzene (TCB) and a second carrier solvent such as chlorobenzene. Solidification is initiated by growth of macroscopic TCB spherulites followed by epitaxial crystallization of P3HT on TCB crystals. Subsequent sublimation of TCB leaves behind a replica of the original TCB spherulites. Thus, highly ordered thin films are obtained, which feature square-centimeter-sized domains that are composed of one spherulite-like structure each. A combination of optical microscopy and polarized photoluminescence spectroscopy reveals radial alignment of the polymer backbone in case of P3HT, whereas P3HT:fullerene blends display a tangential orientation with respect to the center of spherulite-like structures. Moreover, grazing-incidence wide-angle X-ray scattering reveals an increased relative degree of crystallinity and predominantly flat-on conformation of P3HT crystallites in the blend. The use of other processing methods such as dip-coating is also feasible and offers uniaxial orientation of the macromolecule. Finally, the applicability of this method to a variety of other semi-crystalline conjugated polymer systems is established. Those include other poly(3-alkylthiophene)s, two polyfluorenes, the low band-gap polymer PCPDTBT, a diketopyrrolopyrrole (DPP) small molecule as well as a number of polymer:fullerene and polymer:polymer blends. Macroscopic spherulite-like structures of the conjugated polymer poly(3-hexylthiophene) (P3HT) grow directly during spin-coating. This is achieved by processing P3HT or P3HT:fullerene bulk heterojunction blends from a mixture of the crystallizable solvent 1,3,5-trichlorobenzene and a second carrier solvent such as chlorobenzene. Epitaxial growth of the polymer on solidified solvent crystals gives rise to circular-symmetric, spherulite-like structures that feature a high degree of anisotropy.

A glossary of bodily responses

A collaborative video with Avril Huddy where two viewpoints, performer and documenter, were presented simultaneously to investigate Arakawa and Gin’s notion of “boundary-swaying”. In this performance-work, the performer influences what the camera is able to capture by engaging the documenter in a form of improvised dance. The performer’s movements appear impulsive and unpredictable, testing ways for the documenter to frame the performer’s movement. The images revealed by the documenter’s camera reflect a complexity of moments and co-incidences, evoking a sense of the performer’s embodied thinking within improvised movement. While a second camera uses a conventional wide angle shot to document the unfolding of the performance-work and track the connection between the documenter and the performer. While the performance-work itself is still highly-experimental, the ideas underpinning this exploration suggest how future investigations integrating more sensitive technology such as motion capture and tracking devises may be investigated. This performance-work formed part of the Creative Response Exhibition curated by Alan Prohm, Bill Lavender and Jason Nelson and a peer-review committee as part of the proceedings of the AG3 Online: Third International Arakawa and Gins Architecture and Philosophy Conference, hosted by the Centre for Public Culture and Ideas at Griffith University.