Towards Vision-Based Pose- and Condition-Invariant Place Recognition along Routes

Vision-based place recognition involves recognising familiar places despite changes in environmental conditions or camera viewpoint (pose). Existing training-free methods exhibit excellent invariance to either of these challenges, but not both simultaneously. In this paper, we present a technique for condition-invariant place recognition across large lateral platform pose variance for vehicles or robots travelling along routes. Our approach combines sideways facing cameras with a new multi-scale image comparison technique that generates synthetic views for input into the condition-invariant Sequence Matching Across Route Traversals (SMART) algorithm. We evaluate the system’s performance on multi-lane roads in two different environments across day-night cycles. In the extreme case of day-night place recognition across the entire width of a four-lane-plus-median-strip highway, we demonstrate performance of up to 44% recall at 100% precision, where current state-of-the-art fails.

Epistemological lens : birth, death and ecology of documentary practices

This paper considers the epistemological life cycle of the camera lens in documentary practices. The 19th century industrial economies that manufactured and commercialised the camera lens have engendered political and economic contingencies on documentary practices to sustain a hegemonic and singular interpretive epistemology. Colonial documentary practices are considered from the viewpoint of manipulative hegemonic practices - all of which use the interpretive epistemology of the camera lens to capitalise a viewpoint which is singular and possesses the power to sustain its own status and economic privilege. I suggest that decolonising documentary practices can be nurtured in what Boaventura de Sousa Santos proposes as an 'ecology of knowledges' (Andreotti, Ahenakew, & Cooper 2011) - a way of including the epistemologies of cultures beyond the 'abyssal' (Santos), outside the limits of epistemological dominance. If an 'epistemicide' (Santos) of indigenous knowledges in the dominant limits has occurred then in an ecology of knowledges the limits become limitless and what were once invisible knowledges, come into their own ontological and epistemological being: as free agents and on their own terms. In an ecology of knowledges, ignorance and blindness may still exist but are not privileged. The decolonisation of documentary practices inevitably destabilises prevailing historicities and initiates ways for equal privilege to exist between multiple epistemologies.

Accelerating entomology with Web3D insects

Capturing high-quality 3D models of insects is challenging - they are usually too small for laser or depth camera based systems, and techniques such as CT scanning do not record color. We have developed a prototype system that generates unprecedentedly high-quality natural-color 3D models of various insects from 3mm to 30 mm in length. Through the use of 3D web standards we are able to use these models to develop novel applications for entomologists and ensure wide accessibility. © 2014 Authors.

Capturing natural-colour 3D models of insects for species discovery and diagnostics

Collections of biological specimens are fundamental to scientific understanding and characterization of natural diversity - past, present and future. This paper presents a system for liberating useful information from physical collections by bringing specimens into the digital domain so they can be more readily shared, analyzed, annotated and compared. It focuses on insects and is strongly motivated by the desire to accelerate and augment current practices in insect taxonomy which predominantly use text, 2D diagrams and images to describe and characterize species. While these traditional kinds of descriptions are informative and useful, they cannot cover insect specimens "from all angles" and precious specimens are still exchanged between researchers and collections for this reason. Furthermore, insects can be complex in structure and pose many challenges to computer vision systems. We present a new prototype for a practical, cost-effective system of off-the-shelf components to acquire natural-colour 3D models of insects from around 3 mm to 30 mm in length. ("Natural-colour" is used to contrast with "false-colour", i.e., colour generated from, or applied to, gray-scale data post-acquisition.) Colour images are captured from different angles and focal depths using a digital single lens reflex (DSLR) camera rig and two-axis turntable. These 2D images are processed into 3D reconstructions using software based on a visual hull algorithm. The resulting models are compact (around 10 megabytes), afford excellent optical resolution, and can be readily embedded into documents and web pages, as well as viewed on mobile devices. The system is portable, safe, relatively affordable, and complements the sort of volumetric data that can be acquired by computed tomography. This system provides a new way to augment the description and documentation of insect species holotypes, reducing the need to handle or ship specimens. It opens up new opportunities to collect data for research, education, art, entertainment, biodiversity assessment and biosecurity control. © 2014 Nguyen et al.

Visual narratives and counter-narratives in aged care : Centring the participant as photographer in social science research

As detailed by a number of scholars (Emmison & Smith, 2000, 2012; Harrison, 1996, 2002, 2004), photographs and the process of photographing can provide fertile ground for sociological investigation. Examining the production of photography can tell us much about inclusion/omission and power/knowledge in a variety of social settings. Recently, some researchers have begun to utilise the participatory action research methodology, PhotoVoice, where people take and share photographs as a means of communicating and advocating on a specific topic. While medical sociologists have used PhotoVoice to communicate the impacts of disease in vulnerable populations (eg Burles, 2010), little social research has been done that combines PhotoVoice and older persons. This is interesting given the world’s population is ageing and the general lack of research that examines what daily life is like for older people living in aged care (Timonen & O’Dwyer, 2009). In response, a recent project tracked 10 participants who recently transitioned into living in residential aged care (RAC). The project combined the use of PhotoVoice methodology with repeated in-depth interviews. Residents were asked to orally and visually describe the positives and negative aspects of their daily lives. In the first instance, they shared the use of a RAC owned camera and later had the opportunity to access a camera for their sole use. Photographic analysis emphasised the value of centring the participant as an autonomous photographer in social research. In the photographs captured on a shared use camera, the photographs tended to depict predominately positive life stories (e.g. weekly morning tea outings, social activities). In comparison, the photographs captured on the sole use camera also described intimate but everyday activities, spaces, objects and people that frequented in their daily lives. Shifting the responsibility of the camera and photography solely to the participants resulted in the residents disrupting conventions of ‘suitable’ subject matter to photograph (Harrison, 2004) and in doing so, provided a much richer insight into what daily life is like in aged care.

Scheimpflug imaging of the post lens tear film during contact lens wear

A new imaging methodology is described to visualise the post lens tear film (PLTF) during contact lens wear. A rotating-Scheimpflug camera in combination with sodium fluorescein allows evaluation of the PLTF for different contact lens modalities, including mini-scleral, rigid gas permeable (RGP) and soft contact lenses. This imaging technique provides an extension of the instrument’s current functionality. The potential advantages and limitations of the technique are discussed.

Automated sensory data alignment for environmental and epidermal change monitoring

In this paper we present research adapting a state of the art condition-invariant robotic place recognition algorithm to the role of automated inter- and intra-image alignment of sensor observations of environmental and skin change over time. The approach involves inverting the typical criteria placed upon navigation algorithms in robotics; we exploit rather than attempt to fix the limited camera viewpoint invariance of such algorithms, showing that approximate viewpoint repetition is realistic in a wide range of environments and medical applications. We demonstrate the algorithms automatically aligning challenging visual data from a range of real-world applications: ecological monitoring of environmental change, aerial observation of natural disasters including flooding, tsunamis and bushfires and tracking wound recovery and sun damage over time and present a prototype active guidance system for enforcing viewpoint repetition. We hope to provide an interesting case study for how traditional research criteria in robotics can be inverted to provide useful outcomes in applied situations.

A comparison between conductive and infrared devices for measuring mean skin temperature at rest, during exercise in the heat, and recovery

Purpose: Skin temperature assessment has historically been undertaken with conductive devices affixed to the skin. With the development of technology, infrared devices are increasingly utilised in the measurement of skin temperature. Therefore, our purpose was to evaluate the agreement between four skin temperature devices at rest, during exercise in the heat, and recovery. Methods: Mean skin temperature (T̅sk) was assessed in thirty healthy males during 30 min rest (24.0± 1.2°C, 56 ± 8%), 30 min cycle in the heat (38.0 ± 0.5°C, 41 ± 2%), and 45 min recovery(24.0 ± 1.3°C, 56 ± 9%). T̅sk was assessed at four sites using two conductive devices(thermistors, iButtons) and two infrared devices (infrared thermometer, infrared camera). Results: Bland–Altman plots demonstrated mean bias ± limits of agreement between the thermistors and iButtons as follows (rest, exercise, recovery): -0.01 ± 0.04, 0.26 ± 0.85, -0.37 ± 0.98°C; thermistors and infrared thermometer: 0.34 ± 0.44, -0.44 ± 1.23, -1.04 ± 1.75°C; thermistors and infrared camera (rest, recovery): 0.83 ± 0.77, 1.88 ± 1.87°C. Pairwise comparisons of T̅sk found significant differences (p < 0.05) between thermistors and both infrared devices during resting conditions, and significant differences between the thermistors and all other devices tested during exercise in the heat and recovery. Conclusions: These results indicate poor agreement between conductive and infrared devices at rest, during exercise in the heat, and subsequent recovery. Infrared devices may not be suitable for monitoring T̅sk in the presence of, or following, metabolic and environmental induced heat stress.

Searching for semantic person queries using channel representations

It is not uncommon to hear a person of interest described by their height, build, and clothing (i.e. type and colour). These semantic descriptions are commonly used by people to describe others, as they are quick to relate and easy to understand. However such queries are not easily utilised within intelligent surveillance systems as they are difficult to transform into a representation that can be searched for automatically in large camera networks. In this paper we propose a novel approach that transforms such a semantic query into an avatar that is searchable within a video stream, and demonstrate state-of-the-art performance for locating a subject in video based on a description.

On the use of optical flow for scene change detection and description

We propose the use of optical flow information as a method for detecting and describing changes in the environment, from the perspective of a mobile camera. We analyze the characteristics of the optical flow signal and demonstrate how robust flow vectors can be generated and used for the detection of depth discontinuities and appearance changes at key locations. To successfully achieve this task, a full discussion on camera positioning, distortion compensation, noise filtering, and parameter estimation is presented. We then extract statistical attributes from the flow signal to describe the location of the scene changes. We also employ clustering and dominant shape of vectors to increase the descriptiveness. Once a database of nodes (where a node is a detected scene change) and their corresponding flow features is created, matching can be performed whenever nodes are encountered, such that topological localization can be achieved. We retrieve the most likely node according to the Mahalanobis and Chi-square distances between the current frame and the database. The results illustrate the applicability of the technique for detecting and describing scene changes in diverse lighting conditions, considering indoor and outdoor environments and different robot platforms.

IMU aided 3D visual odometry for car-like vehicles

We present a method for calculating odome- try in three-dimensions for car-like ground ve- hicles with an Ackerman-like steering model. In our approach we use the information from a single camera to derive the odometry in the plane and fuse it with roll and pitch informa- tion derived from an on-board IMU to extend to three-dimensions, thus providing odometric altitude as well as traditional x and y transla- tion. We have mounted the odometry module on a standard Toyota Prado SUV and present results from a car-park environment as well as from an off-road track.

Redundant sensing for localisation in outdoor industrial environments

We describe our experiences with automating a large fork-lift type vehicle that operates outdoors and in all weather. In particular, we focus on the use of independent and robust localisation systems for reliable navigation around the worksite. Two localisation systems are briefly described. The first is based on laser range finders and retro-reflective beacons, and the second uses a two camera vision system to estimate the vehicle’s pose relative to a known model of the surrounding buildings. We show the results from an experiment where the 20 tonne experimental vehicle, an autonomous Hot Metal Carrier, was conducting autonomous operations and one of the localisation systems was deliberately made to fail.

Exploiting parallax in panoramic capture to construct light fields

We show that the parallax motion resulting from non-nodal rotation in panorama capture can be exploited for light field construction from commodity hardware. Automated panoramic image capture typically seeks to rotate a camera exactly about its nodal point, for which no parallax motion is observed. This can be difficult or impossible to achieve due to limitations of the mounting or optical systems, and consequently a wide range of captured panoramas suffer from parallax between images. We show that by capturing such imagery over a regular grid of camera poses, then appropriately transforming the captured imagery to a common parameterisation, a light field can be constructed. The resulting four-dimensional image encodes scene geometry as well as texture, allowing an increasingly rich range of light field processing techniques to be applied. Employing an Ocular Robotics REV25 camera pointing system, we demonstrate light field capture,refocusing and low-light image enhancement.

Using viewer’s facial expression and heart rate for sports video highlights detection

Viewer interests, evoked by video content, can potentially identify the highlights of the video. This paper explores the use of facial expressions (FE) and heart rate (HR) of viewers captured using camera and non-strapped sensor for identifying interesting video segments. The data from ten subjects with three videos showed that these signals are viewer dependent and not synchronized with the video contents. To address this issue, new algorithms are proposed to effectively combine FE and HR signals for identifying the time when viewer interest is potentially high. The results show that, compared with subjective annotation and match report highlights, ‘non-neutral’ FE and ‘relatively higher and faster’ HR is able to capture 60%-80% of goal, foul, and shot-on-goal soccer video events. FE is found to be more indicative than HR of viewer’s interests, but the fusion of these two modalities outperforms each of them.

Slippage: Reclaiming personal family history through contemporary photomedia

This paper addresses the role of photography as a documentary medium and how this forms a basis for my practice-led studio investigations. In it, I will explore how photography is used to create histories and sustain specific notions of ‘legacy’ within the context of the family photo album. Family history is often based on stories to which the photo album provides a visual point of reference. Despite the ostensible ‘objectivity’ of the family photograph though it is nonetheless as subjective as the stories that surround it. In this way, the photo album perpetuates a hegemony of truth that obscures the fragmentary and highly selective nature of these documents and stories. The result is that every photo album implicitly documents the gaps or voids present in understandings of our own histories. Homi Bhabha refers to these kinds of voids as ‘disjunctive historical spaces’ – spaces of slippage that create the opportunity for new narratives and understandings to occur. Using Bhabha’s ideas as a chief point of reference, I will explore how these voids or gaps in information – and the opportunities for re-examination that they open up - can be explored through contemporary photomedia. Digital technologies such as camera phones and scanners generate a space in which photography’s own documentary conventions can be turned in on themselves to create a subterfuge. My current studio-based research involves using the scanner to navigate through my family’s sometimes-‘occulted’ history, in order to explore, document and recover my connection to this narrative. I am primarily interested in the scanner as a tool for capturing not simply surfaces, but objects, moments or movements in time. Objects or moments captured by the scanner can often be simultaneously distorted and consolidated, blurred and sharpened. This paper will propose that this ‘slippage’, literally expressed in the disruption of the pixelated field, can be used to create a space in which alternative readings or understandings of past events can be explored and new narratives produced.