Navite: A Neural Network System For Sensory-Based Robot Navigation

A neural network system, NAVITE, for incremental trajectory generation and obstacle avoidance is presented. Unlike other approaches, the system is effective in unstructured environments. Multimodal inforrnation from visual and range data is used for obstacle detection and to eliminate uncertainty in the measurements. Optimal paths are computed without explicitly optimizing cost functions, therefore reducing computational expenses. Simulations of a planar mobile robot (including the dynamic characteristics of the plant) in obstacle-free and object avoidance trajectories are presented. The system can be extended to incorporate global map information into the local decision-making process.

Electromagnetic tracking and steering for catheter navigation

This thesis explores the use of electromagnetics for both steering and tracking of medical instruments in minimally invasive surgeries. The end application is virtual navigation of the lung for biopsy of early stage cancer nodules. Navigation to the peripheral regions of the lung is difficult due to physical dimensions of the bronchi and current methods have low successes rates for accurate diagnosis. Firstly, the potential use of DC magnetic fields for the actuation of catheter devices with permanently magnetised distal attachments is investigated. Catheter models formed from various materials and magnetic tip formations are used to examine the usefulness of relatively low power and compact electromagnets. The force and torque that can be exerted on a small permanent magnet is shown to be extremely limited. Hence, after this initial investigation we turn our attention to electromagnetic tracking, in the development of a novel, low-cost implementation of a GPS-like system for navigating within a patient. A planar magnetic transmitter, formed on a printed circuit board for a low-profile and low cost manufacture, is used to generate a low frequency magnetic field distribution which is detected by a small induction coil sensor. The field transmitter is controlled by a novel closed-loop system that ensures a highly stable magnetic field with reduced interference from one transmitter coil to another. Efficient demodulation schemes are presented which utilise synchronous detection of each magnetic field component experienced by the sensor. The overall tracking accuracy of the system is shown to be less than 2 mm with an orientation error less than 1°. A novel demodulation implementation using a unique undersampling approach allows the use of reduced sample rates to sample the signals of interest without loss of tracking accuracy. This is advantageous for embedded microcontroller implementations of EM tracking systems. The EM tracking system is demonstrated in the pre-clinical environment of a breathing lung phantom. The airways of the phantom are successfully navigated using the system in combination with a 3D computer model rendered from CT data. Registration is achieved using both a landmark rigid registration method and a hybrid fiducial-free approach. The design of a planar magnetic shield structure for blocking the effects of metallic distortion from below the transmitter is presented which successfully blocks the impact of large ferromagnetic objects such as operating tables. A variety of shielding material are analysed with MuMetal and ferrite both providing excellent shieling performance and an increased signal to noise ratio. Finally, the effect of conductive materials and human tissue on magnetic field measurements is presented. Error due to induced eddy currents and capacitive coupling is shown to severely affect EM tracking accuracy at higher frequencies.

Specializing pedestrian maps to address the needs of people using wheelchairs: a case study in community-sustainable information systems

Gemstone Team FASTR (Finding Alternative Specialized Travel Routes)

On-board Robotic Multi-pinhole SPECT System for Region-of-interest (ROI) Imaging

On-board image guidance, such as cone-beam CT (CBCT) and kV/MV 2D imaging, is essential in many radiation therapy procedures, such as intensity modulated radiotherapy (IMRT) and stereotactic body radiation therapy (SBRT). These imaging techniques provide predominantly anatomical information for treatment planning and target localization. Recently, studies have shown that treatment planning based on functional and molecular information about the tumor and surrounding tissue could potentially improve the effectiveness of radiation therapy. However, current on-board imaging systems are limited in their functional and molecular imaging capability. Single Photon Emission Computed Tomography (SPECT) is a candidate to achieve on-board functional and molecular imaging. Traditional SPECT systems typically take 20 minutes or more for a scan, which is too long for on-board imaging. A robotic multi-pinhole SPECT system was proposed in this dissertation to provide shorter imaging time by using a robotic arm to maneuver the multi-pinhole SPECT system around the patient in position for radiation therapy.

A 49-pinhole collimated SPECT detector and its shielding were designed and simulated in this work using the computer-aided design (CAD) software. The trajectories of robotic arm about the patient, treatment table and gantry in the radiation therapy room and several detector assemblies such as parallel holes, single pinhole and 49 pinholes collimated detector were investigated. The rail mounted system was designed to enable a full range of detector positions and orientations to various crucial treatment sites including head and torso, while avoiding collision with linear accelerator (LINAC), patient table and patient.

An alignment method was developed in this work to calibrate the on-board robotic SPECT to the LINAC coordinate frame and to the coordinate frames of other on-board imaging systems such as CBCT. This alignment method utilizes line sources and one pinhole projection of these line sources. The model consists of multiple alignment parameters which maps line sources in 3-dimensional (3D) space to their 2-dimensional (2D) projections on the SPECT detector. Computer-simulation studies and experimental evaluations were performed as a function of number of line sources, Radon transform accuracy, finite line-source width, intrinsic camera resolution, Poisson noise and acquisition geometry. In computer-simulation studies, when there was no error in determining angles (α) and offsets (ρ) of the measured projections, the six alignment parameters (3 translational and 3 rotational) were estimated perfectly using three line sources. When angles (α) and offsets (ρ) were provided by Radon transform, the estimation accuracy was reduced. The estimation error was associated with rounding errors of Radon transform, finite line-source width, Poisson noise, number of line sources, intrinsic camera resolution and detector acquisition geometry. The estimation accuracy was significantly improved by using 4 line sources rather than 3 and also by using thinner line-source projections (obtained by better intrinsic detector resolution). With 5 line sources, median errors were 0.2 mm for the detector translations, 0.7 mm for the detector radius of rotation, and less than 0.5° for detector rotation, tilt and twist. In experimental evaluations, average errors relative to a different, independent registration technique were about 1.8 mm for detector translations, 1.1 mm for the detector radius of rotation (ROR), 0.5° and 0.4° for detector rotation and tilt, respectively, and 1.2° for detector twist.

Simulation studies were performed to investigate the improvement of imaging sensitivity and accuracy of hot sphere localization for breast imaging of patients in prone position. A 3D XCAT phantom was simulated in the prone position with nine hot spheres of 10 mm diameter added in the left breast. A no-treatment-table case and two commercial prone breast boards, 7 and 24 cm thick, were simulated. Different pinhole focal lengths were assessed for root-mean-square-error (RMSE). The pinhole focal lengths resulting in the lowest RMSE values were 12 cm, 18 cm and 21 cm for no table, thin board, and thick board, respectively. In both no table and thin board cases, all 9 hot spheres were easily visualized above background with 4-minute scans utilizing the 49-pinhole SPECT system while seven of nine hot spheres were visible with the thick board. In comparison with parallel-hole system, our 49-pinhole system shows reduction in noise and bias under these simulation cases. These results correspond to smaller radii of rotation for no-table case and thinner prone board. Similarly, localization accuracy with the 49-pinhole system was significantly better than with the parallel-hole system for both the thin and thick prone boards. Median localization errors for the 49-pinhole system with the thin board were less than 3 mm for 5 of 9 hot spheres, and less than 6 mm for the other 4 hot spheres. Median localization errors of 49-pinhole system with the thick board were less than 4 mm for 5 of 9 hot spheres, and less than 8 mm for the other 4 hot spheres.

Besides prone breast imaging, respiratory-gated region-of-interest (ROI) imaging of lung tumor was also investigated. A simulation study was conducted on the potential of multi-pinhole, region-of-interest (ROI) SPECT to alleviate noise effects associated with respiratory-gated SPECT imaging of the thorax. Two 4D XCAT digital phantoms were constructed, with either a 10 mm or 20 mm diameter tumor added in the right lung. The maximum diaphragm motion was 2 cm (for 10 mm tumor) or 4 cm (for 20 mm tumor) in superior-inferior direction and 1.2 cm in anterior-posterior direction. Projections were simulated with a 4-minute acquisition time (40 seconds per each of 6 gates) using either the ROI SPECT system (49-pinhole) or reference single and dual conventional broad cross-section, parallel-hole collimated SPECT. The SPECT images were reconstructed using OSEM with up to 6 iterations. Images were evaluated as a function of gate by profiles, noise versus bias curves, and a numerical observer performing a forced-choice localization task. Even for the 20 mm tumor, the 49-pinhole imaging ROI was found sufficient to encompass fully usual clinical ranges of diaphragm motion. Averaged over the 6 gates, noise at iteration 6 of 49-pinhole ROI imaging (10.9 µCi/ml) was approximately comparable to noise at iteration 2 of the two dual and single parallel-hole, broad cross-section systems (12.4 µCi/ml and 13.8 µCi/ml, respectively). Corresponding biases were much lower for the 49-pinhole ROI system (3.8 µCi/ml), versus 6.2 µCi/ml and 6.5 µCi/ml for the dual and single parallel-hole systems, respectively. Median localization errors averaged over 6 gates, for the 10 mm and 20 mm tumors respectively, were 1.6 mm and 0.5 mm using the ROI imaging system and 6.6 mm and 2.3 mm using the dual parallel-hole, broad cross-section system. The results demonstrate substantially improved imaging via ROI methods. One important application may be gated imaging of patients in position for radiation therapy.

A robotic SPECT imaging system was constructed utilizing a gamma camera detector (Digirad 2020tc) and a robot (KUKA KR150-L110 robot). An imaging study was performed with a phantom (PET CT PhantomTM), which includes 5 spheres of 10, 13, 17, 22 and 28 mm in diameter. The phantom was placed on a flat-top couch. SPECT projections were acquired with a parallel-hole collimator and a single-pinhole collimator both without background in the phantom, and with background at 1/10th the sphere activity concentration. The imaging trajectories of parallel-hole and pinhole collimated detectors spanned 180 degrees and 228 degrees respectively. The pinhole detector viewed a 14.7 cm-diameter common volume which encompassed the 28 mm and 22 mm spheres. The common volume for parallel-hole was a 20.8-cm-diameter cylinder which encompassed all five spheres in the phantom. The maneuverability of the robotic system was tested by navigating the detector to trace the flat-top table while avoiding collision with the table and maintaining the closest possible proximity to the common volume. For image reconstruction, detector trajectories were described by radius-of-rotation and detector rotation angle θ. These reconstruction parameters were obtained from the robot base and tool coordinates. The robotic SPECT system was able to maneuver the parallel-hole and pinhole collimated SPECT detectors in close proximity to the phantom, minimizing impact of the flat-top couch on detector to center-of-rotation (COR) distance. In no background case, all five spheres were visible in the reconstructed parallel-hole and pinhole images. In with background case, three spheres of 17, 22 and 28 mm diameter were readily observed with the parallel-hole imaging, and the targeted spheres (22 and 28 mm diameter) were readily observed in the pinhole ROI imaging.

In conclusion, the proposed on-board robotic SPECT can be aligned to LINAC/CBCT with a single pinhole projection of the line-source phantom. Alignment parameters can be estimated using one pinhole projection of line sources. This alignment method may be important for multi-pinhole SPECT, where relative pinhole alignment may vary during rotation. For single pinhole and multi-pinhole SPECT imaging onboard radiation therapy machines, the method could provide alignment of SPECT coordinates with those of CBCT and the LINAC. In simulation studies of prone breast imaging and respiratory-gated lung imaging, the 49-pinhole detector showed better tumor contrast recovery and localization in a 4-minute scan compared to parallel-hole detector. On-board SPECT could be achieved by a robot maneuvering a SPECT detector about patients in position for radiation therapy on a flat-top couch. The robot inherent coordinate frames could be an effective means to estimate detector pose for use in SPECT image reconstruction.

Simulating the interaction of occupants with signage systems

This paper describes the introduction of chained signage systems into evacuation simulation models. Signage systems are widely used in buildings to provide information for wayfinding, thereby providing exiting information during emergencies and assisting in navigation during normal circulation of pedestrians. Recently a system was developed to introduce simple signs into egress models. The system, known as Visibility Catchment Area or VCA, allowed similated agents to interact with signs which point directly to an exit and signs which are located directly above the exit. However, this approach was not able to represent the more general situation of a sign netwokr within an arbitrarily complex building. In this paper we extend the method to include chained signage systems which provides simulated agents that are unfamiliar with the structure a means by which to navigate to an emergency exit. The model includes the associated navigation behaviours exhibited by occupants that rely on a signage system for navigation including: Searching behaviours, Backtracking behaviours, Lost behaviours and Communication behaviours. The new features are demonstrated through a series of demonstration cases and are shown to produce plausible results.

Testing the role of sensory systems in the migratory heading of a songbird

The identification of the sensory cues and mechanisms by which migratory birds are able to reach the same breeding and wintering grounds year after year has eluded biologists despite more than 50 years of intensive study. While a number of environmental cues have been proposed to play a role in the navigation of birds, arguments still persist about which cues are essential for the experience based navigation shown by adult migrants. To date, few studies have tested the sensory basis of navigational cues used during actual migration in the wild: mainly laboratory based studies or homing during the non-migratory season have been used to investigate this behaviour. Here we tested the role of olfactory and magnetic cues in the migration of the catbird (Dumetella carolinensis) by radio tracking the migration of birds with sensory manipulations during their actual migratory flights. Our data suggest that adult birds treated with zinc sulphate to produce anosmia were unable to show the same orientation as control adults, and instead reverted to a direction similar to that shown by juveniles making their first migration. The magnetic manipulation had no effect on the orientation of either adults or juveniles. These results allow us to propose that the olfactory sense may play a role in experience based migration in adult catbirds. While the olfactory sense has been shown to play a role in the homing of pigeons and other birds, this is the first time it has been implicated in migratory orientation.

Migratory navigation in birds: new opportunities in an era of fast-developing tracking technology

Birds have remained the dominant model for studying the mechanisms of animal navigation for decades, with much of what has been discovered coming from laboratory studies or model systems. The miniaturisation of tracking technology in recent years now promises opportunities for studying navigation during migration itself (migratory navigation) on an unprecedented scale. Even if migration tracking studies are principally being designed for other purposes, we argue that attention to salient environmental variables during the design or analysis of a study may enable a host of navigational questions to be addressed, greatly enriching the field. We explore candidate variables in the form of a series of contrasts (e. g. land vs ocean or night vs day migration), which may vary naturally between migratory species, populations or even within the life span of a migrating individual. We discuss how these contrasts might help address questions of sensory mechanisms, spatiotemporal representational strategies and adaptive variation in navigational ability. We suggest that this comparative approach may help enrich our knowledge about the natural history of migratory navigation in birds.

The effect of human-body shadowing on indoor UWB TOA-based ranging systems

Because of its superior time resolution, ultra-wide bandwidth (UWB) transmission can be a highly accurate technique for ranging in indoor localization systems. Nevertheless, the presence of obstructions may deteriorate the ranging performance of the system. Indoor environments are often densely populated with people. However, t h e effect of the human body presence has been scarcely investigated so far within the UWB ranging context. In this work, we investigate this effect by conducting UWB measurements and analyzing the ranging performance of the system. Two measurement campaigns were performed in the 3-5.5 GHz band, in an anechoic chamber and a laboratory environment. The range estimates were obtained by employing the threshold-based first peak detection technique. Analysis results revealed that the human body significantly attenuates the direct-path signal component. On the other hand, in this study it does not introduce a significant range error since the length difference between the diffracted paths around the body and the direct-path is less than the spatial resolution of the measurement setup. © 2012 IEEE.

True navigation in birds: from quantum physics to global migration

Birds are capable of true navigation, the ability to return to a known goal from a place they have never visited before. This is demonstrated most spectacularly during the vast migratory journeys made by these animals year after year, often between continents and occasionally global in nature. However, it remains one of the great unanswered questions in science, despite more than 50 years of research in this field. Nevertheless, the study of true navigation in birds has made significant advances in the previous 20 years, in part thanks to the integration of many disciplines outside its root in behavioural biology, to address questions of neurobiology, molecular aspects, and the physics of sensory systems and environmental cues involved in bird navigation, often involving quantum physics. However, true navigation remains a controversial field, with many conflicting and confusing results making interpretation difficult, particularly for those outside or new to the field. Unlike many general texts on migration, which avoid discussion of these issues, this review will present these conflicting findings and assess the state of the field of true navigation during bird migration.

True navigation in migrating gulls requires intact olfactory nerves

During migratory journeys, birds may become displaced from their normal migratory route. Experimental evidence has shown that adult birds can correct for such displacements and return to their goal. However, the nature of the cues used by migratory birds to perform long distance navigation is still debated. In this experiment we subjected adult lesser black-backed gulls migrating from their Finnish/Russian breeding grounds (from >60°N) to Africa (to < 5°N) to sensory manipulation, to determine the sensory systems required for navigation. We translocated birds westward (1080 km) or eastward (885 km) to simulate natural navigational challenges. When translocated westwards and outside their migratory corridor birds with olfactory nerve section kept a clear directional preference (southerly) but were unable to compensate for the displacement, while intact birds and gulls with the ophthalmic branch of the trigeminal nerve sectioned oriented towards their population-specific migratory corridor. Thus, air-borne olfactory information seems to be important for migrating gulls to navigate successfully in some circumstances.