Active text perception for mobile robots

Our everyday environment is full of text but this rich source of information remains largely inaccessible to mobile robots. In this paper we describe an active text spotting system that uses a small number of wide angle views to locate putative text in the environment and then foveates and zooms onto that text in order to improve the reliability of text recognition. We present extensive experimental results obtained with a pan/tilt/zoom camera and a ROS-based mobile robot operating in an indoor environment.

Airborne collision scenario flight tests : impact of angle measurement errors on reactive vision-based avoidance control

The future emergence of many types of airborne vehicles and unpiloted aircraft in the national airspace means collision avoidance is of primary concern in an uncooperative airspace environment. The ability to replicate a pilot’s see and avoid capability using cameras coupled with vision based avoidance control is an important part of an overall collision avoidance strategy. But unfortunately without range collision avoidance has no direct way to guarantee a level of safety. Collision scenario flight tests with two aircraft and a monocular camera threat detection and tracking system were used to study the accuracy of image-derived angle measurements. The effect of image-derived angle errors on reactive vision-based avoidance performance was then studied by simulation. The results show that whilst large angle measurement errors can significantly affect minimum ranging characteristics across a variety of initial conditions and closing speeds, the minimum range is always bounded and a collision never occurs.

Distributed low-power image processing in wireless sensor networks for intelligent video surveillance applications

Distributed Wireless Smart Camera (DWSC) network is a special type of Wireless Sensor Network (WSN) that processes captured images in a distributed manner. While image processing on DWSCs sees a great potential for growth, with its applications possessing a vast practical application domain such as security surveillance and health care, it suffers from tremendous constraints. In addition to the limitations of conventional WSNs, image processing on DWSCs requires more computational power, bandwidth and energy that presents significant challenges for large scale deployments. This dissertation has developed a number of algorithms that are highly scalable, portable, energy efficient and performance efficient, with considerations of practical constraints imposed by the hardware and the nature of WSN. More specifically, these algorithms tackle the problems of multi-object tracking and localisation in distributed wireless smart camera net- works and optimal camera configuration determination. Addressing the first problem of multi-object tracking and localisation requires solving a large array of sub-problems. The sub-problems that are discussed in this dissertation are calibration of internal parameters, multi-camera calibration for localisation and object handover for tracking. These topics have been covered extensively in computer vision literatures, however new algorithms must be invented to accommodate the various constraints introduced and required by the DWSC platform. A technique has been developed for the automatic calibration of low-cost cameras which are assumed to be restricted in their freedom of movement to either pan or tilt movements. Camera internal parameters, including focal length, principal point, lens distortion parameter and the angle and axis of rotation, can be recovered from a minimum set of two images of the camera, provided that the axis of rotation between the two images goes through the camera's optical centre and is parallel to either the vertical (panning) or horizontal (tilting) axis of the image. For object localisation, a novel approach has been developed for the calibration of a network of non-overlapping DWSCs in terms of their ground plane homographies, which can then be used for localising objects. In the proposed approach, a robot travels through the camera network while updating its position in a global coordinate frame, which it broadcasts to the cameras. The cameras use this, along with the image plane location of the robot, to compute a mapping from their image planes to the global coordinate frame. This is combined with an occupancy map generated by the robot during the mapping process to localised objects moving within the network. In addition, to deal with the problem of object handover between DWSCs of non-overlapping fields of view, a highly-scalable, distributed protocol has been designed. Cameras that follow the proposed protocol transmit object descriptions to a selected set of neighbours that are determined using a predictive forwarding strategy. The received descriptions are then matched at the subsequent camera on the object's path using a probability maximisation process with locally generated descriptions. The second problem of camera placement emerges naturally when these pervasive devices are put into real use. The locations, orientations, lens types etc. of the cameras must be chosen in a way that the utility of the network is maximised (e.g. maximum coverage) while user requirements are met. To deal with this, a statistical formulation of the problem of determining optimal camera configurations has been introduced and a Trans-Dimensional Simulated Annealing (TDSA) algorithm has been proposed to effectively solve the problem.

Optical and biomechanical factors, associated with near work and myopia

Near work may play an important role in the development of myopia in the younger population. The prevalence of myopia has also been found to be higher in occupations that involve substantial near work tasks, for example in microscopists and textile workers. When nearwork is performed, it typically involves accommodation, convergence and downward gaze. A number of previous studies have examined the effects of accommodation and convergence on changes in the optics and biometrics of the eye in primary gaze. However, little is known about the influence of accommodation on the eye in downward gaze. This thesis is primarily concerned with investigating the changes in the eye during near work in downward gaze under natural viewing conditions. To measure wavefront aberrations in downward gaze under natural viewing conditions, we modified a commercial Shack-Hartmann wavefront sensor by adding a relay lens system to allow on-axis ocular aberration measurements in primary gaze and downward gaze, with binocular fixation. Measurements with the modified wavefront sensor in primary and downward gaze were validated against a conventional aberrometer using both a model eye and in 9 human subjects. We then conducted an experiment to investigate changes in ocular aberrations associated with accommodation in downward gaze over 10 mins in groups of both myopes (n = 14) and emmetropes (n =12) using the modified Shack-Hartmann wavefront sensor. During the distance accommodation task, small but significant changes in refractive power (myopic shift) and higher order aberrations were observed in downward gaze compared to primary gaze. Accommodation caused greater changes in higher order aberrations (in particular coma and spherical aberration) in downward gaze than primary gaze, and there was evidence that the changes in certain aberrations with accommodation over time were different in downward gaze compared to primary gaze. There were no obvious systematic differences in higher order aberrations between refractive error groups during accommodation or downward gaze for fixed pupils. However, myopes exhibited a significantly greater change in higher order aberrations (in particular spherical aberration) than emmetropes for natural pupils after 10 mins of a near task (5 D accommodation) in downward gaze. These findings indicated that ocular aberrations change from primary to downward gaze, particularly with accommodation. To understand the mechanism underlying these changes in greater detail, we then extended this work to examine the characteristics of the corneal optics, internal optics, anterior biometrics and axial length of the eye during a near task, in downward gaze, over 10 mins. Twenty young adult subjects (10 emmetropes and 10 myopes) participated in this study. To measure corneal topography and ocular biometrics in downward gaze, a rotating Scheimpflug camera and an optical biometer were inclined on a custom built, height and tilt adjustable table. We found that both corneal optics and internal optics change with downward gaze, resulting in a myopic shift (~0.10 D) in the spherical power of the eye. The changes in corneal optics appear to be due to eyelid pressure on the anterior surface of the cornea, whereas the changes in the internal optics (an increase in axial length and a decrease in anterior chamber depth) may be associated with movement of the crystalline lens, under the action of gravity, and the influence of altered biomechanical forces from the extraocular muscles on the globe with downward gaze. Changes in axial length with accommodation were significantly greater in downward gaze than primary gaze (p < 0.05), indicating an increased effect of the mechanical forces from the ciliary muscle and extraocular muscles. A subsequent study was conducted to investigate the changes in anterior biometrics, axial length and choroidal thickness in nine cardinal gaze directions under the actions of the extraocular muscles. Ocular biometry measurements were obtained from 30 young adults (10 emmetropes, 10 low myopes and 10 moderate myopes) through a rotating prism with 15° deviation, along the foveal axis, using a non-contact optical biometer in each of nine different cardinal directions of gaze, over 5 mins. There was a significant influence of gaze angle and time on axial length (both p < 0.001), with the greatest axial elongation (+18 ± 8 μm) occurring with infero-nasal gaze (p < 0.001) and a slight decrease in axial length in superior gaze (−12 ± 17 μm) compared with primary gaze (p < 0.001). There was a significant correlation between refractive error (spherical equivalent refraction) and the mean change in axial length in the infero-nasal gaze direction (Pearson's R2 = 0.71, p < 0.001). To further investigate the relative effect of gravity and extraocular muscle force on the axial length, we measured axial length in 15° and 25° downward gaze with the biometer inclined on a tilting table that allowed gaze shifts to occur with either full head turn but no eye turn (reflects the effect of gravity), or full eye turn with no head turn (reflects the effect of extraocular muscle forces). We observed a significant axial elongation in 15° and 25° downward gaze in the full eye turn condition. However, axial length did not change significantly in downward gaze over 5 mins (p > 0.05) in the full head turn condition. The elongation of the axial length in downward gaze appears to be due to the influence of the extraocular muscles, since the effect was not present when head turn was used instead of eye turn. The findings of these experiments collectively show the dynamic characteristics of the optics and biometrics of the eye in downward gaze during a near task, over time. These were small but significant differences between myopic and emmetropic eyes in both the optical and biomechanical changes associated with shifts of gaze direction. These differences between myopes and emmetropes could arise as a consequence of excessive eye growth associated with myopia. However the potentially additive effects of repeated or long lasting near work activities employing infero-nasal gaze could also act to promote elongation of the eye due to optical and/or biomechanical stimuli.

Microstructure of an artificial grain boundary weak link in an YBa2Cu3O(7-δ) thin film grown on a (100)(110), [001]-tilt Y-ZrO2 bicrystal

The microstructure of an artificial grain boundary in an YBa2Cu3O7-δ (YBCO) thin film grown on a (100)(110), [001]-tilt yttria-stabilized-zirconia (YSZ) bicrystal substrate has been studied using transmission electron microscopy (TEM). The orientation relationship between the YBCO film and the YSZ substrate was [001]YBCO∥[001]YSZ and [110]YBCO∥[100]YSZ for each half of the bicrystal film. However, the exact boundary geometry of the bicrystal substrate was not transferred to the film. The substrate boundary was straight while the film boundary was wavy. In several cases there was bending of the lattice confined within a distance of a few basal-plane lattice spacings from the boundary plane and microfaceting. No intergranular secondary phase was observed but about 25% of the boundary was covered by c-axis-tilted YBCO grains and a-axis-oriented grains, both of which were typically adjacent to CuO grains or surrounded by a thin Cu-rich amorphous layer.

Microstructure of epitaxial YBa2Cu3O7-δ thin films on (001)-tilt Y-ZrO2 bicrystals

The microstructures of the grain boundaries in epitaxial YBa2Cu3O7-δ thin films grown on [001]-tilt yttria-stabilized ZrO2 bicrystal substrates were characterized by TEM and at. force microscopy. The exact boundary plane geometries of the bicrystal substrates were not transferred to the films which instead had wiggling grain boundaries. [on SciFinder(R)]

Small angle X-ray scattering mapping and kinetics study of sub-critical CO2 sorption by two Australian coals

Time- and position-resolved synchrotron small angle X-ray scattering data were acquired from samples of two Australian coal seams: Bulli seam (Bulli 4, Ro=1.42%, Sydney Basin), which naturally contains CO2 and Baralaba seam (Ro=0.67%, Bowen Basin), a potential candidate for sequestering CO2. This experimental approach has provided unique, pore-size-specific insights into the kinetics of CO2 sorption in the micro- and small mesopores (diameter 5 to 175 Å) and the density of the sorbed CO2 at reservoir-like conditions of temperature and hydrostatic pressure. For both samples, at pressures above 5 bar, the density of CO2 confined in pores was found to be uniform, with no densification in near-wall regions. In the Bulli 4 sample, CO2 first flooded the slit pores between polyaromatic sheets. In the pore-size range analysed, the confined CO2 density was close to that of the free CO2. The kinetics data are too noisy for reliable quantitative analysis, but qualitatively indicate faster kinetics in mineral-matter-rich regions. In the Baralaba sample, CO2 preferentially invaded the smallest micropores and the confined CO2 density was up to five times that of the free CO2. Faster CO2 sorption kinetics was found to be correlated with higher mineral matter content but, the mineral-matter-rich regions had lower-density CO2 confined in their pores. Remarkably, the kinetics was pore-size dependent, being faster for smaller pores. These results suggest that injection into the permeable section of an interbedded coal-clastic sequence could provide a viable combination of reasonable injectivity and high sorption capacity.

Energy-based nonlinear control of ship roll gyro-stabiliser with precession angle constraints

In this paper, we consider a passivity-based approach for the design of a control law of multiple ship-roll gyro-stabiliser units. We extend previous work on control of ship roll gyro-stabilisation by considering the problem within a nonlinear framework. In particular, we derive an energy-based model using the port-Hamiltonian theory and then design an active precession controller using passivity-based control interconnection and damping assignment. The design considers the possibility of having multiple gyro-stabiliser units, and the desired potential energy of the system (in closed loop) is chosen to behave like a barrier function, which allows us to enforce constraints on the precession angle of the gyros.

Short-term changes in axial length during simulations of typical far, intermediate and near tasks

Purpose: To investigate the changes in axial length with the combined effect of accommodation and angle of gaze (convergence and downward gaze) over 5 minutes in groups of myopes and emmetropes. Methods: A total of 31 subjects (nine emmetropes, 10 low myopes, and 12 moderate to high myopes) aged from 18 to 31 years were recruited. To measure ocular biometrics in inferonasal gaze with accommodation, an optical biometer (Lenstar LS900) was inclined on a tilt and height adjustable stage, with the subject’s chinrest mounted on a rotary stage to induce various levels of convergence by rotation of the subject’s head in primary or downward gaze. Initially, the subjects performed a distance viewing task in primary gaze for 10 minutes to provide a ‘wash-out’ period for prior visual tasks, and then the subject’s axial length and ocular biometrics were measured in nine different combinations of gaze/accommodation over 5 minutes. These nine sessions for all gaze measurements (i.e. three levels of accommodation 9 three levels of convergence) were completed across 3 days of testing (one accommodation condition on each day).The nine combinations of gaze/accommodation were based on those required to view the centre, right and left edges of a distant TV at 6 m in primary gaze, an intermediate task (i.e. computer at 50 cm in 10° downward gaze) and a near task (i.e. reading A4 page at 20 cm in 20° downward gaze). Subjects were wearing a custom built three-axes head tracker throughout the experiment that monitored subjects’ relative head movements (roll, pitch and yaw) during measurements. Results: A significant increase in axial length occurred with the combined effect of accommodation, convergence and downward gaze (repeated measures ANOVA, p < 0.001), with the greatest axial elongation during the near task in downward gaze with convergence (i.e. downward 20°/inward 33°, with 5 D accommodation) (mean change 33 ± 13 lm, after 5 minutes task) followed by the intermediate task (i.e. downward 10°/inward 25°, with 2 D accommodation) (mean change 14 ± 11 lm, after 5 minutes task).Changes in axial length for the distance task (i.e. primary gaze/9° convergence, with 0.16 D accommodation) were not statistically significant (mean change 4 ± 8 lm, after 5 minutes task, p > 0.05). Moderate to high myopes had a greater change in the axial length (mean change 40 ± 11 lm after 5 minutes of near task) than that of emmetropes (mean change 29 ± 15 lm after 5 minutes of near task) and low myopes (mean change 29 ± 16 lm after 5 minutes of near task) associated with time (p = 0.02) and accommodation by time (p = 0.03). Conclusions: The combination of accommodation, convergence and downward angle has a significant short term effect on axial length over time. The near task in downward gaze with convergence caused a greater change in axial length than the intermediate and distant visual tasks. The greater axial elongation measured in the infero-nasal direction with accommodation is most likely associated with a combination of biomechanical factors such as, extraocular muscle forces and ciliary muscle contraction.

Supine to standing Cobb Angle change in idiopathic scoliosis: The effect of endplate preselection

Introduction Standing radiographs are the ‘gold standard’ for clinical assessment of adolescent idiopathic scoliosis (AIS), with the Cobb Angle used to measure the severity and progression of the scoliotic curve. Supine imaging modalities can provide valuable 3D information on scoliotic anatomy, however, due to changes in gravitational loading direction, the geometry of the spine alters between the supine and standing position which in turn affects the Cobb Angle measurement. Previous studies have consistently reported a 7-10° [1-3] Cobb Angle increase from supine to standing, however, none have reported the effect of endplate pre-selection and which (if any) curve parameters affect the supine to standing Cobb Angle difference. Methods Female AIS patients with right-sided thoracic major curves were included in the retrospective study. Clinically measured Cobb Angles from existing standing coronal radiographs and fulcrum bending radiographs [4] were compared to existing low-dose supine CT scans taken within 3 months of the reference radiograph. Reformatted coronal CT images were used to measure Cobb Angle variability with and without endplate pre-selection (end-plates selected on the radiographs used on the CT images). Inter and intra-observer measurement variability was assessed. Multi-linear regression was used to investigate whether there was a relationship between supine to standing Cobb Angle change and patient characteristics (SPSS, v.21, IBM, USA). Results Fifty-two patients were included, with mean age of 14.6 (SD 1.8) years; all curves were Lenke Type 1 with mean Cobb Angle on supine CT of 42° (SD 6.4°) and 52° (SD 6.7°) on standing radiographs. The mean fulcrum bending Cobb Angle for the group was 22.6° (SD 7.5°). The 10° increase from supine to standing is consistent with existing literature. Pre-selecting vertebral endplates was found to increase the Cobb Angle difference by a mean 2° (range 0-9°). Multi-linear regression revealed a statistically significant relationship between supine to standing Cobb Angle change with: fulcrum flexibility (p=0.001), age (p=0.027) and standing Cobb Angle (p<0.001). In patients with high fulcrum flexibility scores, the supine to standing Cobb Angle change was as great as 20°.The 95% confidence intervals for intra-observer and inter-observer measurement variability were 3.1° and 3.6°, respectively. Conclusion There is a statistically significant relationship between supine to standing Cobb Angle change and fulcrum flexibility. Therefore, this difference can be considered a measure of spinal flexibility. Pre-selecting vertebral endplates causes only minor changes.

What is the apparent angle of a Kelvin ship wave pattern?

While the half-angle which encloses a Kelvin ship wave pattern is commonly accepted to be 19.47 degrees, recent observations and calculations for sufficiently fast-moving ships suggest that the apparent wake angle decreases with ship speed. One explanation for this decrease in angle relies on the assumption that a ship cannot generate wavelengths much greater than its hull length. An alternative interpretation is that the wave pattern that is observed in practice is defined by the location of the highest peaks; for wakes created by sufficiently fast-moving objects, these highest peaks no longer lie on the outermost divergent waves, resulting in a smaller apparent angle. In this paper, we focus on the problems of free surface flow past a single submerged point source and past a submerged source doublet. In the linear version of these problems, we measure the apparent wake angle formed by the highest peaks, and observe the following three regimes: a small Froude number pattern, in which the divergent waves are not visible; standard wave patterns for which the maximum peaks occur on the outermost divergent waves; and a third regime in which the highest peaks form a V-shape with an angle much less than the Kelvin angle. For nonlinear flows, we demonstrate that nonlinearity has the effect of increasing the apparent wake angle so that some highly nonlinear solutions have apparent wake angles that are greater than Kelvin's angle. For large Froude numbers, the effect on apparent wake angle can be more dramatic, with the possibility of strong nonlinearity shifting the wave pattern from the third regime to the second. We expect our nonlinear results will translate to other more complicated flow configurations, such as flow due to a steadily moving closed body such as a submarine.

Supine to standing Cobb angle change in idiopathic scoliosis : the effect of endplate pre-selection

Background Supine imaging modalities provide valuable 3D information on scoliotic anatomy, but the altered spine geometry between the supine and standing positions affects the Cobb angle measurement. Previous studies report a mean 7°-10° Cobb angle increase from supine to standing, but none have reported the effect of endplate pre-selection or whether other parameters affect this Cobb angle difference. Methods Cobb angles from existing coronal radiographs were compared to those on existing low-dose CT scans taken within three months of the reference radiograph for a group of females with adolescent idiopathic scoliosis. Reformatted coronal CT images were used to measure supine Cobb angles with and without endplate pre-selection (end-plates selected from the radiographs) by two observers on three separate occasions. Inter and intra-observer measurement variability were assessed. Multi-linear regression was used to investigate whether there was a relationship between supine to standing Cobb angle change and eight variables: patient age, mass, standing Cobb angle, Risser sign, ligament laxity, Lenke type, fulcrum flexibility and time delay between radiograph and CT scan. Results Fifty-two patients with right thoracic Lenke Type 1 curves and mean age 14.6 years (SD 1.8) were included. The mean Cobb angle on standing radiographs was 51.9° (SD 6.7). The mean Cobb angle on supine CT images without pre-selection of endplates was 41.1° (SD 6.4). The mean Cobb angle on supine CT images with endplate pre-selection was 40.5° (SD 6.6). Pre-selecting vertebral endplates increased the mean Cobb change by 0.6° (SD 2.3, range −9° to 6°). When free to do so, observers chose different levels for the end vertebrae in 39% of cases. Multi-linear regression revealed a statistically significant relationship between supine to standing Cobb change and fulcrum flexibility (p = 0.001), age (p = 0.027) and standing Cobb angle (p < 0.001). The 95% confidence intervals for intra-observer and inter-observer measurement variability were 3.1° and 3.6°, respectively. Conclusions Pre-selecting vertebral endplates causes minor changes to the mean supine to standing Cobb change. There is a statistically significant relationship between supine to standing Cobb change and fulcrum flexibility such that this difference can be considered a potential alternative measure of spinal flexibility.

The effect of endplate preselection when measuring supine versus standing cobb angle change in idiopathic scoliosis

The primary aim of this study was to determine whether endplate pre-selection makes a difference to the Cobb Angle change between supine and standing which is known to occur in idiopathic scoliosis. A secondary aim of this study was to identify which (if any) patient characteristics were correlated with supine versus standing Cobb change. The study found that pre-selecting vertebral endplates causes only has a minor effect on supine to standing Cobb change in scoliosis. There is a statistically significant relationship between supine to standing Cobb Angle change and fulcrum flexibility. Therefore, supine to standing Cobb Angle change can be considered as a measure of spinal flexibility when both standing and supine images are clinically available.