Distributed low-power image processing in wireless sensor networks for intelligent video surveillance applications

Distributed Wireless Smart Camera (DWSC) network is a special type of Wireless Sensor Network (WSN) that processes captured images in a distributed manner. While image processing on DWSCs sees a great potential for growth, with its applications possessing a vast practical application domain such as security surveillance and health care, it suffers from tremendous constraints. In addition to the limitations of conventional WSNs, image processing on DWSCs requires more computational power, bandwidth and energy that presents significant challenges for large scale deployments. This dissertation has developed a number of algorithms that are highly scalable, portable, energy efficient and performance efficient, with considerations of practical constraints imposed by the hardware and the nature of WSN. More specifically, these algorithms tackle the problems of multi-object tracking and localisation in distributed wireless smart camera net- works and optimal camera configuration determination. Addressing the first problem of multi-object tracking and localisation requires solving a large array of sub-problems. The sub-problems that are discussed in this dissertation are calibration of internal parameters, multi-camera calibration for localisation and object handover for tracking. These topics have been covered extensively in computer vision literatures, however new algorithms must be invented to accommodate the various constraints introduced and required by the DWSC platform. A technique has been developed for the automatic calibration of low-cost cameras which are assumed to be restricted in their freedom of movement to either pan or tilt movements. Camera internal parameters, including focal length, principal point, lens distortion parameter and the angle and axis of rotation, can be recovered from a minimum set of two images of the camera, provided that the axis of rotation between the two images goes through the camera's optical centre and is parallel to either the vertical (panning) or horizontal (tilting) axis of the image. For object localisation, a novel approach has been developed for the calibration of a network of non-overlapping DWSCs in terms of their ground plane homographies, which can then be used for localising objects. In the proposed approach, a robot travels through the camera network while updating its position in a global coordinate frame, which it broadcasts to the cameras. The cameras use this, along with the image plane location of the robot, to compute a mapping from their image planes to the global coordinate frame. This is combined with an occupancy map generated by the robot during the mapping process to localised objects moving within the network. In addition, to deal with the problem of object handover between DWSCs of non-overlapping fields of view, a highly-scalable, distributed protocol has been designed. Cameras that follow the proposed protocol transmit object descriptions to a selected set of neighbours that are determined using a predictive forwarding strategy. The received descriptions are then matched at the subsequent camera on the object's path using a probability maximisation process with locally generated descriptions. The second problem of camera placement emerges naturally when these pervasive devices are put into real use. The locations, orientations, lens types etc. of the cameras must be chosen in a way that the utility of the network is maximised (e.g. maximum coverage) while user requirements are met. To deal with this, a statistical formulation of the problem of determining optimal camera configurations has been introduced and a Trans-Dimensional Simulated Annealing (TDSA) algorithm has been proposed to effectively solve the problem.

Recognising facial expressions with noisy data

Techniques to improve the automated analysis of natural and spontaneous facial expressions have been developed. The outcome of the research has applications in several fields including national security (eg: expression invariant face recognition); education (eg: affect aware interfaces); mental and physical health (eg: depression and pain recognition).

Robust vision-based underwater homing using self-similar landmarks

Next-generation autonomous underwater vehicles (AUVs) will be required to robustly identify underwater targets for tasks such as inspection, localization, and docking. Given their often unstructured operating environments, vision offers enormous potential in underwater navigation over more traditional methods; however, reliable target segmentation often plagues these systems. This paper addresses robust vision-based target recognition by presenting a novel scale and rotationally invariant target design and recognition routine based on self-similar landmarks that enables robust target pose estimation with respect to a single camera. These algorithms are applied to an AUV with controllers developed for vision-based docking with the target. Experimental results show that the system performs exceptionally on limited processing power and demonstrates how the combined vision and controller system enables robust target identification and docking in a variety of operating conditions.

An examination of learning design in elite springboard diving

The overarching aim of this programme of work was to evaluate the effectiveness of the existing learning environment within the Australian Institute of Sport (AIS) elite springboard diving programme. Unique to the current research programme, is the application of ideas from an established theory of motor learning, specifically ecological dynamics, to an applied high performance training environment. In this research programme springboard diving is examined as a complex system, where individual, task, and environmental constraints are continually interacting to shape performance. As a consequence, this thesis presents some necessary and unique insights into representative learning design and movement adaptations in a sample of elite athletes. The questions examined in this programme of work relate to how best to structure practice, which is central to developing an effective learning environment in a high performance setting. Specifically, the series of studies reported in the chapters of this doctoral thesis: (i) provide evidence for the importance of designing representative practice tasks in training; (ii) establish that completed and baulked (prematurely terminated) take-offs are not different enough to justify the abortion of a planned dive; and (iii), confirm that elite athletes performing complex skills are able to adapt their movement patterns to achieve consistent performance outcomes from variable dive take-off conditions. Chapters One and Two of the thesis provide an overview of the theoretical ideas framing the programme of work, and include a review of literature pertinent to the research aims and subsequent empirical chapters. Chapter Three examined the representativeness of take-off tasks completed in the two AIS diving training facilities routinely used in springboard diving. Results highlighted differences in the preparatory phase of reverse dive take-offs completed by elite divers during normal training tasks in the dry-land and aquatic training environments. The most noticeable differences in dive take-off between environments began during the hurdle (step, jump, height and flight) where the diver generates the necessary momentum to complete the dive. Consequently, greater step lengths, jump heights and flight times, resulted in greater board depression prior to take-off in the aquatic environment where the dives required greater amounts of rotation. The differences observed between the preparatory phases of reverse dive take-offs completed in the dry-land and aquatic training environments are arguably a consequence of the constraints of the training environment. Specifically, differences in the environmental information available to the athletes, and the need to alter the landing (feet first vs. wrist first landing) from the take-off, resulted in a decoupling of important perception and action information and a decomposition of the dive take-off task. In attempting to only practise high quality dives, many athletes have followed a traditional motor learning approach (Schmidt, 1975) and tried to eliminate take-off variations during training. Chapter Four examined whether observable differences existed between the movement kinematics of elite divers in the preparation phases of baulked (prematurely terminated) and completed take-offs that might justify this approach to training. Qualitative and quantitative analyses of variability within conditions revealed greater consistency and less variability when dives were completed, and greater variability amongst baulked take-offs for all participants. Based on these findings, it is probable that athletes choose to abort a planned take-off when they detect small variations from the movement patterns (e.g., step lengths, jump height, springboard depression) of highly practiced comfortable dives. However, with no major differences in coordination patterns (topology of the angle-angle plots), and the potential for negative performance outcomes in competition, there appears to be no training advantage in baulking on unsatisfactory take-offs during training, except when a threat of injury is perceived by the athlete. Instead, it was considered that enhancing the athletes' movement adaptability would be a more functional motor learning strategy. In Chapter Five, a twelve-week training programme was conducted to determine whether a sample of elite divers were able to adapt their movement patterns and complete dives successfully, regardless of the perceived quality of their preparatory movements on the springboard. The data indeed suggested that elite divers were able to adapt their movements during the preparatory phase of the take-off and complete good quality dives under more varied take-off conditions; displaying greater consistency and stability in the key performance outcome (dive entry). These findings are in line with previous research findings from other sports (e.g., shooting, triple jump and basketball) and demonstrate how functional or compensatory movement variability can afford greater flexibility in task execution. By previously only practising dives with good quality take-offs, it can be argued that divers only developed strong couplings between information and movement under very specific performance circumstances. As a result, this sample was sometimes characterised by poor performance in competition when the athletes experienced a suboptimal take-off. Throughout this training programme, where divers were encouraged to minimise baulking and attempt to complete every dive, they demonstrated that it was possible to strengthen the information and movement coupling in a variety of performance circumstances, widening of the basin of performance solutions and providing alternative couplings to solve a performance problem even when the take-off was not ideal. The results of this programme of research provide theoretical and experimental implications for understanding representative learning design and movement pattern variability in applied sports science research. Theoretically, this PhD programme contributes empirical evidence to demonstrate the importance of representative design in the training environments of high performance sports programmes. Specifically, this thesis advocates for the design of learning environments that effectively capture and enhance functional and flexible movement responses representative of performance contexts. Further, data from this thesis showed that elite athletes performing complex tasks were able to adapt their movements in the preparatory phase and complete good quality dives under more varied take-off conditions. This finding signals some significant practical implications for athletes, coaches and sports scientists. As such, it is recommended that care should be taken by coaches when designing practice tasks since the clear implication is that athletes need to practice adapting movement patterns during ongoing regulation of multi-articular coordination tasks. For example, volleyball servers can adapt to small variations in the ball toss phase, long jumpers can visually regulate gait as they prepare for the take-off, and springboard divers need to continue to practice adapting their take-off from the hurdle step. In summary, the studies of this programme of work have confirmed that the task constraints of training environments in elite sport performance programmes need to provide a faithful simulation of a competitive performance environment in order that performance outcomes may be stabilised with practice. Further, it is apparent that training environments can be enhanced by ensuring the representative design of task constraints, which have high action fidelity with the performance context. Ultimately, this study recommends that the traditional coaching adage 'perfect practice makes perfect", be reconsidered; instead advocating that practice should be, as Bernstein (1967) suggested, "repetition without repetition".

Reliability of spatiotemporal and kinetic gait parameters determined by a new instrumented treadmill system

Background Despite the emerging use of treadmills integrated with pressure platforms as outcome tools in both clinical and research settings, published evidence regarding the measurement properties of these new systems is limited. This study evaluated the within– and between–day repeatability of spatial, temporal and vertical ground reaction forces measured by a treadmill system instrumented with a capacitance–based pressure platform. Methods Thirty three healthy adults (mean age, 21.5 ± 2.8 years; height, 168.4 ± 9.9 cm; and mass, 67.8 ± 18.6 kg), walked barefoot on a treadmill system (FDM–THM–S, Zebris Medical GmbH) on three separate occasions. For each testing session, participants set their preferred pace but were blinded to treadmill speed. Spatial (foot rotation, step width, stride and step length), temporal (stride and step times, duration of stance, swing and single and double support) and peak vertical ground reaction force variables were collected over a 30–second capture period, equating to an average of 52 ± 5 steps of steady–state walking. Testing was repeated one week following the initial trial and again, for a third time, 20 minutes later. Repeated measures ANOVAs within a generalized linear modelling framework were used to assess between–session differences in gait parameters. Agreement between gait parameters measured within the same day (session 2 and 3) and between days (session 1 and 2; 1 and 3) were evaluated using the 95% repeatability coefficient. Results There were statistically significant differences in the majority (14/16) of temporal, spatial and kinetic gait parameters over the three test sessions (P < .01). The minimum change that could be detected with 95% confidence ranged between 3% and 17% for temporal parameters, 14% and 33% for spatial parameters, and 4% and 20% for kinetic parameters between days. Within–day repeatability was similar to that observed between days. Temporal and kinetic gait parameters were typically more consistent than spatial parameters. The 95% repeatability coefficient for vertical force peaks ranged between ± 53 and ± 63 N. Conclusions The limits of agreement in spatial parameters and ground reaction forces for the treadmill system encompass previously reported changes with neuromuscular pathology and footwear interventions. These findings provide clinicians and researchers with an indication of the repeatability and sensitivity of the Zebris treadmill system to detect changes in common spatiotemporal gait parameters and vertical ground reaction forces.

Interpersonal, intrapersonal, extrapersonal? Qualitatively investigating coordinative couplings between rowers in Olympic sculling

Coordinative couplings are commonly classified as interpersonal and intrapersonal. Interpersonal coordination is normally thought of as between organisms but a subset can also be considered where the co-actors movements are coupled to an environmental rhythm. This can be termed extrapersonal coordination. This study explores how coordination is achieved in a situation that demands that at least one actor makes use of extrapersonal sources. In this case multi-seat rowing, where one actor cannot see the other one behind them. A qualitative approach using experiential knowledge from expert rowers (N=9) and coaches (N=4) was used to examine how interpersonal coordination was achieved and maintained in 2 person rowing boats. It was reported that where possible, both rowers coordinated their movements by coupling with an invariant provided by the boat. This invariant is underpinned by perception of water flow past the boat; which is in turn used to determine changes in acceleration - 'rowing with the boat.' Bow seat also identified the rower in front and stroke seat identified the looming of the stern as viable alternative sources for coupling.

Crowd monitoring using computer vision

Novel computer vision techniques have been developed for automatic monitoring of crowed environments such as airports, railway stations and shopping malls. Using video feeds from multiple cameras, the techniques enable crowd counting, crowd flow monitoring, queue monitoring and abnormal event detection. The outcome of the research is useful for surveillance applications and for obtaining operational metrics to improve business efficiency.

Effect of defects on fracture strength of graphene sheets

With a hexagonal monolayer network of carbon atoms, graphene has demonstrated exceptional electrical 22 and mechanical properties. In this work, the fracture of graphene sheets with Stone–Wales type defects and vacancies were investigated using molecular dynamics simulations at different temperatures. The initiation of defects via bond rotation was also investigated. The results indicate that the defects and vacancies can cause significant strength loss in graphene. The fracture strength of graphene is also affected by temperature and loading directions. The simulation results were compared with the prediction from the quantized fracture mechanics.

Dealing with shadows : capturing intrinsic scene appearance for image-based outdoor localisation

In outdoor environments shadows are common. These typically strong visual features cause considerable change in the appearance of a place, and therefore confound vision-based localisation approaches. In this paper we describe how to convert a colour image of the scene to a greyscale invariant image where pixel values are a function of underlying material property not lighting. We summarise the theory of shadow invariant images and discuss the modelling and calibration issues which are important for non-ideal off-the-shelf colour cameras. We evaluate the technique with a commonly used robotic camera and an autonomous car operating in an outdoor environment, and show that it can outperform the use of ordinary greyscale images for the task of visual localisation.

Hydraulic instability onset detection in Kaplan turbines by monitoring shaft vibrations

Design of hydraulic turbines has often to deal with hydraulic instability. It is well-known that Francis and Kaplan types present hydraulic instability in their design power range. Even if modern CFD tools may help to define these dangerous operating conditions and optimize runner design, hydraulic instabilities may fortuitously arise during the turbine life and should be timely detected in order to assure a long-lasting operating life. In a previous paper, the authors have considered the phenomenon of helical vortex rope, which happens at low flow rates when a swirling flow, in the draft tube conical inlet, occupies a large portion of the inlet. In this condition, a strong helical vortex rope appears. The vortex rope causes mechanical effects on the runner, on the whole turbine and on the draft tube, which may eventually produce severe damages on the turbine unit and whose most evident symptoms are vibrations. The authors have already shown that vibration analysis is suitable for detecting vortex rope onset, thanks to an experimental test campaign performed during the commissioning of a 23 MW Kaplan hydraulic turbine unit. In this paper, the authors propose a sophisticated data driven approach to detect vortex rope onset at different power load, based on the analysis of the vibration signals in the order domain and introducing the so-called "residual order spectrogram", i.e. an order-rotation representation of the vibration signal. Some experimental test runs are presented and the possibility to detect instability onset, especially in real-time, is discussed.

Training-free probability models for whole-image based place recognition

Whole-image descriptors such as GIST have been used successfully for persistent place recognition when combined with temporal filtering or sequential filtering techniques. However, whole-image descriptor localization systems often apply a heuristic rather than a probabilistic approach to place recognition, requiring substantial environmental-specific tuning prior to deployment. In this paper we present a novel online solution that uses statistical approaches to calculate place recognition likelihoods for whole-image descriptors, without requiring either environmental tuning or pre-training. Using a real world benchmark dataset, we show that this method creates distributions appropriate to a specific environment in an online manner. Our method performs comparably to FAB-MAP in raw place recognition performance, and integrates into a state of the art probabilistic mapping system to provide superior performance to whole-image methods that are not based on true probability distributions. The method provides a principled means for combining the powerful change-invariant properties of whole-image descriptors with probabilistic back-end mapping systems without the need for prior training or system tuning.

Influence of different nitrogen rates and DMPP nitrification inhibitor on annual N2O emissions from a subtropical wheat–maize cropping system

Global cereal production will need to increase by 50% to 70% to feed a world population of about 9 billion by 2050. This intensification is forecast to occur mostly in subtropical regions, where warm and humid conditions can promote high N2O losses from cropped soils. To secure high crop production without exacerbating N2O emissions, new nitrogen (N) fertiliser management strategies are necessary. This one-year study evaluated the efficacy of a nitrification inhibitor (3,4-dimethylpyrazole phosphate—DMPP) and different N fertiliser rates to reduce N2O emissions in a wheat–maize rotation in subtropical Australia. Annual N2O emissions were monitored using a fully automated greenhouse gas measuring system. Four treatments were fertilized with different rates of urea, including a control (40 kg-N ha−1 year−1), a conventional N fertiliser rate adjusted on estimated residual soil N (120 kg-N ha−1 year−1), a conventional N fertiliser rate (240 kg-N ha−1 year−1) and a conventional N fertiliser rate (240 kg-N ha−1 year−1) with nitrification inhibitor (DMPP) applied at top dressing. The maize season was by far the main contributor to annual N2O emissions due to the high soil moisture and temperature conditions, as well as the elevated N rates applied. Annual N2O emissions in the four treatments amounted to 0.49, 0.84, 2.02 and 0.74 kg N2O–N ha−1 year−1, respectively, and corresponded to emission factors of 0.29%, 0.39%, 0.69% and 0.16% of total N applied. Halving the annual conventional N fertiliser rate in the adjusted N treatment led to N2O emissions comparable to the DMPP treatment but extensively penalised maize yield. The application of DMPP produced a significant reduction in N2O emissions only in the maize season. The use of DMPP with urea at the conventional N rate reduced annual N2O emissions by more than 60% but did not affect crop yields. The results of this study indicate that: (i) future strategies aimed at securing subtropical cereal production without increasing N2O emissions should focus on the fertilisation of the summer crop; (ii) adjusting conventional N fertiliser rates on estimated residual soil N is an effective practice to reduce N2O emissions but can lead to substantial yield losses if the residual soil N is not assessed correctly; (iii) the application of DMPP is a feasible strategy to reduce annual N2O emissions from sub-tropical wheat–maize rotations. However, at the N rates tested in this study DMPP urea did not increase crop yields, making it impossible to recoup extra costs associated with this fertiliser. The findings of this study will support farmers and policy makers to define effective fertilisation strategies to reduce N2O emissions from subtropical cereal cropping systems while maintaining high crop productivity. More research is needed to assess the use of DMPP urea in terms of reducing conventional N fertiliser rates and subsequently enable a decrease of fertilisation costs and a further abatement of fertiliser-induced N2O emissions.

A biomechanical analysis of anterior instrumentation used in the surgical correction of adolescent idiopathic scoliosis

Scoliosis is a deformity of the spine which affects children and adolescents, and remains a challenge to treat. This study measured the forces used during surgery to correct scoliosis and studied changes to spinal mechanics from the implantation of metal rods used to hold the spine straight. The results of this study will help surgeons and engineers understand how to straighten the spine more efficiently to provide patients with better outcomes.

A biomechanical analysis of growing rods used in the management of early onset scoliosis (EOS)

The use of dual growing rods is a fusionless surgical approach to the treatment of early onset scoliosis (EOS) which aims to harness potential growth in order to correct spinal deformity. This study compared through in-vitro experiments the biomechanical response of two different rod designs under axial rotation loading. The study showed that a new design of telescoping growing rod preserved the rotational flexibility of the spine in comparison with rigid rods indicating them to be a more physiological way to improve the spinal deformity.

Pore accessibility by methane and carbon dioxide in coal as determined by neutron scattering

Contrast-matching ultrasmall-angle neutron scattering (USANS) and small-angle neutron scattering (SANS) techniques were used for the first time to determine both the total pore volume and the fraction of the pore volume that is inaccessible to deuterated methane, CD4, in four bituminous coals in the range of pore sizes between ∼10 Å and ∼5 μm. Two samples originated from the Illinois Basin in the U.S.A., and the other two samples were commercial Australian bituminous coals from the Bowen Basin. The total and inaccessible porosity were determined in each coal using both Porod invariant and the polydisperse spherical particle (PDSP) model analysis of the scattering data acquired from coals both in vacuum and at the pressure of CD4, at which the scattering length density of the pore-saturating fluid is equal to that of the solid coal matrix (zero average contrast pressure). The total porosity of the coals studied ranged from 7 to 13%, and the volume of pores inaccessible to CD4 varied from ∼13 to ∼36% of the total pore volume. The volume fraction of inaccessible pores shows no correlation with the maceral composition; however, it increases with a decreasing total pore volume. In situ measurements of the structure of one coal saturated with CO2 and CD4 were conducted as a function of the pressure in the range of 1−400 bar. The neutron scattering intensity from small pores with radii less than 35 Å in this coal increased sharply immediately after the fluid injection for both gases, which demonstrates strong condensation and densification of the invading subcritical CO2 and supercritical methane in small pores.