Close-quarters Quadrotor flying for a pole inspection with position based visual servoing and high-speed vision

This paper presents a 100 Hz monocular position based visual servoing system to control a quadrotor flying in close proximity to vertical structures approximating a narrow, locally linear shape. Assuming the object boundaries are represented by parallel vertical lines in the image, detection and tracking is achieved using Plücker line representation and a line tracker. The visual information is fused with IMU data in an EKF framework to provide fast and accurate state estimation. A nested control design provides position and velocity control with respect to the object. Our approach is aimed at high performance on-board control for applications allowing only small error margins and without a motion capture system, as required for real world infrastructure inspection. Simulated and ground-truthed experimental results are presented.

Determinants of second row passenger comfort

China is becoming an increasingly important automotive market. Customer’s vehicle usage, preferences and requirements differ from traditional western markets in a number of aspects – rear seat usage rates are higher, vehicles are used for business purposes as well as for private transport and rear seat usage is generally more important to Chinese customers compared to their western counterparts. The purpose of this project is to dimension and investigate these differences from an ergonomics perspective and use these results to guide the design of future products. The focus for this project will be specific to vehicles in the CD segment. More specifically, this project focuses on the second row ‘ambience’. Ambience refers to the global feeling perceived by second row passengers, and the main factors contributing to ambience are: ingress and egress comfort, seat comfort, roominess, and ease of use of the controls. In order to investigate the aforementioned parameters, an experimental study has been conducted in Shanghai, China. This experiment involved 80 healthy Chinese CD- and D-car customers. These subjects were asked to evaluate different features present in the second row environment of three different cars: A Ford Mondeo, Toyota Camry and Mercedes S-class. Various data has been collected during this experiment: First, the anthropometric dimensions of the subjects have been measured. The subjects were also asked to fill a questionnaire about demographics, their own car usage, and their perception of a various number of features present in the three tested cars. A great amount of technical data was also collected. The first part of this report presents the results given by the questionnaires. It includes Chinese demographics, vehicle usage habits, and the subjective perception of the features present in the tested cars. It also presents the results of the anthropometric measurements. This gives a first insight into Chinese customers’ habits and preferences. The second part deals with the technical data recorded during the experiment: second row seat adjustment ranges, roominess, optimal location of controls, and pressure mapping analysis. Analysis of technical data allows a deeper understanding of the factors contributing to comfort and ambience perception. Using the technical data together with the comfort ratings given by the subjects in the questionnaire, recommendations on several design parameters were provided. Finally, an experimental study of car ingress-egress has been conducted in a University laboratory controlled environment. During this study, the ingress and egress motion of 20 customers from Chinese origin was recorded using a motion capture system. The last part of this report presents the protocol and data processing that led to building an ingress-egress motion database that was provided to Ford.

Paired back

Paired Back (2013) investigated the interpretation of text as a dance score. Specific words were used to trigger movement sequences. The performers, Avril Huddy and Jenny Roche, responded to spoken words with individual movement responses which were captured on video, reviewed and assembled as a duet. The musician Nicholas Ng, playing traditional Chinese instruments was also woven into the dancers’ choreography. This was achieved through choreographing a floor pattern that enabled him to weave through the space and ‘seemingly’ interact with the dancers’ actions. Projections using motion capture were also explored and sequenced with the actions of the dance. Retrospectively, I recognised my ‘intuitive’ use of text which I have mapped from its beginnings during the first rehearsal through to the performance at the Judith Wright Centre and demonstrated in DVD documentation. Consequently traces of this original ‘score’ used during the creative process are visible in final performance outcome. This has enabled me to reflect on the impact of language and instructions within my creative process.

A glossary of bodily responses

A collaborative video with Avril Huddy where two viewpoints, performer and documenter, were presented simultaneously to investigate Arakawa and Gin’s notion of “boundary-swaying”. In this performance-work, the performer influences what the camera is able to capture by engaging the documenter in a form of improvised dance. The performer’s movements appear impulsive and unpredictable, testing ways for the documenter to frame the performer’s movement. The images revealed by the documenter’s camera reflect a complexity of moments and co-incidences, evoking a sense of the performer’s embodied thinking within improvised movement. While a second camera uses a conventional wide angle shot to document the unfolding of the performance-work and track the connection between the documenter and the performer. While the performance-work itself is still highly-experimental, the ideas underpinning this exploration suggest how future investigations integrating more sensitive technology such as motion capture and tracking devises may be investigated. This performance-work formed part of the Creative Response Exhibition curated by Alan Prohm, Bill Lavender and Jason Nelson and a peer-review committee as part of the proceedings of the AG3 Online: Third International Arakawa and Gins Architecture and Philosophy Conference, hosted by the Centre for Public Culture and Ideas at Griffith University.

Shared autonomy for close-quarters navigation and control of a VTOL platform

This thesis presents an approach for a vertical infrastructure inspection using a vertical take-off and landing (VTOL) unmanned aerial vehicle and shared autonomy. Inspecting vertical structure such as light and power distribution poles is a difficult task. There are challenges involved with developing such an inspection system, such as flying in close proximity to a target while maintaining a fixed stand-off distance from it. The contributions of this thesis fall into three main areas. Firstly, an approach to vehicle dynamic modeling is evaluated in simulation and experiments. Secondly, EKF-based state estimators are demonstrated, as well as estimator-free approaches such as image based visual servoing (IBVS) validated with motion capture ground truth data. Thirdly, an integrated pole inspection system comprising a VTOL platform with human-in-the-loop control, (shared autonomy) is demonstrated. These contributions are comprehensively explained through a series of published papers.

An alternative approach to describing agility in sports through establishment of a relationship between velocity and radius of curvature

Agility is an essential part of many athletic activities. Currently, agility drill duration is the sole criterion used for evaluation of agility performance. The relationship between drill duration and factors such as acceleration, deceleration and change of direction, however, has not been fully explored. This paper provides a mathematical description of the relationship between velocity and radius of curvatures in an agility drill through implementation of a power law (PL). Two groups of skilled and unskilled participants performed a cyclic forward/backward shuttle agility test. Kinematic data was recorded using motion capture system at a sampling rate of 200 Hz. The logarithmic relationship between tangential velocity and radius of curvature of participant trajectories in both groups was established using the PL. The slope of the regression line was found to be 0.26 and 0.36, for the skilled and unskilled groups, respectively. The magnitudes of regression line slope for both groups were approximately 0.3 which is close to the expected 1/3 value. Results are an indication of how the PL could be implemented in an agility drill thus opening the way for establishment of a more representative measure of agility performance instead of drill duration.

Mapping joint ROM on a cube using electromagnetic trackers

This paper presents a unified framework using the unit cube for measurement, representation and usage of the range of motion (ROM) of body joints with multiple degrees of freedom (d.o.f) to be used for digital human models (DHM). Traditional goniometry needs skill and kn owledge; it is intrusive and has limited applicability for multi-d.o.f. joints. Measurements using motion capture systems often involve complicated mathematics which itself need validation. In this paper we use change of orientation as the measure of rotation; this definition does not require the identification of any fixed axis of rotation. A two-d.o.f. joint ROM can be represented as a Gaussian map. Spherical polygon representation of ROM, though popular, remains inaccurate, vulnerable due to singularities on parametric sphere and difficult to use for point classification. The unit cube representation overcomes these difficulties. In the work presented here, electromagnetic trackers have been effectively used for measuring the relative orientation of a body segment of interest with respect to another body segment. The orientation is then mapped on a surface gridded cube. As the body segment is moved, the grid cells visited are identified and visualized. Using the visual display as a feedback, the subject is instructed to cover as many grid cells as he can. In this way we get a connected patch of contiguous grid cells. The boundary of this patch represents the active ROM of the concerned joint. The tracker data is converted into the motion of a direction aligned with the axis of the segment and a rotation about this axis later on. The direction identifies the grid cells on the cube and rotation about the axis is represented as a range and visualized using color codes. Thus the present methodology provides a simple, intuitive and accura te determination and representation of up to 3 d.o.f. joints. Basic results are presented for the shoulder. The measurement scheme to be used for wrist and neck, and approach for estimation of the statistical distribution of ROM for a given population are also discussed.

Identificação do padrão biomecânico de condutas motoras em escolares: o caso da marcha

A constituição de uma base de dados normativa da marcha é essencial para o diagnóstico e o tratamento de padrões atípicos da locomoção (SUTHERLAND et al., 1997). Não obstante, são escassas as informações relativas aos padrões normais da marcha de crianças (GANLEY e POWERS, 2005), carência ainda mais evidente no tocante à produção acadêmica sobre o padrão biomecânico da locomoção da população de crianças brasileiras. Nesse sentido, especialistas em análise de marcha alertam para o fato que crianças de diferentes populações podem exibir diferentes padrões de marcha de acordo com os grupos étnicos das quais foram extraídas (MORENO-HERNÁNDEZ et al., 2010). Assim sendo, o objetivo do presente estudo foi descrever o padrão biomecânico da marcha de crianças hígidas brasileiras entre 6 e 11 anos de idade. Cento e vinte e duas crianças hígidas, entre seis e 11 anos de idade foram aleatoriamente recrutadas de um universo de 328 alunos. Os sujeitos foram alocados em três grupos etários: Grupo 1 (6-7 anos), Grupo 2 (8-9 anos) e Grupo 3 (10-11 anos). Para o registro das imagens das marchas das crianças foi utilizado um sistema de captura bidimensional de movimento a uma freqüência de aquisição de 30 Hz, composto por uma câmera Sony modelo HC 46 posicionada ortogonalmente a 6 metros da pista. Marcadores esféricos reflexivos de 20mm de diâmetro foram fixados em ambos os lados do corpo dos participantes. Os valores em bruto das coordenadas dos marcadores foram transformadas em coordenadas globais 2D (CALDWELL et al., 2004) e processadas no software SkillSpector (Versão 1.0). A estratégia de Hof (1996) foi utilizada para a normalização dos dados da marcha. Os comprimentos de passo e passada apresentaram uma tendência de aumento com o avanço da idade até 8-9 anos de idade, ao passo que a cadência dos passos apresentou uma tendência de diminuição até o mesmo período. Os números não-dimensionais não apresentaram qualquer tendência de alteração com o avanço da idade. Os três grupos etários apresentaram trajetórias angulares articulares semelhantes. O presente estudo constitui ação pioneira no que tange à descrição do padrão cinemático da marcha de crianças hígidas brasileiras entre 6 e 11 anos de idade. Assim sendo, consideramos que um primeiro passo foi dado no sentido da constituição de uma base de dados normativa da locomoção desses indivíduos.

Physiological modelling for improved reliability in silhouette-driven gradient-based hand tracking

We present a gradient-based motion capture system that robustly tracks a human hand, based on abstracted visual information - silhouettes. Despite the ambiguity in the visual data and despite the vulnerability of gradient-based methods in the face of such ambiguity, we minimise problems related to misfit by using a model of the hand's physiology, which is entirely non-visual, subject-invariant, and assumed to be known a priori. By modelling seven distinct aspects of the hand's physiology we derive prior densities which are incorporated into the tracking system within a Bayesian framework. We demonstrate how the posterior is formed, and how our formulation leads to the extraction of the maximum a posteriori estimate using a gradient-based search. Our results demonstrate an enormous improvement in tracking precision and reliability, while also achieving near real-time performance. © 2009 IEEE.

A benchmark comparison between reconfigurable, intelligent and autonomous wireless inertial measurement and photonic technologies in rehabilitation

Advanced sensory systems address a number of major obstacles towards the provision for cost effective and proactive rehabilitation. Many of these systems employ technologies such as high-speed video or motion capture to generate quantitative measurements. However these solutions are accompanied by some major limitations including extensive set-up and calibration, restriction to indoor use, high cost and time consuming data analysis. Additionally many do not quantify improvement in a rigorous manner for example gait analysis for 5 minutes as opposed to 24 hour ambulatory monitoring. This work addresses these limitations using low cost, wearable wireless inertial measurement as a mobile and minimal infrastructure alternative. In cooperation with healthcare professionals the goal is to design and implement a reconfigurable and intelligent movement capture system. A key component of this work is an extensive benchmark comparison with the 'gold standard' VICON motion capture system.

A smart wireless inertial measurement unit system: simplifying & encouraging usage of WIMU technology

Wireless Inertial Measurement Units (WIMUs) combine motion sensing, processing & communications functionsin a single device. Data gathered using these sensors has the potential to be converted into high quality motion data. By outfitting a subject with multiple WIMUs full motion data can begathered. With a potential cost of ownership several orders of magnitude less than traditional camera based motion capture, WIMU systems have potential to be crucially important in supplementing or replacing traditional motion capture and opening up entirely new application areas and potential markets particularly in the rehabilitative, sports & at-home healthcarespaces. Currently WIMUs are underutilized in these areas. A major barrier to adoption is perceived complexity. Sample rates, sensor types & dynamic sensor ranges may need to be adjusted on multiple axes for each device depending on the scenario. As such we present an advanced WIMU in conjunction with a Smart WIMU system to simplify this aspect with 3 usage modes: Manual, Intelligent and Autonomous. Attendees will be able to compare the 3 different modes and see the effects of good andbad set-ups on the quality of data gathered in real time.

Of Mice and Men: An Ergonomic and Market Assessment of Current Computer Mice

Gemstone Team MICE (Modifying and Improving Computer Ergonomics)

Synthesis of Walking Sounds for Alleviating Gait Disturbances in Parkinson’s Disease

Managing gait disturbances in people with Parkinson’s disease is a pressing challenge, as symptoms can contribute to injury and morbidity through an increased risk of falls. While drug-based interventions have limited efficacy in alleviating gait impairments, certain non-pharmacological methods, such as cueing, can also induce transient improvements to gait. The approach adopted here is to use computationally-generated sounds to help guide and improve walking actions. The first method described uses recordings of force data taken from the steps of a healthy adult which in turn were used to synthesize realistic gravel-footstep sounds that represented different spatio-temporal parameters of gait, such as step duration and step length. The second method described involves a novel method of sonifying, in real time, the swing phase of gait using real-time motion-capture data to control a sound synthesis engine. Both approaches explore how simple but rich auditory representations of action based events can be used by people with Parkinson’s to guide and improve the quality of their walking, reducing the risk of falls and injury. Studies with Parkinson’s disease patients are reported which show positive results for both techniques in reducing step length variability. Potential future directions for how these sound approaches can be used to manage gait disturbances in Parkinson’s are also discussed.

Design guidelines for developing customised serious games for parkinson's disease rehabilitation using bespoke game sensors

The research presented in this paper proposes a set of design guidelines in the context of a Parkinson's Disease (PD) rehabilitation design framework for the development of serious games for the physical therapy of people with PD. The game design guidelines provided in the paper are informed by the study of the literature review and lessons learned from the pilot testing of serious games designed to suit the requirements of rehabilitation of patients with Parkinson's Disease. The proposed PD rehabilitation design framework employed for the games pilot testing utilises a low-cost, customized and off-the-shelf motion capture system (employing commercial game controllers) developed to cater for the unique requirement of the physical therapy of people with PD. Although design guidelines have been proposed before for the design of serious games in health, this is the first research paper to present guidelines for the design of serious games specifically for PD motor rehabilitation.

Development of a novel immersive interactive virtual reality cricket simulator for cricket batting

Research in the field of sports performance is constantly developing new technology to help extract meaningful data to aid in understanding in a multitude of areas such as improving technical or motor performance. Video playback has previously been extensively used for exploring anticipatory behaviour. However, when using such systems, perception is not active. This loses key information that only emerges from the dynamics of the action unfolding over time and the active perception of the observer. Virtual reality (VR) may be used to overcome such issues. This paper presents the architecture and initial implementation of a novel VR cricket simulator, utilising state of the art motion capture technology (21 Vicon cameras capturing kinematic profile of elite bowlers) and emerging VR technology (Intersense IS-900 tracking combined with Qualisys Motion capture cameras with visual display via Sony Head Mounted Display HMZ-T1), applied in a cricket scenario to examine varying components of decision and action for cricket batters. This provided an experience with a high level of presence allowing for a real-time egocentric view-point to be presented to participants. Cyclical user-testing was carried out, utilisng both qualitative and quantitative approaches, with users reporting a positive experience in use of the system.