System identification, estimation and control for a cost effective open-source quadcopter

This paper describes system identification, estimation and control of translational motion and heading angle for a cost effective open-source quadcopter — the MikroKopter. The dynamics of its built-in sensors, roll and pitch attitude controller, and system latencies are determined and used to design a computationally inexpensive multi-rate velocity estimator that fuses data from the built-in inertial sensors and a low-rate onboard laser range finder. Control is performed using a nested loop structure that is also computationally inexpensive and incorporates different sensors. Experimental results for the estimator and closed-loop positioning are presented and compared with ground truth from a motion capture system.

The fishtown series

Fishtown is a series of mediated animated works which embody artistic conceptions of ambience and explore the interplay between foreground and background. The series draws upon a representation of natural patterns and rhythms in the ambient environment and is produced using a hybrid style of animation process that incorporates motion capture, dynamics and keyframe animation to construct a biomemtic peripheral rhythm. The display of the work is a crucial part of the project, and contributes a considerable amount to the reception of the work. Based on the ambient conceptions defined by Cage, Eno and Bizzocchi, ambient animation should incorporate some form of ambient display. As Eno (1978) states, it should be as ignorable as it is interesting. The ultimate intention is to place the work outside the gallery setting, to provide a more neutral ambient setting for the viewing of the work, and therefore the use of an ambient display is necessary if the work is to be situated in an ambient setting. Craig Walsh is a contemporary artist producing work for large scale projections in ambient settings. Completing Walsh's masterclass in 2011 (Tanawha Arts and Ecology Centre) has been an important factor in arriving at a strategy for the display of the Fishtown series. The most recent work in the Fishtown series was developed during a residency at the Crane Arts studios in Philadelphia USA in August 2012, and is comprised of a screen based animated work, utilizing large scale digital projection. Documentation of this work can be found at the Crane Arts Residency Website: http://cranearts.qcagriffith.com/crane-arts-residency-chris-denaro

Establishing virtual production as a research and teaching activity at QUT

Located within the Creative Industries Faculty, the Animation team at the Queensland University of Technology (QUT) recently acquired a full-body inertial motion capture system. Our research to date has been predominantly concerned with interdisciplinary practice and the benefits this could bring to undergraduate teaching. From early experimental tests it was identified that there was a need to develop a framework for best practice and an efficient production workflow to ensure the system was being used to its full potential. Through our ongoing investigation we have identified at least three areas that stand to have long-term benefits from universities engaging in motion capture related research activity. This includes interdisciplinary collaborative research, undergraduate teaching and improved production processes. The following paper reports the early stages of our research, which explores the use of a full-body inertial motion capture (MoCap) solution in collaboration with performing artists.

100Hz onboard vision for quadrotor state estimation

This paper introduces a high-speed, 100Hz, visionbased state estimator that is suitable for quadrotor control in close quarters manoeuvring applications. We describe the hardware and algorithms for estimating the state of the quadrotor. Experimental results for position, velocity and yaw angle estimators are presented and compared with motion capture data. Quantitative performance comparison with state-of-the-art achievements are also presented.

Vertical infrastructure inspection using a quadcopter and shared autonomy control

This paper presents a shared autonomy control scheme for a quadcopter that is suited for inspection of vertical infrastructure — tall man-made structures such as streetlights, electricity poles or the exterior surfaces of buildings. Current approaches to inspection of such structures is slow, expensive, and potentially hazardous. Low-cost aerial platforms with an ability to hover now have sufficient payload and endurance for this kind of task, but require significant human skill to fly. We develop a control architecture that enables synergy between the ground-based operator and the aerial inspection robot. An unskilled operator is assisted by onboard sensing and partial autonomy to safely fly the robot in close proximity to the structure. The operator uses their domain knowledge and problem solving skills to guide the robot in difficult to reach locations to inspect and assess the condition of the infrastructure. The operator commands the robot in a local task coordinate frame with limited degrees of freedom (DOF). For instance: up/down, left/right, toward/away with respect to the infrastructure. We therefore avoid problems of global mapping and navigation while providing an intuitive interface to the operator. We describe algorithms for pole detection, robot velocity estimation with respect to the pole, and position estimation in 3D space as well as the control algorithms and overall system architecture. We present initial results of shared autonomy of a quadrotor with respect to a vertical pole and robot performance is evaluated by comparing with motion capture data.

General trajectory prior for non-rigid reconstruction

Trajectory basis Non-Rigid Structure From Motion (NRSFM) currently faces two problems: the limit of reconstructability and the need to tune the basis size for different sequences. This paper provides a novel theoretical bound on 3D reconstruction error, arguing that the existing definition of reconstructability is fundamentally flawed in that it fails to consider system condition. This insight motivates a novel strategy whereby the trajectory's response to a set of high-pass filters is minimised. The new approach eliminates the need to tune the basis size and is more efficient for long sequences. Additionally, the truncated DCT basis is shown to have a dual interpretation as a high-pass filter. The success of trajectory filter reconstruction is demonstrated quantitatively on synthetic projections of real motion capture sequences and qualitatively on real image sequences.

Monocular vision based autonomous navigation for a cost-effective MAV in GPS-denied environments

In this paper, we present a monocular vision based autonomous navigation system for Micro Aerial Vehicles (MAVs) in GPS-denied environments. The major drawback of monocular systems is that the depth scale of the scene can not be determined without prior knowledge or other sensors. To address this problem, we minimize a cost function consisting of a drift-free altitude measurement and up-to-scale position estimate obtained using the visual sensor. We evaluate the scale estimator, state estimator and controller performance by comparing with ground truth data acquired using a motion capture system. All resources including source code, tutorial documentation and system models are available online.

Animated Kolam Patterns

The brief for the creative work was to produce a digital backdrop that would be projected behind and enhance a dance performance. The animation needed to display a static kolam pattern that would then dissolve at a choreographed point in the performance. The dissolving mimics the fragmentation that occurs to physical kolam patterns throughout the day as people interact with the drawings. The final animated work was incorporated into Vanessa Mafe-Keane’s performance titled “Paired Back” performed at the Judith Wright Centre, Brisbane 2013 as part of “Dance. Indie Dance. Through the use of motion capture technology the process of dissolving the pattern is a direct result of the performer’s movements allowing visual and temporal connection between motion of performer and digital graphic to be observed. This creative work presented an opportunity to expand upon experiments conducted in the production of experimental visual forms undertaken at QUT using the Xsens MVN Inertial Motion Capture System. The project took on the form of an investigation into practice with a focus on the additional complexities of capturing, then applying multiple data sources into the production of animated visuals along with bringing to light the considerations taken into account when producing this type of generative art work for live performance. The reported outcomes from this investigation have contributed to a larger study on the use of motion capture in the generative arts, furthering the understanding of and generating theories on practice.

Shoes that restrict metatarsophalangeal dorsiflexion cause proximal joint compensations

To describe barefoot, shod and in-shoe kinematics during stance phase of walking gait in a normal arched adult population. An equal sample of males and females (n = 24) was recruited. In order to quantify the effect of footwear independent of technical design features, an ASICS shoe (Onitsuka Tiger-Mexico 66, Japan) was used in this study. Markers were applied to three conditions; barefoot, shod, and in-shoe. The calibration markers were used to define static pose. The order of testing was randomised. Participants completed five trials in each condition. Kinematic data were captured using a 12 camera VICON MX40 motion capture system at 100 Hz and processed in Visual3D. A previously developed model was used to describe joint angles [1]. A univariate two-way ANOVA was used to identify any differences between the pairs of conditions. Post-hoc Sheffé tests were used to further interrogate the data for differences. At peak hallux dorsiflexion (Figure 1), during propulsion, the metatarsophalangeal joint (MPTJ) was significantly more dorsiflexed in the barefoot condition compared to the shod condition (p = 0.004). At the same gait event, the tibiocalcaneal joint (TCJ) was significantly more plantarflexed than both the shod and in-shoe conditions (p < 0.001), and the tarsometatarsal joint (TMTJ) was significantly less dorsiflexed in the barefoot condition compared to the shod and in-shoe conditions (p < 0.001). The findings of the current study demonstrate that footwear has significant effects on sagittal plane MPTJ joint dorsiflexion at peak hallux dorsiflexion, which results in compensations at proximal foot joints.

Adopting virtual production for animated filmaking

Virtual Production is a rapidly growing approach to filmmaking that utilises 3D software, virtual camera systems and motion capture technology to visually interact with a real-time virtual environment. The use of these technologies has continued to increase, however, little has been done to document the various approaches for incorporating this new film making technique into a production. This practice-led research project outlines the development of virtual production in the entertainment industry and explores possible strategies for adopting aspects of this new film making technique into the production of short animated films. The outcome is an improved understanding of possible strategies that could be utilised to assist producers and directors with the transition into this new film making technique. - See more at: http://dl4.globalstf.org/?wpsc-product=adopting-virtual-production-for-animated-filmaking#sthash.DLzRph4Z.dpuf

Effects of a pediatric weight management program with and without active video games

Importance Active video games may offer an effective strategy to increase physical activity in overweight and obese children. However, the specific effects of active gaming when delivered within the context of a pediatric weight management program are unknown. Objective To evaluate the effects of active video gaming on physical activity and weight loss in children participating in an evidence-based weight management program delivered in the community. Design, Setting, and Participants Group-randomized clinical trial conducted during a 16-week period in YMCAs and schools located in Massachusetts, Rhode Island, and Texas. Seventy-five overweight or obese children (41 girls [55%], 34 whites [45%], 20 Hispanics [27%], and 17 blacks [23%]) enrolled in a community-based pediatric weight management program. Mean (SD) age of the participants was 10.0 (1.7) years; body mass index (BMI) z score, 2.15 (0.40); and percentage overweight from the median BMI for age and sex, 64.3% (19.9%). Interventions All participants received a comprehensive family-based pediatric weight management program (JOIN for ME). Participants in the program and active gaming group received hardware consisting of a game console and motion capture device and 1 active game at their second treatment session and a second game in week 9 of the program. Participants in the program-only group were given the hardware and 2 games at the completion of the 16-week program. Main Outcomes and Measures Objectively measured daily moderate-to-vigorous and vigorous physical activity, percentage overweight, and BMI z score. Results Participants in the program and active gaming group exhibited significant increases in moderate-to-vigorous (mean [SD], 7.4 [2.7] min/d) and vigorous (2.8 [0.9] min/d) physical activity at week 16 (P < .05). In the program-only group, a decline or no change was observed in the moderate-to-vigorous (mean [SD] net difference, 8.0 [3.8] min/d; P = .04) and vigorous (3.1 [1.3] min/d; P = .02) physical activity. Participants in both groups exhibited significant reductions in percentage overweight and BMI z scores at week 16. However, the program and active gaming group exhibited significantly greater reductions in percentage overweight (mean [SD], −10.9% [1.6%] vs −5.5% [1.5%]; P = .02) and BMI z score (−0.25 [0.03] vs −0.11 [0.03]; P < .001). Conclusions and Relevance Incorporating active video gaming into an evidence-based pediatric weight management program has positive effects on physical activity and relative weight.

Close-quarters Quadrotor flying for a pole inspection with position based visual servoing and high-speed vision

This paper presents a 100 Hz monocular position based visual servoing system to control a quadrotor flying in close proximity to vertical structures approximating a narrow, locally linear shape. Assuming the object boundaries are represented by parallel vertical lines in the image, detection and tracking is achieved using Plücker line representation and a line tracker. The visual information is fused with IMU data in an EKF framework to provide fast and accurate state estimation. A nested control design provides position and velocity control with respect to the object. Our approach is aimed at high performance on-board control for applications allowing only small error margins and without a motion capture system, as required for real world infrastructure inspection. Simulated and ground-truthed experimental results are presented.

Determinants of second row passenger comfort

China is becoming an increasingly important automotive market. Customer’s vehicle usage, preferences and requirements differ from traditional western markets in a number of aspects – rear seat usage rates are higher, vehicles are used for business purposes as well as for private transport and rear seat usage is generally more important to Chinese customers compared to their western counterparts. The purpose of this project is to dimension and investigate these differences from an ergonomics perspective and use these results to guide the design of future products. The focus for this project will be specific to vehicles in the CD segment. More specifically, this project focuses on the second row ‘ambience’. Ambience refers to the global feeling perceived by second row passengers, and the main factors contributing to ambience are: ingress and egress comfort, seat comfort, roominess, and ease of use of the controls. In order to investigate the aforementioned parameters, an experimental study has been conducted in Shanghai, China. This experiment involved 80 healthy Chinese CD- and D-car customers. These subjects were asked to evaluate different features present in the second row environment of three different cars: A Ford Mondeo, Toyota Camry and Mercedes S-class. Various data has been collected during this experiment: First, the anthropometric dimensions of the subjects have been measured. The subjects were also asked to fill a questionnaire about demographics, their own car usage, and their perception of a various number of features present in the three tested cars. A great amount of technical data was also collected. The first part of this report presents the results given by the questionnaires. It includes Chinese demographics, vehicle usage habits, and the subjective perception of the features present in the tested cars. It also presents the results of the anthropometric measurements. This gives a first insight into Chinese customers’ habits and preferences. The second part deals with the technical data recorded during the experiment: second row seat adjustment ranges, roominess, optimal location of controls, and pressure mapping analysis. Analysis of technical data allows a deeper understanding of the factors contributing to comfort and ambience perception. Using the technical data together with the comfort ratings given by the subjects in the questionnaire, recommendations on several design parameters were provided. Finally, an experimental study of car ingress-egress has been conducted in a University laboratory controlled environment. During this study, the ingress and egress motion of 20 customers from Chinese origin was recorded using a motion capture system. The last part of this report presents the protocol and data processing that led to building an ingress-egress motion database that was provided to Ford.

Paired back

Paired Back (2013) investigated the interpretation of text as a dance score. Specific words were used to trigger movement sequences. The performers, Avril Huddy and Jenny Roche, responded to spoken words with individual movement responses which were captured on video, reviewed and assembled as a duet. The musician Nicholas Ng, playing traditional Chinese instruments was also woven into the dancers’ choreography. This was achieved through choreographing a floor pattern that enabled him to weave through the space and ‘seemingly’ interact with the dancers’ actions. Projections using motion capture were also explored and sequenced with the actions of the dance. Retrospectively, I recognised my ‘intuitive’ use of text which I have mapped from its beginnings during the first rehearsal through to the performance at the Judith Wright Centre and demonstrated in DVD documentation. Consequently traces of this original ‘score’ used during the creative process are visible in final performance outcome. This has enabled me to reflect on the impact of language and instructions within my creative process.

A glossary of bodily responses

A collaborative video with Avril Huddy where two viewpoints, performer and documenter, were presented simultaneously to investigate Arakawa and Gin’s notion of “boundary-swaying”. In this performance-work, the performer influences what the camera is able to capture by engaging the documenter in a form of improvised dance. The performer’s movements appear impulsive and unpredictable, testing ways for the documenter to frame the performer’s movement. The images revealed by the documenter’s camera reflect a complexity of moments and co-incidences, evoking a sense of the performer’s embodied thinking within improvised movement. While a second camera uses a conventional wide angle shot to document the unfolding of the performance-work and track the connection between the documenter and the performer. While the performance-work itself is still highly-experimental, the ideas underpinning this exploration suggest how future investigations integrating more sensitive technology such as motion capture and tracking devises may be investigated. This performance-work formed part of the Creative Response Exhibition curated by Alan Prohm, Bill Lavender and Jason Nelson and a peer-review committee as part of the proceedings of the AG3 Online: Third International Arakawa and Gins Architecture and Philosophy Conference, hosted by the Centre for Public Culture and Ideas at Griffith University.