Curiosity driven reinforcement learning for motion planning on humanoids

Most previous work on artificial curiosity (AC) and intrinsic motivation focuses on basic concepts and theory. Experimental results are generally limited to toy scenarios, such as navigation in a simulated maze, or control of a simple mechanical system with one or two degrees of freedom. To study AC in a more realistic setting, we embody a curious agent in the complex iCub humanoid robot. Our novel reinforcement learning (RL) framework consists of a state-of-the-art, low-level, reactive control layer, which controls the iCub while respecting constraints, and a high-level curious agent, which explores the iCub's state-action space through information gain maximization, learning a world model from experience, controlling the actual iCub hardware in real-time. To the best of our knowledge, this is the first ever embodied, curious agent for real-time motion planning on a humanoid. We demonstrate that it can learn compact Markov models to represent large regions of the iCub's configuration space, and that the iCub explores intelligently, showing interest in its physical constraints as well as in objects it finds in its environment.

Remembering the past through picture books

In anticipation of the commemorations around the centenary of World War 1 (2014-2018) this chapter examines the ways in which war and its effects have been represented in picture books for children. It looks at the ways in which these picture books create “textual monuments” as points of reference through which younger generations can “develop a narrative of the past” and “explore different points of view”. The focus of the discussion centres on a number of recent picture books and their application to aspects of the F-2 Australian History curriculum.

ATAR scores only part of the picture for teaching

A common debate has resurfaced over teacher quality and the quality of teacher education in Australia. This time it was started by a leaked draft report into teacher education from the Australian Institute of Teaching and School Leadership (AITSL) which the public can’t expect to see for at least another month. Media reports have all focused on one aspect of the wide-ranging report: teaching students' ATARs.

Numerical investigation of motion and deformation of a single red blood cell in a stenosed capillary

It is generally assumed that influence of the red blood cells (RBCs) is predominant in blood rheology. The healthy RBCs are highly deformable and can thus easily squeeze through the smallest capillaries having internal diameter less than their characteristic size. On the other hand, RBCs infected by malaria or other diseases are stiffer and so less deformable. Thus it is harder for them to flow through the smallest capillaries. Therefore, it is very important to critically and realistically investigate the mechanical behavior of both healthy and infected RBCs which is a current gap in knowledge. The motion and the steady state deformed shape of the RBCs depend on many factors, such as the geometrical parameters of the capillary through which blood flows, the membrane bending stiffness and the mean velocity of the blood flow. In this study, motion and deformation of a single two-dimensional RBC in a stenosed capillary is explored by using smoothed particle hydrodynamics (SPH) method. An elastic spring network is used to model the RBC membrane, while the RBC's inside fluid and outside fluid are treated as SPH particles. The effect of RBC's membrane stiffness (kb), inlet pressure (P) and geometrical parameters of the capillary on the motion and deformation of the RBC is studied. The deformation index, RBC's mean velocity and the cell membrane energy are analyzed when the cell passes through the stenosed capillary. The simulation results demonstrate that the kb, P and the geometrical parameters of the capillary have a significant impact on the RBCs' motion and deformation in the stenosed section.

Encouraging Empathy through Picture Books about Migration

Australia has become one of the most highly multilingual and multicultural societies in the world today with people descending from 270 ancestries, who speak more than 260 languages (Commonwealth of Australia, 2011). Immigration is something that children encounter in their daily lives either through personal experience or through witnessing the lives of migrants at school, in the community, or through popular media, including children’s literature. Schools are frequently the initial interface for individuals who resettle in Australia and they ‘play a significant role in establishing meaningful connections to Australian society and a sense of belonging in Australia’ (Uptin, Wright, & Harwood, 2013, p. 1). Children's literature about cultural and ethnic diversity explores the impacts of migration and related issues creating ‘imaginary realms’ (Dudek & Ommundsen, 2007). These fictional interpretations of the migrant experience or the experience of migration are supported by distinctive “real life” cultural experiences. Picture books furnish teachers and students with an accessible means to investigate these complex issues through sensitive discussions. This chapter investigates how picture books about migration help deepen children’s perceptive understanding of migrants’ plights, and thereby nurture tolerance and empathy.

Adaptive compliance control of a multi‐legged stair‐climbing robot based on proprioceptive data

Purpose – The purpose of this paper is to describe an innovative compliance control architecture for hybrid multi‐legged robots. The approach was verified on the hybrid legged‐wheeled robot ASGUARD, which was inspired by quadruped animals. The adaptive compliance controller allows the system to cope with a variety of stairs, very rough terrain, and is also able to move with high velocity on flat ground without changing the control parameters. Design/methodology/approach – The paper shows how this adaptivity results in a versatile controller for hybrid legged‐wheeled robots. For the locomotion control we use an adaptive model of motion pattern generators. The control approach takes into account the proprioceptive information of the torques, which are applied on the legs. The controller itself is embedded on a FPGA‐based, custom designed motor control board. An additional proprioceptive inclination feedback is used to make the same controller more robust in terms of stair‐climbing capabilities. Findings – The robot is well suited for disaster mitigation as well as for urban search and rescue missions, where it is often necessary to place sensors or cameras into dangerous or inaccessible areas to get a better situation awareness for the rescue personnel, before they enter a possibly dangerous area. A rugged, waterproof and dust‐proof corpus and the ability to swim are additional features of the robot. Originality/value – Contrary to existing approaches, a pre‐defined walking pattern for stair‐climbing was not used, but an adaptive approach based only on internal sensor information. In contrast to many other walking pattern based robots, the direct proprioceptive feedback was used in order to modify the internal control loop, thus adapting the compliance of each leg on‐line.

Analysis and evaluation of use of the V1 and South East Freeway Bicycleway post completion of Stage C of the V1

Executive Summary: Completion of the Veloway 1 (V1) will provide a dedicated and safe route for cyclists between the Brisbane CBD and the Gateway Motorway off-ramp at Eight Mile Plains alongside the South East Motorway. The V1 is being delivered in stages and when completed will provide a dedicated 3m wide cycleway 17km in length. Two stages (D and E) remain to be constructed to complete the V1. Major trip attractors along the V1 include the Mater, Princes Alexandra and Greenslopes Hospitals, two campuses of Griffith University, Garden City shopping centre and the Australian Tax Office. This report assesses the available evidence on the impacts on cycling behaviour of the recently completed V1 Stage C. The data sources informing this review include three intercept surveys, motion activated traffic cameras and travel time surveys on the V1 and adjoining South East Freeway Bikeway (SEFB), Strava app data, and cyclist crash data along Logan Road. The key findings from the evidence are that the completed V1 Stage C has: a Attracted cyclists from Holland Park, Holland Park West, Mt Gravatt and southern parts of Tarragindi onto the V1 Stage C. b Reduced the crash exposure of pedestrians to cyclists by attracting higher speed cyclists off the adjoining SEFB onto the cycling dedicated V1 Stage C. c Reduced the potential crash exposure of cyclists to motor vehicles by attracting cyclists off Logan Road on to the V1. d Provided travel time benefits to cyclists and reduced road crossings (eight down to two). e Predominantly attracted adults commuting alone to and from work and university. The evidence shows that the two traffic crossings across Birdwood Road (required as a temporary measure until the V1 is completed) negate much of the travel time gains of the V1 Stage C compared to the adjoining SEFB for southbound cyclists. Many cyclists accessing the V1 Stage C from the south are cycling in high-volume vehicular traffic lanes to reduce their travel time along Birdwood Road, but in the process are increasing their exposure to crashes with motor vehicles. Based on these findings this report recommends that TMR: a. Continue with plans to complete the V1 Veloway b. Undertake an engineering feasibility assessment to determine the viability of constructing a section of the V1 Stage E from the intersection Weller and Birdwood Roads over Marshall Road and along Bapaume Road on the western side of the Motorway to the intersection of Bapaume and Sterculia Roads. c. In the interim, improve signage and Birdwood Road crossing points for cyclists accessing and egressing the southern end of the V1 Stage C. d. Work with Brisbane City Council to identify the safest and most practical bicycle facilities to facilitate cycle travel between Logan Road and the V1 south of Birdwood Road. e. Improve the awareness of the V1 Stage C through signage for cyclists approaching from the north with the aim of providing a better understanding of the route of the V1 to the south. f. Refine the use of motion activated traffic cameras to improve the capture rate of useable images and obtain an ongoing collection over time of V1 usage data. g. Undertake discussions with Strava, Inc. to refine the presentation of Strava data to improve visual understanding of maps showing before and after cycle route volumes along and on roads leading to the V1.

Predictive motion planning for AUVs subject to strong time-varying currents and forecasting uncertainties

This paper presents a novel path planning method for minimizing the energy consumption of an autonomous underwater vehicle subjected to time varying ocean disturbances and forecast model uncertainty. The algorithm determines 4-Dimensional path candidates using Nonlinear Robust Model Predictive Control (NRMPC) and solutions optimised using A*-like algorithms. Vehicle performance limits are incorporated into the algorithm with disturbances represented as spatial and temporally varying ocean currents with a bounded uncertainty in their predictions. The proposed algorithm is demonstrated through simulations using a 4-Dimensional, spatially distributed time-series predictive ocean current model. Results show the combined NRMPC and A* approach is capable of generating energy-efficient paths which are resistant to both dynamic disturbances and ocean model uncertainty.

Simulating droplet motion on virtual leaf surfaces

A curvilinear thin film model is used to simulate the motion of droplets on a virtual leaf surface, with a view to better understand the retention of agricultural sprays on plants. The governing model, adapted from Roy et al. (2002 J. Fluid Mech. 454, 235–261) with the addition of a disjoining pressure term, describes the gravity- and curvature driven flow of a small droplet on a complex substrate: a cotton leaf reconstructed from digitized scan data. Coalescence is the key mechanism behind spray coating of foliage, and our simulations demonstrate that various experimentally observed coalescence behaviours can be reproduced qualitatively. By varying the contact angle over the domain, we also demonstrate that the presence of a chemical defect can act as an obstacle to the droplet’s path, causing break-up. In simulations on the virtual leaf, it is found that the movement of a typical spray size droplet is driven almost exclusively by substrate curvature gradients. It is not until droplet mass is sufficiently increased via coalescence that gravity becomes the dominating force.

Made by motion: A conceptual framework for abstracted animation derived from motion-captured movements

Despite an increasing number of acclaimed abstract animations being created through the application of motion capture technologies there has been little detailed documentation and analysis of this approach for abstract animation production. More specifically, it is unclear what the key considerations are, and what issues practitioners might face, when integrating motion capture movement data into their practice. In response to this issue this study explored and documented the practice of generating abstract visual and temporal artefacts from motion captured dance movements that compose abstract animated short films. The study has resulted in a possible framework for this form of practice and outlines five key considerations which should be taken into account by practitioners who use motion capture in the production of abstract animated short films.

Development of a new ultrasound-based system for tracking motion of the human lumbar spine: Reliability, stability and repeatability during forward bending movement trials

The aim of this study was to develop a new method for quantifying intersegmental motion of the spine in an instrumented motion segment L4–L5 model using ultrasound image post-processing combined with an electromagnetic device. A prospective test–retest design was employed, combined with an evaluation of stability and within- and between-day intra-tester reliability during forward bending by 15 healthy male patients. The accuracy of the measurement system using the model was calculated to be ± 0.9° (standard deviation = 0.43) over a 40° range and ± 0.4 cm (standard deviation = 0.28) over 1.5 cm. The mean composite range of forward bending was 15.5 ± 2.04° during a single trial (standard error of the mean = 0.54, coefficient of variation = 4.18). Reliability (intra-class correlation coefficient = 2.1) was found to be excellent for both within-day measures (0.995–0.999) and between-day measures (0.996–0.999). Further work is necessary to explore the use of this approach in the evaluation of biomechanics, clinical assessments and interventions.

Heritability of head motion during resting state functional MRI in 462 healthy twins

Head motion (HM) is a critical confounding factor in functional MRI. Here we investigate whether HM during resting state functional MRI (RS-fMRI) is influenced by genetic factors in a sample of 462 twins (65% fema≤ 101 MZ (monozygotic) and 130 DZ (dizygotic) twin pairs; mean age: 21 (SD=3.16), range 16-29). Heritability estimates for three HM components-mean translation (MT), maximum translation (MAXT) and mean rotation (MR)-ranged from 37 to 51%. We detected a significant common genetic influence on HM variability, with about two-thirds (genetic correlations range 0.76-1.00) of the variance shared between MR, MT and MAXT. A composite metric (HM-PC1), which aggregated these three, was also moderately heritable (h2=42%). Using a sub-sample (N=35) of the twins we confirmed that mean and maximum translational and rotational motions were consistent "traits" over repeated scans (r=0.53-0.59); reliability was even higher for the composite metric (r=0.66). In addition, phenotypic and cross-trait cross-twin correlations between HM and resting state functional connectivities (RS-FCs) with Brodmann areas (BA) 44 and 45, in which RS-FCs were found to be moderately heritable (BA44: h2-=0.23 (sd=0.041), BA45: h2-=0.26 (sd=0.061)), indicated that HM might not represent a major bias in genetic studies using FCs. Even so, the HM effect on FC was not completely eliminated after regression. HM may be a valuable endophenotype whose relationship with brain disorders remains to be elucidated.

Top-down influences on lexical selection during spoken word production: A 4T fMRI investigation of refractory effects in picture naming

Spoken word production is assumed to involve stages of processing in which activation spreads through layers of units comprising lexical-conceptual knowledge and their corresponding phonological word forms. Using high-field (4T) functional magnetic resonance imagine (fMRI), we assessed whether the relationship between these stages is strictly serial or involves cascaded-interactive processing, and whether central (decision/control) processing mechanisms are involved in lexical selection. Participants performed the competitor priming paradigm in which distractor words, named from a definition and semantically related to a subsequently presented target picture, slow picture-naming latency compared to that with unrelated words. The paradigm intersperses two trials between the definition and the picture to be named, temporally separating activation in the word perception and production networks. Priming semantic competitors of target picture names significantly increased activation in the left posterior temporal cortex, and to a lesser extent the left middle temporal cortex, consistent with the predictions of cascaded-interactive models of lexical access. In addition, extensive activation was detected in the anterior cingulate and pars orbitalis of the inferior frontal gyrus. The findings indicate that lexical selection during competitor priming is biased by top-down mechanisms to reverse associations between primed distractor words and target pictures to select words that meet the current goal of speech.