A Novel Approach to Haptic Tele-operation of Aerial Robot Vehicles

We present a novel, simple and effective approach for tele-operation of aerial robotic vehicles with haptic feedback. Such feedback provides the remote pilot with an intuitive feel of the robot’s state and perceived local environment that will ensure simple and safe operation in cluttered 3D environments common in inspection and surveillance tasks. Our approach is based on energetic considerations and uses the concepts of network theory and port-Hamiltonian systems. We provide a general framework for addressing problems such as mapping the limited stroke of a ‘master’ joystick to the infinite stroke of a ‘slave’ vehicle, while preserving passivity of the closed-loop system in the face of potential time delays in communications links and limited sensor data

Grounding action in visuo-haptic space using experience networks

Traditional approaches to the use of machine learning algorithms do not provide a method to learn multiple tasks in one-shot on an embodied robot. It is proposed that grounding actions within the sensory space leads to the development of action-state relationships which can be re-used despite a change in task. A novel approach called an Experience Network is developed and assessed on a real-world robot required to perform three separate tasks. After grounded representations were developed in the initial task, only minimal further learning was required to perform the second and third task.

Multisensory integration weightings underlying haptic feedback laparoscopic surgery

"This letter aims to highlight the multisensory integration weighting mechanisms that may account for the results in studies investigating haptic feedback in laparoscopic surgery. The current lack of multisensory theoretical knowledge in laparoscopy is evident, and “a much better understanding of how multimodal displays in virtual environments influence human performance is required” ...publisher website

Attunement to haptic information helps skilled performers select implements for striking a ball in cricket

This study examined the perceptual attunement of relatively skilled individuals to physical properties of striking implements in the sport of cricket. We also sought to assess whether utilising bats of different physical properties influenced performance of a specific striking action: the front foot straight drive. Eleven, skilled male cricketers (mean age = 16.6 ± 0.3 years) from an elite school cricket development programme consented to participate in the study. Whist blindfolded, participants wielded six bats exhibiting different mass and moment of inertia (MOI) characteristics and were asked to identify their three most preferred bats for hitting a ball to a maximum distance by performing a front foot straight drive (a common shot in cricket). Next, participants actually attempted to hit balls projected from a ball machine using each of the six bat configurations to enable kinematic analysis of front foot straight drive performance with each implement. Results revealed that, on first choice, the two bats with the smallest mass and MOI values (1 and 2) were most preferred by almost two-thirds (63.7%) of the participants. Kinematic analysis of movement patterns revealed that bat velocity, step length and bat-ball contact position measures significantly differed between bats. Data revealed how skilled youth cricketers were attuned to the different bat characteristics and harnessed movement system degeneracy to perform this complex interceptive action.

Gestural, emergent and expressive : three research themes for haptic interaction

Drawing on three case studies of work in the fields of participatory design, interaction design and electronic arts, we reflect on the implications of these studies for haptic interface research. We propose three themes: gestural; emergent; and expressive; as signposts for a program of research into haptic interaction that could point the way towards novel approaches to haptic interaction and move us from optic to haptic ways of seeing.

Intercontinental haptic teleoperation of a flying vehicle : a step towards real-time applications

This paper describes the theory and practice for a stable haptic teleoperation of a flying vehicle. It extends passivity-based control framework for haptic teleoperation of aerial vehicles in the longest intercontinental setting that presents great challenges. The practicality of the control architecture has been shown in maneuvering and obstacle-avoidance tasks over the internet with the presence of significant time-varying delays and packet losses. Experimental results are presented for teleoperation of a slave quadrotor in Australia from a master station in the Netherlands. The results show that the remote operator is able to safely maneuver the flying vehicle through a structure using haptic feedback of the state of the slave and the perceived obstacles.

From democracy in America to a la francaise accountability. Grasping the sociopolitical origins of accountability [De la démocratie en Amérique du Nord à l’accountability à la française]

Whilst native French speakers oftentimes collapse accountability to account giving, this paper outlines the shape of an accountability ala française. Reading Tocqueville’s (1835) work highlights that accountability as practiced in Anglo-Saxonc countries has been an offspring of American democracy. An accountability a la française would be characterised by conformance to a set or universal values, the submission of minorities to choices made by the majority, a means obligation as well as the rejection of transparency. [Alors que le francophone réduit généralement l’accountability à la reddition de comptes, cet article esquisse les contours d’une véritable accountability à la française. La lecture de Tocqueville (1835) révèle que l’accountability pratiquée dans les pays anglo-saxons trouve ses origines dans les fondements de la démocratie américaine. En France, l’accountability serait caractérisée par le respect d’un ensemble de valeurs universelles, l’adhésion des minorités aux choix majoritaires, l’absence de discriminations, une obligation de moyens et un rejet de la transparence.]

Intrinsic frames of reference in haptic spatial learning

It has been proposed that spatial reference frames with which object locations are specified in memory are intrinsic to a to-be-remembered spatial layout (intrinsic reference theory). Although this theory has been supported by accumulating evidence, it has only been collected from paradigms in which the entire spatial layout was simultaneously visible to observers. The present study was designed to examine the generality of the theory by investigating whether the geometric structure of a spatial layout (bilateral symmetry) influences selection of spatial reference frames when object locations are sequentially learned through haptic exploration. In two experiments, participants learned the spatial layout solely by touch and performed judgments of relative direction among objects using their spatial memories. Results indicated that the geometric structure can provide a spatial cue for establishing reference frames as long as it is accentuated by explicit instructions (Experiment 1) or alignment with an egocentric orientation (Experiment 2). These results are entirely consistent with those from previous studies in which spatial information was encoded through simultaneous viewing of all object locations, suggesting that the intrinsic reference theory is not specific to a type of spatial memory acquired by the particular learning method but instead generalizes to spatial memories learned through a variety of encoding conditions. In particular, the present findings suggest that spatial memories that follow the intrinsic reference theory function equivalently regardless of the modality in which spatial information is encoded.

Reactive reaching and grasping on a humanoid: Towards closing the action-perception loop on the iCub

We propose a system incorporating a tight integration between computer vision and robot control modules on a complex, high-DOF humanoid robot. Its functionality is showcased by having our iCub humanoid robot pick-up objects from a table in front of it. An important feature is that the system can avoid obstacles - other objects detected in the visual stream - while reaching for the intended target object. Our integration also allows for non-static environments, i.e. the reaching is adapted on-the-fly from the visual feedback received, e.g. when an obstacle is moved into the trajectory. Furthermore we show that this system can be used both in autonomous and tele-operation scenarios.

Extending visual perception with haptic exploration for improved scene understanding

Scene understanding has been investigated from a mainly visual information point of view. Recently depth has been provided an extra wealth of information, allowing more geometric knowledge to fuse into scene understanding. Yet to form a holistic view, especially in robotic applications, one can create even more data by interacting with the world. In fact humans, when growing up, seem to heavily investigate the world around them by haptic exploration. We show an application of haptic exploration on a humanoid robot in cooperation with a learning method for object segmentation. The actions performed consecutively improve the segmentation of objects in the scene.

Force-controlled automatic microassembly of tissue engineering scaffolds

This paper presents an automated system for 3D assembly of tissue engineering (TE) scaffolds made from biocompatible microscopic building blocks with relatively large fabrication error. It focuses on the pin-into-hole force control developed for this demanding microassembly task. A beam-like gripper with integrated force sensing at a 3 mN resolution with a 500 mN measuring range is designed, and is used to implement an admittance force-controlled insertion using commercial precision stages. Visual-based alignment followed by an insertion is complemented by a haptic exploration strategy using force and position information. The system demonstrates fully automated construction of TE scaffolds with 50 microparts whose dimension error is larger than 5%.

A new framework for force feedback teleoperation of robotic vehicles based on optical flow

This paper proposes the use of optical flow from a moving robot to provide force feedback to an operator's joystick to facilitate collision free teleoperation. Optic flow is measured by wide angle cameras on board the vehicle and used to generate a virtual environmental force that is reflected to the user through the joystick, as well as feeding back into the control of the vehicle. The coupling between optical flow (velocity) and force is modelled as an impedance - in this case an optical impedance. We show that the proposed control is dissipative and prevents the vehicle colliding with the environment as well as providing the operator with a natural feel for the remote environment. The paper focuses on applications to aerial robotics vehicles, however, the ideas apply directly to other force actuated vehicles such as submersibles or space vehicles, and the authors believe the approach has potential for control of terrestrial vehicles and even teleoperation of manipulators. Experimental results are provided for a simulated aerial robot in a virtual environment controlled by a haptic joystick.

Marginalising the mainstream : a signed performance of The Miracle Worker places deaf issues centre-stage

William Gibson’s The Miracle Worker was staged at the Brisbane Powerhouse June 2009 by Crossbow Productions. In this adaption, people with hearing impairment were privileged through the use of shadow-signing, unscripted signing and the appropriation of signing as a theatrical language in itself. 250 people living with hearing impairment attended the production, 70 had never attended a theatrical event before. During the post-performance discussions hearing audience members expressed feelings of displacement through experiencing the culture of the deaf society and not grasping some of the ideas. This paper argues that this inversion enhanced meaning making for all and illustrates a way forward to encourage the signing of more theatrical events.

Developments in measuring the “creative” workforce

This article outlines the contribution the ARC Centre of Excellence for Creative Industries and Innovation has made to the project to improve statistical parameters for defining the “creative” workforce. This is one approach which addresses the imprecision of official statistics in grasping the emergent nature of the creative industries. The article discusses the policy implications of the differences between emphasizing industry and occupation or workforce. It provides qualitative case studies that provide further perspectives on quantitative analysis of the creative workforce. It also outlines debates about the implications for the cultural disciplines of an evidence-based account of creative labour. The “creative trident” methodology is summarized: it is the total of creative occupations within the core creative industries (specialists), plus the creative occupations employed in other industries (embedded) plus the business and support occupations employed in creative industries who are often responsible for managing, accounting for and technically supporting creative activity (support). The method is applied to the arts workforce in Australia. An industry-facing spin-off from the centre's mapping work, Creative Business Benchmarker, is discussed. The implications of this approach to the creative workforce is raised and exemplified in case studies of design and of the health industry.

The digital Dark Ages : a retro-speculative history of possible futures

The Dark Ages are generally held to be a time of technological and intellectual stagnation in western development. But that is not necessarily the case. Indeed, from a certain perspective, nothing could be further from the truth. In this paper we draw historical comparisons, focusing especially on the thirteenth and fourteenth centuries, between the technological and intellectual ruptures in Europe during the Dark Ages, and those of our current period. Our analysis is framed in part by Harold Innis’s2 notion of "knowledge monopolies". We give an overview of how these were affected by new media, new power struggles, and new intellectual debates that emerged in thirteenth and fourteenth century Europe. The historical salience of our focus may seem elusive. Our world has changed so much, and history seems to be an increasingly far-from-favoured method for understanding our own period and its future potentials. Yet our seemingly distant historical focus provides some surprising insights into the social dynamics that are at work today: the fracturing of established knowledge and power bases; the democratisation of certain "sacred" forms of communication and knowledge, and, conversely, the "sacrosanct" appropriation of certain vernacular forms; challenges and innovations in social and scientific method and thought; the emergence of social world-shattering media practices; struggles over control of vast networks of media and knowledge monopolies; and the enclosure of public discursive and social spaces for singular, manipulative purposes. The period between the eleventh and fourteenth centuries in Europe prefigured what we now call the Enlightenment, perhaps moreso than any other period before or after; it shaped what the Enlightenment was to become. We claim no knowledge of the future here. But in the "post-everything" society, where history is as much up for sale as it is for argument, we argue that our historical perspective provides a useful analogy for grasping the wider trends in the political economy of media, and for recognising clear and actual threats to the future of the public sphere in supposedly democratic societies.