Bilateral haptic teleoperation of an articulated track mobile robot

Teleoperation has been used in many applications, allowing a human operator to remotely control a robotic system in order to perform a particular task. Recently haptic teleoperation has focused mainly on improving performance in remote manipulation tasks, however the haptic approach offers similar advantages for teleoperative control of the motion of a mobile robot. This paper describes a prototype system designed to facilitate haptic teleoperation of an all-terrain, articulated track mobile robot. This system utilizes a multi-modal user interface intended to improve operator immersion, reduce operator overload and improve teleoperative task performance. The system architecture facilitates implementation of an application-specific haptic augmentation algorithm in order to improve operator performance in challenging real-world tasks. The contributions of this work can be categorized as the custom mobile platform, teleoperator interface and haptic augmentation strategy.

OzBot TM - Haptic augmentation of a teleoperated robotic platform for search and rescue operations

A continued increase in computing power, sensor capability, software functionality, immersive interfaces and hardware modularity has given robot designers seemingly endless potential in the area of mobile robotics.  While some mobile robotic system designers are focusing on expensive, full-featured platforms, developers are realising the advantages of emerging technology in providing small, low-cost mobile reconnaissance vehicles as expendable teleoperated robotic systems.  The OzBot^TM mobile reconnaissance platform presents one such system.  The design objectives of the OzBot^TM platform focus on the development of inexpensive, lightweight carry-case sized robots for search and rescue operations, law enforcement scenarios and hazardous environment inspection.  The incorporation of Haptic augmentation provides the teleoperator with improved task immersion for an outdoor search and rescue scenario.  Achieved in cooperation with law enforcement agencies within Australia, this paper discusses the performance of the first four revisions of the OzBot^TM platform.

3D haptic needle insertion simulator utilising an agent based spherical voxel model

This paper describes a technique for the real-time modeling of deformable tissue. Specifically geared towards needle insertion simulation, the low computational requirements of the model enable highly accurate haptic feedback to a user without introducing noticeable time delay or buzzing generally associated with haptic surgery simulation. Using a spherical voxel array combined with aspects of computational geometry and agent communication and interaction principals, the model is capable of providing haptic update rates of over 1000Hz with real-time visual feedback. Iterating through over 1000 voxels per millisecond to determine collision and haptic response while making use of Vieta’s Theorem for extraneous force culling.

Haptic control methodologies for telerobotic stair traversal

Teleoperated mobile robots provide the ability for a human operator to safely explore and evaluate hazardous environments. This ability represents an important progression towards the preservation of human safety in the inevitable response to situations such as terrorist activities and urban search and rescue. The benefits of removing physical human presence from such environments are obvious, however challenges inhibiting task performance when remotely operating a mobile robotic system need to be addressed. The removal of physical human presence from the target environment introduces telepresence as a vital consideration in achieving the desired objective. Introducing haptic human-robotic interaction represents one approach towards improving operator performance in such a scenario. Teleoperative stair traversal proves to be a challenging task when undertaking threat response in an urban environment. This article investigates the teleoperation of an articulated track mobile robot designed for traversing stairs in a threat response scenario. Utilising a haptic medium for bilateral human-robotic interaction, the haptic cone methodology is introduced with the aim of providing the operator with a vision-independent, intuitive indication of the current commanded robot velocity. The haptic cone methodology operates synergistically with the introduced fuzzy-haptic augmentation for improving teleoperator performance in the stair traversal scenario.

Intuitive haptic control surface for mobile robot motion control

Haptic human-machine interfaces and similar techniques to enhancing human-robotic interaction offer significant potential over conventional approaches. This work considers achieving intuitive motion control of a tracked mobile robotic platform utilising a 3D virtual haptic cone. The 3D haptic cone extends upon existing approaches by introducing of a third dimension to the haptic control surface. It is suggested that this approach improves upon existing methods by providing the human operator with an intuitive method for issuing vehicle motion commands whilst still facilitating simultaneous real-time haptic augmentation regarding the task at hand. The presented approach is considered in the context of mobile robotic teleoperation however offers potential across many applications. Using the 2D haptic control surface as a benchmark, preliminary evaluation of the 3D haptic cone approach demonstrates a significant improvement in the ability to command the robot to cease motion.

Intuitive haptic control surface for mobile robot motion control

Haptic human-machine interfaces and similar techniques to enhancing human-robotic interaction offer significant potential over conventional approaches. This work considers achieving intuitive motion control of a tracked mobile robotic platform utilising a 3D virtual haptic cone. The 3D haptic cone extends upon existing approaches by introducing of a third dimension to the haptic control surface. It is suggested that this approach improves upon existing methods by providing the human operator with an intuitive method for issuing vehicle motion commands whilst still facilitating simultaneous real-time haptic augmentation regarding the task at hand. The presented approach is considered in the context of mobile robotic teleoperation however offers potential across many applications. Using the 2D haptic control surface as a benchmark, preliminary evaluation of the 3D haptic cone approach demonstrates a significant improvement in the ability to command the robot to cease motion.

3D virtual haptic cone for intuitive vehicle motion control

Haptic human-machine interfaces and interaction techniques have been shown to offer advantages over conventional approaches. This work introduces the 3D virtual haptic cone with the aim of improving human remote control of a vehicle's motion. The 3D cone introduces a third dimension to the haptic control surface over existing approaches. This approach improves upon existing methods by providing the human operator with an intuitive method for issuing vehicle motion commands whilst simultaneously receiving real-time haptic information from the remote system. The presented approach offers potential across many applications, and as a case study, this work considers the approach in the context of mobile robot motion control. The performance of the approach in providing the operator with improved motion controllability is evaluated and the performance improvement determined.

Exploiting ungrounded tactile haptic displays for mobile robotic teleoperation

Teleoperated mobile robotics offer potential use in a variety of different real-world applications including hazardous materials handling, urban search and rescue and explosive ordnance handling and disposal. Recent research discusses the use of Haptic technology in increasing task immersion and teleoperator performance. This work investigates the utility of low-cost, ungrounded tactile haptic interfaces in mobile robotic teleoperation. In order to achieve the desired implementation using only tactile sensation presents distinct challenges. Innovative haptic control methodologies providing the teleoperator with intuitive motion control and task-relevant haptic augmentation are presented within this paper.

Exploiting ungrounded tactile haptic displays for mobile robotic teleoperation

Teleoperated mobile robotics offer potential use in a variety of different real-world applications including hazardous materials handling, urban search and rescue and explosive ordnance handling and disposal. Recent research discusses the use of Haptic technology in increasing task immersion and teleoperator performance. This work investigates the utility of low-cost, ungrounded tactile haptic interfaces in mobile robotic teleoperation. In order to achieve the desired implementation using only tactile sensation presents distinct challenges. Innovative haptic control methodologies providing the teleoperator with intuitive motion control and task-relevant haptic augmentation are presented within this paper.

3D virtual haptic cone for intuitive vehicle motion control

Haptic technology provides the ability for a system to recreate the sense of touch to a human operator, and as such offers wide reaching advantages. The ability to interact with the human's tactual modality introduces haptic human-machine interaction to replace or augment existing mediums such as visual and audible information. A distinct advantage of haptic human-machine interaction is the intrinsic bilateral nature, where information can be communicated in both directions simultaneously. This paper investigates the bilateral nature of the haptic interface in controlling the motion of a remote (or virtual) vehicle and presents the ability to provide an additional dimension of haptic information to the user over existing approaches [1-4]. The 3D virtual haptic cone offers the ability to not only provide the user with relevant haptic augmentation pertaining to the task at hand, as do existing approaches, however, to also simultaneously provide an intuitive indication of the current velocities being commanded.

Haptic control methodologies for rover teleoperation in non-deterministic remote environments

Haptic teleoperation allows human operators to interact with a remote mobile robot using their haptic sensory modality. This research introduces new haptic control methodologies allowing the teleoperator to overcome the limitations of existing techniques, ultimately facilitating improved mobile robotic control for the exploration of hazardous and remote environments.

Towards haptic microrobotic intracellular injection

This paper proposes a system providing the operator with an intuitive method for controlling a micromanipulator during intracellular injection. A low-cost haptic device is utilised and 3D position-to-position kinematic mapping allows the operator to control the micropipette using a similar method to handheld needle insertion. The workspaces of the haptic device and micromanipulator are analysed and the importance of appropriate scaling to positioning resolution and tracking performance is investigated. The control issues integral to achieving adequate control of the micromanipulator using the Phantom Omni haptic device are addressed. Aside from offering an intuitive method for controlling the micropipette, this work lays the foundation for real-time haptic assistance in the cell injection task.