Exploiting ungrounded tactile haptic displays for mobile robotic teleoperation

Teleoperated mobile robotics offer potential use in a variety of different real-world applications including hazardous materials handling, urban search and rescue and explosive ordnance handling and disposal. Recent research discusses the use of Haptic technology in increasing task immersion and teleoperator performance. This work investigates the utility of low-cost, ungrounded tactile haptic interfaces in mobile robotic teleoperation. In order to achieve the desired implementation using only tactile sensation presents distinct challenges. Innovative haptic control methodologies providing the teleoperator with intuitive motion control and task-relevant haptic augmentation are presented within this paper.

3D virtual haptic cone for intuitive vehicle motion control

Haptic technology provides the ability for a system to recreate the sense of touch to a human operator, and as such offers wide reaching advantages. The ability to interact with the human's tactual modality introduces haptic human-machine interaction to replace or augment existing mediums such as visual and audible information. A distinct advantage of haptic human-machine interaction is the intrinsic bilateral nature, where information can be communicated in both directions simultaneously. This paper investigates the bilateral nature of the haptic interface in controlling the motion of a remote (or virtual) vehicle and presents the ability to provide an additional dimension of haptic information to the user over existing approaches [1-4]. The 3D virtual haptic cone offers the ability to not only provide the user with relevant haptic augmentation pertaining to the task at hand, as do existing approaches, however, to also simultaneously provide an intuitive indication of the current velocities being commanded.

Haptic control methodologies for rover teleoperation in non-deterministic remote environments

Haptic teleoperation allows human operators to interact with a remote mobile robot using their haptic sensory modality. This research introduces new haptic control methodologies allowing the teleoperator to overcome the limitations of existing techniques, ultimately facilitating improved mobile robotic control for the exploration of hazardous and remote environments.

Towards haptic microrobotic intracellular injection

This paper proposes a system providing the operator with an intuitive method for controlling a micromanipulator during intracellular injection. A low-cost haptic device is utilised and 3D position-to-position kinematic mapping allows the operator to control the micropipette using a similar method to handheld needle insertion. The workspaces of the haptic device and micromanipulator are analysed and the importance of appropriate scaling to positioning resolution and tracking performance is investigated. The control issues integral to achieving adequate control of the micromanipulator using the Phantom Omni haptic device are addressed. Aside from offering an intuitive method for controlling the micropipette, this work lays the foundation for real-time haptic assistance in the cell injection task.

Method and apparatus for haptic control

The present invention provides remote interfacing utilising haptic technology. In a first aspect there is provided a haptic grasping interface comprising a plurality of finger interaction points, with actuators connected at one end to an actuator control mechanism. The mechanism is mounted remotely from the grasping interface, inverse to the finger interaction points, for manipulation of these points. The grasping points comprise pulleys which route the actuators through a cable tension and transmission system. A second aspect provides haptic augmentation to an operator, which indicates to the operator the state of a control input to a controlled device. A third aspect provides a means of simulating motion where haptic feedback is provided to a user in correspondence with the movement of the user within a pod environment.

Method and apparatus for haptic control

The present invention provides remote interfacing utilising haptic technology. In a first aspect there is provided a haptic grasping interface comprising a plurality of finger interaction points, with actuators connected at one end to an actuator control mechanism. The mechanism is mounted remotely from the grasping interface, inverse to the finger interaction points, for manipulation of these points. The grasping points comprise pulleys which route the actuators through a cable tension and transmission system. A second aspect provides haptic augmentation to an operator, which indicates to the operator the state of a control input to a controlled device. A third aspect provides a means of simulating motion where haptic feedback is provided to a user in correspondence with the movement of the user within a pod environment.

Method and apparatus for haptic control

The present invention provides remote interfacing utilising haptic technology. In a first aspect there is provided a haptic grasping interface comprising a plurality of finger interaction points, with actuators connected at one end to an actuator control mechanism. The mechanism is mounted remotely from the grasping interface, inverse to the finger interaction points, for manipulation of these points. The grasping points comprise pulleys which route the actuators through a cable tension and transmission system. A second aspect provides haptic augmentation to an operator, which indicates to the operator the state of a control input to a controlled device. A third aspect provides a means of simulating motion where haptic feedback is provided to a user in correspondence with the movement of the user within a pod environment.

Method and apparatus for haptic control

The present invention provides remote interfacing utilising haptic technology. In a first aspect there is provided a haptic grasping interface comprising a plurality of finger interaction points, with actuators connected at one end to an actuator control mechanism. The mechanism is mounted remotely from the grasping interface, inverse to the finger interaction points, for manipulation of these points. The grasping points comprise pulleys which route the actuators through a cable tension and transmission system. A second aspect provides haptic augmentation to an operator, which indicates to the operator the state of a control input to a controlled device. A third aspect provides a means of simulating motion where haptic feedback is provided to a user in correspondence with the movement of the user within a pod environment.

Haptic mobility control for teleoperated rovers

Future missions involving human and robotic systems co-resident on the lunar surface may call for rovers to be teleoperated from the safety of pressurized habitats or vehicles. An approach is presented that emphasizes human-level judgment and intuition in the total control of a rover’s mobility actions. This is facilitated through human-robotic haptics interaction. The concept of a haptics cone control surface is presented, which provides a teleoperator with a means to intuitively determine the velocities he/she is commanding to control rover motion. The teleoperator is also provided with real-time, tasks-relevant haptic augmentation indicating suggestive control actions concerning the desired mobility objective. Utility of the approach for teleoperated control of steep terrain traversal is demonstrated in simulation.

Data-based dynamic haptic interaction model with deformable 3D objects

The data-based modeling of the haptic interaction simulation is a growing trend in research. These techniques offer a quick alternative to parametric modeling of the simulation. So far, most of the use of the data-based techniques was applied to static simulations. This paper introduces how to use data-based model in dynamic simulations. This ensures realistic behavior and produce results that are very close to parametric modeling. The results show that a quick and accurate response can be achieved using the proposed methods.

Haptic guidance for microrobotic intracellular injection

The ability for a bio-operator to utilise a haptic device to manipulate a microrobot for intracellular injection offers immense benefits. One significant benefit is for the bio-operator to receive haptic guidance while performing the injection process. In order to address this, this paper investigates the use of haptic virtual fixtures for cell injection and proposes a novel force field virtual fixture. The guidance force felt by the bio-operator is determined by force field analysis within the virtual fixture. The proposed force field virtual fixture assists the bio-operator when performing intracellular injection by limiting the micropipette tip's motion to a conical volume as well as recommending the desired path for optimal injection. A virtual fixture plane is also introduced to prevent the bio-operator from moving the micropipette tip beyond the deposition target inside the cell. Simulation results demonstrate the operation of the guidance system.

A haptic training environment for the heart myoblast cell injection procedure

The heart muscle of a cardiac arrest victim continues to accumulate damage throughout its lifetime. This reduces the heart's ability to pump sufficient oxygen and nutrient blood to meet the body's needs. Medical researchers have shown that direct injection of pre-harvested skeletal myoblast cells into the heart can restore some muscle function [1]. This operative procedure usually necessitates the surgeon to open a patient's chest. The open chest procedure is usually a lengthy process and often extends the recovery time of the patient. Alternatively, a high accuracy surgical aid robotic system can be used to assist the thoracoscopic surgery [2][3]. While the robotic surgical method aids faster patient recovery, a less experienced surgeon can potentially cause damage to surrounding tissue.

This paper presents a study into the development of a virtual haptically-enabled heart myoblast injection simulation environment, which can be used to train new surgeons to get hands on experience with the process. The paper also discusses the development of a generic constraint motion technique for needle insertion. Experiments on human performance measures and efficacy, while interacting with haptic feedback training models, are also presented. The experiment involved 10 operators, with each person repeating the needle insertion and injection 10 times. A notable improvement in the task execution time with the number of repetitions was observed. Operators improved their time by up to 300% compared to their first training attempt for a static heart scenario. Under a dynamic heart motion, operator's performance was slightly lower, with the successful rate of completing the experiment reduced from 84% to 75%.

Haptic microrobotic intracellular injection assistance using virtual fixtures

In manual cell injection the operator relies completely on visual information for task feedback and is subject to extended training times as well as poor success rates and repeatability. From this perspective, enhancing human-in-the-loop intracellular injection through haptic interaction offers significant benefits. This paper outlines two haptic virtual fixtures aiming to assist the human operator while performing cell injection. The first haptic virtual fixture is a parabolic force field designed to assist the operator in guiding the micropipette's tip to a desired penetration point on the cell's surface. The second is a planar virtual fixture which attempts to assist the operator from moving the micropipette's tip beyond the deposition target location inside the cell. Preliminary results demonstrate the operation of the haptically assisted microrobotic cell injection system.