Intuitive haptic control surface for mobile robot motion control

Haptic human-machine interfaces and similar techniques to enhancing human-robotic interaction offer significant potential over conventional approaches. This work considers achieving intuitive motion control of a tracked mobile robotic platform utilising a 3D virtual haptic cone. The 3D haptic cone extends upon existing approaches by introducing of a third dimension to the haptic control surface. It is suggested that this approach improves upon existing methods by providing the human operator with an intuitive method for issuing vehicle motion commands whilst still facilitating simultaneous real-time haptic augmentation regarding the task at hand. The presented approach is considered in the context of mobile robotic teleoperation however offers potential across many applications. Using the 2D haptic control surface as a benchmark, preliminary evaluation of the 3D haptic cone approach demonstrates a significant improvement in the ability to command the robot to cease motion.

Intuitive haptic control surface for mobile robot motion control

Haptic human-machine interfaces and similar techniques to enhancing human-robotic interaction offer significant potential over conventional approaches. This work considers achieving intuitive motion control of a tracked mobile robotic platform utilising a 3D virtual haptic cone. The 3D haptic cone extends upon existing approaches by introducing of a third dimension to the haptic control surface. It is suggested that this approach improves upon existing methods by providing the human operator with an intuitive method for issuing vehicle motion commands whilst still facilitating simultaneous real-time haptic augmentation regarding the task at hand. The presented approach is considered in the context of mobile robotic teleoperation however offers potential across many applications. Using the 2D haptic control surface as a benchmark, preliminary evaluation of the 3D haptic cone approach demonstrates a significant improvement in the ability to command the robot to cease motion.

3D virtual haptic cone for intuitive vehicle motion control

Haptic human-machine interfaces and interaction techniques have been shown to offer advantages over conventional approaches. This work introduces the 3D virtual haptic cone with the aim of improving human remote control of a vehicle's motion. The 3D cone introduces a third dimension to the haptic control surface over existing approaches. This approach improves upon existing methods by providing the human operator with an intuitive method for issuing vehicle motion commands whilst simultaneously receiving real-time haptic information from the remote system. The presented approach offers potential across many applications, and as a case study, this work considers the approach in the context of mobile robot motion control. The performance of the approach in providing the operator with improved motion controllability is evaluated and the performance improvement determined.

Exploiting ungrounded tactile haptic displays for mobile robotic teleoperation

Teleoperated mobile robotics offer potential use in a variety of different real-world applications including hazardous materials handling, urban search and rescue and explosive ordnance handling and disposal. Recent research discusses the use of Haptic technology in increasing task immersion and teleoperator performance. This work investigates the utility of low-cost, ungrounded tactile haptic interfaces in mobile robotic teleoperation. In order to achieve the desired implementation using only tactile sensation presents distinct challenges. Innovative haptic control methodologies providing the teleoperator with intuitive motion control and task-relevant haptic augmentation are presented within this paper.

Exploiting ungrounded tactile haptic displays for mobile robotic teleoperation

Teleoperated mobile robotics offer potential use in a variety of different real-world applications including hazardous materials handling, urban search and rescue and explosive ordnance handling and disposal. Recent research discusses the use of Haptic technology in increasing task immersion and teleoperator performance. This work investigates the utility of low-cost, ungrounded tactile haptic interfaces in mobile robotic teleoperation. In order to achieve the desired implementation using only tactile sensation presents distinct challenges. Innovative haptic control methodologies providing the teleoperator with intuitive motion control and task-relevant haptic augmentation are presented within this paper.

3D virtual haptic cone for intuitive vehicle motion control

Haptic technology provides the ability for a system to recreate the sense of touch to a human operator, and as such offers wide reaching advantages. The ability to interact with the human's tactual modality introduces haptic human-machine interaction to replace or augment existing mediums such as visual and audible information. A distinct advantage of haptic human-machine interaction is the intrinsic bilateral nature, where information can be communicated in both directions simultaneously. This paper investigates the bilateral nature of the haptic interface in controlling the motion of a remote (or virtual) vehicle and presents the ability to provide an additional dimension of haptic information to the user over existing approaches [1-4]. The 3D virtual haptic cone offers the ability to not only provide the user with relevant haptic augmentation pertaining to the task at hand, as do existing approaches, however, to also simultaneously provide an intuitive indication of the current velocities being commanded.

Haptic control methodologies for rover teleoperation in non-deterministic remote environments

Haptic teleoperation allows human operators to interact with a remote mobile robot using their haptic sensory modality. This research introduces new haptic control methodologies allowing the teleoperator to overcome the limitations of existing techniques, ultimately facilitating improved mobile robotic control for the exploration of hazardous and remote environments.

Towards haptic microrobotic intracellular injection

This paper proposes a system providing the operator with an intuitive method for controlling a micromanipulator during intracellular injection. A low-cost haptic device is utilised and 3D position-to-position kinematic mapping allows the operator to control the micropipette using a similar method to handheld needle insertion. The workspaces of the haptic device and micromanipulator are analysed and the importance of appropriate scaling to positioning resolution and tracking performance is investigated. The control issues integral to achieving adequate control of the micromanipulator using the Phantom Omni haptic device are addressed. Aside from offering an intuitive method for controlling the micropipette, this work lays the foundation for real-time haptic assistance in the cell injection task.

Haptic mobility control for teleoperated rovers

Future missions involving human and robotic systems co-resident on the lunar surface may call for rovers to be teleoperated from the safety of pressurized habitats or vehicles. An approach is presented that emphasizes human-level judgment and intuition in the total control of a rover’s mobility actions. This is facilitated through human-robotic haptics interaction. The concept of a haptics cone control surface is presented, which provides a teleoperator with a means to intuitively determine the velocities he/she is commanding to control rover motion. The teleoperator is also provided with real-time, tasks-relevant haptic augmentation indicating suggestive control actions concerning the desired mobility objective. Utility of the approach for teleoperated control of steep terrain traversal is demonstrated in simulation.

Data-based dynamic haptic interaction model with deformable 3D objects

The data-based modeling of the haptic interaction simulation is a growing trend in research. These techniques offer a quick alternative to parametric modeling of the simulation. So far, most of the use of the data-based techniques was applied to static simulations. This paper introduces how to use data-based model in dynamic simulations. This ensures realistic behavior and produce results that are very close to parametric modeling. The results show that a quick and accurate response can be achieved using the proposed methods.

Haptic guidance for microrobotic intracellular injection

The ability for a bio-operator to utilise a haptic device to manipulate a microrobot for intracellular injection offers immense benefits. One significant benefit is for the bio-operator to receive haptic guidance while performing the injection process. In order to address this, this paper investigates the use of haptic virtual fixtures for cell injection and proposes a novel force field virtual fixture. The guidance force felt by the bio-operator is determined by force field analysis within the virtual fixture. The proposed force field virtual fixture assists the bio-operator when performing intracellular injection by limiting the micropipette tip's motion to a conical volume as well as recommending the desired path for optimal injection. A virtual fixture plane is also introduced to prevent the bio-operator from moving the micropipette tip beyond the deposition target inside the cell. Simulation results demonstrate the operation of the guidance system.

A haptic training environment for the heart myoblast cell injection procedure

The heart muscle of a cardiac arrest victim continues to accumulate damage throughout its lifetime. This reduces the heart's ability to pump sufficient oxygen and nutrient blood to meet the body's needs. Medical researchers have shown that direct injection of pre-harvested skeletal myoblast cells into the heart can restore some muscle function [1]. This operative procedure usually necessitates the surgeon to open a patient's chest. The open chest procedure is usually a lengthy process and often extends the recovery time of the patient. Alternatively, a high accuracy surgical aid robotic system can be used to assist the thoracoscopic surgery [2][3]. While the robotic surgical method aids faster patient recovery, a less experienced surgeon can potentially cause damage to surrounding tissue.

This paper presents a study into the development of a virtual haptically-enabled heart myoblast injection simulation environment, which can be used to train new surgeons to get hands on experience with the process. The paper also discusses the development of a generic constraint motion technique for needle insertion. Experiments on human performance measures and efficacy, while interacting with haptic feedback training models, are also presented. The experiment involved 10 operators, with each person repeating the needle insertion and injection 10 times. A notable improvement in the task execution time with the number of repetitions was observed. Operators improved their time by up to 300% compared to their first training attempt for a static heart scenario. Under a dynamic heart motion, operator's performance was slightly lower, with the successful rate of completing the experiment reduced from 84% to 75%.