Enabling multi-point haptic grasping in virtual environments

Haptic interaction has received increasing research interest in recent years. Currently, most commercially available haptic devices provide the user with a single point of interaction. Multi-point haptic devices present a logical progression in device design and enable the operator to experience a far wider range of haptic interactions, particularly the ability to grasp via multiple fingers. This is highly desirable for various haptically enabled applications including virtual training, telesurgery and telemanipulation. This paper presents a gripper attachment which utilises two low-cost commercially available haptic devices to facilitate multi-point haptic grasping. It provides the ability to render forces to the user's fingers independently and using Phantom Omni haptic devices offers several benefits over more complex approaches such as low-cost, reliability, and ease of programming. The workspace of the gripper attachment is considered and in order to haptically render the desired forces to the user's fingers, kinematic analysis is discussed and necessary formulations presented. The integrated multi-point haptic platform is presented and exploration of a virtual environment using CHAI 3D is demonstrated.

A multi-point haptic platform for grasping and manipulating virtual objects

This work presents a multi-point haptic platform that employs two Phantom Omni haptic devices. A gripper attachment connects to both devices and enables multi-point haptic grasping in virtual environments. In contrast to more complex approaches, this setup benefits from low-cost, reliability, and ease of programming while being capable of independently rendering forces to each of the user’s fingertips. The ability to grasp with multiple points potentially lends itself to applications such as virtual training, telesurgery and telemanipulation.

Extending support to customised multi-point haptic devices in CHAI3D

 CHAI3D is a widely accepted haptic SDK in the society because it is open-source and provides support to devices from different vendors. In many cases, CHAI3D and its related demos are used for benchmarking various haptic collision and rendering algorithms. However, CHAI3D is designed for off-the-shelf single-point haptic devices only, and it does not provide native support to customised multi-point haptic devices. In this paper, we aim to extend the existing CHAI3D framework and provide a standardized routine to support customised, single/multi-point haptic devices. Our extension aims at two issues: Intra-device communication and Inter-device communication. Therefore, our extension includes an HIP wrapper layer to concurrently handle multiple HIPs of a single device, and a communication layer to concurrently handle multiple position, orientation and force calculations of multiple haptic devices. Our extension runs on top of a custom-built 8-channel device controller, although other offthe shelf controllers can also be integrated easily. Our extension complies with the CHAI3D design framework and advanced provide inter-device communication capabilities for multi-device operations. With straightforward conversion routines, existing CHAI3D demos can be adapted to multi-point demos, supporting real-time parallel collision detection and force rendering.

Countering Improvised explosive devices through a multi-point haptic teleoperation system

Improvised Explosive Devices (IEDs) are reported as the number one cause of injury and death for allied troops in the current theater of operation. Current stand-off technologies for Counter IED (CIED) tasks rely on robotic platforms that have not improved in capability over the past decade to combat the ever increasing threat of IEDs. While they provide operational capability, the effectiveness of these platforms is limited. This is because they primarily utilise video and audio feedback, and require extensive training and specialist operators. Recent operational experience has demonstrated the need for robotic systems that are highly capable, yet easily operable for high fidelity manipulation. Force feedback provides an operator with more intuitive control of a robotic system. This sense of touch allows an operator to obtain a sense of feel from a stand-off location of what the robot touches or grasps through a human-robot interface. This paper reports the design and development of a Haptically-Enabled Counter IED robotic system that was funded by the Australian Defence Force. The presented work focuses on the design methodology for the system, and provides the results of the manipulator analysis and trial outcomes.

Grasping virtual objects with multi-point haptics

The majority of commercially available haptic devices offer a single point of haptic interaction. These devices are limited when it is desirable to grasp with multiple fingers in applications including virtual training, telesurgery and telemanipulation. Multipoint haptic devices serve to facilitate a greater range of interactions. This paper presents a gripper attachment to enable multi-point haptic grasping in virtual environments. The approach employs two Phantom Omni haptic devices to independently render forces to the user's thumb and other fingers. Compared with more complex approaches to multi-point haptics, this approach provides a number of advantages including low-cost, reliability and ease of programming. The ability of the integrated multi-point haptic platform to interact within a CHAI 3D virtual environment is also presented.

Augmented optometry training simulator with multi-point haptics

Training of optometrists is traditionally achieved under close supervision of peers and superiors. With the rapid advancement in technology, medical procedures are performed more efficiently and effectively, resulting in faster recovery times and less trauma to the patient. However, application of this technology has made it difficult to effectively demonstrate and teach these manual skills as the education is now a combination of not only the medical procedure but also the use of the technology. In this paper we propose to increase the training capabilities of optometry students through haptically-enabled single-point and multi-point training tools as well as augmented reality techniques. Haptics technology allows a human to touch and feel virtual computer models as though they are real. Through physical connection to the operator, haptic devices are considered to be personal robots that are capable of improving the human-computer interaction with a virtual environment. These devices have played an increasing role in developing expertise, reducing instances of medical error and reducing training costs. A haptically-enabled virtual training environment, integrated with an optometry slit lamp instrument can be used to teach cognitive and manual skills while the system tracks the performance of each individual. These interactions would ideally replicate every aspect of the real procedure, consequently preparing the trainee for every possible scenario, without risking the health of a real patient.

Multi-point and multi-level solar integration into a conventional coal-fired power plant

Solar-aided power generation (SAPG) is capable of integrating solar thermal energy into a conventional thermal power plant, at multi-points and multi-levels, to replace parts of steam extractions in the regenerative Rankine cycle. The integration assists the power plant to reduce coal (gas) consumption and pollution emission or to increase power output. The overall efficiencies of the SAPG plants with different solar replacements of extraction steam have been studied in this paper. The results indicate that the solar thermal to electricity conversion efficiencies of the SAPG system are higher than those of a solar-alone power plant with the same temperature level of solar input. The efficiency with solar input at 330 °C can be as high as 45% theoretically in a SAPG plant. Even the low-temperature solar heat at about 85 °C can be used in the SAPG system to heat the lower temperature feedwater, and the solar to electricity efficiency is nearly 10%. However, the low-temperature heat resource is very hard to be used for power generation in other types of solar power plants. Therefore, the SAPG plant is one of the most efficient ways for solar thermal power generation.

A haptic platform to enable fingertip grasping and manipulation

Haptic technologies allow human users to haptically interact with virtual environments. Haptics has been employed in many application domains including operator training, virtual exploration and teleoperation. Currently, most commercially available haptic devices focus on a single point of haptic interaction. While single-point haptics have been successfully employed in many applications, they remain limited to particular types of haptic interaction. Multi-point haptic devices are a logical progression and facilitate a far wider range of interactions including object grasping, multi-finger object manipulation and size discrimination. The ability to effectively achieve such interactions offers significant benefits for many applications including virtual training, telesurgery and telemanipulation. In such applications, the ability to use multi-point haptic interactions can provide far more effective user interaction as well improved perception of the virtual environment.

Function-based single and dual point haptic interaction in Cyberworlds

Polygon and point based models dominate virtual reality. These models also affect haptic rendering algorithms, which are often based on collision with polygons. With application to dual point haptic devices for operations like grasping, complex polygon and point based models will make the collision detection procedure slow. This results in the system not able to achieve interactivity for force rendering. To solve this issue, we use mathematical functions to define and implement geometry (curves, surfaces and solid objects), visual appearance (3D colours and geometric textures) and various tangible physical properties (elasticity, friction, viscosity, and force fields). The function definitions are given as analytical formulas (explicit, implicit and parametric), function scripts and procedures. We proposed an algorithm for haptic rendering of virtual scenes including mutually penetrating objects with different sizes and arbitrary location of the observer without a prior knowledge of the scene to be rendered. The algorithm is based on casting multiple haptic rendering rays from the Haptic Interaction Point (HIP), and it builds a stack to keep track on all colliding objects with the HIP. The algorithm uses collision detection based on implicit function representation of the object surfaces. The proposed approach allows us to be flexible when choosing the actual rendering platform, while it can also be easily adopted for dual point haptic collision detection as well as force and torque rendering. The function-defined objects and parts constituting them can be used together with other common definitions of virtual objects such as polygon meshes, point sets, voxel volumes, etc. We implemented an extension of X3D and VRML as well as several standalone application examples to validate the proposed methodology. Experiments show that our concern about fast, accurate rendering as well as compact representation could be fulfilled in various application scenarios and on both single and dual point haptic devices.

Extending haptic device capability for 3D virtual grasping

This paper presents an investigation into the workspace constraints observed through the use of multiple single point haptic interfaces, which lead to the design of a novel grasping device that improves upon current commercial haptic interfaces. The presented device is desktop based, and has been designed to maximise the haptic workspace while offering the ability to grasp and manipulate virtual objects, which is a function that current commercial interfaces are limited in providing. The performance of the commercial haptic interface in producing sustained effective operation and increased workspace with the attached haptic gripper is evaluated, and the improvement of both has been determined.

Realistic grasping of rigid virtual objects through event-based haptics

This research presents a novel haptic grasping interface and demonstrates its ability within multi-point event-based feedback. Through experimental methodology, the dynamics involved in grasp contact interactions are modelled based on first principles. The proposed approach demonstrates a method of realistically representing grasp contact with rigid virtual objects through multi-point interaction.

Multipoint haptic guidance for micrograsping systems

The ability to perform accurate micromanipulation offers wide-reaching benefits and is of increasing interest to researchers. Recent research into microgripper, microtweezer, and microforcep systems contributes toward accurate micrograsping and manipulation. Despite these efforts, achieving adequate operator control remains a distinct research challenge. Haptic interfaces interact with the human's haptic modality and offer the ability to enhance the operator's controllability of micromanipulation systems. Our previous work introduced single-point haptic guidance to assist the operator during intracellular microinjection. This paper extends the approach to propose multipoint haptic guidance for micrograsping tasks. Accurate micrograsping is valuable in many applications, including microassembly and biomanipulation. A multipoint haptic gripper facilitates haptic interaction, and haptic guidance assists the operator in controlling systems suitable for micrograsping. Force fields are used to guide the operator to suitable grasp points on micrometer-sized objects and consist of attractive and repulsive forces. The ability of the force field to effectively assist the operator in grasping the cell is evaluated using a virtual environment. Evaluation results demonstrate the ability of the approach to significantly reduce participants' average grasping error.

Haptic control of multi-axis robotic systems

Control of tele-operated remote robot’s is nothing new; the public was introduced to this 'new' field in 1986 when the Chernobyl cleanup began. Pictures of weird and wonderful robotic workers pouring concrete or moving rubble flooded the world. Integration of force feedback or 'haptics' to remote robot's is a new development and one that is likely to make a big difference in man-machine interaction. Development of haptic capable tele-operation schema is a challenge. Often platform specific software is developed for one off tasks. This research focussed on the development of an open software platform for haptic control of multiple remote robotic platforms. The software utilises efficient server/client architecture for low data latency, while efficiently performing required kinematic transforms and data manipulation in real time. A description of the algorithm, software interface and hardware is presented in this paper. Preliminary results are encouraging as haptic control has been shown to greatly enhances remote positioning tasks.