Function-based single and dual point haptic interaction in Cyberworlds

Polygon and point based models dominate virtual reality. These models also affect haptic rendering algorithms, which are often based on collision with polygons. With application to dual point haptic devices for operations like grasping, complex polygon and point based models will make the collision detection procedure slow. This results in the system not able to achieve interactivity for force rendering. To solve this issue, we use mathematical functions to define and implement geometry (curves, surfaces and solid objects), visual appearance (3D colours and geometric textures) and various tangible physical properties (elasticity, friction, viscosity, and force fields). The function definitions are given as analytical formulas (explicit, implicit and parametric), function scripts and procedures. We proposed an algorithm for haptic rendering of virtual scenes including mutually penetrating objects with different sizes and arbitrary location of the observer without a prior knowledge of the scene to be rendered. The algorithm is based on casting multiple haptic rendering rays from the Haptic Interaction Point (HIP), and it builds a stack to keep track on all colliding objects with the HIP. The algorithm uses collision detection based on implicit function representation of the object surfaces. The proposed approach allows us to be flexible when choosing the actual rendering platform, while it can also be easily adopted for dual point haptic collision detection as well as force and torque rendering. The function-defined objects and parts constituting them can be used together with other common definitions of virtual objects such as polygon meshes, point sets, voxel volumes, etc. We implemented an extension of X3D and VRML as well as several standalone application examples to validate the proposed methodology. Experiments show that our concern about fast, accurate rendering as well as compact representation could be fulfilled in various application scenarios and on both single and dual point haptic devices.

Design, development, and evaluation of a pinch-grasp haptic interface

Interaction with virtual or teleoperated environments requires contact with objects on a multipoint level. We describe the design of a pinch--grasp hand interface device for use as a grasping mechanism to complement haptic interfaces. To preserve a suitable level of transparency for human--computer interaction, this novel interface is designed for high-resolution contact forces, while centered around a lightweight structure. This functionality renders the device scalable and adaptable to a wide range of haptic interface structures and force level requirements. We present an optimal configuration for a pinch--grasp interface, which produces bidirectional forces to an operator's fingers and a rotational force to the wrist through a cable drive system. The device is characterized for use on a commercial haptic interface through demonstration of sustained peak performance and also workspace utilization. The dynamic performance of the pinch--grasp interface is experimentally determined, and the frequency response is identified to illustrate its contact force resolution.

Multipoint haptic guidance for micrograsping systems

The ability to perform accurate micromanipulation offers wide-reaching benefits and is of increasing interest to researchers. Recent research into microgripper, microtweezer, and microforcep systems contributes toward accurate micrograsping and manipulation. Despite these efforts, achieving adequate operator control remains a distinct research challenge. Haptic interfaces interact with the human's haptic modality and offer the ability to enhance the operator's controllability of micromanipulation systems. Our previous work introduced single-point haptic guidance to assist the operator during intracellular microinjection. This paper extends the approach to propose multipoint haptic guidance for micrograsping tasks. Accurate micrograsping is valuable in many applications, including microassembly and biomanipulation. A multipoint haptic gripper facilitates haptic interaction, and haptic guidance assists the operator in controlling systems suitable for micrograsping. Force fields are used to guide the operator to suitable grasp points on micrometer-sized objects and consist of attractive and repulsive forces. The ability of the force field to effectively assist the operator in grasping the cell is evaluated using a virtual environment. Evaluation results demonstrate the ability of the approach to significantly reduce participants' average grasping error.

Foot-targeting in reaching and grasping

Foot positioning was investigated when right-handed (Experiment One) and left handed adults (Experiment Two) stopped walking to grasp a stationary 70 mm ball at shoulder height. In both experiments centroid location formed by the toe and heel coordinates relative to the object was highly consistent within a target-location condition, demonstrating a foot-targeting phenomenon. Centroid location in the anterior-posterior direction was uninfluenced by grasping hand but the centroid shifted right for left hand grasps and left for right hand grasps. With the target either centrally located or on the same side as the dominant hand, foot positioning brought the grasping hand closer to the target in the medial-lateral direction. When the target object was aligned with the shoulder opposite the dominant hand both groups adopted foot positions to the left of the target. Thus, neither group adopted optimal foot position when the target was located opposite their dominant hand. Foot orientation angle relative to the target was also influenced by choice of grasping hand. Collectively, the findings demonstrate a close association between grasping hand and foot position when approaching to reach and grasp an object but also suggest that foot-dominance may influence medial-lateral centroid location.

An active stereo vision-based learning approach for robotic tracking, fixating and grasping control

In this paper, an active stereo vision-based learning approach is proposed for a robot to track, fixate and grasp an object in unknown environments. First, the functional mapping relationships between the joint angles of the active stereo vision system and the spatial representations of the object are derived and expressed in a three-dimensional workspace frame. Next, the self-adaptive resonance theory-based neural networks and the feedforward neural networks are used to learn the mapping relationships in a self-organized way. Then, the approach is verified by simulation using the models of an active stereo vision system which is installed in the end-effector of a robot. Finally, the simulation results confirm the effectiveness of the present approach.

Soft tissue modelling for haptic rendering in virtual environments

This paper focuses on the development of a haptic recording and modelling system. Currently being evaluated for multiple uses in surgery and manufacturing, this recording system evaluates haptic data captured via a robotic ann coupled with real time high-resolution load cell. This data is then analysed and validated against previous samples and a generated model before being logged for playback during simulation and training of a human operator. 3D models of point force interactions are created allowing unique visuals to be presented to a user. Primarily designed for the medical field, recorded results of soft tissue cutting have been presented.

Haptic handwriting aid for training and rehabilitation

This paper reports a method of controlling a user's hand through the process of writing. Developed predominantly for enabling users to re-learn the skill of writing after a stroke, the process could also be used for teaching children hand/eye coordination, motor skills, movement and position awareness in writing. Utilising low cost haptic technology and custom control software, the system has the potential to increase writing skills in stroke sufferers in the privacy and comfort of their own home.

Haptic control of multi-axis robotic systems

Control of tele-operated remote robot’s is nothing new; the public was introduced to this 'new' field in 1986 when the Chernobyl cleanup began. Pictures of weird and wonderful robotic workers pouring concrete or moving rubble flooded the world. Integration of force feedback or 'haptics' to remote robot's is a new development and one that is likely to make a big difference in man-machine interaction. Development of haptic capable tele-operation schema is a challenge. Often platform specific software is developed for one off tasks. This research focussed on the development of an open software platform for haptic control of multiple remote robotic platforms. The software utilises efficient server/client architecture for low data latency, while efficiently performing required kinematic transforms and data manipulation in real time. A description of the algorithm, software interface and hardware is presented in this paper. Preliminary results are encouraging as haptic control has been shown to greatly enhances remote positioning tasks.

Fuzzy haptic augmentation for telerobotic stair climbing

Teleoperated robotic systems provide a valuable solution for the exploration of hazardous environments. The ability to explore dangerous environments from the safety of a remote location represents an important progression towards the preservation of human safety in the inevitable response to such a threat. While the benefits of removing physical human presence are clear, challenges associated with remote operation of a robotic system need to be addressed. Removing direct human presence from the robot's operating environment introduces telepresence as an important consideration in achieving the desired objective. The introduction of the haptic modality represents one approach towards improving operator performance subject to reduced telepresence. When operating in an urban environment, teleoperative stair climbing is not an uncommon scenario. This work investigates the operation of an articulated track mobile robot designed for ascending stairs under teleoperative control. In order to assist the teleoperator in improved navigational capabilities, a fuzzy expert system is utilised to provide the teleoperator with intelligent haptic augmentation with the aim of improving task performance.

Bilateral haptic teleoperation of an articulated track mobile robot

Teleoperation has been used in many applications, allowing a human operator to remotely control a robotic system in order to perform a particular task. Recently haptic teleoperation has focused mainly on improving performance in remote manipulation tasks, however the haptic approach offers similar advantages for teleoperative control of the motion of a mobile robot. This paper describes a prototype system designed to facilitate haptic teleoperation of an all-terrain, articulated track mobile robot. This system utilizes a multi-modal user interface intended to improve operator immersion, reduce operator overload and improve teleoperative task performance. The system architecture facilitates implementation of an application-specific haptic augmentation algorithm in order to improve operator performance in challenging real-world tasks. The contributions of this work can be categorized as the custom mobile platform, teleoperator interface and haptic augmentation strategy.

OzBot TM - Haptic augmentation of a teleoperated robotic platform for search and rescue operations

A continued increase in computing power, sensor capability, software functionality, immersive interfaces and hardware modularity has given robot designers seemingly endless potential in the area of mobile robotics.  While some mobile robotic system designers are focusing on expensive, full-featured platforms, developers are realising the advantages of emerging technology in providing small, low-cost mobile reconnaissance vehicles as expendable teleoperated robotic systems.  The OzBot^TM mobile reconnaissance platform presents one such system.  The design objectives of the OzBot^TM platform focus on the development of inexpensive, lightweight carry-case sized robots for search and rescue operations, law enforcement scenarios and hazardous environment inspection.  The incorporation of Haptic augmentation provides the teleoperator with improved task immersion for an outdoor search and rescue scenario.  Achieved in cooperation with law enforcement agencies within Australia, this paper discusses the performance of the first four revisions of the OzBot^TM platform.

3D haptic needle insertion simulator utilising an agent based spherical voxel model

This paper describes a technique for the real-time modeling of deformable tissue. Specifically geared towards needle insertion simulation, the low computational requirements of the model enable highly accurate haptic feedback to a user without introducing noticeable time delay or buzzing generally associated with haptic surgery simulation. Using a spherical voxel array combined with aspects of computational geometry and agent communication and interaction principals, the model is capable of providing haptic update rates of over 1000Hz with real-time visual feedback. Iterating through over 1000 voxels per millisecond to determine collision and haptic response while making use of Vieta’s Theorem for extraneous force culling.

Haptic control methodologies for telerobotic stair traversal

Teleoperated mobile robots provide the ability for a human operator to safely explore and evaluate hazardous environments. This ability represents an important progression towards the preservation of human safety in the inevitable response to situations such as terrorist activities and urban search and rescue. The benefits of removing physical human presence from such environments are obvious, however challenges inhibiting task performance when remotely operating a mobile robotic system need to be addressed. The removal of physical human presence from the target environment introduces telepresence as a vital consideration in achieving the desired objective. Introducing haptic human-robotic interaction represents one approach towards improving operator performance in such a scenario. Teleoperative stair traversal proves to be a challenging task when undertaking threat response in an urban environment. This article investigates the teleoperation of an articulated track mobile robot designed for traversing stairs in a threat response scenario. Utilising a haptic medium for bilateral human-robotic interaction, the haptic cone methodology is introduced with the aim of providing the operator with a vision-independent, intuitive indication of the current commanded robot velocity. The haptic cone methodology operates synergistically with the introduced fuzzy-haptic augmentation for improving teleoperator performance in the stair traversal scenario.