Haptics interface for modelling and simulation of flexible cables

Virtual reality systems are becoming a must for product and process design, training practices and ergonomic analysis in many manufacturing industries. The automotive sector is considered to be the leader in applying virtual reality (VR) solutions for real-world, non-trivial, problems. Although, a number of commercial 3D engineering tools for digital mockups exist, most of them lack intuitive direct manipulation of the digital mockups. The majority of these 3D engineering tools are constrained to the interaction mainly with rigid objects which is just half the story. To bridge this gap, we have developed a haptics interface for modelling and simulation of flexible objects. The graphical and haptic user interface developed allows the creation of multiple one dimensional (1D) flexible objects, such as hoses, cables and harnesses. The user is required to provide the mechanical properties of the material such as Young's modulus, Poisson's ratio, material density, damping factors, as well as dimensional properties such as length, and inner and outer diameters of the flexible object. Flexilution solver is employed to estimate and simulate the dynamic behaviour of flexible objects in response to external user interaction, whereas Nvidia's generic physics engine is used to simulate the behaviour of rigid objects. A generic communication interface is developed to accommodate a variety of devices without the reconfiguration of the simulation platform.

Force measurement capability for robotic assisted minimally invasive surgery systems

An automated laparoscopic instrument capable of non-invasive measurement of tip/tissue interaction forces for direct application in robotic assisted minimally invasive surgery systems_ is introduced in this paper. It has the capability to measure normal grasping forces as well as lateral interaction forces without any sensor mounted on the tip jaws. Further to non-invasive actuation of the tip, the proposed instrument is also able to change the grasping direction during surgical operation. Modular design of the instrument allows conversion between surgical modalities (e.g., grasping, cutting, and dissecting). The main focus of this paper is on evaluation of the grasping force capability of the proposed instrument. The mathematical formulation of fenestrated insert is presented and its non-linear behaviour is studied. In order to measure the stiffness of soft tissues, a device was developed that is also described in this paper. Tissue characterisation experiments were conducted and results are presented and analysed here. The experimental results verify the capability of the proposed instrument in accurately measuring grasping forces and in characterising artificial tissue samples of varying stiffness.

The effective radius and resistance to slippage

This work reveals that parallel gripper flat-jaw configuration affects grasping effectiveness. An important finding is the fact that object grasp reliability is influenced significantly by gripper's ability to develop high resistance to object rotation in the gripper. The concept of effective torque radius, which increases resistance to object rotation in the gripper, is presented here and can be extrapolated to other grasping devices and grasping strategies to improve their reliability and make them more effective. Grippers with full-jaw contact surface and those with discrete contact areas have been investigated using simple experimental setups. Essential mathematical models needed for analytical investigation, based on simple mechanics for full-jaw contact surfaces and discrete-jaw contact surfaces, are presented. These may be useful for gripper jaw design purposes.

Soft tissue characterisation using a force feedback-enabled instrument for robotic assisted minimally invasive surgery systems

An automated laparoscopic instrument capable of non-invasivemeasurement of tip/tissue interaction forces for direct application in robotic assisted minimally invasive surgery systems is introduced in this chapter. It has the capability to measure normal grasping forces as well as lateral interaction forces without any sensor mounted on the tip jaws. Further to non-invasive actuation of the tip, the proposed instrument is also able to change the grasping direction during surgical operation. Modular design of the instrument allows conversion between surgical modalities (e.g., grasping, cutting, and dissecting). The main focus of thispaper is on evaluation of the grasping force capability of the proposed instrument. The mathematical formulation of fenestrated insert is presented and its non-linear behaviour is studied. In order to measure the stiffness of soft tissues, a device was developed that is also described in this chapter. Tissue characterisation experiments were conducted and results are presented and analysed here. The experimental results verify the capability of the proposed instrument in accurately measuring grasping forces and in characterising artificial tissue samples of varying stiffness.

Exploring associations between gaze patterns and putative human mirror neuron system activity

The human mirror neuron system (MNS) is hypothesized to be crucial to social cognition. Given that key MNS-input regions such as the superior temporal sulcus are involved in biological motion processing, and mirror neuron activity in monkeys has been shown to vary with visual attention, aberrant MNS function may be partly attributable to atypical visual input. To examine the relationship between gaze pattern and interpersonal motor resonance (IMR; an index of putative MNS activity), healthy right-handed participants aged 18-40 (n = 26) viewed videos of transitive grasping actions or static hands, whilst the left primary motor cortex received transcranial magnetic stimulation. Motor-evoked potentials recorded in contralateral hand muscles were used to determine IMR. Participants also underwent eyetracking analysis to assess gaze patterns whilst viewing the same videos. No relationship was observed between predictive gaze and IMR. However, IMR was positively associated with fixation counts in areas of biological motion in the videos, and negatively associated with object areas. These findings are discussed with reference to visual influences on the MNS, and the possibility that MNS atypicalities might be influenced by visual processes such as aberrant gaze pattern.

Searching Baxter's URDF robot joint and link tree for active serial chains

Teleoperation is integral to society's uptake of modern robotic systems. Given the wide array of readily available robots, ranging from simple mobile platforms and UAVs to advanced humanoid robots such as ASIMO and PR2, teleoperation is required in many different forms. The recent advances in virtual reality systems, interactive input controls and even haptic devices facilitate a wide range of new approaches to teleoperation control. This paper considers a dynamic user interface for improving the operator's ability to teleoperate heterogeneous robotic systems in dynamic and challenging environments. In order to achieve the proposed dynamic user interface the robot(s) comprising the heterogeneous robotic system and their active components need to be categorized. The recent uptake of ROS means that many robots are now represented within the standardized Unified Robot Descriptive Format (URDF), and this paper proposes a method for searching the URDF for active serial chains in individual robot systems. Results demonstrate the ability of the approach to determine active serial chains and associated kinematic information for the Baxter torso robot.

Design of a virtual reality training system for micro-robotic cell injection

This paper discusses the design of a virtual reality (VR) training system for micro-robotic cell injection. A brief explanation of cell injection and the challenges associated with the procedure are first presented. This is followed by discussion of the skills required by the bio-operator to achieve successful injection, such as accuracy, trajectory and applied force. The design of the VR system which includes the visual display, input controllers, mapping strategies, haptic guidance and output data is then discussed. Initial evaluation of the VR system is presented including analysis and discussion based on conducted user evaluations. Finally, given the findings of the initial evaluation, this paper concludes that an effective haptically-enabled virtual cell injection training system is feasible, and recommendations for improvement and future work are given.

Increased premotor cortex activation in high functioning autism during action observation

The mirror neuron (MN) hypothesis of autism has received considerable attention, but to date has produced inconsistent findings. Using functional MRI, participants with high functioning autism or Asperger's syndrome were compared to typically developing individuals (n=12 in each group). Participants passively observed hand gestures that included waving, pointing, and grasping. Concerning the MN network, both groups activated similar regions including prefrontal, inferior parietal and superior temporal regions, with the autism group demonstrating significantly greater activation in the dorsal premotor cortex. Concerning other regions, participants with autism demonstrated increased activity in the anterior cingulate and medial frontal gyrus, and reduced activation in calcarine, cuneus, and middle temporal gyrus. These results suggest that during observation of hand gestures, frontal cortex activation is affected in autism, which we suggest may be linked to abnormal functioning of the MN system.

Object slippage prevention using different control strategies

This paper presents experimental results obtained using a friction-based slippage and tangential force sensing device that has been developed for the purpose of reliable object slippage prevention during robotic manipulation. The experimental results obtained demonstrate that the developed slippage sensing strategy is rugged and reliable even in its current “rough prototype” state of development. This work has the potential to yield a low cost and highly customisable slippage and tangential force sensing device for a variety of robotic object grasping and manipulation applications. It is envisaged that the work presented here will be beneficial to researchers in the area of object slippage prevention.

Virtual reality training for micro-robotic cell injection

This research was carried out to fill the gap within existing knowledge on the approaches to supplement the training for micro-robotic cell injection procedure by utilising virtual reality and haptic technologies.