Extended Kalman filtering for robotic proximity sensing

The authors address the problems in using a fiber-optic proximity sensor to detect robot end-effector positioning errors in performing a contact task when uncertainties about target position exist. An extended Kalman filter approach is employed to solve the nonlinear filtering problem. Some experimental results are given.

Modular non-computational-connectionist-hybrid neural network approach to robotic systems

Spiking neural networks are usually limited in their applications due to their complex mathematical models and the lack of intuitive learning algorithms. In this paper, a simpler, novel neural network derived from a leaky integrate and fire neuron model, the ‘cavalcade’ neuron, is presented. A simulation for the neural network has been developed and two basic learning algorithms implemented within the environment. These algorithms successfully learn some basic temporal and instantaneous problems. Inspiration for neural network structures from these experiments are then taken and applied to process sensor information so as to successfully control a mobile robot.

Developing skin analogues for a robotic octopus

In order to fabricate a biomimetic skin for an octopus inspired robot, a new process was developed based on mechanical properties measured from real octopus skin. Various knitted nylon textiles were tested and the one of 10-denier nylon was chosen as reinforcement. A combination of Ecoflex 0030 and 0010 silicone rubbers was used as matrix of the composite to obtain the right stiffness for the skin-analogue system. The open mould fabrication process developed allows air bubble to escape easily and the artificial skin produced was thin and waterproof. Material properties of the biomimetic skin were characterised using static tensile and instrumented scissors cutting tests. The Young’s moduli of the artificial skin are 0.08 MPa and 0.13 MPa in the longitudinal and transverse directions, which are much lower than those of the octopus skin. The strength and fracture toughness of the artificial skin, on the other hand are higher than those of real octopus skins. Conically-shaped skin prototypes to be used to cover the robotic arm unit were manufactured and tested. The biomimetic skin prototype was stiff enough to maintain it conical shape when filled with water. The driving force for elongation was reduced significantly compared with previous prototypes.

A feasible study of EEG-driven assistive robotic system for stroke rehabilitation

Stroke is a medical emergency and can cause a neurological damage, affecting the motor and sensory systems. Harnessing brain plasticity should make it possible to reconstruct the closed loop between the brain and the body, i.e., association of the generation of the motor command with the somatic sensory feedback might enhance motor recovery. In order to aid reconstruction of this loop with a robotic device it is necessary to assist the paretic side of the body at the right moment to achieve simultaneity between motor command and feedback signal to somatic sensory area in brain. To this end, we propose an integrated EEG-driven assistive robotic system for stroke rehabilitation. Depending on the level of motor recovery, it is important to provide adequate stimulation for upper limb motion. Thus, we propose an assist arm incorporating a Magnetic Levitation Joint that can generate a compliant motion due to its levitation and mechanical redundancy. This paper reports on a feasibility study carried out to verify the validity of the robot sensing and on EEG measurements conducted with healthy volunteers while performing a spontaneous arm flexion/extension movement. A characteristic feature was found in the temporal evolution of EEG signal in the single motion prior to executed motion which can aid in coordinating timing of the robotic arm assistance onset.

Visual sensor fusion for active security in robotic industrial environments

This work presents a method of information fusion involving data captured by both a standard CCD camera and a ToF camera to be used in the detection of the proximity between a manipulator robot and a human. Both cameras are assumed to be located above the work area of an industrial robot. The fusion of colour images and time of light information makes it possible to know the 3D localization of objects with respect to a world coordinate system. At the same time this allows to know their colour information. Considering that ToF information given by the range camera contains innacuracies including distance error, border error, and pixel saturation, some corrections over the ToF information are proposed and developed to improve the results. The proposed fusion method uses the calibration parameters of both cameras to reproject 3D ToF points, expressed in a common coordinate system for both cameras and a robot arm, in 2D colour images. In addition to this, using the 3D information, the motion detection in a robot industrial environment is achieved, and the fusion of information is applied to the foreground objects previously detected. This combination of information results in a matrix that links colour and 3D information, giving the possibility of characterising the object by its colour in addition to its 3D localization. Further development of these methods will make it possible to identify objects and their position in the real world, and to use this information to prevent possible collisions between the robot and such objects.

Visual sensor fusion for active security in robotic industrial environments

This work presents a method of information fusion involving data captured by both a standard charge-coupled device (CCD) camera and a time-of-flight (ToF) camera to be used in the detection of the proximity between a manipulator robot and a human. Both cameras are assumed to be located above the work area of an industrial robot. The fusion of colour images and time-of-flight information makes it possible to know the 3D localization of objects with respect to a world coordinate system. At the same time, this allows to know their colour information. Considering that ToF information given by the range camera contains innacuracies including distance error, border error, and pixel saturation, some corrections over the ToF information are proposed and developed to improve the results. The proposed fusion method uses the calibration parameters of both cameras to reproject 3D ToF points, expressed in a common coordinate system for both cameras and a robot arm, in 2D colour images. In addition to this, using the 3D information, the motion detection in a robot industrial environment is achieved, and the fusion of information is applied to the foreground objects previously detected. This combination of information results in a matrix that links colour and 3D information, giving the possibility of characterising the object by its colour in addition to its 3D localisation. Further development of these methods will make it possible to identify objects and their position in the real world and to use this information to prevent possible collisions between the robot and such objects.

Proposal of a floating mechanism based on magnetic levitation method toward EEG-driven robotic system

We discussed a floating mechanism based on quasi-magnetic levitation method that can be attached at the endpoint of a robot arm in order to construct a novel redundant robot arm for producing compliant motions. The floating mechanism can be composed of magnets and a constraint mechanism such that the repelling force of the magnets floats the endpoint part of the mechanism stable for the guided motions. The analytical and experimental results show that the proposed floating mechanism can produce stable floating motions with small inertia and viscosity. The results also show that the proposed mechanism can detect small force applied to the endpoint part because the friction force of the mechanism is very small.

Situation assessment through multi-modal sensing of dynamic environments to support cognitive robot control

Awareness of emerging situations in a dynamic operational environment of a robotic assistive device is an essential capability of such a cognitive system, based on its effective and efficient assessment of the prevailing situation. This allows the system to interact with the environment in a sensible (semi)autonomous / pro-active manner without the need for frequent interventions from a supervisor. In this paper, we report a novel generic Situation Assessment Architecture for robotic systems directly assisting humans as developed in the CORBYS project. This paper presents the overall architecture for situation assessment and its application in proof-of-concept Demonstrators as developed and validated within the CORBYS project. These include a robotic human follower and a mobile gait rehabilitation robotic system. We present an overview of the structure and functionality of the Situation Assessment Architecture for robotic systems with results and observations as collected from initial validation on the two CORBYS Demonstrators.

Feasibility study on EEG driven robotic system to realize efficient stroke rehabilitation

We aim to develop an efficient robotic system for stroke rehabilitation, in which a robotic arm moves the hemiplegic upper limb when the patient tries to move it. In order to achieve this goal we have considered a method to detect the patient's intended motion using EEG (Electroencephalogram), and have designed a rehabilitation robot based on a Redundant Drive Method. In this paper, we propose an EEG driven rehabilitation robot system and present initial results evaluating the feasibility of the proposed system.

Multi-agent model for robotic assembly system

In this paper, a multi-agent based model for a robotic assembly system is presented. Firstly, an organization model is used to construct the multi-agent model. Secondly, a dynamic self-organizing method is then put forward for the multi-agent robotic system to bid and contract the operations. Thirdly, a real multi-agent robotic system is built and assembly experiments are carried out. Finally, the experimental results confirm that the present multi-agent robotic system has flexibility, adaptation and stability.

An active stereo vision-based learning approach for robotic tracking, fixating and grasping control

In this paper, an active stereo vision-based learning approach is proposed for a robot to track, fixate and grasp an object in unknown environments. First, the functional mapping relationships between the joint angles of the active stereo vision system and the spatial representations of the object are derived and expressed in a three-dimensional workspace frame. Next, the self-adaptive resonance theory-based neural networks and the feedforward neural networks are used to learn the mapping relationships in a self-organized way. Then, the approach is verified by simulation using the models of an active stereo vision system which is installed in the end-effector of a robot. Finally, the simulation results confirm the effectiveness of the present approach.

Solution to robotic landmine detection through use of path planning and motor control

Low cost robotic detectors are a promising new approach to combat the disturbing landmine crisis. In this paper a low-cost robotic solution is proposed, we present several control techniques used to improve the precision of the robotic motion. A P and PD controller is applied, and it is concluded that a cascaded control system provides a more stable and accurate response. Two search patterns for landmine detection are considered, rectangular and spiral, these are used to analyse the effectiveness of the control system.

Haptic control of multi-axis robotic systems

Control of tele-operated remote robot’s is nothing new; the public was introduced to this 'new' field in 1986 when the Chernobyl cleanup began. Pictures of weird and wonderful robotic workers pouring concrete or moving rubble flooded the world. Integration of force feedback or 'haptics' to remote robot's is a new development and one that is likely to make a big difference in man-machine interaction. Development of haptic capable tele-operation schema is a challenge. Often platform specific software is developed for one off tasks. This research focussed on the development of an open software platform for haptic control of multiple remote robotic platforms. The software utilises efficient server/client architecture for low data latency, while efficiently performing required kinematic transforms and data manipulation in real time. A description of the algorithm, software interface and hardware is presented in this paper. Preliminary results are encouraging as haptic control has been shown to greatly enhances remote positioning tasks.

Automated robotic grinding by low-powered manipulator

A new robotic grinding process has been developed for a low-powered robot system using a spring balancer as a suspension system. To manipulate a robot-arm in the vertical plane, a large actuator torque is required due to the tool weight and enormous gravity effect. But the actuators of the robot system always exhibit a limited torque capacity. This paper presents a cheap and available system for precise grinding tasks by a low-powered robot system using a suspension system. For grinding operations, to achieve position and force-tracking simultaneously, this paper presents an algorithm of the hybrid position/force-tracking scheme with respect to the dynamic behavior of a spring balancer. Material Removal Rate (MRR) is developed for materials SS400 and SUS304. Simulations and experiments have been carried out to demonstrate the feasibility of the proposed system.

Bilateral haptic teleoperation of an articulated track mobile robot

Teleoperation has been used in many applications, allowing a human operator to remotely control a robotic system in order to perform a particular task. Recently haptic teleoperation has focused mainly on improving performance in remote manipulation tasks, however the haptic approach offers similar advantages for teleoperative control of the motion of a mobile robot. This paper describes a prototype system designed to facilitate haptic teleoperation of an all-terrain, articulated track mobile robot. This system utilizes a multi-modal user interface intended to improve operator immersion, reduce operator overload and improve teleoperative task performance. The system architecture facilitates implementation of an application-specific haptic augmentation algorithm in order to improve operator performance in challenging real-world tasks. The contributions of this work can be categorized as the custom mobile platform, teleoperator interface and haptic augmentation strategy.