Visual sensor fusion for active security in robotic industrial environments

This work presents a method of information fusion involving data captured by both a standard CCD camera and a ToF camera to be used in the detection of the proximity between a manipulator robot and a human. Both cameras are assumed to be located above the work area of an industrial robot. The fusion of colour images and time of light information makes it possible to know the 3D localization of objects with respect to a world coordinate system. At the same time this allows to know their colour information. Considering that ToF information given by the range camera contains innacuracies including distance error, border error, and pixel saturation, some corrections over the ToF information are proposed and developed to improve the results. The proposed fusion method uses the calibration parameters of both cameras to reproject 3D ToF points, expressed in a common coordinate system for both cameras and a robot arm, in 2D colour images. In addition to this, using the 3D information, the motion detection in a robot industrial environment is achieved, and the fusion of information is applied to the foreground objects previously detected. This combination of information results in a matrix that links colour and 3D information, giving the possibility of characterising the object by its colour in addition to its 3D localization. Further development of these methods will make it possible to identify objects and their position in the real world, and to use this information to prevent possible collisions between the robot and such objects.

Visual sensor fusion for active security in robotic industrial environments

This work presents a method of information fusion involving data captured by both a standard charge-coupled device (CCD) camera and a time-of-flight (ToF) camera to be used in the detection of the proximity between a manipulator robot and a human. Both cameras are assumed to be located above the work area of an industrial robot. The fusion of colour images and time-of-flight information makes it possible to know the 3D localization of objects with respect to a world coordinate system. At the same time, this allows to know their colour information. Considering that ToF information given by the range camera contains innacuracies including distance error, border error, and pixel saturation, some corrections over the ToF information are proposed and developed to improve the results. The proposed fusion method uses the calibration parameters of both cameras to reproject 3D ToF points, expressed in a common coordinate system for both cameras and a robot arm, in 2D colour images. In addition to this, using the 3D information, the motion detection in a robot industrial environment is achieved, and the fusion of information is applied to the foreground objects previously detected. This combination of information results in a matrix that links colour and 3D information, giving the possibility of characterising the object by its colour in addition to its 3D localisation. Further development of these methods will make it possible to identify objects and their position in the real world and to use this information to prevent possible collisions between the robot and such objects.

Proposal of a floating mechanism based on magnetic levitation method toward EEG-driven robotic system

We discussed a floating mechanism based on quasi-magnetic levitation method that can be attached at the endpoint of a robot arm in order to construct a novel redundant robot arm for producing compliant motions. The floating mechanism can be composed of magnets and a constraint mechanism such that the repelling force of the magnets floats the endpoint part of the mechanism stable for the guided motions. The analytical and experimental results show that the proposed floating mechanism can produce stable floating motions with small inertia and viscosity. The results also show that the proposed mechanism can detect small force applied to the endpoint part because the friction force of the mechanism is very small.

Obstacle avoidance routing scheme through optimal sink movement for home monitoring and mobile robotic consumer devices

In recent years, ZigBee has been proven to be an excellent solution to create scalable and flexible home automation networks. In a home automation network, consumer devices typically collect data from a home monitoring environment and then transmit the data to an end user through multi-hop communication without the need for any human intervention. However, due to the presence of typical obstacles in a home environment, error-free reception may not be possible, particularly for power constrained devices. A mobile sink based data transmission scheme can be one solution but obstacles create significant complexities for the sink movement path determination process. Therefore, an obstacle avoidance data routing scheme is of vital importance to the design of an efficient home automation system. This paper presents a mobile sink based obstacle avoidance routing scheme for a home monitoring system. The mobile sink collects data by traversing through the obstacle avoidance path. Through ZigBee based hardware implementation and verification, the proposed scheme successfully transmits data through the obstacle avoidance path to improve network performance in terms of life span, energy consumption and reliability. The application of this work can be applied to a wide range of intelligent pervasive consumer products and services including robotic vacuum cleaners and personal security robots1.

Development of a wearable assistive soft robotic device for elbow rehabilitation

The loss of motor function at the elbow joint can result as a consequence of stroke. Stroke is a clinical illness resulting in long lasting neurological deficits often affecting somatosensory and motor cortices. More than half of those that recover from a stroke survive with disability in their upper arm and need rehabilitation therapy to help in regaining functions of daily living. In this paper, we demonstrated a prototype of a low-cost, ultra-light and wearable soft robotic assistive device that could aid administration of elbow motion therapies to stroke patients. In order to assist the rotation of the elbow joint, the soft modules which consist of soft wedge-like cellular units was inflated by air to produce torque at the elbow joint. Highly compliant rotation can be naturally realised by the elastic property of soft silicone and pneumatic control of air. Based on the direct visual-actuation control, a higher control loop utilised visual processing to apply positional control, the lower control loop was implemented by an electronic circuit to achieve the desired pressure of the soft modules by Pulse Width Modulation. To examine the functionality of the proposed soft modular system, we used an anatomical model of the upper limb and performed the experiments with healthy participants.

Feasibility study on EEG driven robotic system to realize efficient stroke rehabilitation

We aim to develop an efficient robotic system for stroke rehabilitation, in which a robotic arm moves the hemiplegic upper limb when the patient tries to move it. In order to achieve this goal we have considered a method to detect the patient's intended motion using EEG (Electroencephalogram), and have designed a rehabilitation robot based on a Redundant Drive Method. In this paper, we propose an EEG driven rehabilitation robot system and present initial results evaluating the feasibility of the proposed system.

Evaluation of sensor configurations for robotic surgical instruments

Designing surgical instruments for robotic-assisted minimally-invasive surgery (RAMIS) is challenging due to constraints on the number and type of sensors imposed by considerations such as space or the need for sterilization. A new method for evaluating the usability of virtual teleoperated surgical instruments based on virtual sensors is presented. This method uses virtual prototyping of the surgical instrument with a dual physical interaction, which allows testing of different sensor configurations in a real environment. Moreover, the proposed approach has been applied to the evaluation of prototypes of a two-finger grasper for lump detection by remote pinching. In this example, the usability of a set of five different sensor configurations, with a different number of force sensors, is evaluated in terms of quantitative and qualitative measures in clinical experiments with 23 volunteers. As a result, the smallest number of force sensors needed in the surgical instrument that ensures the usability of the device can be determined. The details of the experimental setup are also included.

A planar flexible robotic manipulator

Presents the dynamic modelling of a flexible robotic manipulator with two flexible links and two revolute joints, which rotates in the horizontal plane. The dynamic equations are derived using the Newton-Euler formulation and the finite element method, based on elementary beam theory, which is used to discretize the displacements such that the small motion is represented in terms of nodal displacements. Computer simulation results are presented to illustrate this study. The dynamic model becomes necessary for use in future design and control applications.

On homoclinic chaos and a control chaos strategy applied to a free-joint nonholonomic manipulator

In this work, the occurrence of chaos (homoclinic scene) is verified in a robotic system with two degrees of freedom by using Poincare-Mel'nikov method. The studied problem was based on experimental results of a two-joint planar manipulator-first joint actuated and the second joint free-that resides in a horizontal plane. This is the simplest model of nonholonomic free-joint manipulators. The purpose of the present study is to verify analytically those results and to suggest a control strategy.

The rigid-flexible nonlinear robotic manipulator: Modeling and control

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Dynamic modeling and simulation of a flexible robotic manipulator

This work focuses on the dynamic modeling of a flexible robotic manipulator with two flexible links and two revolute joints, which rotates in the horizontal plane. The dynamic equations are derived using the Newton-Euler formulation and the finite element method, based on elementary beam theory. Computer simulation results are presented to illustrate this study. The dynamic model becomes necessary for use in future design and control applications.

The fractional-nonlinear robotic manipulator: Modeling and dynamic simulations

In this paper, we applied the Riemann-Liouville approach and the fractional Euler-Lagrange equations in order to obtain the fractional-order nonlinear dynamics equations of a two link robotic manipulator. The aformentioned equations have been simulated for several cases involving: integer and non-integer order analysis, with and without external forcing acting and some different initial conditions. The fractional nonlinear governing equations of motion are coupled and the time evolution of the angular positions and the phase diagrams have been plotted to visualize the effect of fractional order approach. The new contribution of this work arises from the fact that the dynamics equations of a two link robotic manipulator have been modeled with the fractional Euler-Lagrange dynamics approach. The results reveal that the fractional-nonlinear robotic manipulator can exhibit different and curious behavior from those obtained with the standard dynamical system and can be useful for a better understanding and control of such nonlinear systems. © 2012 American Institute of Physics.

SDRE control strategy applied to a nonlinear robotic including drive motor

A robotic control design considering all the inherent nonlinearities of the robot-engine configuration is developed. The interactions between the robot and joint motor drive mechanism are considered. The proposed control combines two strategies, one feedforward control in order to maintain the system in the desired coordinate, and feedback control system to take the system into a desired coordinate. The feedback control is obtained using State-Dependent Riccati Equation (SDRE). For link positioning two cases are considered. Case I: For control positioning, it is only used motor voltage; Case II: For control positioning, it is used both motor voltage and torque between the links. Simulation results, including parametric uncertainties in control shows the feasibility of the proposed control for the considered system.

On nonlinear dynamics and control of a robotic arm with chaos

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Nonlinear state estimation and control applied to a manipulator robotic including drive motor

A robotic control design considering all the inherent nonlinearities of the robot engine configuration is developed. The interactions between the robot and joint motor drive mechanism are considered. The proposed control combines two strategies, one feedforward control in order to maintain the system in the desired coordinate, and feedback control system to take the system into a desired coordinate. The feedback control is obtained using State Dependent Riccati Equation (SDRE). For link positioning two cases are considered. Case 1: For control positioning, it is only used motor voltage; Case 2: For control positioning, it is used both motor voltage and torque between the links. Simulation results, including parametric uncertainties in control shows the feasibility of the proposed control for the considered system.