Analysis of EEG signal to detect motor command generation towards stroke rehabilitation

Our aim is to reconstruct the brain-body loop of stroke patients via an EEG-driven robotic system. After the detection of motor command generation, the robotic arm should assist patient’s movement at the correct moment and in a natural way. In this study we performed EEG measurements from healthy subjects performing discrete spontaneous motion. An EEG analysis based on the temporal correlation of the brain activity was employed to determine the onset of single motion motor command generation.

A multimedia environment for supporting the teaching of robotics systems

This paper aims at describing an educational system for teaching and learning robotic systems. Multimedia resources were used to construct a virtual laboratory where users are able to use functionalities of a virtual robotic arm, by moving and clicking the mouse without caring about the detailed internal robot operation. Moreover through the multimedia system the user can interact with a real robot arm. The engineering students are the target public of the developed system. With its contents and interactive capabilities, it has been used as a support to the traditional face-to-face classes on the subject of robotics.. In the paper it is first introduced the metaphor of Virtual Laboratory used in the system. Next, it is described the Graphical and Multimedia Environment approach: an interactive graphic user interface with a 3D environment for simulation. Design and implementation issues of the real-time interactive multimedia learning system, which supports the W3C SMIL standard for presenting the real-time multimedia teaching material, are described. Finally, some preliminary conclusions and possible future works from this research are presented.

Teaching robotics systems in a multimedia environment

This paper describes the development of a multimedia educational system to teach and learn robotic systems. Multimedia resources have been used to build a virtual laboratory where users are able to utilize functions of a robotic arm, by moving and clicking the mouse without worrying about the detailed robot internal operation. The multimedia system is integrated with a real robotic arm, which was also developed at the university. Through robotic topic presentations and interactive capabilities provided by this system and its tools, students can devote themselves on the learning process just as they do in the traditional face-to-face classes. and the target public of this system are the engineering students themselves.

Contribuições na modelagem dinâmica e no controle neural de um braço robótico com elos flexíveis

Em geral, estruturas espaciais e manipuladores robóticos leves têm uma característica similar e inerente que é a flexibilidade. Esta característica torna a dinâmica do sistema muito mais complexa e com maiores dificuldades para a análise de estabilidade e controle. Então, braços robóticos bastantes leves, com velocidade elevada e potencia limitada devem considerar o controle de vibração causada pela flexibilidade. Por este motivo, uma estratégia de controle é desejada não somente para o controle do modo rígido mas também que seja capaz de controlar os modos de vibração do braço robótico flexível. Também, redes neurais artificiais (RNA) são identificadas como uma subespecialidade de inteligência artificial. Constituem atualmente uma teoria para o estudo de fenômenos complexos e representam uma nova ferramenta na tecnologia de processamento de informação, por possuírem características como processamento paralelo, capacidade de aprendizagem, mapeamento não-linear e capacidade de generalização. Assim, neste estudo utilizam-se RNA na identificação e controle do braço robótico com elos flexíveis. Esta tese apresenta a modelagem dinâmica de braços robóticos com elos flexíveis, 1D no plano horizontal e 2D no plano vertical com ação da gravidade, respectivamente. Modelos dinâmicos reduzidos são obtidos pelo formalismo de Newton-Euler, e utiliza-se o método dos elementos finitos (MEF) na discretização dos deslocamentos elásticos baseado na teoria elementar da viga. Além disso, duas estratégias de controle têm sido desenvolvidas com a finalidade de eliminar as vibrações devido à flexibilidade do braço robótico com elos flexíveis. Primeiro, utilizase um controlador neural feedforward (NFF) na obtenção da dinâmica inversa do braço robótico flexível e o calculo do torque da junta. E segundo, para obter precisão no posicionamento... (Resumo completo, clicar acesso eletrônico abaixo)

Tele-obstetric ultrasound: analysis of first-trimester ultrasound images transmitted in realtime

We evaluated the diagnostic quality of first-trimester ultrasound images transmitted in realtime using low-cost telecommunications. A prospective sample of fetal ultrasound images from 11 weeks to 13 weeks and six days of pregnancy was obtained from pregnant women over 18 years old. The examinations were transmitted in realtime to three independent examiners who carried out a qualitative assessment based on parameters established by the Fetal Medicine Foundation. All fetal structures could be viewed and the quality of images received by the examiners was considered normal. There were significant differences for crown-rump length and nuchal translucency in the transmitted images but the loss in definition was acceptable. Thus the quality of images transmitted via the Internet through the use of low-cost software appeared suitable for screening for chromosomal abnormalities in the first trimester of pregnancy.

Diseño, implementación y verificación de un controlador para robots educativos

[EN] This project briefly analyzes the scope and applications of Industrial Robotics, as well as the importance that this technical discipline has gained in the past decades. In addition, it proposes a modern platform to assist in teaching this discipline in colleges and universities. This new educational platform for the teaching of Industrial Robotics is based on the robotic systems from Rhino Robotics Ltd., using the existing robotic arms and replacing the control electronics by a newer, modern and yet backwards-compatible controller. In addition to the controller, this platform also provides new, up-to-date software utilities that are more intuitive than those provided with the old system. The work to be done consists essentially in receiving commands from a personal computer which the controller must interpret in order to control the motors of the robotic arm. The controller itself will be implemented as an embedded system based on microcontrollers. This requires the implementation of a communication protocol between the personal computer and the microcontroller, the design of a command interpreter, the design of the electronics for motor control using PWM and H-bridges, and the implementation of control techniques (more precisely, PID control). Hence, this project combines software and hardware design and integration techniques with motor control techniques and feedback control methods from Control Engineering, along with the kinematic analysis of the Rhino XR-4 robotic arm. 

Model and control of tendon actuated robots

The use of tendons for the transmission of the forces and the movements in robotic devices has been investigated from several researchers all over the world. The interest in this kind of actuation modality is based on the possibility of optimizing the position of the actuators with respect to the moving part of the robot, in the reduced weight, high reliability, simplicity in the mechanic design and, finally, in the reduced cost of the resulting kinematic chain. After a brief discussion about the benefits that the use of tendons can introduce in the motion control of a robotic device, the design and control aspects of the UB Hand 3 anthropomorphic robotic hand are presented. In particular, the tendon-sheaths transmission system adopted in the UB Hand 3 is analyzed and the problem of force control and friction compensation is taken into account. The implementation of a tendon based antagonistic actuated robotic arm is then investigated. With this kind of actuation modality, and by using transmission elements with nonlinear force/compression characteristic, it is possible to achieve simultaneous stiffness and position control, improving in this way the safety of the device during the operation in unknown environments and in the case of interaction with other robots or with humans. The problem of modeling and control of this type of robotic devices is then considered and the stability analysis of proposed controller is reported. At the end, some tools for the realtime simulation of dynamic systems are presented. This realtime simulation environment has been developed with the aim of improving the reliability of the realtime control applications both for rapid prototyping of controllers and as teaching tools for the automatic control courses.

Kinematic analysis of a novel 2-d.o.f. orientation device

This paper presents the development of a new parallel robot designed for helping with bone milling surgeries. The robot is a small modular wrist with 2 active degrees of freedom, and it is proposed to be used as an orientation device located at the end of a robotic arm designed for bone milling processes. A generic kinematic geometry is proposed for this device. This first article shows the developments on the workspace optimization and the analysis of the force field required to complete a reconstruction of the inferior jawbone. The singularities of the mechanism are analyzed, and the actuator selection is justified with the torque requirements and the study of the force space. The results obtained by the simulations allow building a first prototype using linear motors. Bone milling experiment video is shown as additional material.

Design and kinematic analysis of 3PSS-1S wrist for needle insertion guidance

In this work it is presented a complete kinematic analysis of the 3PSS-1S parallel mechanism for its implementation as a spherical wrist for a needle insertion guidance robot. The spherical 3PSS-1S mechanism is a low weight and reduced dimension parallel mechanism that allows spherical movements providing the requirements needed for the serial–parallel robotic arm for needle insertion guidance. The solution of its direct kinematic is computed with a numerical method based on the Newton–Raphson formulation and a constraint function of the mechanism. The input–output velocity equation is obtained with the use of screw theory. Three types of singular postures are identified during simulations and verified in the real prototype. The 3PSS-1S can perform pure rotations of ±45°±45°, ±40°±40°, ±60°±60° along the View the MathML sourcex, View the MathML sourcey, View the MathML sourcez axes respectively.

Motion Planning and Controls with Safety and Temporal Constraints

Motion planning, or trajectory planning, commonly refers to a process of converting high-level task specifications into low-level control commands that can be executed on the system of interest. For different applications, the system will be different. It can be an autonomous vehicle, an Unmanned Aerial Vehicle(UAV), a humanoid robot, or an industrial robotic arm. As human machine interaction is essential in many of these systems, safety is fundamental and crucial. Many of the applications also involve performing a task in an optimal manner within a given time constraint. Therefore, in this thesis, we focus on two aspects of the motion planning problem. One is the verification and synthesis of the safe controls for autonomous ground and air vehicles in collision avoidance scenarios. The other part focuses on the high-level planning for the autonomous vehicles with the timed temporal constraints. In the first aspect of our work, we first propose a verification method to prove the safety and robustness of a path planner and the path following controls based on reachable sets. We demonstrate the method on quadrotor and automobile applications. Secondly, we propose a reachable set based collision avoidance algorithm for UAVs. Instead of the traditional approaches of collision avoidance between trajectories, we propose a collision avoidance scheme based on reachable sets and tubes. We then formulate the problem as a convex optimization problem seeking control set design for the aircraft to avoid collision. We apply our approach to collision avoidance scenarios of quadrotors and fixed-wing aircraft. In the second aspect of our work, we address the high level planning problems with timed temporal logic constraints. Firstly, we present an optimization based method for path planning of a mobile robot subject to timed temporal constraints, in a dynamic environment. Temporal logic (TL) can address very complex task specifications such as safety, coverage, motion sequencing etc. We use metric temporal logic (MTL) to encode the task specifications with timing constraints. We then translate the MTL formulae into mixed integer linear constraints and solve the associated optimization problem using a mixed integer linear program solver. We have applied our approach on several case studies in complex dynamical environments subjected to timed temporal specifications. Secondly, we also present a timed automaton based method for planning under the given timed temporal logic specifications. We use metric interval temporal logic (MITL), a member of the MTL family, to represent the task specification, and provide a constructive way to generate a timed automaton and methods to look for accepting runs on the automaton to find an optimal motion (or path) sequence for the robot to complete the task.

Self-Organizing Map Neural Architectures Based on Limit Cycle Attractors

Recent efforts to develop large-scale neural architectures have paid relatively little attention to the use of self-organizing maps (SOMs). Part of the reason is that most conventional SOMs use a static encoding representation: Each input is typically represented by the fixed activation of a single node in the map layer. This not only carries information in an inefficient and unreliable way that impedes building robust multi-SOM neural architectures, but it is also inconsistent with rhythmic oscillations in biological neural networks. Here I develop and study an alternative encoding scheme that instead uses limit cycle attractors of multi-focal activity patterns to represent input patterns/sequences. Such a fundamental change in representation raises several questions: Can this be done effectively and reliably? If so, will map formation still occur? What properties would limit cycle SOMs exhibit? Could multiple such SOMs interact effectively? Could robust architectures based on such SOMs be built for practical applications? The principal results of examining these questions are as follows. First, conditions are established for limit cycle attractors to emerge in a SOM through self-organization when encoding both static and temporal sequence inputs. It is found that under appropriate conditions a set of learned limit cycles are stable, unique, and preserve input relationships. In spite of the continually changing activity in a limit cycle SOM, map formation continues to occur reliably. Next, associations between limit cycles in different SOMs are learned. It is shown that limit cycles in one SOM can be successfully retrieved by another SOM’s limit cycle activity. Control timings can be set quite arbitrarily during both training and activation. Importantly, the learned associations generalize to new inputs that have never been seen during training. Finally, a complete neural architecture based on multiple limit cycle SOMs is presented for robotic arm control. This architecture combines open-loop and closed-loop methods to achieve high accuracy and fast movements through smooth trajectories. The architecture is robust in that disrupting or damaging the system in a variety of ways does not completely destroy the system. I conclude that limit cycle SOMs have great potentials for use in constructing robust neural architectures.

Safe and Collaborative Navigation & Interaction With Mobile Manipulators in Domestic Appliance Test Labs

Safe collaboration between a robot and human operator forms a critical requirement for deploying a robotic system into a manufacturing and testing environment. In this dissertation, the safety requirement for is developed and implemented for the navigation system of the mobile manipulators. A methodology for human-robot co-existence through a 3d scene analysis is also investigated. The proposed approach exploits the advance in computing capability by relying on graphic processing units (GPU’s) for volumetric predictive human-robot contact checking. Apart from guaranteeing safety of operators, human-robot collaboration is also fundamental when cooperative activities are required, as in appliance test automation floor. To achieve this, a generalized hierarchical task controller scheme for collision avoidance is developed. This allows the robotic arm to safely approach and inspect the interior of the appliance without collision during the testing procedure. The unpredictable presence of the operators also forms dynamic obstacle that changes very fast, thereby requiring a quick reaction from the robot side. In this aspect, a GPU-accelarated distance field is computed to speed up reaction time to avoid collision between human operator and the robot. An automated appliance testing also involves robotized laundry loading and unloading during life cycle testing. This task involves Laundry detection, grasp pose estimation and manipulation in a container, inside the drum and during recovery grasping. A wrinkle and blob detection algorithms for grasp pose estimation are developed and grasp poses are calculated along the wrinkle and blobs to efficiently perform grasping task. By ranking the estimated laundry grasp poses according to a predefined cost function, the robotic arm attempt to grasp poses that are more comfortable from the robot kinematic side as well as collision free on the appliance side. This is achieved through appliance detection and full-model registration and collision free trajectory execution using online collision avoidance.

Mars delivery service - development of the electro-mechanical systems of the Sample Fetch Rover for the Mars Sample Return Campaign

This thesis describes the development of the Sample Fetch Rover (SFR), studied for Mars Sample Return (MSR), an international campaign carried out in cooperation between the National Aeronautics and Space Administration (NASA) and the European Space Agency (ESA). The focus of this document is the design of the electro-mechanical systems of the rover. After placing this work into the general context of robotic planetary exploration and summarising the state of the art for what concerns Mars rovers, the architecture of the Mars Sample Return Campaign is presented. A complete overview of the current SFR architecture is provided, touching upon all the main subsystems of the spacecraft. For each area, it is discussed what are the design drivers, the chosen solutions and whether they use heritage technology (in particular from the ExoMars Rover) or new developments. This research focuses on two topics of particular interest, due to their relevance for the mission and the novelty of their design: locomotion and sample acquisition, which are discussed in depth. The early SFR locomotion concepts are summarised, covering the initial trade-offs and discarded designs for higher traverse performance. Once a consolidated architecture was reached, the locomotion subsystem was developed further, defining the details of the suspension, actuators, deployment mechanisms and wheels. This technology is presented here in detail, including some key analysis and test results that support the design and demonstrate how it responds to the mission requirements. Another major electro-mechanical system developed as part of this work is the one dedicated to sample tube acquisition. The concept of operations of this machinery was defined to be robust against the unknown conditions that characterise the mission. The design process led to a highly automated robotic system which is described here in its main components: vision system, robotic arm and tube storage.

Design and specification of a modular automatic testing solution

Electric vehicles and electronic components inside the vehicle are becoming increasingly important. The software as well starts to have a significant impact on modern high-end cars therefore a careful validation process needs to be implemented with the aim of having a bug free product when it is released. The software complexity increases and thus also the testing phases is more demanding. Test can be troublesome and, in some cases, boring and easy. The intelligence can be moved in test definition and writing rather than on test execution. The aim of this document is to start the definition of an automatic modular testing system capable to execute test cycles on systems that interacts with the CAN networks and with DUT that can be touched with a robotic arm. The document defines a first version of the system, in particular the hardware interface part with the aim of taking logs and execute test in an automated fashion with the test engineer can have a higher focus on the test definition and analysis rather than execution.

Nonlinear optimization for human-like synchronous movements of a dual arm-hand robotic system

In previous work we have presented a model capable of generating human-like movements for a dual arm-hand robot involved in human-robot cooperative tasks. However, the focus was on the generation of reach-to-grasp and reach-to-regrasp bimanual movements and no synchrony in timing was taken into account. In this paper we extend the previous model in order to accomplish bimanual manipulation tasks by synchronously moving both arms and hands of an anthropomorphic robotic system. Specifically, the new extended model has been designed for two different tasks with different degrees of difficulty. Numerical results were obtained by the implementation of the IPOPT solver embedded in our MATLAB simulator.