Learning Robot Motions from Visual Sensing

Learning from demonstration becomes increasingly popular as an efficient way of robot programming. Not only a scientific interest acts as an inspiration in this case but also the possibility of producing the machines that would find application in different areas of life: robots helping with daily routine at home, high performance automata in industries or friendly toys for children. One way to teach a robot to fulfill complex tasks is to start with simple training exercises, combining them to form more difficult behavior. The objective of the Master’s thesis work was to study robot programming with visual input. Dynamic movement primitives (DMPs) were chosen as a tool for motion learning and generation. Assuming a movement to be a spring system influenced by an external force, making this system move, DMPs represent the motion as a set of non-linear differential equations. During the experiments the properties of DMP, such as temporal and spacial invariance, were examined. The effect of the DMP parameters, including spring coefficient, damping factor, temporal scaling, on the trajectory generated were studied.

Mobile Teleoperation of a Mobile Robot

This thesis describes the design and implementation of a graphical application on a mobile device to teleoperate a mobile robot. The department of information technology in Lappeenranta University conducts research in robotics, and the main motivation was to extend the available teleoperation applications for mobile devices. The challenge was to port existing robot software library onto an embedded device platform, then develop a suitable user interface application that provides sufficient functionality to perform teleoperation tasks over a wireless communication network. This thesis involved investigating previous teleoperation applications and conducted similar experiments to test and evaluate the designed application for functional activity and measure performance on a mobile device which have been identified and achieved. The implemented solution offered good results for navigation purposes particularly for teleoperating a visible robot and suggests solutions for exploration when no environment map for the operator is present.

Learning Robot Environment through Simulation

Traditionally simulators have been used extensively in robotics to develop robotic systems without the need to build expensive hardware. However, simulators can be also be used as a “memory”for a robot. This allows the robot to try out actions in simulation before executing them for real. The key obstacle to this approach is an uncertainty of knowledge about the environment. The goal of the Master’s Thesis work was to develop a method, which allows updating the simulation model based on actual measurements to achieve a success of the planned task. OpenRAVE was chosen as an experimental simulation environment on planning,trial and update stages. Steepest Descent algorithm in conjunction with Golden Section search procedure form the principle part of optimization process. During experiments, the properties of the proposed method, such as sensitivity to different parameters, including gradient and error function, were examined. The limitations of the approach were established, based on analyzing the regions of convergence.

Design and implementation of robot gripper interface

This thesis presents a design for an asynchronous interface to Robotiq adaptive gripper s-model. Designed interface is a communication layer that works on top of modbus layer. The design contains function definitions, finite state machine and exceptions. The design was not fully implemented but enough was so that it can be used. The implementation was done with c++ in linux environment. Additionally to the implementation a simple demo program was made to show the interface is used. Also grippers closing speed and force were measured. There is also a brief introduction into robotics and robot grasping.

Flexible multibody dynamics and intelligent control of a hydraulically driven hybrid redundant robot machine

The assembly and maintenance of the International Thermonuclear Experimental Reactor (ITER) vacuum vessel (VV) is highly challenging since the tasks performed by the robot involve welding, material handling, and machine cutting from inside the VV. The VV is made of stainless steel, which has poor machinability and tends to work harden very rapidly, and all the machining operations need to be carried out from inside of the ITER VV. A general industrial robot cannot be used due to its poor stiffness in the heavy duty machining process, and this will cause many problems, such as poor surface quality, tool damage, low accuracy. Therefore, one of the most suitable options should be a light weight mobile robot which is able to move around inside of the VV and perform different machining tasks by replacing different cutting tools. Reducing the mass of the robot manipulators offers many advantages: reduced material costs, reduced power consumption, the possibility of using smaller actuators, and a higher payload-to-robot weight ratio. Offsetting these advantages, the lighter weight robot is more flexible, which makes it more difficult to control. To achieve good machining surface quality, the tracking of the end effector must be accurate, and an accurate model for a more flexible robot must be constructed. This thesis studies the dynamics and control of a 10 degree-of-freedom (DOF) redundant hybrid robot (4-DOF serial mechanism and 6-DOF 6-UPS hexapod parallel mechanisms) hydraulically driven with flexible rods under the influence of machining forces. Firstly, the flexibility of the bodies is described using the floating frame of reference method (FFRF). A finite element model (FEM) provided the Craig-Bampton (CB) modes needed for the FFRF. A dynamic model of the system of six closed loop mechanisms was assembled using the constrained Lagrange equations and the Lagrange multiplier method. Subsequently, the reaction forces between the parallel and serial parts were used to study the dynamics of the serial robot. A PID control based on position predictions was implemented independently to control the hydraulic cylinders of the robot. Secondly, in machining, to achieve greater end effector trajectory tracking accuracy for surface quality, a robust control of the actuators for the flexible link has to be deduced. This thesis investigates the intelligent control of a hydraulically driven parallel robot part based on the dynamic model and two schemes of intelligent control for a hydraulically driven parallel mechanism based on the dynamic model: (1) a fuzzy-PID self-tuning controller composed of the conventional PID control and with fuzzy logic, and (2) adaptive neuro-fuzzy inference system-PID (ANFIS-PID) self-tuning of the gains of the PID controller, which are implemented independently to control each hydraulic cylinder of the parallel mechanism based on rod length predictions. The serial component of the hybrid robot can be analyzed using the equilibrium of reaction forces at the universal joint connections of the hexa-element. To achieve precise positional control of the end effector for maximum precision machining, the hydraulic cylinder should be controlled to hold the hexa-element. Thirdly, a finite element approach of multibody systems using the Special Euclidean group SE(3) framework is presented for a parallel mechanism with flexible piston rods under the influence of machining forces. The flexibility of the bodies is described using the nonlinear interpolation method with an exponential map. The equations of motion take the form of a differential algebraic equation on a Lie group, which is solved using a Lie group time integration scheme. The method relies on the local description of motions, so that it provides a singularity-free formulation, and no parameterization of the nodal variables needs to be introduced. The flexible slider constraint is formulated using a Lie group and used for modeling a flexible rod sliding inside a cylinder. The dynamic model of the system of six closed loop mechanisms was assembled using Hamilton’s principle and the Lagrange multiplier method. A linearized hydraulic control system based on rod length predictions was implemented independently to control the hydraulic cylinders. Consequently, the results of the simulations demonstrating the behavior of the robot machine are presented for each case study. In conclusion, this thesis studies the dynamic analysis of a special hybrid (serialparallel) robot for the above-mentioned special task involving the ITER and investigates different control algorithms that can significantly improve machining performance. These analyses and results provide valuable insight into the design and control of the parallel robot with flexible rods.

Energy and Dynamics of the solar agricultural robot "SolarSprayer"

The main objective of the present study was to design an agricultural robot, which work is based on the generation of the electricity by the solar panel. To achieve the proper operation of the robot according to the assumed working cycle the detailed design of the main equipment was made. By analysing the possible areas of implementation together with developments, the economic forecast was held. As a result a decision about possibility of such device working in agricultural sector was made and the probable topics of the further study were found out.

Development of a Control System for a Tele Operated Mobile Robot

Mobile robots are capable of performing spatial displacement motions in different environments. This motions can be calculated based on sensorial data (autonomous robot) or given by an operator (tele operated robot). This thesis is focused on the latter providing the control architecture which bridges the tele operator and the robot’s locomotion system and end effectors. Such a task might prove overwhelming in cases where the robot comprises a wide variety of sensors and actuators hence a relatively new option was selected: Robot Operating System (ROS). The control system of a new robot will be sketched and tested in a simulation model using ROS together with Gazebo in order to determine the viability of such a system. The simulated model will be based on the projected shape and main features of the real machine. A stability analysis will be performed first theoretically and afterwards using the developed model. This thesis concluded that both the physical properties and the control architecture are feasible and stable settling up the ground for further work with the same robot.

Quadcopter assistant for a mobile assembly robot

Science has revolutionized the human life. The advance progress in science and research is making human life easier and more comfortable. The new and emerging technology of micro drone is penetrating and widening the scientific research. This thesis is a part of work in which a unique work is carried out, although related research paper and journal are available. Design and development of automatic charging station for a ready to fly quadcopter is rare and unusual work. The work is carried out as an standard engineering process that include requirements gathering, creating the required document (this thesis is a part of required document as well), selection of suitable hardware, configuring the hardware, generate the code for software, uploading code to the microcontroller, troubleshooting and rectification, finalized prototype and testing. Thesis describe how mechatronics engineering is useful in generating a customized and unique project. At the starting phase of this project (before purchasing a ready to fly quadcopter) every single aspect of this work was known. The only unknown alternatives was a battery and charger. Several task was achieved including design and development of automatic charging station, accurate landing and telecast a live video on additional screen. At starting it was decided that quadcopter should follow the mobile robot, during study it was concluded there is no such quadcopter available in market to auto follow a robot indoor. This works starts with a market survey and comparing the different brands of quadcopter that meets all the requirements and specifications of the mobile robot assembly. Selection of quadcopter is a result of discussion and meeting with the team members, supervisor, professor and project manage.

Design of traction transmission and suspension systems for an omni-directional mobile robot

This project aims to design and manufacture a mobile robot with two Universal Robot UR10 mainly used indoors. In order to obtain omni-directional maneuverability, the mobile robot is constructed with Mecanum wheels. The Mecanum wheel can move in any direction with a series of rollers attached to itself. These rollers are angled at 45º about the hub’s circumference. This type of wheels can be used in both driving and steering with their any-direction property. This paper is focused on the design of traction system and suspension system, and the velocity control of Mecanum wheels in the close-loop control system. The mechanical design includes selection of bearing housing, couplers which are act as connection between shafts, motor parts, and other needed components. The 3D design software SolidWorks is utilized to assemble all the components in order to get correct tolerance. The driving shaft is designed based on assembled structure via the software as well. The design of suspension system is to compensate the assembly error of Mecanum wheels to guarantee the stability of the robot. The control system of motor drivers is realized through the Robot Operating System (ROS) on Ubuntu Linux. The purpose of inverse kinematics is to obtain the relationship among the movements of all Mecanum wheels. Via programming and interacting with the computer, the robot could move with required speed and direction.

Control of a line robot system with Embedded Linux

Many, if not all, aspects of our everyday lives are related to computers and control. Microprocessors and wireless communications are involved in our lives. Embedded systems are an attracting field because they combine three key factors, small size, low power consumption and high computing capabilities. The aim of this thesis is to study how Linux communicates with the hardware, to answer the question if it is possible to use an operating system like Debian for embedded systems and finally, to build a Mechatronic real time application. In the thesis a presentation of Linux and the Xenomai real time patch is given, the bootloader and communication with the hardware is analyzed. BeagleBone the evaluation board is presented along with the application project consisted of a robot cart with a driver circuit, a line sensor reading a black line and two Xbee antennas. It makes use of Xenomai threads, the real time kernel. According to the obtained results, Linux is able to operate as a real time operating system. The issue of future research is the area of embedded Linux is also discussed.

Design and implementation of machine vision system for the mobile assembly robot

The review of intelligent machines shows that the demand for new ways of helping people in perception of the real world is becoming higher and higher every year. This thesis provides information about design and implementation of machine vision for mobile assembly robot. The work has been done as a part of LUT project in Laboratory of Intelligent Machines. The aim of this work is to create a working vision system. The qualitative and quantitative research were done to complete this task. In the first part, the author presents the theoretical background of such things as digital camera work principles, wireless transmission basics, creation of live stream, methods used for pattern recognition. Formulas, dependencies and previous research related to the topic are shown. In the second part, the equipment used for the project is described. There is information about the brands, models, capabilities and also requirements needed for implementation. Although, the author gives a description of LabVIEW software, its add-ons and OpenCV which are used in the project. Furthermore, one can find results in further section of considered thesis. They mainly represented by screenshots from cameras, working station and photos of the system. The key result of this thesis is vision system created for the needs of mobile assembly robot. Therefore, it is possible to see graphically what was done on examples. Future research in this field includes optimization of the pattern recognition algorithm. This will give less response time for recognizing objects. Presented by author system can be used also for further activities which include artificial intelligence usage.

Kaukokäyttöliittymä liikkuvalle robotille

Lappeenrannan teknillinen yliopiston Tietotekniikan osaston Tietojenkäsittelytieteen laitoksen tutkimuskäytössä olevaan liikkuvaan robottiin toteutettiin tässä työssä graafinen kaukokäyttöliittymä. Työlle on motivaationa laajennettavuus, jota olemassaoleva suljetun lähdekoodin käyttöliittymä ei pysty tarjoamaan. Työssä olennaisin on olio-ohjelmointitekniikalla toteutettu robotin datamallin, ja sen graafisen esityksen arkkitehtuurillinen erottaminen. Lisäksi tarkastellaan lyhyesti liikkuvien robottien kaukokäyttöliittymien teoriaa, ja WLAN-tekniikan soveltuvuutta robotin ja käyttöliittymän välisen yhteyden toteuttamiseen.

Metsäkonetuotannon hitsauksen robotisointi

Diplomityön tavoitteena oli selvittää robottihitsauksen antamat mahdollisuudet metsäkoneen runkorakenteiden hitsauksessa. Työn teoriaosassa selvitettiin kaarihitsauksen automatisointia ja sen tuomia etuja manuaaliseen hitsaukseen verrattuna. Työssä käytiin läpi kaarihitsauksen automatisointiinsoveltuvat robottivaihtoehdot, nykyaikaisen robotin hitsausvarustus, sekä kappaleenkäsittelylaitteet ja robotisoidun käytön turvallisuus. Hitsauksen robotisointiin soveltuvat eri hitsausmenetelmät ja perinteisten menetelmien tehostamiskeinot käytiin lävitse teoriaosuudessa. Hitsaustuotannon laatuun vaikuttavia asioitaja robottihitsattavan kappaleen suunnittelun huomioonottamista tuotesuunnittelussa tarkasteltiin myös työn teoriaosuudessa. Käytännön osiossa tarkasteltiin robotilla hitsattavat tuotteet ja tehtiin niille luoksepäästävyystarkasteluja. Laadittiin vaatimusluettelo tarvittavalle hitsausrobottilaitteistolle ja mallinnettiin erilaisia vaihtoehtoisia ratkaisuja hitsausrobottiympäristöstä kaarihitsauksen graafista simulointiohjelmaa käyttäen. Vertailtiin eri laitetoimittajilta saatuja 'avaimet käteen'- periaatteella tarjottuja ratkaisuja janiiden vastaavuutta laadittuun vaatimusluetteloon sekä eri laiteratkaisujen keskinäistä paremmuutta kyseiseen tapaukseen. Päätuotteille määritettiin hitsausajat ja selvitettiin laitteiston hitsauskapasiteettia. Investoinnin taloudellista kannattavuutta tarkasteltiin eri laskentamenetelmien avulla. Lopuksi arvioitiin hitsaustuotannon jatkokehitystarpeita tulevaisuutta ajatellen.

Design of adjustable packaging line

Diplomityön tavoite oli tutkia, mitä toimintoja ja tekniikoita uusi, joustava kartonkipakkauslinja sisältää ja mitkä suuntaukset pakkausteollisuudessa tulevat olemaan tärkeitä tulevaisuudessa. Pakkauslinjan päätoimintoja tarkasteltiin nykyisten jatulevaisuuden tekniikoiden pohjalta. Erityisesti tarkasteltiin laser-sovellusten käytön mahdollisuutta pakkauslinjan eri osatoiminnoissa. Katsaus pakkausteollisuuden tulevaisuuden näkymiin luotiin kirjallisuuden ja aikaisempien tutkimusten pohjalta, minkä perusteella työssä oletetaan, että yksilölliset ja monitoimipakkaukset tulevat lisääntymään tulevaisuudessa. Eri tuotantoerien välillä olevat asetusajat tulee saada minimoitua, mutta millä keinoin joustavuus on saavutettavissa? Yksi ratkaisu pakkausten valmistamisessa on käyttää robottisolua, mikä on mahdollista luultavasti ainakin kuppimuotoisten pakkausten kohdalla. Muutenkin robotiikka on lisääntymässä pakkausteollisuudessa. Digitaalisten painotekniikoiden kehitys on mahdollistanut yksilölliset painatukset. Tulevaisuudessa painatus on mahdollista tehdä pakkauslinjan loppupäässä, jopa vasta täytön ja suljennan jälkeen. Laserleikkaus on jo nyt käytössä, mutta tulevaisuudessa myös saumaus ja perinteinen nuuttaus on mahdollista tehdä lasersovelluksia käyttäen. Kehittynyt, väyläpohjainen ohjausjärjestelmä on tulevaisuudessa välttämätön joustavassa pakkauslinjassa. Internetin välityksellä toimiva etäohjattu virheenkorjausdiagnostiikka tulee myös olemaan itsestäänselvyys tulevaisuudessa. Kustannussäästöjä voidaan saavuttaa käyttämälläpakkauslinjassa modulaarista rakennetta. Standardiosien ja standardiosajärjestelmien käyttäminen pienentää myös käyttö- ja huoltokustannuksia. Tärkeää on kuitenkin muistaa, ettei joustavuutta voida saavuttaa pelkästään yhtä ominaisuutta tai tekniikkaa hyödyntäen vaan monia menetelmiä yhdistäen. Suunniteltavan pakkauslinjan toiminta on myös hyvä varmistaa käyttäen apuna mallinnusta ja simulointia.

Hitsaussuojakaasujen tehokas ja taloudellinen käyttö

Suojakaasun päätehtävänä on suojata hitsaustapahtumaa ympäröivän ilman vaikutukselta. Päätehtävän lisäksi suojakaasullavoidaan vaikuttaa suoraan tai välillisesti lähes kaikkiin hitsauksen asioihin, joista laatu, tehokkuus ja taloudellisuus muodostuvat. Suojakaasuja tarvitsevat hitsausmenetelmät ovat: kaasukaarihitsausprosessit (MIG/MAG-, TIG- ja plasmahitsaus), laserhitsaus sekä näiden yhdistelmät eli hybridihitsausmenetelmät sekä MIG-juotto. Hitsaussuojakaasujen peruskaasu tänä päivänä on argon, johon hitsausprosessista tai materiaalistariippuen sekoitetaan hiilidioksidia, heliumia, vetyä tai happea. Pääsääntöisesti hitsaussuojakaasut ovat kahden komponentin kaasuja, mutta 3-komponenttikaasut ovat yleistymässä. Sopivalla suojakaasuseostuksella saadaan erittäin merkittävä hyöty tuottavuuden lisääntyessä ja laadun parantuessa. Suojakaasujen oikealla toimitusmuodolla on merkittävä vaikutus kokonaiskustannuksiin. Uudet, kehittyneet sekoitinlaitteet mahdollistavat tarkat osakomponenttien sekoittamiset hitsauspaikalla. Seokset ovat jatkuvasti analysoitavissa ja jäljitettävissä. Suojakaasujen kierrätys on erityisesti kalliiden kaasujen, kuten helium ja argon, kohdalta tulevaisuuden haaste ja mahdollisuus. Suojakaasulla on suuri merkitys hitsauksen tuottavuuteen, taloudellisuuteen ja myös hitsausympäristöön ja työturvallisuuteen. Robottihitsauksen lisääntyminen asettaa vaatimuksia, joihinoikein valitulla suojakaasulla voidaan myönteisesti vaikuttaa. Tehokashitsaus on valmistusprosessin tärkeä osa, jossa oikein valituilla suojakaasuilla saavutetaan merkittävä tuottavuuden lisäys vaikuttamalla kaariominaisuuksiin, tunkeumaan, roiskeisiin, nopeuteen, hitsimetallurgiaan, lämmöntuontiin ja hitsausympäristöön. Diplomityössä tutkittiin casena Peikko Finland Oy:n suojakaasujärjestelmät, niiden tehokkuus, toimivuus ja sopivuus konepajan tuotantoon ja erityisesti robottihitsaukseen.