Coloured Petri nets and graphical simulation for the validation of a robotic cell in aircraft industry

This paper proposes a mixed validation approach based on coloured Petri nets and 3D graphic simulation for the design of supervisory systems in manufacturing cells with multiple robots. The coloured Petri net is used to model the cell behaviour at a high level of abstraction. It models the activities of each cell component and its coordination by a supervisory system. The graphical simulation is used to analyse and validate the cell behaviour in a 3D environment, allowing the detection of collisions and the calculation of process times. The motivation for this work comes from the aeronautic industry. The automation of a fuselage assembly process requires the integration of robots with other cell components such as metrological or vision systems. In this cell, the robot trajectories are defined by the supervisory system and results from the coordination of the cell components. The paper presents the application of the approach for an aircraft assembly cell under integration in Brazil. This case study shows the feasibility of the approach and supports the discussion of its main advantages and limits. (C) 2011 Elsevier Ltd. All rights reserved.

Optimal location of the workpiece in a PKM-based machining robotic cell

Most machining tasks require high accuracy and are carried out by dedicated machine-tools. On the other hand, traditional robots are flexible and easy to program, but they are rather inaccurate for certain tasks. Parallel kinematic robots could combine the accuracy and flexibility that are usually needed in machining operations. Achieving this goal requires proper design of the parallel robot. In this chapter, a multi-objective particle swarm optimization algorithm is used to optimize the structure of a parallel robot according to specific criteria. Afterwards, for a chosen optimal structure, the best location of the workpiece with respect to the robot, in a machining robotic cell, is analyzed based on the power consumed by the manipulator during the machining process.

An ontology-based representation of an agent-based controlled robotic cell

Dissertação apresentada na Faculdade de Ciência e Tecnologia da Universidade Nova de Lisboa para a obtenção do grau de Mestre em Engenharia Electrotécnica e de Computadores

Robotisoidun hitsaussolun toiminnan kehittäminen ohutlevytuotteita valmistavassa yrityksessä

Robotisoitu hitsaus tarjoaa mahdollisuuden tasaiseen laatuun ja miehittämättömään tuotantoon. Se ei ole kuitenkaan yhtä joustava menetelmä kuin käsinhitsaus ja siihen liittyy yleensä paljon asetus- ja ohjelmointikustannuksia. Tässä diplomityössä selvitetään, mitkä ovat robotisoidun ohutlevyjen hitsauksen erityispiirteet ja mitä seikkoja tulee huomioida robotisoidun hitsaussolun kehittämisessä. Ohutlevytuotteiden tulee soveltua robotisoituun hitsaukseen. Ne ovat ohuita ja taipuisia kappaleita, joten liitosten tarkka kohdistaminen voi olla vaikeaa. Tämä edellyttää suunnittelulta menetelmän erityispiirteiden ymmärtämistä ja valmistukselta erinomaista laaduntuottokykyä. Materiaaleina ohutlevyt ovat pääosin hyvin hitsattavia kaikilla tavanomaisilla menetelmillä.Haitallisten muodonmuutosten välttämiseksi kannattaa suosia hitsausprosesseja, joilla on mahdollisimman pieni lämmöntuonti. Saavutettu hitsausnopeus riippuu prosessin lisäksi myös liitosten kokoonpanon tarkkuudesta. Työnkokeellisessa osassa selvitetään erään robottihitsaussolun kehitystyötä. Tavoitteena oli nostaa solun nopeus ja kapasiteetti vastaamaan yrityksen muun tuotannon tasoa. Solua varten kehitettiin erityinen automaattisesti toimiva hitsauskiinnitin, jonka toimintaperiaate esitellään. Kiinnitin kohdistaaohutlevystä valmistetun kotelon pohjan sivut riittävän tarkasti, jotta ne voidaan hitsata robotilla.

Joustavan robotisoidun särmäyssolun käyttöönotto levytuotetahtaalla

Diplomityön ensimmäisenä tavoitteena on selvittää robotisoidun särmäyssolun tehokkaimmat käyttöalueet särmättävien kappaleiden muotojen ja laitteiston teknisten edellytysten perusteella. Toisena tavoitteena on tuoda esille robotisoidun särmäyssolun käyttöönottoon liittyviä ongelmia ja antaa käytännön ohjeita niiden ratkaisemiseksi. Tuloksia sovelletaan jatkossa kohdeyrityksen markkinoiman särmäyssolun tuotekehitykseen. Särmäyksen automatisoinnin pääpiirteitä tarkastellaan tutkimalla markkinoilla olevien robottisolujen toimintaperiaatteita ja ohjelmointitapoja. Työssä on myös esitetty kohdeyrityksen omat tavoitteet ja lähtökohdat särmäysmenetelmien kehittämiseen, joista tärkeimmät ovat integroitavuus joustavaan valmistusjärjestelmään ja solun kehittäminen myyntiartikkeliksi. Työssä esitellään robotisoidun särmäyssolun toimintaa kuvaamalla työkierron toiminnot pääpiirteissään. Samassa yhteydessä esitellään myös solun konekanta sekä koneiden välillä tapahtuva tiedon siirto. Erityisenä mielenkiinnon kohteena ovat olleet joustavan valmistusjärjestelmän soluohjaimen toiminnot ja särmäyssolun toimivuus FMS:n osana. Analyyttisessä osuudessa tutkitaan kappaleiden särmättävyyttä robotisoidussa tuotantoratkaisussa. Lähtökohdaksi on otettu särmäyspuristimen, robotin, lisälaitteiden ja kappaleen muotojen asettamat rajoitukset sekä toisaalta robotisoinnin tuomat uudet mahdollisuudet. Tulosten perusteella robotisointi soveltuu parhaiten painaville tai monimutkaisille kappaleille, joiden manuaalisärmäys vie paljon aikaa. Taloudellisia käyttöalueita kartoitettiin tutkimalla eräkokoon, ohjelmointiajan, kappaleajan ja särmien määrän vaikutusta valmistuskustannuksiin. Robotisoinnin on todettu kannattavan yrityksissä, joissa sarjat ovat usein toistuvia ja eräkoot yli 150 kappaleen suuruisia. Kappaleen muoto ja särmien määrä vaikuttaa monin tavoin kappaleaikaan ja siten myös valmistuskustannuksiin. Robotisoinnin kannattavuutta on näissä tapauksissa arvioitava aina tapauskohtaisesti työkierron vaatimien toimintojen perusteella.

Machine vision and planning applied on assembby line of multiple products

This article describes the use of Artificial Intelligence (IA) techniques applied in cells of a manufacturing system. Machine Vision was used to identify pieces and their positions of two different products to be assembled in the same productive line. This information is given as input for an IA planner embedded in the manufacturing system. Therefore, initial and final states are sent automatically to the planner capable to generate assembly plans for a robotic cell, in real time.

Visual Tracking, Pose Estimation, and Control for Aerial Vehicles

El principal objetivo de esta tesis es dotar a los vehículos aéreos no tripulados (UAVs, por sus siglas en inglés) de una fuente de información adicional basada en visión. Esta fuente de información proviene de cámaras ubicadas a bordo de los vehículos o en el suelo. Con ella se busca que los UAVs realicen tareas de aterrizaje o inspección guiados por visión, especialmente en aquellas situaciones en las que no haya disponibilidad de estimar la posición del vehículo con base en GPS, cuando las estimaciones de GPS no tengan la suficiente precisión requerida por las tareas a realizar, o cuando restricciones de carga de pago impidan añadir sensores a bordo de los vehículos. Esta tesis trata con tres de las principales áreas de la visión por computador: seguimiento visual y estimación visual de la pose (posición y orientación), que a su vez constituyen la base de la tercera, denominada control servo visual, que en nuestra aplicación se enfoca en el empleo de información visual para controlar los UAVs. Al respecto, esta tesis se ocupa de presentar propuestas novedosas que permitan solucionar problemas relativos al seguimiento de objetos mediante cámaras ubicadas a bordo de los UAVs, se ocupa de la estimación de la pose de los UAVs basada en información visual obtenida por cámaras ubicadas en el suelo o a bordo, y también se ocupa de la aplicación de las técnicas propuestas para solucionar diferentes problemas, como aquellos concernientes al seguimiento visual para tareas de reabastecimiento autónomo en vuelo o al aterrizaje basado en visión, entre otros. Las diversas técnicas de visión por computador presentadas en esta tesis se proponen con el fin de solucionar dificultades que suelen presentarse cuando se realizan tareas basadas en visión con UAVs, como las relativas a la obtención, en tiempo real, de estimaciones robustas, o como problemas generados por vibraciones. Los algoritmos propuestos en esta tesis han sido probados con información de imágenes reales obtenidas realizando pruebas on-line y off-line. Diversos mecanismos de evaluación han sido empleados con el propósito de analizar el desempeño de los algoritmos propuestos, entre los que se incluyen datos simulados, imágenes de vuelos reales, estimaciones precisas de posición empleando el sistema VICON y comparaciones con algoritmos del estado del arte. Los resultados obtenidos indican que los algoritmos de visión por computador propuestos tienen un desempeño que es comparable e incluso mejor al de algoritmos que se encuentran en el estado del arte. Los algoritmos propuestos permiten la obtención de estimaciones robustas en tiempo real, lo cual permite su uso en tareas de control visual. El desempeño de estos algoritmos es apropiado para las exigencias de las distintas aplicaciones examinadas: reabastecimiento autónomo en vuelo, aterrizaje y estimación del estado del UAV. Abstract The main objective of this thesis is to provide Unmanned Aerial Vehicles (UAVs) with an additional vision-based source of information extracted by cameras located either on-board or on the ground, in order to allow UAVs to develop visually guided tasks, such as landing or inspection, especially in situations where GPS information is not available, where GPS-based position estimation is not accurate enough for the task to develop, or where payload restrictions do not allow the incorporation of additional sensors on-board. This thesis covers three of the main computer vision areas: visual tracking and visual pose estimation, which are the bases the third one called visual servoing, which, in this work, focuses on using visual information to control UAVs. In this sense, the thesis focuses on presenting novel solutions for solving the tracking problem of objects when using cameras on-board UAVs, on estimating the pose of the UAVs based on the visual information collected by cameras located either on the ground or on-board, and also focuses on applying these proposed techniques for solving different problems, such as visual tracking for aerial refuelling or vision-based landing, among others. The different computer vision techniques presented in this thesis are proposed to solve some of the frequently problems found when addressing vision-based tasks in UAVs, such as obtaining robust vision-based estimations at real-time frame rates, and problems caused by vibrations, or 3D motion. All the proposed algorithms have been tested with real-image data in on-line and off-line tests. Different evaluation mechanisms have been used to analyze the performance of the proposed algorithms, such as simulated data, images from real-flight tests, publicly available datasets, manually generated ground truth data, accurate position estimations using a VICON system and a robotic cell, and comparison with state of the art algorithms. Results show that the proposed computer vision algorithms obtain performances that are comparable to, or even better than, state of the art algorithms, obtaining robust estimations at real-time frame rates. This proves that the proposed techniques are fast enough for vision-based control tasks. Therefore, the performance of the proposed vision algorithms has shown to be of a standard appropriate to the different explored applications: aerial refuelling and landing, and state estimation. It is noteworthy that they have low computational overheads for vision systems.

The Application of a Dendric Cell Algorithm to a Robotic Classifier

The dendritic cell algorithm is an immune-inspired technique for processing time-dependant data. Here we propose it as a possible solution for a robotic classification problem. The dendritic cell algorithm is implemented on a real robot and an investigation is performed into the effects of varying the migration threshold median for the cell population. The algorithm performs well on a classification task with very little tuning. Ways of extending the implementation to allow it to be used as a classifier within the field of robotic security are suggested.

The Application of a Dendric Cell Algorithm to a Robotic Classifier

The dendritic cell algorithm is an immune-inspired technique for processing time-dependant data. Here we propose it as a possible solution for a robotic classification problem. The dendritic cell algorithm is implemented on a real robot and an investigation is performed into the effects of varying the migration threshold median for the cell population. The algorithm performs well on a classification task with very little tuning. Ways of extending the implementation to allow it to be used as a classifier within the field of robotic security are suggested.

The Application of a Dendric Cell Algorithm to a Robotic Classifier

The dendritic cell algorithm is an immune-inspired technique for processing time-dependant data. Here we propose it as a possible solution for a robotic classification problem. The dendritic cell algorithm is implemented on a real robot and an investigation is performed into the effects of varying the migration threshold median for the cell population. The algorithm performs well on a classification task with very little tuning. Ways of extending the implementation to allow it to be used as a classifier within the field of robotic security are suggested.

Robotic Approach in the Treatment of Locally Advanced (Stage IIIA-pN2) non Small Cell Lung Cancer after Induction Therapy

Introduction: Despite there are already many studies on robotic surgery as minimally invasive approach for non-small cell lung cancer (NSCLC) patients, the use of this technique for stage III disease is still poorly described. These are the preliminary results of our prospective study on safety and effectiveness of robotic approach in patients with locally advanced NSCLC, in terms of postoperative complications and oncological outcome. Methods: Since 2016, we prospectively investigated, using standardized questionnaire and protocol, 21 consecutive patients with NSCLC stage IIIA-pN2 (diagnosed by EBUS-TBNA) who underwent lobectomy and radical lymph node dissection with robotic approach after induction treatment. Then, we performed a matched case-control study with 54 patients treated with open surgery during the same period of time, with similar age, clinical and pathological tumor stage. Results: The individual matched population was composed of 14 robot-assisted thoracic surgery and 14 patients who underwent open surgery. The median time range of resection was inferior in the open group compared to robotic lobectomy (148 vs 229 minutes; P=0.002). Lymph nodes resection and positivity were not statistically significantly different (p=0.66 and p=0.73 respectively). No difference was observed also for PFS (P=0.99) or OS (P=0.94). Conclusions: Our preliminary results demonstrated that the early outcomes and oncological results of N2-patients after robotic lobectomy were similar to open surgery. Considering the advantages of minimally invasive surgery, robotic assisted lobectomy should be a safe approach also to patients with local advanced disease.

A cell spot microarray method for high-throughput biology

High-throughput screening of cellular effects of RNA interference (RNAi) libraries is now being increasingly applied to explore the role of genes in specific cell biological processes and disease states. However, the technology is still limited to specialty laboratories, due to the requirements for robotic infrastructure, access to expensive reagent libraries, expertise in high-throughput screening assay development, standardization, data analysis and applications. In the future, alternative screening platforms will be required to expand functional large-scale experiments to include more RNAi constructs, allow combinatorial loss-of-function analyses (e.g. genegene or gene-drug interaction), gain-of-function screens, multi-parametric phenotypic readouts or comparative analysis of many different cell types. Such comprehensive perturbation of gene networks in cells will require a major increase in the flexibility of the screening platforms, throughput and reduction of costs. As an alternative for the conventional multi-well based high-throughput screening -platforms, here the development of a novel cell spot microarray method for production of high density siRNA reverse transfection arrays is described. The cell spot microarray platform is distinguished from the majority of other transfection cell microarray techniques by the spatially confined array layout that allow highly parallel screening of large-scale RNAi reagent libraries with assays otherwise difficult or not applicable to high-throughput screening. This study depicts the development of the cell spot microarray method along with biological application examples of high-content immunofluorescence and phenotype based cancer cell biological analyses focusing on the regulation of prostate cancer cell growth, maintenance of genomic integrity in breast cancer cells, and functional analysis of integrin protein-protein interactions in situ.

Robotic multiwell planar patch-clamp for native and primary mammalian cells

Robotic multiwell planar patch-clamp has become common in drug development and safety programs because it enables efficient and systematic testing of compounds against ion channels during voltage-clamp. It has not, however, been adopted significantly in other important areas of ion channel research, where conventional patch-clamp remains the favored method. Here, we show the wider potential of the multiwell approach with the ability for efficient intracellular solution exchange, describing protocols and success rates for recording from a range of native and primary mammalian cells derived from blood vessels, arthritic joints and the immune and central nervous systems. The protocol involves preparing a suspension of single cells to be dispensed robotically into 4-8 microfluidic chambers each containing a glass chip with a small aperture. Under automated control, giga-seals and whole-cell access are achieved followed by preprogrammed routines of voltage paradigms and fast extracellular or intracellular solution exchange. Recording from 48 chambers usually takes 1-6 h depending on the experimental design and yields 16-33 cell recordings.

Minimally Invasive Selective Neck Dissection: A Prospective Study of Endoscopically Assisted Dissection via a Small Submandibular Approach in cT(1-2)N(0) Oral Squamous Cell Carcinoma

Selective neck dissection (SND) in clinical N-0 (cN(0)) cases of oral squamous cell carcinoma (SCC) has been performed by surgeons using a retroauricular or modified facelift approach with robotic or endoscopic assistance. However, these procedures provide cosmetic satisfaction at the cost of possible maximal invasiveness. In this prospective study, we introduced and evaluated the feasibility as well as surgical invasiveness and cosmetic outcome of endoscopically-assisted SND via a small submandibular approach.Forty-four patients with cT(1-2)N(0) oral SCC (OSCC) were randomly divided into two groups of endoscopically-assisted SND and conventional SND. Perioperative and postoperative outcomes of patients were evaluated, including the length of the incision, operating time for neck dissection, estimated blood loss during the operation, amount and duration of drainage, total hospitalization period, total number of lymph nodes retrieved, satisfaction scores based on the cosmetic results, perioperative local complications, shoulder syndrome, and follow-up information.The mean operation time in the endoscopically-assisted group (126.04 +/- A 12.67 min) was longer than that in the conventional group (75.67 +/- A 16.67 min). However, the mean length of the incision was 4.33 +/- A 0.76 cm in the endoscopically-assisted SND group, and the amount and duration of drainage, total hospital stay, postoperative shoulder pain score, and cosmetic outcomes were superior in the endoscopically-assisted SND group. Additionally, the retrieved lymph nodes and complications were comparable.Endoscopically-assisted SND via a small submandibular approach had a longer operation time than the conventional approach. However, endoscopically-assisted SND was feasible and reliable while providing minimal invasiveness and satisfactory appearance.