Computational Foundations for Safe and Efficient Human-Robot Collaboration in Assembly Cells

Human and robots have complementary strengths in performing assembly operations. Humans are very good at perception tasks in unstructured environments. They are able to recognize and locate a part from a box of miscellaneous parts. They are also very good at complex manipulation in tight spaces. The sensory characteristics of the humans, motor abilities, knowledge and skills give the humans the ability to react to unexpected situations and resolve problems quickly. In contrast, robots are very good at pick and place operations and highly repeatable in placement tasks. Robots can perform tasks at high speeds and still maintain precision in their operations. Robots can also operate for long periods of times. Robots are also very good at applying high forces and torques. Typically, robots are used in mass production. Small batch and custom production operations predominantly use manual labor. The high labor cost is making it difficult for small and medium manufacturers to remain cost competitive in high wage markets. These manufactures are mainly involved in small batch and custom production. They need to find a way to reduce the labor cost in assembly operations. Purely robotic cells will not be able to provide them the necessary flexibility. Creating hybrid cells where humans and robots can collaborate in close physical proximities is a potential solution. The underlying idea behind such cells is to decompose assembly operations into tasks such that humans and robots can collaborate by performing sub-tasks that are suitable for them. Realizing hybrid cells that enable effective human and robot collaboration is challenging. This dissertation addresses the following three computational issues involved in developing and utilizing hybrid assembly cells: - We should be able to automatically generate plans to operate hybrid assembly cells to ensure efficient cell operation. This requires generating feasible assembly sequences and instructions for robots and human operators, respectively. Automated planning poses the following two challenges. First, generating operation plans for complex assemblies is challenging. The complexity can come due to the combinatorial explosion caused by the size of the assembly or the complex paths needed to perform the assembly. Second, generating feasible plans requires accounting for robot and human motion constraints. The first objective of the dissertation is to develop the underlying computational foundations for automatically generating plans for the operation of hybrid cells. It addresses both assembly complexity and motion constraints issues. - The collaboration between humans and robots in the assembly cell will only be practical if human safety can be ensured during the assembly tasks that require collaboration between humans and robots. The second objective of the dissertation is to evaluate different options for real-time monitoring of the state of human operator with respect to the robot and develop strategies for taking appropriate measures to ensure human safety when the planned move by the robot may compromise the safety of the human operator. In order to be competitive in the market, the developed solution will have to include considerations about cost without significantly compromising quality. - In the envisioned hybrid cell, we will be relying on human operators to bring the part into the cell. If the human operator makes an error in selecting the part or fails to place it correctly, the robot will be unable to correctly perform the task assigned to it. If the error goes undetected, it can lead to a defective product and inefficiencies in the cell operation. The reason for human error can be either confusion due to poor quality instructions or human operator not paying adequate attention to the instructions. In order to ensure smooth and error-free operation of the cell, we will need to monitor the state of the assembly operations in the cell. The third objective of the dissertation is to identify and track parts in the cell and automatically generate instructions for taking corrective actions if a human operator deviates from the selected plan. Potential corrective actions may involve re-planning if it is possible to continue assembly from the current state. Corrective actions may also involve issuing warning and generating instructions to undo the current task.

A framework for abstraction and virtualization of sensors in mobile context-aware computing

110 p.

A piada e a narrativa conversacional de cariz humorístico : um breve estudo comparativo

O Humor é uma das bases da interação social humana e, por conseguinte, uma parte importante das relações que os indivíduos de uma sociedade estabelecem uns com os outros, utilizando-o com as mais variadas intenções. A presente dissertação tem como objetivo analisar nos dois subgéneros narrativos humorísticos - a Piada e a Narrativa Conversacional de Cariz Humorístico - as semelhanças e as diferenças na construção das suas estruturas, na utilização das estratégias interacionais usadas pelos interlocutores durante as interações, bem como alguns elementos avaliativos que traduzem as reações dos intervenientes perante as narrativas ouvidas. Na primeira parte, procedemos à referência das principais linhas teóricas que norteiam o tema do presente trabalho. Neste âmbito, referenciamos os quadros teóricos como o de Raskin (1985) e o de Morais (2010), tendo este último sido utilizado como ferramenta base nas nossas análises. Na segunda parte, analisámos Piadas e Narrativas Conversacionais de Cariz Humorístico, uns retirados do Corpus Morais (2010), outros de um Corpus por nós criado (Furtado (2014)). A partir desta análise constatou-se que (i) a estrutura tanto da Piada como da Narrativa Conversacional de Cariz Humorístico se constrói de forma muito semelhante; (ii) o Ataque na Narrativa Conversacional de Cariz Humorístico se assemelha em muito ao Ataque da Piada; (iii) que o modo como o locutor constrói a Orientação e a Ação na Piada é, de um modo geral, fixo; (iv) que ambos os géneros narrativos contêm formas de qualificação dos enunciados muito semelhantes; (v) que o trigger das Piadas opõe sempre duas ideias distintas, conforme o preconizado por Raskin; (vi) que tanto nas Piadas como nas Narrativas Conversacionais de Cariz Humorístico os interlocutores necessitam de partilhar os mesmos conhecimentos prévios para que o objetivo final do locutor seja alcançado, isto é, o riso.

Comparative study of human age estimation based on hand-crafted and deep face features

In the past few years, human facial age estimation has drawn a lot of attention in the computer vision and pattern recognition communities because of its important applications in age-based image retrieval, security control and surveillance, biomet- rics, human-computer interaction (HCI) and social robotics. In connection with these investigations, estimating the age of a person from the numerical analysis of his/her face image is a relatively new topic. Also, in problems such as Image Classification the Deep Neural Networks have given the best results in some areas including age estimation. In this work we use three hand-crafted features as well as five deep features that can be obtained from pre-trained deep convolutional neural networks. We do a comparative study of the obtained age estimation results with these features.

ADVANCED COMPUTATIONAL MODELING OF THE INTERNAL STRUCTURE OF SMART WIND-TURBINE BLADES

Implementation of stable aeroelastic models with the ability to capture the complex features of Multi concept smartblades is a prime step in reducing the uncertainties that come along with blade dynamics. The numerical simulations of fluid structure interaction can thus be used to test a realistic scenarios comprising of full-scale blades at a reasonably low computational cost. A code which was a combination of two advanced numerical models was designed and was run with the help of paralell HPC supercomputer platform. The first model was based on a variation of dimensional reduction technique proposed by Hodges and Yu. This model was the one to record the structural response of heterogenous composite blades. This technique reduces the geometrical complexities of the heterogenous blade section into a stiffness matrix for an equivalent beam. This derived equivalent 1-D strain energy matrix is similar to the actual 3-D strain energy matrix in an asymptotic sense. As this 1-D matrix helps in accurately modeling the blade structure as a 1-D finite element problem, this substantially redues the computational effort and subsequently the computational cost that are required to model the structural dynamics at each step. Second model comprises of implementation of the Blade Element Momentum Theory. In this approach we map all the velocities and the forces with the help of orthogonal matrices that help in capturing the large deformations and the effects of rotations in calculating the aerodynamic forces. This ultimately helps us to take into account the complex flexo torsional deformations. In this thesis we have succesfully tested these computayinal tools developed by MTU’s research team lead by for the aero elastic analysis of wind-turbine blades. The validation in this thesis is majorly based on several experiments done on NREL-5MW blade, as this is widely accepted as a benchmark blade in the wind industry. Along with the use of this innovative model the internal blade structure was also changed to add up to the existing benefits of the already advanced numerical models.

A NATURALISTIC COMPUTATIONAL MODEL OF HUMAN BEHAVIOR IN NAVIGATION AND SEARCH TASKS

Planning, navigation, and search are fundamental human cognitive abilities central to spatial problem solving in search and rescue, law enforcement, and military operations. Despite a wealth of literature concerning naturalistic spatial problem solving in animals, literature on naturalistic spatial problem solving in humans is comparatively lacking and generally conducted by separate camps among which there is little crosstalk. Addressing this deficiency will allow us to predict spatial decision making in operational environments, and understand the factors leading to those decisions. The present dissertation is comprised of two related efforts, (1) a set of empirical research studies intended to identify characteristics of planning, execution, and memory in naturalistic spatial problem solving tasks, and (2) a computational modeling effort to develop a model of naturalistic spatial problem solving. The results of the behavioral studies indicate that problem space hierarchical representations are linear in shape, and that human solutions are produced according to multiple optimization criteria. The Mixed Criteria Model presented in this dissertation accounts for global and local human performance in a traditional and naturalistic Traveling Salesman Problem. The results of the empirical and modeling efforts hold implications for basic and applied science in domains such as problem solving, operations research, human-computer interaction, and artificial intelligence.

User interaction monitoring and analysis framework

An overview is given of a user interaction monitoring and analysis framework called BaranC. Monitoring and analysing human-digital interaction is an essential part of developing a user model as the basis for investigating user experience. The primary human-digital interaction, such as on a laptop or smartphone, is best understood and modelled in the wider context of the user and their environment. The BaranC framework provides monitoring and analysis capabilities that not only records all user interaction with a digital device (e.g. smartphone), but also collects all available context data (such as from sensors in the digital device itself, a fitness band or a smart appliances). The data collected by BaranC is recorded as a User Digital Imprint (UDI) which is, in effect, the user model and provides the basis for data analysis. BaranC provides functionality that is useful for user experience studies, user interface design evaluation, and providing user assistance services. An important concern for personal data is privacy, and the framework gives the user full control over the monitoring, storing and sharing of their data.

Robotics and neurodevelopmental disorder: design and implementation of a system of engagement metrics in human-robot interactions.

In the recent decades, robotics has become firmly embedded in areas such as education, teaching, medicine, psychology and many others. We focus here on social robotics; social robots are designed to interact with people in a natural and interpersonal way, often to achieve positive results in different applications. To interact and cooperate with humans in their daily-life activities, robots should exhibit human-like intelligence. The rapid expansion of social robotics and the existence of various kinds of robots on the market have allowed research groups to carry out multiple experiments. The experiments carried out have led to the collections of various kinds of data, which can be used or processed for psychological studies, and studies in other fields. However, there are no tools available in which data can be stored, processed and shared with other research groups. This thesis proposes the design and implementation of visual tool for organizing dataflows in Human Robot Interaction (HRI).

Building a Open Source Framework for Virtual Medical Training

This paper presents a framework to build medical training applications by using virtual reality and a tool that helps the class instantiation of this framework. The main purpose is to make easier the building of virtual reality applications in the medical training area, considering systems to simulate biopsy exams and make available deformation, collision detection, and stereoscopy functionalities. The instantiation of the classes allows quick implementation of the tools for such a purpose, thus reducing errors and offering low cost due to the use of open source tools. Using the instantiation tool, the process of building applications is fast and easy. Therefore, computer programmers can obtain an initial application and adapt it to their needs. This tool allows the user to include, delete, and edit parameters in the functionalities chosen as well as storing these parameters for future use. In order to verify the efficiency of the framework, some case studies are presented.

The practice of Information Architecture of websites in Brazil

The project of Information Architecture is one of the initial stages of the project of a website, thus the detection and correction of errors in this stage are easier and time-saving than in the following stages. However, to minimize errors for the projects of information architecture, a methodology is necessary to organize the work of the professional and guarantee the final product quality. The profile of the professional who works with Information Architecture in Brazil has been analyzed (quantitative research by means of a questionnaire on-line) as well as the difficulties, techniques and methodologies found in his projects (qualitative research by means of interviews in depth with support of the approaches of the Sense-Making). One concludes that the methodologies of projects of information architecture need to develop the adoption of the approaches of Design Centered in the User and in the ways to evaluate its results.

Positioning of Deadeners for Vibration Reduction in Vehicle Roof Using Embedded Sensitivity

The noise, vibration and harshness (NVH) performance of passenger vehicles strongly depends on the fluid-structure interaction between the air in the vehicle cavity and the sheet metal structure of the vehicle. Most of the noise and vibration problems related to this interaction come from resonance peaks of the sheet metal, which are excited by external forces (road, engine, and wind). A reduction in these resonance peaks can be achieved by applying bitumen damping layers, also called deadeners, in the sheet metal. The problem is where these deadeners shall be fixed, which is usually done in a trial-and-error basis. In this work, one proposes the use of embedded sensitivity to locate the deadeners in the sheet metal of the vehicle, more specifically in the vehicle roof. Experimental frequency response functions (FRFs) of the roof are obtained and the data are processed by adopting the embedded sensitivity method, thus obtaining the sensitivity of the resonance peaks on the local increase in damping due to the deadeners. As a result, by examining the sensitivity functions, one can find the optimum location of the deadeners that maximize their effect in reducing the resonance peaks of interest. After locating the deadeners in the optimum positions, it was possible to verify a strong reduction in resonance peaks of the vehicle roof, thus showing the efficiency of the procedure. The main advantage of this procedure is that it only requires FRF measurements of the vehicle in its original state not needing any previous modification of the vehicle structure to find the sensitivity functions. [DOI: 10.1115/1.4000769]

Acoplamentos: um estudo sobre a intera????o entre humanos e computadores

Este estudo investiga a intera????o dos humanos com os computadores pessoais. A partir dos inc??modos produzidos por esses encontros, na primeira parte estuda-se a produ????o da m??quina ???amig??vel??? ??? que insinua compara????es com a mente humana ??? e seus fortes efeitos nas transforma????es culturais do final do s??culo XX. Na segunda parte do trabalho, a partir de entrevistas de trabalhadores falando sobre sua aprendizagem b??sica do uso de computadores pessoais, faz-se uma an??lise das principais concep????es sobre a rela????o homem-t??cnica que est??o influenciando a intera????o humano-computador. Com isso fica evidenciado o papel do computador na crise do sujeito moderno, e afirma-se a necessidade de se pensar a subjetividade para al??m da cl??ssica divis??o sujeito-objeto, homem m??quina, natureza-artif??cio... o que aponta para a id??ia de acoplamentos flex??veis entre humanos e computadores e pede por uma no????o de aprendizagem que acolha a cria????o de problemas como seu aspecto mais rico.

Estudo preliminar para a avaliação da acessibilidade de um sítio Web

O avanço e difusão da tecnologia, em particular da Internet, obrigaram à disponibilização de informação com qualidade e facilmente acessível. Tais exigências vêm confirmar a relevância do papel da interface como elemento principal na interacção do utilizador com os sistemas de informação. É, por isso, fundamental que a interface seja fácil de usar e que vá ao encontro das expectativas e necessidades de todos os utilizadores. O desenvolvimento de interfaces que satisfaçam utilizadores com necessidades distintas, independentemente das suas capacidades motoras e perceptivas, culturais e sociais não é uma tarefa que possa se considerada simples [1]. De acordo com vários especialistas em Interacção Homem-Computador, [1], [2] e [3] as interfaces devem ser construídas respeitando os princípios de desenho centrado no utilizador, visando um elevado grau de usabilidade e em conformidade com directrizes de acessibilidade básicas. Este trabalho apresenta uma metodologia para avaliação da acessibilidade de um sítio Web, baseado num documento disponibilizado pela Web Accessibility Initiative, WAI, [4], a ser aplicada à secretaria on-line de uma escola do ensino superior.

A user-centered interface for scheduling problem definition

In this paper we present a user-centered interface for a scheduling system. The purpose of this interface is to provide graphical and interactive ways of defining a scheduling problem. To create such user interface an evaluation-centered user interaction development method was adopted: the star life cycle. The created prototype comprises the Task Module and the Scheduling Problem Module. The first one allows users to define a sequence of operations, i.e., a task. The second one enables a scheduling problem definition, which consists in a set of tasks. Both modules are equipped with a set of real time validations to assure the correct definition of the necessary data input for the scheduling module of the system. The usability evaluation allowed us to measure the ease of interaction and observe the different forms of interaction provided by each participant, namely the reactions to the real time validation mechanism.

Determination of stresses around a cylindrical single pile caused by horizontal movements of soils with the finitive element method

This study was carried out with the aim of modeling in 2D, in plain strain, the movement of a soft cohesive soil around a pile, in order to enable the determination of stresses resulting along the pile, per unit length. The problem in study fits into the large deformations problem and can be due to landslide, be close of depth excavations, to be near of zones where big loads are applied in the soil, etc. In this study is used an constitutive Elasto-Plastic model with the failure criterion of Mohr-Coulomb to model the soil behavior. The analysis is developed considering the soil in undrained conditions. To the modeling is used the finite element program PLAXIS, which use the Updated Lagrangian - Finite Element Method (UL-FEM). In this work, special attention is given to the soil-pile interaction, where is presented with some detail the formulation of the interface elements and some studies for a better understand of his behavior. It is developed a 2-D model that simulates the effect of depth allowing the study of his influence in the stress distribution around the pile. The results obtained give an important base about how behaves the movement of the soil around a pile, about how work the finite element program PLAXIS and how is the stress distribution around the pile. The analysis demonstrate that the soil-structure interaction modeled with the UL-FEM and interface elements is more appropriate to small deformations problems.