An Embedded In-Cabin Lightweight High-Performance 3D Gaze Estimation System

Gaze estimation has gained interest in recent years for being an important cue to obtain information about the internal cognitive state of humans. Regardless of whether it is the 3D gaze vector or the point of gaze (PoG), gaze estimation has been applied in various fields, such as: human robot interaction, augmented reality, medicine, aviation and automotive. In the latter field, as part of Advanced Driver-Assistance Systems (ADAS), it allows the development of cutting-edge systems capable of mitigating road accidents by monitoring driver distraction. Gaze estimation can be also used to enhance the driving experience, for instance, autonomous driving. It also can improve comfort with augmented reality components capable of being commanded by the driver's eyes. Although, several high-performance real-time inference works already exist, just a few are capable of working with only a RGB camera on computationally constrained devices, such as a microcontroller. This work aims to develop a low-cost, efficient and high-performance embedded system capable of estimating the driver's gaze using deep learning and a RGB camera. The proposed system has achieved near-SOTA performances with about 90% less memory footprint. The capabilities to generalize in unseen environments have been evaluated through a live demonstration, where high performance and near real-time inference were obtained using a webcam and a Raspberry Pi4.

Integration of ROS for the control of industrial robotic systems in a proprietary environment

The paper deals with the integration of ROS, in the proprietary environment of the Marchesini Group company, for the control of industrial robotic systems. The basic tools of this open-source software are deeply studied to model a full proprietary Pick and Place manipulator inside it, and to develop custom ROS nodes to calculate trajectories; speaking of which, the URDF format is the standard to represent robots in ROS and the motion planning framework MoveIt offers user-friendly high-level methods. The communication between ROS and the Marchesini control architecture is established using the OPC UA standard; the tasks computed are transmitted offline to the PLC, supervisor controller of the physical robot, because the performances of the protocol don’t allow any kind of active control by ROS. Once the data are completely stored at the Marchesini side, the industrial PC makes the real robot execute a trajectory computed by MoveIt, so that it replicates the behaviour of the simulated manipulator in Rviz. Multiple experiments are performed to evaluate in detail the potential of ROS in the planning of movements for the company proprietary robots. The project ends with a small study regarding the use of ROS as a simulation platform. First, it is necessary to understand how a robotic application of the company can be reproduced in the Gazebo real world simulator. Then, a ROS node extracts information and examines the simulated robot behaviour, through the subscription to specific topics.

Development of a Robotic Wires Storage System for Switchgear Manufacturing Automation

Considering the great development of robotics in industrial automation, the Remodel project aims to reproduce, through the use of Cobots, the wiring activity typical of a human operator and to realize an autonomous storage work. My researches focused on this second topic. In this paper, we will see how to realize a gripper compatible with an Omron TM5X-900, able to perform a pick and place of different types of cables, but also how to compute possible trajectories. In particular, what I needed, was a trajectory going from the Komax, the cables production machine, to a Warehouse taking into account the possible entangles of cables with the robot during its motion. The last part has been dedicated to the synchronization between robot and main machine work.

Operazioni di assemblaggio automatizzato tramite robot antropomorfo e visione artificiale

Obiettivo dello studio condotto è l’implementazione di cicli di operazioni per l’assemblaggio automatizzato di componenti che costituiscono un sistema di trasporto a catena presente in alcune macchine automatiche. L’automazione del processo, fino ad oggi svolto manualmente, prevede l’utilizzo di un robot e, per il controllo di quest’ultimo, di un sistema di visione artificiale. L’attività di tirocinio associata alla tesi di laurea, che ha incluso una parte sperimentale oltre alla scrittura degli algoritmi di controllo del robot, è stata svolta all’interno del laboratorio TAILOR (Technology and Automation for Industry LabORatory) presso Siropack Italia S.r.l dove è presente una cella dotata di robot antropomorfo (Mitsubishi Electric) e di sistema di visione artificiale con camere 2D (Omron). La presenza di quest’ultimo è risultata strategica in termini di possibilità di adattare il montaggio anche a diversi posizionamenti degli oggetti all’interno dello spazio di lavoro, fermo restando che gli stessi risultassero appoggiati su una superficie piana. In primo luogo, affinché fosse garantita la ripetibilità del processo, sono state testate le prestazioni del sistema di visione tramite opportuna calibrazione della camera e del sistema di illuminazione ad esso collegata, al fine di ottenere un’acquisizione delle immagini che fosse sufficientemente robusta e risoluta mediante lo sfruttamento del software di elaborazione Omron FH Vision System. Un’opportuna programmazione della traiettoria del robot in ambiente di simulazione RT Toolbox 3, software integrato nel sistema di controllo del robot Mitsubishi Electric, ha infine consentito le regolari operazioni di assemblaggio, garantendo un processo affidabile ed, allo stesso tempo, adattabile ad ambienti eventualmente non strutturati in cui esso si trova ad operare.

Design and Performance Analysis of the Electrical Power System of a Petrochemical Facility

This thesis deals with the sizing and analysis of the electrical power system of a petrochemical plant. The activity was carried out in the framework of an electrical engineering internship. The sizing and electrical calculations, as well as the study of the dynamic behavior of network quantities, are accomplished by using the ETAP (Electrical Transient Analyzer Program) software. After determining the type and size of the loads, the calculation of power flows is carried out for all possible network layout and different power supply configurations. The network is normally operated in a double radial configuration. However, the sizing must be carried out taking into account the most critical configuration, i.e., the temporary one of single radial operation, and also considering the most unfavorable power supply conditions. The calculation of shortcircuit currents is then carried out and the appropriate circuit breakers are selected. Where necessary, capacitor banks are sized in order to keep power factor at the point of common coupling within the preset limits. The grounding system is sized by using the finite element method. For loads with the highest level of criticality, UPS are sized in order to ensure their operation even in the absence of the main power supply. The main faults that can occur in the plant are examined, determining the intervention times of the protections to ensure that, in case of failure on one component, the others can still properly operate. The report concludes with the dynamic and stability analysis of the power system during island operation, in order to ensure that the two gas turbines are able to support the load even during transient conditions.