POSE ESTIMATION AND 3D RECONSTRUCTION USING SENSOR FUSION

A camera maps 3-dimensional (3D) world space to a 2-dimensional (2D) image space. In the process it loses the depth information, i.e., the distance from the camera focal point to the imaged objects. It is impossible to recover this information from a single image. However, by using two or more images from different viewing angles this information can be recovered, which in turn can be used to obtain the pose (position and orientation) of the camera. Using this pose, a 3D reconstruction of imaged objects in the world can be computed. Numerous algorithms have been proposed and implemented to solve the above problem; these algorithms are commonly called Structure from Motion (SfM). State-of-the-art SfM techniques have been shown to give promising results. However, unlike a Global Positioning System (GPS) or an Inertial Measurement Unit (IMU) which directly give the position and orientation respectively, the camera system estimates it after implementing SfM as mentioned above. This makes the pose obtained from a camera highly sensitive to the images captured and other effects, such as low lighting conditions, poor focus or improper viewing angles. In some applications, for example, an Unmanned Aerial Vehicle (UAV) inspecting a bridge or a robot mapping an environment using Simultaneous Localization and Mapping (SLAM), it is often difficult to capture images with ideal conditions. This report examines the use of SfM methods in such applications and the role of combining multiple sensors, viz., sensor fusion, to achieve more accurate and usable position and reconstruction information. This project investigates the role of sensor fusion in accurately estimating the pose of a camera for the application of 3D reconstruction of a scene. The first set of experiments is conducted in a motion capture room. These results are assumed as ground truth in order to evaluate the strengths and weaknesses of each sensor and to map their coordinate systems. Then a number of scenarios are targeted where SfM fails. The pose estimates obtained from SfM are replaced by those obtained from other sensors and the 3D reconstruction is completed. Quantitative and qualitative comparisons are made between the 3D reconstruction obtained by using only a camera versus that obtained by using the camera along with a LIDAR and/or an IMU. Additionally, the project also works towards the performance issue faced while handling large data sets of high-resolution images by implementing the system on the Superior high performance computing cluster at Michigan Technological University.

Studio e sperimentazione di missioni autonome di un veicolo terrestre controllato con sistemi inerziali e satellitari

L'argomento del lavoro di tesi svolto ha lo scopo di testare le prestazioni di dispositivi riceventi per Global Navigation Satellite System (GNSS) che utilizzano la tecnologia di posizionamento Real-Time Kinematics (RTK) e valutarne le prestazioni rispetto alle tradizionali riceventi GNSS, nello sviluppo di missioni autonome per veicoli di terra di piccole dimensioni. Per questi esperimenti è stato usato un rover di piccole dimensioni alimentato a batteria, su cui è stato installato un autopilota Pixhawk Cube Orange con firmware Ardupilot, nello specifico Ardurover. Attraverso il software Mission Planner è stato richiesto al rover di effettuare completamente in autonomia delle missioni per testare sia le prestazioni dei sistemi GNSS tradizionali sia dei sistemi RTK. Attraverso i dati raccolti durante le sperimentazioni è stato fatto un confronto tra GNSS e RTK. I dati raccolti sono stati utilizzati per valutare le prestazioni in termini di precisione dei sistemi e non sono state rilevate significative differenze durante l'utilizzo del dispositivo RTK per lo svolgimento della missione richiesta al rover, con l'architettura hardware proposta.

Assessment of gait spatio-temporal parameters in neurological disorders using wearable inertial sensors

Movement analysis carried out in laboratory settings is a powerful, but costly solution since it requires dedicated instrumentation, space and personnel. Recently, new technologies such as the magnetic and inertial measurement units (MIMU) are becoming widely accepted as tools for the assessment of human motion in clinical and research settings. They are relatively easy-to-use and potentially suitable for estimating gait kinematic features, including spatio-temporal parameters. The objective of this thesis regards the development and testing in clinical contexts of robust MIMUs based methods for assessing gait spatio-temporal parameters applicable across a number of different pathological gait patterns. First, considering the need of a solution the least obtrusive as possible, the validity of the single unit based approach was explored. A comparative evaluation of the performance of various methods reported in the literature for estimating gait temporal parameters using a single unit attached to the trunk first in normal gait and then in different pathological gait conditions was performed. Then, the second part of the research headed towards the development of new methods for estimating gait spatio-temporal parameters using shank worn MIMUs on different pathological subjects groups. In addition to the conventional gait parameters, new methods for estimating the changes of the direction of progression were explored. Finally, a new hardware solution and relevant methodology for estimating inter-feet distance during walking was proposed. Results of the technical validation of the proposed methods at different walking speeds and along different paths against a gold standard were reported and showed that the use of two MIMUs attached to the lower limbs associated with a robust method guarantee a much higher accuracy in determining gait spatio-temporal parameters. In conclusion, the proposed methods could be reliably applied to various abnormal gaits obtaining in some cases a comparable level of accuracy with respect to normal gait.

Automatic front-crawl temporal phase detection using adaptive filtering of inertial signals

This study introduces a novel approach for automatic temporal phase detection and inter-arm coordination estimation in front-crawl swimming using inertial measurement units (IMUs). We examined the validity of our method by comparison against a video-based system. Three waterproofed IMUs (composed of 3D accelerometer, 3D gyroscope) were placed on both forearms and the sacrum of the swimmer. We used two underwater video cameras in side and frontal views as our reference system. Two independent operators performed the video analysis. To test our methodology, seven well-trained swimmers performed three 300 m trials in a 50 m indoor pool. Each trial was in a different coordination mode quantified by the index of coordination. We detected different phases of the arm stroke by employing orientation estimation techniques and a new adaptive change detection algorithm on inertial signals. The difference of 0.2 +/- 3.9% between our estimation and video-based system in assessment of the index of coordination was comparable to experienced operators' difference (1.1 +/- 3.6%). The 95% limits of agreement of the difference between the two systems in estimation of the temporal phases were always less than 7.9% of the cycle duration. The inertial system offers an automatic easy-to-use system with timely feedback for the study of swimming.

Functional calibration procedure for 3D knee joint angle description using inertial sensors.

Measurement of three-dimensional (3D) knee joint angle outside a laboratory is of benefit in clinical examination and therapeutic treatment comparison. Although several motion capture devices exist, there is a need for an ambulatory system that could be used in routine practice. Up-to-date, inertial measurement units (IMUs) have proven to be suitable for unconstrained measurement of knee joint differential orientation. Nevertheless, this differential orientation should be converted into three reliable and clinically interpretable angles. Thus, the aim of this study was to propose a new calibration procedure adapted for the joint coordinate system (JCS), which required only IMUs data. The repeatability of the calibration procedure, as well as the errors in the measurement of 3D knee angle during gait in comparison to a reference system were assessed on eight healthy subjects. The new procedure relying on active and passive movements reported a high repeatability of the mean values (offset<1 degrees) and angular patterns (SD<0.3 degrees and CMC>0.9). In comparison to the reference system, this functional procedure showed high precision (SD<2 degrees and CC>0.75) and moderate accuracy (between 4.0 degrees and 8.1 degrees) for the three knee angle. The combination of the inertial-based system with the functional calibration procedure proposed here resulted in a promising tool for the measurement of 3D knee joint angle. Moreover, this method could be adapted to measure other complex joint, such as ankle or elbow.

Optimal phasor measurement units placement for fault location on overhead electric power distribution feeders

This paper proposes a new approach for optimal phasor measurement units placement for fault location on electric power distribution systems using Greedy Randomized Adaptive Search Procedure metaheuristic and Monte Carlo simulation. The optimized placement model herein proposed is a general methodology that can be used to place devices aiming to record the voltage sag magnitudes for any fault location algorithm that uses voltage information measured at a limited set of nodes along the feeder. An overhead, three-phase, three-wire, 13.8 kV, 134-node, real-life feeder model is used to evaluate the algorithm. Tests show that the results of the fault location methodology were improved thanks to the new optimized allocation of the meters pinpointed using this methodology. © 2011 IEEE.

A framework for experimental determination of localised vertical pedestrian forces on full-scale structures using wireless attitude and heading reference systems

A major weakness among loading models for pedestrians walking on flexible structures proposed in recent years is the various uncorroborated assumptions made in their development. This applies to spatio-temporal characteristics of pedestrian loading and the nature of multi-object interactions. To alleviate this problem, a framework for the determination of localised pedestrian forces on full-scale structures is presented using a wireless attitude and heading reference systems (AHRS). An AHRS comprises a triad of tri-axial accelerometers, gyroscopes and magnetometers managed by a dedicated data processing unit, allowing motion in three-dimensional space to be reconstructed. A pedestrian loading model based on a single point inertial measurement from an AHRS is derived and shown to perform well against benchmark data collected on an instrumented treadmill. Unlike other models, the current model does not take any predefined form nor does it require any extrapolations as to the timing and amplitude of pedestrian loading. In order to assess correctly the influence of the moving pedestrian on behaviour of a structure, an algorithm for tracking the point of application of pedestrian force is developed based on data from a single AHRS attached to a foot. A set of controlled walking tests with a single pedestrian is conducted on a real footbridge for validation purposes. A remarkably good match between the measured and simulated bridge response is found, indeed confirming applicability of the proposed framework.

Preventing worker’s musculoskeletal disorders with wearable inertial sensors: ergonomics and modelling of physical human-robot interactions

The most widespread work-related diseases are musculoskeletal disorders (MSD) caused by awkward postures and excessive effort to upper limb muscles during work operations. The use of wearable IMU sensors could monitor the workers constantly to prevent hazardous actions, thus diminishing work injuries. In this thesis, procedures are developed and tested for ergonomic analyses in a working environment, based on a commercial motion capture system (MoCap) made of 17 Inertial Measurement Units (IMUs). An IMU is usually made of a tri-axial gyroscope, a tri-axial accelerometer, and a tri-axial magnetometer that, through sensor fusion algorithms, estimates its attitude. Effective strategies for preventing MSD rely on various aspects: firstly, the accuracy of the IMU, depending on the chosen sensor and its calibration; secondly, the correct identification of the pose of each sensor on the worker’s body; thirdly, the chosen multibody model, which must consider both the accuracy and the computational burden, to provide results in real-time; finally, the model scaling law, which defines the possibility of a fast and accurate personalization of the multibody model geometry. Moreover, the MSD can be diminished using collaborative robots (cobots) as assisted devices for complex or heavy operations to relieve the worker's effort during repetitive tasks. All these aspects are considered to test and show the efficiency and usability of inertial MoCap systems for assessing ergonomics evaluation in real-time and implementing safety control strategies in collaborative robotics. Validation is performed with several experimental tests, both to test the proposed procedures and to compare the results of real-time multibody models developed in this thesis with the results from commercial software. As an additional result, the positive effects of using cobots as assisted devices for reducing human effort in repetitive industrial tasks are also shown, to demonstrate the potential of wearable electronics in on-field ergonomics analyses for industrial applications.

An estimate of biometric parameters in eucalyptus clone plantations in Southern Bahia: an application of the airborne laser scanning (ALS) technology

The application of airborne laser scanning (ALS) technologies in forest inventories has shown great potential to improve the efficiency of forest planning activities. Precise estimates, fast assessment and relatively low complexity can explain the good results in terms of efficiency. The evolution of GPS and inertial measurement technologies, as well as the observed lower assessment costs when these technologies are applied to large scale studies, can explain the increasing dissemination of ALS technologies. The observed good quality of results can be expressed by estimates of volumes and basal area with estimated error below the level of 8.4%, depending on the size of sampled area, the quantity of laser pulses per square meter and the number of control plots. This paper analyzes the potential of an ALS assessment to produce certain forest inventory statistics in plantations of cloned Eucalyptus spp with precision equal of superior to conventional methods. The statistics of interest in this case were: volume, basal area, mean height and dominant trees mean height. The ALS flight for data assessment covered two strips of approximately 2 by 20 Km, in which clouds of points were sampled in circular plots with a radius of 13 m. Plots were sampled in different parts of the strips to cover different stand ages. The clouds of points generated by the ALS assessment: overall height mean, standard error, five percentiles (height under which we can find 10%, 30%, 50%,70% and 90% of the ALS points above ground level in the cloud), and density of points above ground level in each percentile were calculated. The ALS statistics were used in regression models to estimate mean diameter, mean height, mean height of dominant trees, basal area and volume. Conventional forest inventory sample plots provided real data. For volume, an exploratory assessment involving different combinations of ALS statistics allowed for the definition of the most promising relationships and fitting tests based on well known forest biometric models. The models based on ALS statistics that produced the best results involved: the 30% percentile to estimate mean diameter (R(2)=0,88 and MQE%=0,0004); the 10% and 90% percentiles to estimate mean height (R(2)=0,94 and MQE%=0,0003); the 90% percentile to estimate dominant height (R(2)=0,96 and MQE%=0,0003); the 10% percentile and mean height of ALS points to estimate basal area (R(2)=0,92 and MQE%=0,0016); and, to estimate volume, age and the 30% and 90% percentiles (R(2)=0,95 MQE%=0,002). Among the tested forest biometric models, the best fits were provided by the modified Schumacher using age and the 90% percentile, modified Clutter using age, mean height of ALS points and the 70% percentile, and modified Buckman using age, mean height of ALS points and the 10% percentile.

All over the place localization system

The MAP-i Doctoral Programme in Informatics, of the Universities of Minho, Aveiro and Porto

Diseño y desarrollo de un equipo de caracterización de ISFET para la medida de analitos iónicos

En este proyecto se desarrolla una unidad de medida para investigar la cuantificación de la concentración de analitos iónicos en análisis clínico mediante sensores ISFET. Para su desarrollo se precisa de un elemento que simule el comportamiento de un ISFET por lo que también se desarrolla un simulador de ISFET. Para realizar la unidad de medida se diseñan unos circuitos SMU que permiten polarizar en tensión y medir la corriente de cada terminal de un ISFET y del electrodo de referencia que actúa de puerta. El simulador se realiza con un MOSFET de la misma geometría que el ISFET y dos generadores de tensión programables. Desarrollados y validados los circuitos correspondientes, obtenemos unos excelentes resultados en el simulador que se revela de gran utilidad para la puesta en marcha de la unidad de medida, la cual ofrece unos resultados bastante buenos, si bien se aprecian ciertas corrientes de fuga que no permiten alcanzar toda la exactitud que se pretendía. Ello es debido a los circuitos impresos que deberán ser mejorados hasta conseguir la exactitud deseada. Sin embargo pueden darse por válidos los circuitos de medida diseñados.

Desarrollo de un sistema integrado de navegación inercial: interfície IMU + FPGA

Els sistemes automatitzats que requereixen d’un control d’estabilitat o moviment es poden trobar cada cop en més àmbits. Aplicacions UAV o de posicionament global són les més comunes per aquest tipus de sistemes, degut a que necessiten d’un control de moviment molt precís. Per a dur a terme aquest procés s’utilitzen unitats de mesura inercial, que mitjançant acceleròmetres i giroscopis degudament posicionats, a més a més d’una correcció del possible error que puguin introduir aquests últims, proporcionen una acceleració i una velocitat angular de les quals es pot extreure el camí efectuat per aquestes unitats. La IMU, combinada amb un GPS i mitjançant un filtre de Kalman, proporcionen una major exactitud , a més d’un punt de partida (proporcionat per el GPS), un recorregut representable en un mapa y, en el cas de perdre la senyal GPS, poder seguir adquirint dades de la IMU. Aquestes dades poden ser recollides i processades per una FPGA, que a la vegada podem sincronitzar amb una PDA per a que l’usuari pugui veure representat el moviment del sistema. Aquest treball es centra en el funcionament de la IMU i l’adquisició de dades amb la FPGA. També introdueix el filtre de Kalman per a la correcció de l’error dels sensors.

On the foundations of well-being economics and policy

When one wishes to implement public policies, there is a previous need of comparing different actions and valuating and evaluating them to assess their social attractiveness. Recently the concept of well-being has been proposed as a multidimensional proxy for measuring societal prosperity and progress; a key research topic is then on how we can measure and evaluate this plurality of dimensions for policy decisions. This paper defends the thesis articulated in the following points: 1. Different metrics are linked to different objectives and values. To use only one measurement unit (on the grounds of the so-called commensurability principle) for incorporating a plurality of dimensions, objectives and values, implies reductionism necessarily. 2. Point 1) can be proven as a matter of formal logic by drawing on the work of Geach about moral philosophy. This theoretical demonstration is an original contribution of this article. Here the distinction between predicative and attributive adjectives is formalised and definitions are provided. Predicative adjectives are further distinguished into absolute and relative ones. The new concepts of set commensurability and rod commensurability are introduced too. 3. The existence of a plurality of social actors, with interest in the policy being assessed, causes that social decisions involve multiple types of values, of which economic efficiency is only one. Therefore it is misleading to make social decisions based only on that one value. 4. Weak comparability of values, which is grounded on incommensurability, is proved to be the main methodological foundation of policy evaluation in the framework of well-being economics. Incommensurability does not imply incomparability; on the contrary incommensurability is the only rational way to compare societal options under a plurality of policy objectives. 5. Weak comparability can be implemented by using multi-criteria evaluation, which is a formal framework for applied consequentialism under incommensurability. Social Multi-Criteria Evaluation, in particular, allows considering both technical and social incommensurabilities simultaneously.

Estudi comparatiu dels filtres de Kalman i IMM per a navegació

Els sistemes híbrids de navegació integren mesures de posició i velocitat provinents de satèl·lits (GPS) i d’unitats de mesura inercials (IMU).Les dades d’aquests sensors s’han de fusionar i suavitzar, i per a aquest propòsit existeixen diversos algorismes de filtratge, que tracten les dades conjuntament o per separat. En aquest treball s’han codificat en Matlab els algorismes dels filtres de Kalman i IMM, i s’han comparat les seves prestacions en diverses trajectòries d’un vehicle. S’han avaluat quantitativament els errors dels dos filtres, i s’han sintonitzat els seus paràmetres per a minimitzar aquests errors. Amb una correcta sintonia dels filtres, s’ha comprovat que el filtre IMM és superior al filtre de Kalman, tant per maniobres brusques com per maniobres suaus, malgrat que la complexitat i el temps de càlcul requerit són majors.

Reaaliaikaisen PMU-mittaustiedon hyödyntäminen voimajärjestelmän valvonnassa

Tämä työ on tehty Fingrid Oyj:lle. Työn tavoitteena oli tutkia, miten reaaliaikaista PMU-mittaustietoa voidaan hyödyntää voimajärjestelmän valvonnassa. Voimajärjestelmän dynaamisia ilmiöitä ovat jännite- ja kulmastabiilius. Työssä tutkittiin voimajärjestelmän kulmastabiiliutta PSS/E-ohjelmalla simuloitujen mittaustulosten perusteella. Fouriermuunnoksen tulokset osoittavat, että huonoiten vaimeneva taajuuskomponentti on 0,3 Hz taajuus. Lisäksi tiedetään, että huonosti vaimeneva taajuuskomponentti rajoittaa siirtokapasiteettia. Voimajärjestelmän stabiiliutta voidaan esittää Wide Area Monitoring -järjestelmien (WAMS) avulla. WAMS perustuu Phasor Measurement -laitteen (PMU) reaaliaikaiseen mittaustekniikkaan. Jännitteen vaihekulman mittaaminen mahdollistaa voimajärjestelmän tilan määrittämisen reaaliajassa. Työssä on esitelty Fingridin käytössä oleva WAMS ja lisäksi esitelty kolmen eri laitetoimittajan WAMS:n rakennetta ja operaattorin käyttöön tarkoitettuja käyttöliittymiä. WAMS:n rakenteet ovat pääpiirteittäin samanlaisia, mutta stabiiliuden visuaalisessa esittämisessä on eroja. PMU -mittaustietoja on mahdollista tuoda käytönvalvontajärjestelmään erillisellä tiedonsiirtoprotokollalla. PMU-mittaustiedon hyödyntäminen käytönvalvontajärjestelmän toimintaaluenäytöllä mahdollistaa verkon tilan esittämisen reaaliajassa. Roottorin kulmastabiilius esitetään Fingridin käytönvalvontajärjestelmässä vaihekulmaerojen avulla ja työssä on esitetty, kuinka vaihekulmaeron arvolla on vaikutus tehonsiirtoon. Vaihekulmaeron arvo kuvaa vian jälkeisen tehoheilahtelun voimakkuutta. PMU-mittaustiedon esittäminen antaa operaattorille selkeämmän kuvan ylläpitää tehonsiirto turvallisella tasolla ja epästabiilin heilahtelun havainnoiminen vähentää suurhäiriön riskiä. Tulevaisuudessa siirtoverkon kehittyessä tarvitaan operaattorin käyttöön myös nopeita stabiilisuutta esittäviä työkaluja.