Vision-Based Tracking, Odometry and Control for UAV Autonomy

El principal objetivo de este trabajo es proporcionar una solución en tiempo real basada en visión estéreo o monocular precisa y robusta para que un vehículo aéreo no tripulado (UAV) sea autónomo en varios tipos de aplicaciones UAV, especialmente en entornos abarrotados sin señal GPS. Este trabajo principalmente consiste en tres temas de investigación de UAV basados en técnicas de visión por computador: (I) visual tracking, proporciona soluciones efectivas para localizar visualmente objetos de interés estáticos o en movimiento durante el tiempo que dura el vuelo del UAV mediante una aproximación adaptativa online y una estrategia de múltiple resolución, de este modo superamos los problemas generados por las diferentes situaciones desafiantes, tales como cambios significativos de aspecto, iluminación del entorno variante, fondo del tracking embarullado, oclusión parcial o total de objetos, variaciones rápidas de posición y vibraciones mecánicas a bordo. La solución ha sido utilizada en aterrizajes autónomos, inspección de plataformas mar adentro o tracking de aviones en pleno vuelo para su detección y evasión; (II) odometría visual: proporciona una solución eficiente al UAV para estimar la posición con 6 grados de libertad (6D) usando únicamente la entrada de una cámara estéreo a bordo del UAV. Un método Semi-Global Blocking Matching (SGBM) eficiente basado en una estrategia grueso-a-fino ha sido implementada para una rápida y profunda estimación del plano. Además, la solución toma provecho eficazmente de la información 2D y 3D para estimar la posición 6D, resolviendo de esta manera la limitación de un punto de referencia fijo en la cámara estéreo. Una robusta aproximación volumétrica de mapping basada en el framework Octomap ha sido utilizada para reconstruir entornos cerrados y al aire libre bastante abarrotados en 3D con memoria y errores correlacionados espacialmente o temporalmente; (III) visual control, ofrece soluciones de control prácticas para la navegación de un UAV usando Fuzzy Logic Controller (FLC) con la estimación visual. Y el framework de Cross-Entropy Optimization (CEO) ha sido usado para optimizar el factor de escala y la función de pertenencia en FLC. Todas las soluciones basadas en visión en este trabajo han sido probadas en test reales. Y los conjuntos de datos de imágenes reales grabados en estos test o disponibles para la comunidad pública han sido utilizados para evaluar el rendimiento de estas soluciones basadas en visión con ground truth. Además, las soluciones de visión presentadas han sido comparadas con algoritmos de visión del estado del arte. Los test reales y los resultados de evaluación muestran que las soluciones basadas en visión proporcionadas han obtenido rendimientos en tiempo real precisos y robustos, o han alcanzado un mejor rendimiento que aquellos algoritmos del estado del arte. La estimación basada en visión ha ganado un rol muy importante en controlar un UAV típico para alcanzar autonomía en aplicaciones UAV. ABSTRACT The main objective of this dissertation is providing real-time accurate robust monocular or stereo vision-based solution for Unmanned Aerial Vehicle (UAV) to achieve the autonomy in various types of UAV applications, especially in GPS-denied dynamic cluttered environments. This dissertation mainly consists of three UAV research topics based on computer vision technique: (I) visual tracking, it supplys effective solutions to visually locate interesting static or moving object over time during UAV flight with on-line adaptivity approach and multiple-resolution strategy, thereby overcoming the problems generated by the different challenging situations, such as significant appearance change, variant surrounding illumination, cluttered tracking background, partial or full object occlusion, rapid pose variation and onboard mechanical vibration. The solutions have been utilized in autonomous landing, offshore floating platform inspection and midair aircraft tracking for sense-and-avoid; (II) visual odometry: it provides the efficient solution for UAV to estimate the 6 Degree-of-freedom (6D) pose using only the input of stereo camera onboard UAV. An efficient Semi-Global Blocking Matching (SGBM) method based on a coarse-to-fine strategy has been implemented for fast depth map estimation. In addition, the solution effectively takes advantage of both 2D and 3D information to estimate the 6D pose, thereby solving the limitation of a fixed small baseline in the stereo camera. A robust volumetric occupancy mapping approach based on the Octomap framework has been utilized to reconstruct indoor and outdoor large-scale cluttered environments in 3D with less temporally or spatially correlated measurement errors and memory; (III) visual control, it offers practical control solutions to navigate UAV using Fuzzy Logic Controller (FLC) with the visual estimation. And the Cross-Entropy Optimization (CEO) framework has been used to optimize the scaling factor and the membership function in FLC. All the vision-based solutions in this dissertation have been tested in real tests. And the real image datasets recorded from these tests or available from public community have been utilized to evaluate the performance of these vision-based solutions with ground truth. Additionally, the presented vision solutions have compared with the state-of-art visual algorithms. Real tests and evaluation results show that the provided vision-based solutions have obtained real-time accurate robust performances, or gained better performance than those state-of-art visual algorithms. The vision-based estimation has played a critically important role for controlling a typical UAV to achieve autonomy in the UAV application.

Decoupling of soil nutrient cycles as a function of aridity in global drylands

The biogeochemical cycles of carbon (C), nitrogen (N) and phosphorus (P) are interlinked by primary production, respiration and decomposition in terrestrial ecosystems. It has been suggested that the C, N and P cycles could become uncoupled under rapid climate change because of the different degrees of control exerted on the supply of these elements by biological and geochemical processes. Climatic controls on biogeochemical cycles are particularly relevant in arid, semi-arid and dry sub-humid ecosystems (drylands) because their biological activity is mainly driven by water availability. The increase in aridity predicted for the twenty-first century in many drylands worldwide may therefore threaten the balance between these cycles, differentially affecting the availability of essential nutrients. Here we evaluate how aridity affects the balance between C, N and P in soils collected from 224 dryland sites from all continents except Antarctica. We find a negative effect of aridity on the concentration of soil organic C and total N, but a positive effect on the concentration of inorganic P. Aridity is negatively related to plant cover, which may favour the dominance of physical processes such as rock weathering, a major source of P to ecosystems, over biological processes that provide more C and N, such as litter decomposition. Our findings suggest that any predicted increase in aridity with climate change will probably reduce the concentrations of N and C in global drylands, but increase that of P. These changes would uncouple the C, N and P cycles in drylands and could negatively affect the provision of key services provided by these ecosystems.

Optical characterisation of semi-transparent PV modules for building integration

A complete characterisation of PV modules for building integration is needed in order to know their influence on the building’s global energy balance. Specifically, certain characteristic parameters should be obtained for each different PV module suitable for building integrated photovoltaics (BIPV), some by direct or indirect measurements at the laboratory, and others by monitoring the element performance mounted in real operating conditions. In the case of transparent building envelopes it is particularly important to perform an optical and thermal characterization of the PV modules that would be integrated in them. This paper addresses the optical characterization of some commercial thin-film PV modules having different degrees of transparency, suitable for building integration in façades. The approach is based on the measurement of the spectral UV/Vis/NIR reflectance and transmittance of the different considered samples, both at normal incidence and as a function of the angle of incidence. With the obtained results, the total and zoned UV, visible and NIR transmission and reflection values are calculated, enabling the correct characterization of the PV modules integrated in façades and the subsequent evaluation of their impact over the electrical, thermal and lighting performance in a building.

Energy saving potential of semi-transparent photovoltaic elements for building integration

Within the building energy saving strategies, BIPV (building integrated photovoltaic systems) present a promising potential based on the close relationship existing between these multifunctional systems and the overall building energy balance. Building integration of STPV (semi-transparent photovoltaic) elements affects deeply the building energy demand since it influences the heating, cooling and lighting loads as well as the local electricity generation. This work analyses over different window-to-wall ratios the overall energy performance of five STPV elements, each element having a specific degree of transparency, in order to assess the energy saving potential compared to a conventional solar control glass compliant with the local technical standard. The prior optical characterization, focused to measure the spectral properties of the elements, was experimentally undertaken. The obtained data were used to perform simulations based on a reference office building using a package of specific software tools (DesignBuilder, EnergyPlus, PVsyst, and COMFEN) to take proper account of the STPV peculiarities. To evaluate the global energy performance of the STPV elements a new Energy Balance Index was formulated. The results show that for intermediate and large façade openings the energy saving potential provided by the STPV solutions ranges between 18% and 59% compared to the reference glass.

Integral energy behaviour of photovoltaic semi-transparent glazing elements for building integration

La hipótesis general que esta tesis quiere demostrar es que la integración arquitectónica de sistemas fotovoltaicos semitransparentes (STPV) puede contribuir a mejorar la eficiencia energética de los edificios. Por lo tanto, la investigación se centra en el desarrollo de una metodología capaz de cuantificar la reducción de la demanda energética del edificio proporcionada por estas novedosas soluciones constructivas. Al mismo tiempo, los parámetros de diseño de las soluciones STPV se han analizado para establecer cuales presentan el mayor impacto sobre el balance energético global del edificio y por lo tanto tienen que ser cuidadosamente definidos a la hora de optimizar el comportamiento energético del mismo. A la luz de estos objetivos, la metodología de estudio se ha centrado en tres puntos principales:  Caracterizar el comportamiento energético global de sistemas STPV en condiciones de operación realistas, similares a las que se darían en un sistema real;  Caracterizar el comportamiento energético global de sistemas STPV en condiciones controladas, con el objetivo de estudiar la variación del comportamiento del los elementos en función de parámetro de diseño y operación;  Evaluar el potencial de ahorro energético global de los sistemas STPV en comparación con soluciones acristaladas convencionales al variar de las condiciones de contorno constituidas por los parámetros de diseño (como el grado de transparencia), las características arquitectónicas (como el ratio entre superficie acristalada y superficie opaca en la fachada del edificio) y las condiciones climáticas (cubriendo en particular la climatología europea). En síntesis, este trabajo intenta contribuir a comprender la interacción que existe entre los sistemas STPV y el edificio, proporcionando tanto a los fabricantes de los componentes como a los profesionales de la construcción información valiosa sobre el potencial de ahorro energético asociado a estos nuevos sistemas constructivos. Asimismo el estudio define los parámetros de diseño adecuados para lograr soluciones eficientes tanto en proyectos nuevos como de rehabilitación. ABSTRACT The general hypothesis this work seeks to demonstrate is that the architectural integration of Semi-Transparent Photovoltaic (STPV) systems can contribute to improving the energy efficiency of buildings. Accordingly, the research has focused on developing a methodology able to quantify the building energy demand reduction provided by these novel constructive solutions. At the same time, the design parameters of the STPV solution have been analysed to establish which of them have the greatest impact on the global energy balance of the building, and therefore which have to be carefully defined in order to optimize the building operation. In the light of these goals, the study methodology has focused on three main points:  To characterise the global energy behaviour of STPV systems in realistic operating conditions, similar to those in which a real system will operate;  To characterise the global energy behaviour of STPV systems in controlled conditions in order to study how the performance varies depending on the design and operating parameters;  To assess the global energy saving potential of STPV systems in comparison with conventional glazing solutions by varying the boundary conditions, including design parameters (such as the degree of transparency), architectural characteristics (such as the Window to Wall Ratio) and climatic conditions (covering the European climatic conditions). In summary, this work has sought to contribute to the understanding of the interaction between STPV systems and the building, providing both components manufacturers and construction technicians, valuable information on the energy savings potential of these new construction systems and defining the appropriate design parameters to achieve efficient solutions in both new and retrofitting projects.