An approach to vision-based station keeping for an unmanned underwater vehicle

This paper presents an automatic vision-based system for UUV station keeping. The vehicle is equipped with a down-looking camera, which provides images of the sea-floor. The station keeping system is based on a feature-based motion detection algorithm, which exploits standard correlation and explicit textural analysis to solve the correspondence problem. A visual map of the area surveyed by the vehicle is constructed to increase the flexibility of the system, allowing the vehicle to position itself when it has lost the reference image. The testing platform is the URIS underwater vehicle. Experimental results demonstrating the behavior of the system on a real environment are presented

Bioinspired autonomous visual vertical control of a quadrotor unmanned aerial vehicle

Near-ground maneuvers, such as hover, approach, and landing, are key elements of autonomy in unmanned aerial vehicles. Such maneuvers have been tackled conventionally by measuring or estimating the velocity and the height above the ground, often using ultrasonic or laser range finders. Near-ground maneuvers are naturally mastered by flying birds and insects because objects below may be of interest for food or shelter. These animals perform such maneuvers efficiently using only the available vision and vestibular sensory information. In this paper, the time-tocontact (tau) theory, which conceptualizes the visual strategy with which many species are believed to approach objects, is presented as a solution for relative ground distance control for unmanned aerial vehicles. The paper shows how such an approach can be visually guided without knowledge of height and velocity relative to the ground. A control scheme that implements the tau strategy is developed employing only visual information from a monocular camera and an inertial measurement unit. To achieve reliable visual information at a high rate, a novel filtering system is proposed to complement the control system. The proposed system is implemented onboard an experimental quadrotor unmannedaerial vehicle and is shown to not only successfully land and approach ground, but also to enable the user to choose the dynamic characteristics of the approach. The methods presented in this paper are applicable to both aerial and space autonomous vehicles.

Experimental model identification of open-frame underwater vehicles

Most of the works published on hydrodynamic parameter identification of open-frame underwater vehicles focus their attention almost exclusively on good coherence between simulated and measured responses, giving less importance to the determination of “actual values” for hydrodynamic parameters. To gain insight into hydrodynamic parameter experimental identification of open-frame underwater vehicles, an experimental identification procedure is proposed here to determine parameters of uncoupled and coupled models. The identification procedure includes: (i) a prior estimation of actual values of the forces/torques applied to the vehicle, (ii) identification of drag parameters from constant velocity tests and (iii) identification of inertia and coupling parameters from oscillatory tests; at this stage, the estimated values of drag parameter obtained in item (ii) are used. The procedure proposed here was used to identify the hydrodynamic parameters of LAURS—an unmanned underwater vehicle developed at the University of São Paulo. The thruster–thruster and thruster–hull interactions and the advance velocity of the vehicle are shown to have a strong impact on the efficiency of thrusters appended to open-frame underwater vehicles, especially for high advance velocities. Results of tests with excitation in 1-DOF and 3-DOF are reported and discussed, showing the feasibility of the developed procedure.

Precision Agriculture without borders: Practical issues and improvements in farmland coverage with aerial vehicles.

This work presents a solution for the aerial coverage of a field by using a fleet of aerial vehicles. The use of Unmanned Aerial Vehicles allows to obtain high resolution mosaics to be used in Precision Agriculture techniques. This report is focus on providing a solution for the full simultaneous coverage problem taking into account restrictions as the required spatial resolution and overlap while maintaining similar light conditions and safety operation of the drones. Results obtained from real field tests are finally reported

Visual Tracking, Pose Estimation, and Control for Aerial Vehicles

El principal objetivo de esta tesis es dotar a los vehículos aéreos no tripulados (UAVs, por sus siglas en inglés) de una fuente de información adicional basada en visión. Esta fuente de información proviene de cámaras ubicadas a bordo de los vehículos o en el suelo. Con ella se busca que los UAVs realicen tareas de aterrizaje o inspección guiados por visión, especialmente en aquellas situaciones en las que no haya disponibilidad de estimar la posición del vehículo con base en GPS, cuando las estimaciones de GPS no tengan la suficiente precisión requerida por las tareas a realizar, o cuando restricciones de carga de pago impidan añadir sensores a bordo de los vehículos. Esta tesis trata con tres de las principales áreas de la visión por computador: seguimiento visual y estimación visual de la pose (posición y orientación), que a su vez constituyen la base de la tercera, denominada control servo visual, que en nuestra aplicación se enfoca en el empleo de información visual para controlar los UAVs. Al respecto, esta tesis se ocupa de presentar propuestas novedosas que permitan solucionar problemas relativos al seguimiento de objetos mediante cámaras ubicadas a bordo de los UAVs, se ocupa de la estimación de la pose de los UAVs basada en información visual obtenida por cámaras ubicadas en el suelo o a bordo, y también se ocupa de la aplicación de las técnicas propuestas para solucionar diferentes problemas, como aquellos concernientes al seguimiento visual para tareas de reabastecimiento autónomo en vuelo o al aterrizaje basado en visión, entre otros. Las diversas técnicas de visión por computador presentadas en esta tesis se proponen con el fin de solucionar dificultades que suelen presentarse cuando se realizan tareas basadas en visión con UAVs, como las relativas a la obtención, en tiempo real, de estimaciones robustas, o como problemas generados por vibraciones. Los algoritmos propuestos en esta tesis han sido probados con información de imágenes reales obtenidas realizando pruebas on-line y off-line. Diversos mecanismos de evaluación han sido empleados con el propósito de analizar el desempeño de los algoritmos propuestos, entre los que se incluyen datos simulados, imágenes de vuelos reales, estimaciones precisas de posición empleando el sistema VICON y comparaciones con algoritmos del estado del arte. Los resultados obtenidos indican que los algoritmos de visión por computador propuestos tienen un desempeño que es comparable e incluso mejor al de algoritmos que se encuentran en el estado del arte. Los algoritmos propuestos permiten la obtención de estimaciones robustas en tiempo real, lo cual permite su uso en tareas de control visual. El desempeño de estos algoritmos es apropiado para las exigencias de las distintas aplicaciones examinadas: reabastecimiento autónomo en vuelo, aterrizaje y estimación del estado del UAV. Abstract The main objective of this thesis is to provide Unmanned Aerial Vehicles (UAVs) with an additional vision-based source of information extracted by cameras located either on-board or on the ground, in order to allow UAVs to develop visually guided tasks, such as landing or inspection, especially in situations where GPS information is not available, where GPS-based position estimation is not accurate enough for the task to develop, or where payload restrictions do not allow the incorporation of additional sensors on-board. This thesis covers three of the main computer vision areas: visual tracking and visual pose estimation, which are the bases the third one called visual servoing, which, in this work, focuses on using visual information to control UAVs. In this sense, the thesis focuses on presenting novel solutions for solving the tracking problem of objects when using cameras on-board UAVs, on estimating the pose of the UAVs based on the visual information collected by cameras located either on the ground or on-board, and also focuses on applying these proposed techniques for solving different problems, such as visual tracking for aerial refuelling or vision-based landing, among others. The different computer vision techniques presented in this thesis are proposed to solve some of the frequently problems found when addressing vision-based tasks in UAVs, such as obtaining robust vision-based estimations at real-time frame rates, and problems caused by vibrations, or 3D motion. All the proposed algorithms have been tested with real-image data in on-line and off-line tests. Different evaluation mechanisms have been used to analyze the performance of the proposed algorithms, such as simulated data, images from real-flight tests, publicly available datasets, manually generated ground truth data, accurate position estimations using a VICON system and a robotic cell, and comparison with state of the art algorithms. Results show that the proposed computer vision algorithms obtain performances that are comparable to, or even better than, state of the art algorithms, obtaining robust estimations at real-time frame rates. This proves that the proposed techniques are fast enough for vision-based control tasks. Therefore, the performance of the proposed vision algorithms has shown to be of a standard appropriate to the different explored applications: aerial refuelling and landing, and state estimation. It is noteworthy that they have low computational overheads for vision systems.

Autonomous Landing of an Unmanned Aerial Vehicle using Image-Based Fuzzy Control

This paper presents a vision based autonomous landing control approach for unmanned aerial vehicles (UAV). The 3D position of an unmanned helicopter is estimated based on the homographies estimated of a known landmark. The translation and altitude estimation of the helicopter against the helipad position are the only information that is used to control the longitudinal, lateral and descend speeds of the vehicle. The control system approach consists in three Fuzzy controllers to manage the speeds of each 3D axis of the aircraft s coordinate system. The 3D position estimation was proven rst, comparing it with the GPS + IMU data with very good results. The robust of the vision algorithm against occlusions was also tested. The excellent behavior of the Fuzzy control approach using the 3D position estimation based in homographies was proved in an outdoors test using a real unmanned helicopter.

A General Purpose Configurable Navigation Controller for Micro Aerial Multirotor Vehicles

In this paper, we consider the problem of autonomous navigation of multirotor platforms in GPS-denied environments. The focus of this work is on safe navigation based on unperfect odometry measurements, such as on-board optical flow measurements. The multirotor platform is modeled as a flying object with specific kinematic constraints that must be taken into account in order to obtain successful results. A navigation controller is proposed featuring a set of configurable parameters that allow, for instance, to have a configuration setup for fast trajectory following, and another to soften the control laws and make the vehicle navigation more precise and slow whenever necessary. The proposed controller has been successfully implemented in two different multirotor platforms with similar sensoring capabilities showing the openness and tolerance of the approach. This research is focused around the Computer Vision Group's objective of applying multirotor vehicles to civilian service applications. The presented work was implemented to compete in the International Micro Air Vehicle Conference and Flight Competition IMAV 2012, gaining two awards: the Special Award on "Best Automatic Performance - IMAV 2012" and the second overall prize in the participating category "Indoor Flight Dynamics - Rotary Wing MAV". Most of the code related to the present work is available as two open-source projects hosted in GitHub.

Unmanned electric propulsion mission capabilities of the SNAP-50/SPUR powerplant /

"Contract AT(30-1)-2789."

DESIGN, FABRICATION, AND PERFORMANCE CHARACTERIZATION OF MULTIFUNCTIONAL STRUCTURES TO HARVEST SOLAR ENERGY FOR FLAPPING WING AERIAL VEHICLES

Flapping Wing Aerial Vehicles (FWAVs) have the capability to combine the benefits of both fixed wing vehicles and rotary vehicles. However, flight time is limited due to limited on-board energy storage capacity. For most Unmanned Aerial Vehicle (UAV) operators, frequent recharging of the batteries is not ideal due to lack of nearby electrical outlets. This imposes serious limitations on FWAV flights. The approach taken to extend the flight time of UAVs was to integrate photovoltaic solar cells onto different structures of the vehicle to harvest and use energy from the sun. Integration of the solar cells can greatly improve the energy capacity of an UAV; however, this integration does effect the performance of the UAV and especially FWAVs. The integration of solar cells affects the ability of the vehicle to produce the aerodynamic forces necessary to maintain flight. This PhD dissertation characterizes the effects of solar cell integration on the performance of a FWAV. Robo Raven, a recently developed FWAV, is used as the platform for this work. An additive manufacturing technique was developed to integrate photovoltaic solar cells into the wing and tail structures of the vehicle. An approach to characterizing the effects of solar cell integration to the wings, tail, and body of the UAV is also described. This approach includes measurement of aerodynamic forces generated by the vehicle and measurements of the wing shape during the flapping cycle using Digital Image Correlation. Various changes to wing, body, and tail design are investigated and changes in performance for each design are measured. The electrical performance from the solar cells is also characterized. A new multifunctional performance model was formulated that describes how integration of solar cells influences the flight performance. Aerodynamic models were developed to describe effects of solar cell integration force production and performance of the FWAV. Thus, performance changes can be predicted depending on changes in design. Sensing capabilities of the solar cells were also discovered and correlated to the deformation of the wing. This demonstrated that the solar cells were capable of: (1) Lightweight and flexible structure to generate aerodynamic forces, (2) Energy harvesting to extend operational time and autonomy, (3) Sensing of an aerodynamic force associated with wing deformation. Finally, different flexible photovoltaic materials with higher efficiencies are investigated, which enable the multifunctional wings to provide enough solar power to keep the FWAV aloft without batteries as long as there is enough sunlight to power the vehicle.

First steps in underwater photogrammetry with the support of an unmanned underwater vehicle

The evolution of modern and increasingly sensitive image sensors, the increasingly compact design of the cameras, and the recent emergence of low-cost cameras allowed the Underwater Photogrammetry to become an infallible and irreplaceable technique used to estimate the structure of the seabed with high accuracy. Within this context, the main topic of this work is the Underwater Photogrammetry from a geomatic point of view and all the issues associated with its implementation, in particular with the support of Unmanned Underwater Vehicles. Questions such as: how does the technique work, what is needed to deal with a proper survey, what tools are available to apply this technique, and how to resolve uncertainties in measurement will be the subject of this thesis. The study conducted can be divided into two major parts: one devoted to several ad-hoc surveys and tests, thus a practical part, another supported by the bibliographical research. However the main contributions are related to the experimental section, in which two practical case studies are carried out in order to improve the quality of the underwater survey of some calibration platforms. The results obtained from these two experiments showed that, the refractive effects due to water and underwater housing can be compensated by the distortion coefficients in the camera model, but if the aim is to achieve high accuracy then a model that takes into account the configuration of the underwater housing, based on ray tracing, must also be coupled. The major contributions that this work brought are: an overview of the practical issues when performing surveys exploiting an UUV prototype, a method to reach a reliable accuracy in the 3D reconstructions without the use of an underwater local geodetic network, a guide for who addresses underwater photogrammetry topics for the first time, and the use of open-source environments.

Modeling and Analysis of Piezoelectric Energy Harvesting From Aeroelastic Vibrations Using the Doublet-Lattice Method

Multifunctional structures are pointed out as an important technology for the design of aircraft with volume, mass, and energy source limitations such as unmanned air vehicles (UAVs) and micro air vehicles (MAVs). In addition to its primary function of bearing aerodynamic loads, the wing/spar structure of an UAV or a MAV with embedded piezoceramics can provide an extra electrical energy source based on the concept of vibration energy harvesting to power small and wireless electronic components. Aeroelastic vibrations of a lifting surface can be converted into electricity using piezoelectric transduction. In this paper, frequency-domain piezoaeroelastic modeling and analysis of a canti-levered platelike wing with embedded piezoceramics is presented for energy harvesting. The electromechanical finite-element plate model is based on the thin-plate (Kirchhoff) assumptions while the unsteady aerodynamic model uses the doublet-lattice method. The electromechanical and aerodynamic models are combined to obtain the piezoaeroelastic equations, which are solved using a p-k scheme that accounts for the electromechanical coupling. The evolution of the aerodynamic damping and the frequency of each mode are obtained with changing airflow speed for a given electrical circuit. Expressions for piezoaeroelastically coupled frequency response functions (voltage, current, and electrical power as well the vibratory motion) are also defined by combining flow excitation with harmonic base excitation. Hence, piezoaeroelastic evolution can be investigated in frequency domain for different airflow speeds and electrical boundary conditions. [DOI:10.1115/1.4002785]

Piezoaeroelastic Modeling and Analysis of a Generator Wing with Continuous and Segmented Electrodes

Unmanned air vehicles (UAVs) and micro air vehicles (MAVs) constitute unique application platforms for vibration-based energy harvesting. Generating usable electrical energy during their mission has the important practical value of providing an additional energy source to run small electronic components. Electrical energy can be harvested from aeroelastic vibrations of lifting surfaces of UAVs and MAVs as they tend to have relatively flexible wings compared to their larger counterparts. In this work, an electromechanically coupled finite element model is combined with an unsteady aerodynamic model to develop a piezoaeroelastic model for airflow excitation of cantilevered plates representing wing-like structures. The electrical power output and the displacement of the wing tip are investigated for several airflow speeds and two different electrode configurations (continuous and segmented). Cancelation of electrical output occurs for typical coupled bending-torsion aeroelastic modes of a cantilevered generator wing when continuous electrodes are used. Torsional motions of the coupled modes become relatively significant when segmented electrodes are used, improving the broadband performance and altering the flutter speed. Although the focus is placed on the electrical power that can be harvested for a given airflow speed, shunt damping effect of piezoelectric power generation is also investigated for both electrode configurations.

Vehicle and driver attributes affecting distance from the steering wheel in motor vehicles

The current study was designed to confirm that female drivers sit closer to the steering wheel than do male drivers and to investigate whether this expected difference in sitting position is attributable to differences in the physical dimensions of men and women. Driver body dimensions and multiple measures of sitting distance from the steering wheel were collected from a sample of 150 men and 150 women. The results confirmed that on average, women sit closer to the steering wheel than men do and that this difference is accounted for by variations in body dimensions, especially height. This result suggests that driver height may provide a good surrogate for sitting distance from the steering wheel when investigating the role of driver position in real-world crash outcomes. The potential applications of this research include change to vehicle design that allows independent adjustment of the relative distance among the driver's seat, the steering wheel, and the floor pedals.

Probing the effect of vehicles on topical delivery: Understanding the basic relationship between solvent and solute penetration using silicone membranes

Purpose. In the present study we examined the relationship between solvent uptake into a model membrane (silicone) with the physical properties of the solvents (e.g., solubility parameter, melting point, molecular weight) and its potential predictability. We then assessed the subsequent topical penetration and retention kinetics of hydrocortisone from various solvents to define whether modifications to either solute diffusivity or partitioning were dominant in increasing permeability through solvent-modified membranes. Methods. Membrane sorption of solvents was determined from weight differences following immersion in individual solvents, corrected for differences in density. Permeability and retention kinetics of H-3-hydrocortisone, applied as saturated solutions in the various solvents, were determined over 48 h in horizontal Franz-type glass diffusion cells. Results. Solvent sorption into the membrane could be related to differences in solubility parameters, MW and hydrogen bonding (r(2) = 0.76). The actual and predicted volume of solvent sorbed into the membrane was also found to be linearly related to Log hydrocortisone flux, with changes in both diffusivity and partitioning of hydrocortisone observed for the different solvent vehicles. Conclusions. A simple structure-based predictive model can be applied to the sorption of solvents into silicone membranes. Changes in solute diffusivity and partitioning appeared to contribute to the increased hydrocortisone flux observed with the various solvent vehicles. The application of this predictive model to the more complex skin membrane remains to be determined.