On-board and Ground Visual Pose Estimation Techniques for UAV Control

In this paper, two techniques to control UAVs (Unmanned Aerial Vehicles), based on visual information are presented. The first one is based on the detection and tracking of planar structures from an on-board camera, while the second one is based on the detection and 3D reconstruction of the position of the UAV based on an external camera system. Both strategies are tested with a VTOL (Vertical take-off and landing) UAV, and results show good behavior of the visual systems (precision in the estimation and frame rate) when estimating the helicopter¿s position and using the extracted information to control the UAV.

Visual Tracking, Pose Estimation, and Control for Aerial Vehicles

El principal objetivo de esta tesis es dotar a los vehículos aéreos no tripulados (UAVs, por sus siglas en inglés) de una fuente de información adicional basada en visión. Esta fuente de información proviene de cámaras ubicadas a bordo de los vehículos o en el suelo. Con ella se busca que los UAVs realicen tareas de aterrizaje o inspección guiados por visión, especialmente en aquellas situaciones en las que no haya disponibilidad de estimar la posición del vehículo con base en GPS, cuando las estimaciones de GPS no tengan la suficiente precisión requerida por las tareas a realizar, o cuando restricciones de carga de pago impidan añadir sensores a bordo de los vehículos. Esta tesis trata con tres de las principales áreas de la visión por computador: seguimiento visual y estimación visual de la pose (posición y orientación), que a su vez constituyen la base de la tercera, denominada control servo visual, que en nuestra aplicación se enfoca en el empleo de información visual para controlar los UAVs. Al respecto, esta tesis se ocupa de presentar propuestas novedosas que permitan solucionar problemas relativos al seguimiento de objetos mediante cámaras ubicadas a bordo de los UAVs, se ocupa de la estimación de la pose de los UAVs basada en información visual obtenida por cámaras ubicadas en el suelo o a bordo, y también se ocupa de la aplicación de las técnicas propuestas para solucionar diferentes problemas, como aquellos concernientes al seguimiento visual para tareas de reabastecimiento autónomo en vuelo o al aterrizaje basado en visión, entre otros. Las diversas técnicas de visión por computador presentadas en esta tesis se proponen con el fin de solucionar dificultades que suelen presentarse cuando se realizan tareas basadas en visión con UAVs, como las relativas a la obtención, en tiempo real, de estimaciones robustas, o como problemas generados por vibraciones. Los algoritmos propuestos en esta tesis han sido probados con información de imágenes reales obtenidas realizando pruebas on-line y off-line. Diversos mecanismos de evaluación han sido empleados con el propósito de analizar el desempeño de los algoritmos propuestos, entre los que se incluyen datos simulados, imágenes de vuelos reales, estimaciones precisas de posición empleando el sistema VICON y comparaciones con algoritmos del estado del arte. Los resultados obtenidos indican que los algoritmos de visión por computador propuestos tienen un desempeño que es comparable e incluso mejor al de algoritmos que se encuentran en el estado del arte. Los algoritmos propuestos permiten la obtención de estimaciones robustas en tiempo real, lo cual permite su uso en tareas de control visual. El desempeño de estos algoritmos es apropiado para las exigencias de las distintas aplicaciones examinadas: reabastecimiento autónomo en vuelo, aterrizaje y estimación del estado del UAV. Abstract The main objective of this thesis is to provide Unmanned Aerial Vehicles (UAVs) with an additional vision-based source of information extracted by cameras located either on-board or on the ground, in order to allow UAVs to develop visually guided tasks, such as landing or inspection, especially in situations where GPS information is not available, where GPS-based position estimation is not accurate enough for the task to develop, or where payload restrictions do not allow the incorporation of additional sensors on-board. This thesis covers three of the main computer vision areas: visual tracking and visual pose estimation, which are the bases the third one called visual servoing, which, in this work, focuses on using visual information to control UAVs. In this sense, the thesis focuses on presenting novel solutions for solving the tracking problem of objects when using cameras on-board UAVs, on estimating the pose of the UAVs based on the visual information collected by cameras located either on the ground or on-board, and also focuses on applying these proposed techniques for solving different problems, such as visual tracking for aerial refuelling or vision-based landing, among others. The different computer vision techniques presented in this thesis are proposed to solve some of the frequently problems found when addressing vision-based tasks in UAVs, such as obtaining robust vision-based estimations at real-time frame rates, and problems caused by vibrations, or 3D motion. All the proposed algorithms have been tested with real-image data in on-line and off-line tests. Different evaluation mechanisms have been used to analyze the performance of the proposed algorithms, such as simulated data, images from real-flight tests, publicly available datasets, manually generated ground truth data, accurate position estimations using a VICON system and a robotic cell, and comparison with state of the art algorithms. Results show that the proposed computer vision algorithms obtain performances that are comparable to, or even better than, state of the art algorithms, obtaining robust estimations at real-time frame rates. This proves that the proposed techniques are fast enough for vision-based control tasks. Therefore, the performance of the proposed vision algorithms has shown to be of a standard appropriate to the different explored applications: aerial refuelling and landing, and state estimation. It is noteworthy that they have low computational overheads for vision systems.

A technical summary and compilation of characteristics and specifications on steep-gradient aircraft; [Project Hummingbird, technical report]

Mode of access: Internet.

Fishing effort and fish yield over a 15 year period on Lake Victoria, Uganda: management implications

The National Fisheries Resources Research Institute (NaFIRRI), the Directorate of Fisheries Resources (DiFR), the Local Government fisheries staff and those from the Beach Management Units (BMUs) of the riparian districts to Lake Victoria regularly and jointly conduct Frame and Catch Assessment Surveys. The information obtained is used to guide fisheries management and development. We reveal the trends in the commercial fish catch landings and fishing effort on the Uganda side of Lake Victoria, over a 15 year period (2000-2015) and provide the underlying factors to the observed changes. The contribution of the high value large size species (Nile perch and Tilapia) to the commercial catch of Lake Victoria has significantly reduced while that of the low value small size species, Mukene has increased over a ten year (2005-2015)period. The information is intended to update and sensitize the key stakeholders on the status of the Lake Victoria fisheries. In addition, the information provided is expected to guide policy formulation and management planning by the fisheries managers at all levels including the BMUs and Landing Site Management Committees (LSMCs), the Local government fisheries staff and the Directorate of Fisheries Resources. The information is anticipated to create awareness among the lakeside fisher communities to reverse the current trend in fish declines.

Análise cinemática tridimensional do salto em distância de atletas de alto nível em competição

Universidade Estadual de Campinas . Faculdade de Educação Física

Desenvolvimento e Controlo de um Veículo Autónomo Aéreo Quadrotor

A crescente necessidade de meios de inspecção e recolha de informação de infraestruturas e do meio ambiente natural, origina o recurso a meios tecnológicos cada vez mais evoluídos. Neste contexto, os robôs móveis autónomos aéreos surgem como uma ferramenta importante. Em particular, os veículos aéreos de asa móvel, pela sua manobrabilidade e controlo podem-se utilizar eficazmente em meios complexos como cenários interiores onde o ambiente é parcialmente controlado. A sua utilização em coordenação com outros veículos robóticos móveis e em particular com a crescente autonomia de decisão, permitem uma eficiência elevada, por exemplo, em tarefas de recolha automática de informação, vigilância, apoio a comunicações, etc. A inexistência de um veículo autónomo de asa móvel no cenário multi-robótico desenvolvido pelo Laboratório de Sistemas Autónomos do Instituto Superior de Engenharia do Porto, aliada às suas aplicações referidas, criou a necessidade do desenvolvimento de um veículo desta gama. Identificou-se, pois, o desenvolvimento de um veículo autónomo aéreo do tipo quadrotor com capacidade de vôo base estabilizado como o problema a resolver. Foi efectuado um levantamento de requisitos do sistema, a caracterização de um veículo autónomo aéreo Vertical Take-off and Landing - VTOL, e efectuado um trabalho de pesquisa a fim de possibilitar o conhecimento das técnicas e tecnologias envolvidas. Tendo em vista o objectivo de controlo e estabilização do veículo, foi efectuada a modelização do sistema que serviu não só para a melhor compreensão da sua dinâmica mas também para o desenvolvimento de um simulador que possibilitou a validação de estratégias de controlo e avaliação de comportamentos do veículo para diferentes cenários. A inexistência de controladores de motores brushless adequada (frequência de controlo), originou o desenvolvimento de um controlador dedicado para motores brushless, motores esses utilizados para a propulsão do veículo. Este controlador permite uma taxa de controlo a uma frequência de 20KHz, possui múltiplas interfaces de comunicação (CAN, RS232, Ethernet, SPI e JTAG), é de reduzido peso e dimensões e modular, visto ter sido implementado em dois módulos, i.e., permite a sua utilização com diferentes interfaces de potência. Projectou-se um veículo autónomo aéreo em termos físicos com a definição da sua arquitectura de hardware e software bem como o sistema de controlo de vôo. O sistema de estabilização de vôo compreende o processamento de informação fornecida por um sistema de navegação inercial, um sonar e o envio de referências de velocidade para cada um dos nós de controlo ligados a um barramento CAN instalado no veículo. A implementação do veículo foi alcançada nas suas vertentes mecânica, de hardware e software. O UAV foi equipado com um sistema computacional dotando-o de capacidades para o desempenho de tarefas previamente analisadas. No presente trabalho, são também tiradas algumas conclusões sobre o desenvolvimento do sistema e sua implementação bem como perspectivada a sua evolução futura no contexto de missões coordenadas de múltiplos veículos robóticos.

A possible territorial or recognition behavior of Leptoglossus zonatus (Dallas) (Heteroptera, Coreidae)

The coreid Leptoglossus zonatus (Dallas, 1852) is commonly found in corn (Zea mays L.) fields in Brazil, and it has been observed flying and landing on objects or persons near these fields. During January, 1995, this behavior was studied in corn plantations. Results indicated that the bugs concentrated on objects (plastic cylinders traps) introduced into their habitat and that their number increased during the first 24 hs. However, as time passed (8 days), this possible territorial or recognition behavior gradually decreased, and tended to disappear.

Saccadic eye movements as an index of perceptual decision-making

One of the most common decisions we make is the one about where to move our eyes next. Here we examine the impact that processing the evidence supporting competing options has on saccade programming. Participants were asked to saccade to one of two possible visual targets indicated by a cloud of moving dots. We varied the evidence which supported saccade target choice by manipulating the proportion of dots moving towards one target or the other. The task was found to become easier as the evidence supporting target choice increased. This was reflected in an increase in percent correct and a decrease in saccade latency. The trajectory and landing position of saccades were found to deviate away from the non-selected target reflecting the choice of the target and the inhibition of the non-target. The extent of the deviation was found to increase with amount of sensory evidence supporting target choice. This shows that decision-making processes involved in saccade target choice have an impact on the spatial control of a saccade. This would seem to extend the notion of the processes involved in the control of saccade metrics beyond a competition between visual stimuli to one also reflecting a competition between options.

The development of the spatial extent of oculomotor inhibition

Inhibition is intimately involved in the ability to select a target for a goal-directed movement. The effect of distracters on the deviation of oculomotor trajectories and landing positions provides evidence of such inhibition. individual saccade trajectories and landing positions may deviate initially either towards, or away from, a competing distracter-the direction and extent of this deviation depends upon saccade latency and the target to distracter separation. However, the underlying commonality of the sources of oculomotor inhibition has not been investigated. Here we report the relationship between distracter-related deviation of saccade trajectory, landing position and saccade latency. Observers saccaded to a target which could be accompanied by a distracter shown at various distances from very close (10 angular degrees) to far away (120 angular degrees). A fixation-gap paradigm was used to manipulate latency independently of the influence of competing distracters. When distracters were close to the target, saccade trajectory and landing position deviated toward the distracter position, while at greater separations landing position was always accurate but trajectories deviated away from the distracters. Different spatial patterns of deviations across latency were found. This pattern of results is consistent with the metrics of the saccade reflecting coarse pooling of the ongoing activity at the distracter location: saccade trajectory reflects activity at saccade initiation while landing position reveals activity at saccade end. (C) 2009 Elsevier B.V. All rights reserved.

Bio-inspired autonomous visual vertical control of a quadrotor UAV

Near ground maneuvers, such as hover, approach and landing, are key elements of autonomy in unmanned aerial vehicles. Such maneuvers have been tackled conventionally by measuring or estimating the velocity and the height above the ground often using ultrasonic or laser range finders. Near ground maneuvers are naturally mastered by flying birds and insects as objects below may be of interest for food or shelter. These animals perform such maneuvers efficiently using only the available vision and vestibular sensory information. In this paper, the time-to-contact (Tau) theory, which conceptualizes the visual strategy with which many species are believed to approach objects, is presented as a solution for Unmanned Aerial Vehicles (UAV) relative ground distance control. The paper shows how such an approach can be visually guided without knowledge of height and velocity relative to the ground. A control scheme that implements the Tau strategy is developed employing only visual information from a monocular camera and an inertial measurement unit. To achieve reliable visual information at a high rate, a novel filtering system is proposed to complement the control system. The proposed system is implemented on-board an experimental quadrotor UAV and shown not only to successfully land and approach ground, but also to enable the user to choose the dynamic characteristics of the approach. The methods presented in this paper are applicable to both aerial and space autonomous vehicles.

Bioinspired autonomous visual vertical control of a quadrotor unmanned aerial vehicle

Near-ground maneuvers, such as hover, approach, and landing, are key elements of autonomy in unmanned aerial vehicles. Such maneuvers have been tackled conventionally by measuring or estimating the velocity and the height above the ground, often using ultrasonic or laser range finders. Near-ground maneuvers are naturally mastered by flying birds and insects because objects below may be of interest for food or shelter. These animals perform such maneuvers efficiently using only the available vision and vestibular sensory information. In this paper, the time-tocontact (tau) theory, which conceptualizes the visual strategy with which many species are believed to approach objects, is presented as a solution for relative ground distance control for unmanned aerial vehicles. The paper shows how such an approach can be visually guided without knowledge of height and velocity relative to the ground. A control scheme that implements the tau strategy is developed employing only visual information from a monocular camera and an inertial measurement unit. To achieve reliable visual information at a high rate, a novel filtering system is proposed to complement the control system. The proposed system is implemented onboard an experimental quadrotor unmannedaerial vehicle and is shown to not only successfully land and approach ground, but also to enable the user to choose the dynamic characteristics of the approach. The methods presented in this paper are applicable to both aerial and space autonomous vehicles.

Attempted re-establishment of a sooty tern Onychoprion fuscatus breeding colony on Denis Island, Seychelles

Seychelles supports around three million nesting pairs of sooty terns. However, there have been recent declines and the colonies continue to face ongoing threats from habitat change and excessive commercial harvesting of their eggs, as well as potential threats by commercial fishing and climate change. A possible method to counter these threats is to re-establish breeding colonies on islands from which they have disappeared. An attempt was made to attract birds to a previously occupied island through habitat management, decoy birds and playback of recorded sooty tern calls. Habitat preparation involved predator eradication and tree removal to provide open ground with bare sandy areas and low herb vegetation. Overflying birds were attracted by broadcast calls, with some circling over and landing among the decoys. Large three-dimensional plastic models were superior to other models presented. This study demonstrated that large numbers of birds can be attracted by these means and that the birds then undertook behaviour associated with breeding, including egg laying by a few birds. However, after five seasons a breeding colony has not yet been established; one possible cause is the emergence of unexpected egg predators, common moorhen Gallinula chloropus and common myna Acridotheres tristis.

Seven steps to a successful career

A guide to succeeding in finding the right career and landing the perfect job.

Avaliação da incorporação combinada dos resíduos de cascalho de perfuração de poço de petróleo e de polimento do porcelanato em cerâmica vermelha

Among the industries, those that produce ceramic porcelain for use in construction industry and oil, during the exploration and production period, play an important role in the production of waste. Much research has been carried out both by academia and the productive sector, sometimes reintroducing them in the same production line that generated them, sometimes in areas unrelated to their generation, as in the production of concrete and mortar for the construction, for example, but each one in an isolated way. In this research, the aim is to study the combined incorporation of the waste drill cuttings of oil well and the residue of the polishing of porcelain, generated in the final stage of finishing of this product in a clay matrix, for the production of red pottery, specifically bricks, ceramic blocks and tiles. The clay comes from the municipality of São Gonçalo, RN, the drilling waste is from the Natal basin, in Rio Grande do Norte, and the residue of the polishing proceeds from a ceramic porcelain of the State of Paraíba. For this purpose, we used a mixture of a plastic clay with a non-plastic, in a ratio of 50% each, settling formulations with the addition of these two residues in this clay matrix. In the formulations, both residues were incorporated with a minimum percentage of 2.5% and maximum of 12.5%, varying from 2.5% each, in each formulation, which the sum of the waste be no more than 15%. It should be noted that the residue of the polishing of ceramic porcelain is a IIa class (not inert). The materials were characterized by XRF, XRD, TG, DTA, laser granulometry and the plasticity index. The technological properties of water absorption, apparent porosity, linear shrinkage of burning, flexural tensile strength and bulk density were evaluated after the sintering of the pieces to 850 °C, 950 °C and 1050 °C, with a burning time of 3 hr, 3 hr and 30 minutes, and 3 hr and 50 minutes, respectively, with a heating rate of 10 °C/minute, for all formulations and landing of 30 minutes. To better understand the influence of each residue and temperature on the evaluated properties, we used the factorial planning and its surfaces of response for the interpretation of the results. It was found that the temperature has no statistical significance at a 95% of reliability level in flexural tensile strength and that it decreases the water absorption and the porosity, but increases the shrinkage and the bulk density. The results showed the feasibility of the desired incorporation, but adjusting the temperature to each product and formulation, and that the temperatures of 850 °C and 950 °C were the one that responded to the largest number of formulations

Parâmetros cinemáticos da marcha com obstáculos em idosos com Doença de Parkinson, com e sem efeito da levodopa: um estudo piloto

CONTEXTO: Os efeitos da levodopa na marcha de pacientes com Doença de Parkinson (DP) em terrenos desobstruídos são conhecidos, mas pouco se conhece sobre seus efeitos na marcha com obstáculos. OBJETIVO: Este estudo objetivou descrever, por meio de ferramenta cinemática, o comportamento locomotor de pacientes com DP e verificar as estratégias locomotoras, sem e sob o efeito da levodopa, durante a ultrapassagem de obstáculos de diferentes alturas. MÉTODO: Cinco pacientes com DP (Hoehn e Yahr= 2±0; idade= 68,4±5,7 anos) percorreram, andando, 10m e ultrapassaram um de dois obstáculos (alto= metade da altura do joelho e baixo= altura do tornozelo) posicionado no meio da passarela em duas sessões (em jejum e no pico de ação do medicamento). As seguintes variáveis foram coletadas e analisadas: distância horizontal pé-obstáculo (DHPO), distância vertical pé-obstáculo (DVPO); distância horizontal obstáculo-pé (DHOP) e velocidades médias, horizontais e verticais, nas fases de abordagem e aterrissagem (respectivamente, VHAO,VVAO; VHDO,VVDO). RESULTADOS: A ANOVA, por tentativa, revelou efeito principal de obstáculo para DVPO (F1,49=15,33; p< 0,001), para VVAO (F1,49= 82,184; p< 0,001), para VHDO (F1,49= 15,33; p< 0,001) e para VVDO (F1,49= 31,30; p< 0,001); e efeito principal de medicamento para DVPO (F1,49= 6,66; p< 0,013) e para VVAO (F1,49= 10,174; p< 0,002). CONCLUSÕES: Pacientes foram mais perturbados pelo obstáculo alto. Os sintomas da DP (bradicinesia e hipocinesia) foram diminuídos com o medicamento, evidenciando aumento geral da velocidade da perna de abordagem e da margem de segurança sobre os obstáculos. Pacientes com DP, independente da condição de medicamento, apresentaram um comportamento que garantiu segurança e estabilidade na marcha.