The use of context in the classification of urban aerial imagery

Urban regions present some of the most challenging areas for the remote sensing community. Many different types of land cover have similar spectral responses, making them difficult to distinguish from one another. Traditional per-pixel classification techniques suffer particularly badly because they only use these spectral properties to determine a class, and no other properties of the image, such as context. This project presents the results of the classification of a deeply urban area of Dudley, West Midlands, using 4 methods: Supervised Maximum Likelihood, SMAP, ECHO and Unsupervised Maximum Likelihood. An accuracy assessment method is then developed to allow a fair representation of each procedure and a direct comparison between them. Subsequently, a classification procedure is developed that makes use of the context in the image, though a per-polygon classification. The imagery is broken up into a series of polygons extracted from the Marr-Hildreth zero-crossing edge detector. These polygons are then refined using a region-growing algorithm, and then classified according to the mean class of the fine polygons. The imagery produced by this technique is shown to be of better quality and of a higher accuracy than that of other conventional methods. Further refinements are suggested and examined to improve the aesthetic appearance of the imagery. Finally a comparison with the results produced from a previous study of the James Bridge catchment, in Darleston, West Midlands, is made, showing that the Polygon classified ATM imagery performs significantly better than the Maximum Likelihood classified videography used in the initial study, despite the presence of geometric correction errors.

Deep learning based style transfer for low altitude aerial imagery

Unmanned Aerial Vehicle (UAVs) equipped with cameras have been fast deployed to a wide range of applications, such as smart cities, agriculture or search and rescue applications. Even though UAV datasets exist, the amount of open and quality UAV datasets is limited. So far, we want to overcome this lack of high quality annotation data by developing a simulation framework for a parametric generation of synthetic data. The framework accepts input via a serializable format. The input specifies which environment preset is used, the objects to be placed in the environment along with their position and orientation as well as additional information such as object color and size. The result is an environment that is able to produce UAV typical data: RGB image from the UAVs camera, altitude, roll, pitch and yawn of the UAV. Beyond the image generation process, we improve the resulting image data photorealism by using Synthetic-To-Real transfer learning methods. Transfer learning focuses on storing knowledge gained while solving one problem and applying it to a different - although related - problem. This approach has been widely researched in other affine fields and results demonstrate it to be an interesing area to investigate. Since simulated images are easy to create and synthetic-to-real translation has shown good quality results, we are able to generate pseudo-realistic images. Furthermore, object labels are inherently given, so we are capable of extending the already existing UAV datasets with realistic quality images and high resolution meta-data. During the development of this thesis we have been able to produce a result of 68.4% on UAVid. This can be considered a new state-of-art result on this dataset.

Aerial video geo-registration using terrain models from dense and coherent stereo matching

In the context of aerial imagery, one of the first steps toward a coherent processing of the information contained in multiple images is geo-registration, which consists in assigning geographic 3D coordinates to the pixels of the image. This enables accurate alignment and geo-positioning of multiple images, detection of moving objects and fusion of data acquired from multiple sensors. To solve this problem there are different approaches that require, in addition to a precise characterization of the camera sensor, high resolution referenced images or terrain elevation models, which are usually not publicly available or out of date. Building upon the idea of developing technology that does not need a reference terrain elevation model, we propose a geo-registration technique that applies variational methods to obtain a dense and coherent surface elevation model that is used to replace the reference model. The surface elevation model is built by interpolation of scattered 3D points, which are obtained in a two-step process following a classical stereo pipeline: first, coherent disparity maps between image pairs of a video sequence are estimated and then image point correspondences are back-projected. The proposed variational method enforces continuity of the disparity map not only along epipolar lines (as done by previous geo-registration techniques) but also across them, in the full 2D image domain. In the experiments, aerial images from synthetic video sequences have been used to validate the proposed technique.

Testing low-altitude infrared digital photography from a mini-UAV to retrieve information for biological conservation

Satellite remote sensing imagery is used for forestry, conservation and environmental applications, but insufficient spatial resolution, and, in particular, unavailability of images at the precise timing required for a given application, often prevent achieving a fully operational stage. Airborne remote sensing has the advantage of custom-tuned sensors, resolution and timing, but its price prevents using it as a routine technique for the mentioned fields. Some Unmanned Aerial Vehicles might provide a “third way” solution as low-cost techniques for acquiring remotely sensed information, under close control of the end-user, albeit at the expense of lower quality instrumentation and instability. This report evaluates a light remote sensing system based on a remotely-controlled mini-UAV (ATMOS-3) equipped with a color infra-red camera (VEGCAM-1) designed and operated by CATUAV. We conducted a testing mission over a Mediterranean landscape dominated by an evergreen woodland of Aleppo pine (Pinus halepensis) and (Holm) oak (Quercus ilex) in the Montseny National Park (Catalonia, NE Spain). We took advantage of state-of-the-art ortho-rectified digital aerial imagery (acquired by the Institut Cartogràfic de Catalunya over the area during the previous year) and used it as quality reference. In particular, we paid attention to: 1) Operationality of flight and image acquisition according to a previously defined plan; 2) Radiometric and geometric quality of the images; and 3) Operational use of the images in the context of applications. We conclude that the system has achieved an operational stage regarding flight activities, although with meteorological limits set by wind speed and turbulence. Appropriate landing areas can be sometimes limiting also, but the system is able to land on small and relatively rough terrains such as patches of grassland or short matorral, and we have operated the UAV as far as 7 km from the control unit. Radiometric quality is sufficient for interactive analysis, but probably insufficient for automated processing. A forthcoming camera is supposed to greatly improve radiometric quality and consistency. Conventional GPS positioning through time synchronization provides coarse orientation of the images, with no roll information.

A discrete forest in a continuous landscape : investigating interactions between natural resource management and sustainable development

Summary Forests are key ecosystems of the earth and associated with a large range of functions. Many of these functions are beneficial to humans and are referred to as ecosystem services. Sustainable development requires that all relevant ecosystem services are quantified, managed and monitored equally. Natural resource management therefore targets the services associated with ecosystems. The main hypothesis of this thesis is that the spatial and temporal domains of relevant services do not correspond to a discrete forest ecosystem. As a consequence, the services are not quantified, managed and monitored in an equal and sustainable manner. The thesis aims were therefore to test this hypothesis, establish an improved conceptual approach and provide spatial applications for the relevant land cover and structure variables. The study was carried out in western Switzerland and based primarily on data from a countrywide landscape inventory. This inventory is part of the third Swiss national forest inventory and assesses continuous landscape variables based on a regular sampling of true colour aerial imagery. In addition, land cover variables were derived from Landsat 5 TM passive sensor data and land structure variables from active sensor data from a small footprint laserscanning system. The results confirmed the main hypothesis, as relevant services did not scale well with the forest ecosystem. Instead, a new conceptual approach for sustainable management of natural resources was described. This concept quantifies the services as a continuous function of the landscape, rather than a discrete function of the forest ecosystem. The explanatory landscape variables are therefore called continuous fields and the forest becomes a dependent and function-driven management unit. Continuous field mapping methods were established for land cover and structure variables. In conclusion, the discrete forest ecosystem is an adequate planning and management unit. However, monitoring the state of and trends in sustainability of services requires them to be quantified as a continuous function of the landscape. Sustainable natural resource management iteratively combines the ecosystem and gradient approaches. Résumé Les forêts sont des écosystèmes-clés de la terre et on leur attribue un grand nombre de fonctions. Beaucoup de ces fonctions sont bénéfiques pour l'homme et sont nommées services écosystémiques. Le développement durable exige que ces services écosystémiques soient tous quantifiés, gérés et surveillés de façon égale. La gestion des ressources naturelles a donc pour cible les services attribués aux écosystèmes. L'hypothèse principale de cette thèse est que les domaines spatiaux et temporels des services attribués à la forêt ne correspondent pas à un écosystème discret. Par conséquent, les services ne sont pas quantifiés, aménagés et surveillés d'une manière équivalente et durable. Les buts de la thèse étaient de tester cette hypothèse, d'établir une nouvelle approche conceptuelle de la gestion des ressources naturelles et de préparer des applications spatiales pour les variables paysagères et structurelles appropriées. L'étude a été menée en Suisse occidentale principalement sur la base d'un inventaire de paysage à l'échelon national. Cet inventaire fait partie du troisième inventaire forestier national suisse et mesure de façon continue des variables paysagères sur la base d'un échantillonnage régulier sur des photos aériennes couleur. En outre, des variables de couverture ? terrestre ont été dérivées des données d'un senseur passif Landsat 5 TM, ainsi que des variables structurelles, dérivées du laserscanning, un senseur actif. Les résultats confirment l'hypothèse principale, car l'échelle des services ne correspond pas à celle de l'écosystème forestier. Au lieu de cela, une nouvelle approche a été élaborée pour la gestion durable des ressources naturelles. Ce concept représente les services comme une fonction continue du paysage, plutôt qu'une fonction discrète de l'écosystème forestier. En conséquence, les variables explicatives de paysage sont dénommées continuous fields et la forêt devient une entité dépendante, définie par la fonction principale du paysage. Des méthodes correspondantes pour la couverture terrestre et la structure ont été élaborées. En conclusion, l'écosystème forestier discret est une unité adéquate pour la planification et la gestion. En revanche, la surveillance de la durabilité de l'état et de son évolution exige que les services soient quantifiés comme fonction continue du paysage. La gestion durable des ressources naturelles joint donc l'approche écosystémique avec celle du gradient de manière itérative.

Emergent geomorphic-vegetation interactions on a subalpine alluvial fan

Following perturbation, an ecosystem (flora, fauna, soil) should evolve as a function of time at a rate conditioned by external variables (relief, climate, geology). More recently, biogeomorphologists have focused upon the notion of co-development of geomorphic processes with ecosystems over very short through to very long (evolutionary) timescales. Alpine environments have been a particular focus of this co-development. However, work in this field has tended to adopt a simplified view of the relationship between perturbation and succession, including: how the landform and ecosystem itself conditions the impact of a perturbation to create a complex spatial response impact; and how perturbations are not simply ecosystem destroyers but can be a significant source of ecosystem resources. What this means is that at the within landform scale, there may well be a complex and dynamic topographic and sedimentological template that co-develops with soil, flora and fauna. Here, we present and test a conceptual model of this template for a subalpine alluvial fan. We combine detailed floristic inventory with soil inventory, determination of edaphic variables and analysis of historical aerial imagery. Spatial variation in the probability of perturbation of sites on the fan surface was associated with down fan variability in the across-fan distribution of fan ages, fan surface channel characteristics and fan surface sedimentology. Floristic survey confirmed that these edaphic factors distinguished site floristic richness and plant communities up until the point that the soil-vegetation system was sufficiently developed to sustain plant communities regardless of edaphic conditions. Thus, the primary explanatory variable was the estimated age of each site, which could be tied back into perturbation history and its spatial expression due to the geometry of the fan: distinct plant communities were emergent both across fan and down fan, a distribution maintained by the way in which the fan dissipates potentially perturbing events.

ESTIMATION OF CORK PRODUCTION USINGAERIAL IMAGERY1

ABSTRACT Inventory and prediction of cork harvest over time and space is important to forest managers who must plan and organize harvest logistics (transport, storage, etc.). Common field inventory methods including the stem density, diameter and height structure are costly and generally point (plot) based. Furthermore, the irregular horizontal structure of cork oak stands makes it difficult, if not impossible, to interpolate between points. We propose a new method to estimate cork production using digital multispectral aerial imagery. We study the spectral response of individual trees in visible and near infrared spectra and then correlate that response with cork production prior to harvest. We use ground measurements of individual trees production to evaluate the model’s predictive capacity. We propose 14 candidate variables to predict cork production based on crown size in combination with different NDVI index derivates. We use Akaike Information Criteria to choose the best among them. The best model is composed of combinations of different NDVI derivates that include red, green, and blue channels. The proposed model is 15% more accurate than a model that includes only a crown projection without any spectral information.

Predição de sombras de edifícios sobre vias urbanas com base em modelos digitais de elevações e dados de imagens aéreas de alta resolução

This research presents a methodology for prediction of building shadows cast on urban roads existing on high-resolution aerial imagery. Shadow elements can be used in the modeling of contextual information, whose use has become more and more common in image analysis complex processes. The proposed methodology consists in three sequential steps. First, the building roof contours are manually extracted from an intensity image generated by the transformation of a digital elevation model (DEM) obtained from airborne laser scanning data. In similarly, the roadside contours are extracted, now from the radiometric information of the laser scanning data. Second, the roof contour polygons are projected onto the adjacent roads by using the parallel projection straight lines, whose directions are computed from the solar ephemeris, which depends on the aerial image acquisition time. Finally, parts of shadow polygons that are free from building perspective obstructions are determined, given rise to new shadow polygons. The results obtained in the experimental evaluation of the methodology showed that the method works properly, since it allowed the prediction of shadow in high-resolution imagery with high accuracy and reliability.

Extração de contornos de telhado de edifícios no espaço-objeto baseada em snakes e programação dinâmica a partir de TIN/laser e imagens aéreas de alta resolução

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Estudo da inflexão da Serra do Garrote e sua influência na zona de falha de Vazante (MG)

The Vazante Fault Zone (VFZ), located northwestward of Minas Gerais, host the largest zinc deposit known in the Brazilian territory. This structure is hosted in Vazante’s Group rocks, a metassedimentary sequence of marine environment. Near Vazante is situated the south end of the VFZ. To the west, occur the Serra do Garrote inflexion, characterized by a curvature in the contact of Formations Serra do Garrote and Serra do Poço Verde. This structure is through the analysis of aerial imagery of the region and represented in the published geological maps. The objective of this work is to understand what causes this inflexion and determine whether it affects the VZF, causing a shift in the same, and possibly, in the mineralization as well. To this end, it was done a mapping work in the region covering the Serra do Garrote inflexion and the south end of the VFZ, in 1:25.000 scale, supplemented by petrographic description of thin section and geologic sections, with cooperated to the understanding of the structural evolution of the region. Data analysis allowed the identification of six deformation phases. The D1 an D2 phases generated the main foliation. The D3 phase generate kink bands folds, with NS axis and vertical axial plane. The fourth phase is responsible for generating the Vazante Fault Zone. The fifth phase produces low angle folds and shear zones, subparallel to S1//S2. The last phase generates folds with NW axis and vertical axial plane, with causes the inflection of lithologic contactas. Field observations also make possible the conclusion that the Vazante Fault Zone presents a south continuation, which is affected by deformation associated to D6 phase attributing to the trace of the VFZ a curved geometry, similar to that exhibited by lithologic contacts between units of the map

Geospatial analysis of western juniper (Juniperus occidentalis) encroachment utilizing remotely sensed data

Utilizing remote sensing methods to assess landscape-scale ecological change are rapidly becoming a dominant force in the natural sciences. Powerful and robust non-parametric statistical methods are also actively being developed to compliment the unique characteristics of remotely sensed data. The focus of this research is to utilize these powerful, robust remote sensing and statistical approaches to shed light on woody plant encroachment into native grasslands--a troubling ecological phenomenon occurring throughout the world. Specifically, this research investigates western juniper encroachment within the sage-steppe ecosystem of the western USA. Western juniper trees are native to the intermountain west and are ecologically important by means of providing structural diversity and habitat for many species. However, after nearly 150 years of post-European settlement changes to this threatened ecosystem, natural ecological processes such as fire regimes no longer limit the range of western juniper to rocky refugia and other areas protected from short fire return intervals that are historically common to the region. Consequently, sage-steppe communities with high juniper densities exhibit negative impacts, such as reduced structural diversity, degraded wildlife habitat and ultimately the loss of biodiversity. Much of today's sage-steppe ecosystem is transitioning to juniper woodlands. Additionally, the majority of western juniper woodlands have not reached their full potential in both range and density. The first section of this research investigates the biophysical drivers responsible for juniper expansion patterns observed in the sage-steppe ecosystem. The second section is a comprehensive accuracy assessment of classification methods used to identify juniper tree cover from multispectral 1 m spatial resolution aerial imagery.

Unravelling past flash flood activity in a forested mountain catchment of the Spanish Central System

Flash floods represent one of the most common natural hazards in mountain catchments, and are frequent in Mediterranean environments. As a result of the widespread lack of reliable data on past events, the understanding of their spatio-temporal occurrence and their climatic triggers remains rather limited. Here, we present a dendrogeomorphic reconstruction of past flash flood activity in the Arroyo de los Puentes stream (Sierra de Guadarrama, Spanish Central System). We analyze a total of 287 increment cores from 178 disturbed Scots pine trees (Pinus sylvestris L.) which yielded indications on 212 growth disturbances related to past flash flood impact. In combination with local archives, meteorological data, annual forest management records and highly-resolved terrestrial data (i.e., LiDAR data and aerial imagery), the dendrogeomorphic time series allowed dating 25 flash floods over the last three centuries, with a major event leaving an intense geomorphic footprint throughout the catchment in 1936. The analysis of meteorological records suggests that the rainfall thresholds of flash floods vary with the seasonality of events. Dated flash floods in the 20th century were primarily related with synoptic troughs owing to the arrival of air masses from north and west on the Iberian Peninsula during negative indices of the North Atlantic Oscillation. The results of this study contribute considerably to a better understanding of hazards related with hydrogeomorphic processes in central Spain in general and in the Sierra de Guadarrama National Park in particular.

A Guide to Surface Features Related to Underground Coal Mining

The purpose of this guide is to assist investigators conducting geologic hazard assessments with the understanding, detection, and characterization of surface features related to subsidence from underground coal mining. Subsidence related to underground coal mining can present serious problems to new and/or existing infrastructure, utilities, and facilities. For example, heavy equipment driving over the ground surface during construction processes may punch into voids created by sinkholes or cracks, resulting in injury to persons and property. Abandoned underground mines also may be full of water, and if punctured, can flood nearby areas. Furthermore, the integrity of rigid structures such as buildings, dams and bridges may be compromised if mining subsidence results in differential movement at the ground surface. Subsidence of the ground surface is a phenomenon associated with the removal of material at depth, and may occur coincident with mining, gradually over time, or sometimes suddenly, long after mining operations have ceased (Gray and Bruhn, 1984). The spatial limits of underground coal mines may extend for great distances beyond the surface operations of a mine, in some cases more than 10 miles for an individual mine. When conducting geologic hazard assessments, several remote investigation methods can be used to observe surface features related to underground mining subsidence. LiDAR-derived DEMs are generally the most useful method available for identifying these features because the bare earth surface can be viewed. However, due to limitations in the availability of LiDAR data, other methods often need to be considered when investigating surface features related to underground coal mining subsidence, such as Google Earth and aerial imagery. Mine maps, when available, can be viewed in tandem with these datasets, potentially improving the confidence of any possible mining subsidence-related features observed remotely. However, maps for both active and abandoned mines may be incomplete or unavailable. Therefore, it is important to be able to recognize possible surface features related to underground mining subsidence. This guide provides examples of surface subsidence features related to the two principal underground coal mining methods used in the United States: longwall mining and room and pillar mining. The depth and type of mining, geologic conditions, hydrologic conditions, and time are all factors that may influence the type of features that manifest at the surface. This guide provides investigators a basic understanding about the size, character and conditions of various surface features that occur as a result of underground mining subsidence.