Kernel-based methods for change detection in remote sensing images

Nowadays, the joint exploitation of images acquired daily by remote sensing instruments and of images available from archives allows a detailed monitoring of the transitions occurring at the surface of the Earth. These modifications of the land cover generate spectral discrepancies that can be detected via the analysis of remote sensing images. Independently from the origin of the images and of type of surface change, a correct processing of such data implies the adoption of flexible, robust and possibly nonlinear method, to correctly account for the complex statistical relationships characterizing the pixels of the images. This Thesis deals with the development and the application of advanced statistical methods for multi-temporal optical remote sensing image processing tasks. Three different families of machine learning models have been explored and fundamental solutions for change detection problems are provided. In the first part, change detection with user supervision has been considered. In a first application, a nonlinear classifier has been applied with the intent of precisely delineating flooded regions from a pair of images. In a second case study, the spatial context of each pixel has been injected into another nonlinear classifier to obtain a precise mapping of new urban structures. In both cases, the user provides the classifier with examples of what he believes has changed or not. In the second part, a completely automatic and unsupervised method for precise binary detection of changes has been proposed. The technique allows a very accurate mapping without any user intervention, resulting particularly useful when readiness and reaction times of the system are a crucial constraint. In the third, the problem of statistical distributions shifting between acquisitions is studied. Two approaches to transform the couple of bi-temporal images and reduce their differences unrelated to changes in land cover are studied. The methods align the distributions of the images, so that the pixel-wise comparison could be carried out with higher accuracy. Furthermore, the second method can deal with images from different sensors, no matter the dimensionality of the data nor the spectral information content. This opens the doors to possible solutions for a crucial problem in the field: detecting changes when the images have been acquired by two different sensors.

Parallelizing remote sensing image geometric correction

Remote sensing spatial, spectral, and temporal resolutions of images, acquired over a reasonably sized image extent, result in imagery that can be processed to represent land cover over large areas with an amount of spatial detail that is very attractive for monitoring, management, and scienti c activities. With Moore's Law alive and well, more and more parallelism is introduced into all computing platforms, at all levels of integration and programming to achieve higher performance and energy e ciency. Being the geometric calibration process one of the most time consuming processes when using remote sensing images, the aim of this work is to accelerate this process by taking advantage of new computing architectures and technologies, specially focusing in exploiting computation over shared memory multi-threading hardware. A parallel implementation of the most time consuming process in the remote sensing geometric correction has been implemented using OpenMP directives. This work compares the performance of the original serial binary versus the parallelized implementation, using several multi-threaded modern CPU architectures, discussing about the approach to nd the optimum hardware for a cost-e ective execution.

Domain Adaptation in remote sensing: increasing the portability of land-cover classifiers

Among the types of remote sensing acquisitions, optical images are certainly one of the most widely relied upon data sources for Earth observation. They provide detailed measurements of the electromagnetic radiation reflected or emitted by each pixel in the scene. Through a process termed supervised land-cover classification, this allows to automatically yet accurately distinguish objects at the surface of our planet. In this respect, when producing a land-cover map of the surveyed area, the availability of training examples representative of each thematic class is crucial for the success of the classification procedure. However, in real applications, due to several constraints on the sample collection process, labeled pixels are usually scarce. When analyzing an image for which those key samples are unavailable, a viable solution consists in resorting to the ground truth data of other previously acquired images. This option is attractive but several factors such as atmospheric, ground and acquisition conditions can cause radiometric differences between the images, hindering therefore the transfer of knowledge from one image to another. The goal of this Thesis is to supply remote sensing image analysts with suitable processing techniques to ensure a robust portability of the classification models across different images. The ultimate purpose is to map the land-cover classes over large spatial and temporal extents with minimal ground information. To overcome, or simply quantify, the observed shifts in the statistical distribution of the spectra of the materials, we study four approaches issued from the field of machine learning. First, we propose a strategy to intelligently sample the image of interest to collect the labels only in correspondence of the most useful pixels. This iterative routine is based on a constant evaluation of the pertinence to the new image of the initial training data actually belonging to a different image. Second, an approach to reduce the radiometric differences among the images by projecting the respective pixels in a common new data space is presented. We analyze a kernel-based feature extraction framework suited for such problems, showing that, after this relative normalization, the cross-image generalization abilities of a classifier are highly increased. Third, we test a new data-driven measure of distance between probability distributions to assess the distortions caused by differences in the acquisition geometry affecting series of multi-angle images. Also, we gauge the portability of classification models through the sequences. In both exercises, the efficacy of classic physically- and statistically-based normalization methods is discussed. Finally, we explore a new family of approaches based on sparse representations of the samples to reciprocally convert the data space of two images. The projection function bridging the images allows a synthesis of new pixels with more similar characteristics ultimately facilitating the land-cover mapping across images.

Estimation of soil moisture in the root-zone from remote sensing data

Field-based soil moisture measurements are cumbersome. Thus, remote sensing techniques are needed because allows field and landscape-scale mapping of soil moisture depth-averaged through the root zone of existing vegetation. The objective of the study was to evaluate the accuracy of an empirical relationship to calculate soil moisture from remote sensing data of irrigated soils of the Apodi Plateau, in the Brazilian semiarid region. The empirical relationship had previously been tested for irrigated soils in Mexico, Egypt, and Pakistan, with promising results. In this study, the relationship was evaluated from experimental data collected from a cotton field. The experiment was carried out in an area of 5 ha with irrigated cotton. The energy balance and evaporative fraction (Λ) were measured by the Bowen ratio method. Soil moisture (θ) data were collected using a PR2 - Profile Probe (Delta-T Devices Ltd). The empirical relationship was tested using experimentally collected Λ and θ values and was applied using the Λ values obtained from the Surface Energy Balance Algorithm for Land (SEBAL) and three TM - Landsat 5 images. There was a close correlation between measured and estimated θ values (p<0.05, R² = 0.84) and there were no significant differences according to the Student t-test (p<0.01). The statistical analyses showed that the empirical relationship can be applied to estimate the root-zone soil moisture of irrigated soils, i.e. when the evaporative fraction is greater than 0.45.

Recent advances in remote sensing image processing

Remote sensing image processing is nowadays a mature research area. The techniques developed in the field allow many real-life applications with great societal value. For instance, urban monitoring, fire detection or flood prediction can have a great impact on economical and environmental issues. To attain such objectives, the remote sensing community has turned into a multidisciplinary field of science that embraces physics, signal theory, computer science, electronics, and communications. From a machine learning and signal/image processing point of view, all the applications are tackled under specific formalisms, such as classification and clustering, regression and function approximation, image coding, restoration and enhancement, source unmixing, data fusion or feature selection and extraction. This paper serves as a survey of methods and applications, and reviews the last methodological advances in remote sensing image processing.

The Use of Remote Sensing Techniques Compared to Traditional Archaeological Phase II Testing Methods: A Cost-Benefit Analysis, HR-524, 1986

Remote sensing was utilized in the Phase II Cultural Resources Investigation for this project in lieu of extensive excavations. The purpose of the present report is to compare the costs and benefits of the use of remote sensing to the hypothetical use of traditional excavation methods for this project. Estimates for this hypothetical situation are based on the project archaeologist's considerable past experience in conducting similar investigations. Only that part of the Phase II investigation involving field investigations is addressed in this report. Costs for literature review, laboratory analysis, report preparation, etc., are not included. The project manager proposed the use of this technique for the fol lowing logistic, safety and budgetary reasons.

Remote Sensing (LIDAR) for Management of Highway Assets for Safety, 2003

The main objective of this study was to utilize light detection and ranging (LIDAR) technology to obtain highway safety-related information. The safety needs of older drivers in terms of prolonged reaction times were taken into consideration. The tasks undertaken in this study were (1) identification of crashes that older drivers are more likely to be involved in, (2) identification of highway geometric features that are important in such crashes, (3) utilization of LIDAR data for obtaining information on the identified highway geometric features, and (4) assessment of the feasibility of using LIDAR data for such applications. A review of previous research indicated that older drivers have difficulty negotiating intersections, and it was recognized that intersection sight triangles were critical to safe intersection negotiation. LIDAR data were utilized to obtain information on potential sight distance obstructions at six selected intersections located on the Iowa Highway 1 corridor by conducting in-office line-of-sight analysis. Crash frequency, older driver involvement, and data availability were considerations in the selection of the six intersections. Results of the in-office analysis were then validated by visiting the intersections in the field. Sixty-six potential sight distance obstructions were identified by the line-of-sight analysis, out of which 62 (89.8%) were confirmed while four (5.8%) were not confirmed by the video. At least three (4.4%) potential sight distance obstructions were discovered in the video that were not detected by the line-of-sight analysis. The intersection with the highest crash frequency involving older drivers was correctly found to have obstructions located within the intersection sight triangles. Based on research results, it is concluded that LIDAR data can be utilized for identifying potential sight distance obstructions at intersections. The safety of older drivers can be enhanced by locating and rectifying intersections with obstructions in sight triangles.

Remote Sensing Change Analysis Methodology to Support Traffic Monitoring Programs, 2003

The Federal Highway Administration mandates that states collect traffic count information at specified intervals to meet the needs of the Highway Performance Monitoring System (HPMS). A manual land use change detection method was employed to determine the effects of land use change on traffic for Black Hawk County, Iowa, from 1994 to 2002. Results from land use change detection could enable redirecting traffic count activities and related data management resources to areas that are experiencing the greatest changes in land use and related traffic volume. Including a manual land use change detection process in the Iowa Department of Transportation’s traffic count program has the potential to improve efficiency by focusing monitoring activities in areas more likely to experience significant increase in traffic.

Remote Sensing Change Analysis Methodology to Support Traffic Monitoring Programs: Phase 2, 2004

The Center for Transportation Research and Education (CTRE) issued a report in July 2003, based on a sample study of the application of remote sensed image land use change detection to the methodology of traffic monitoring in Blackhawk County, Iowa. In summary, the results indicated a strong correlation and a statistically significant regression coefficient between the identification of built-up land use change areas from remote sensed data and corresponding changes in traffic patterns, expressed as vehicle miles traveled (VMT). Based on these results, the Iowa Department of Transportation (Iowa DOT) requested that CTRE expand the study area to five counties in the southwest quadrant of the state. These counties are scheduled for traffic counts in 2004, and the Iowa DOT desired the data to 1) evaluate the current methodology used to place the devices; 2) potentially influence the placement of traffic counting devices in areas of high built-up land use change; and 3) determine if opportunities exist to reduce the frequency and/or density of monitoring activity in lower trafficked rural areas of the state. This project is focused on the practical application of built-up land use change data for placement of traffic count data recording devices in five southwest Iowa counties.

Use of Remote Sensing for Collection of Data Elements for Linear Referencing Systems, 2001

This report evaluates the use of remotely sensed images in implementing the Iowa DOT LRS that is currently in the stages of system architecture. The Iowa Department of Transportation is investing a significant amount of time and resources into creation of a linear referencing system (LRS). A significant portion of the effort in implementing the system will be creation of a datum, which includes geographically locating anchor points and then measuring anchor section distances between those anchor points. Currently, system architecture and evaluation of different data collection methods to establish the LRS datum is being performed for the DOT by an outside consulting team.

A novel semi-fragile forensic watermarking scheme for remote sensing images

Peer-reviewed

Multispectral remote sensing for site-specific nitrogen fertilizer management

The objective of this work was to evaluate the use of multispectral remote sensing for site-specific nitrogen fertilizer management. Satellite imagery from the advanced spaceborne thermal emission and reflection radiometer (Aster) was acquired in a 23 ha corn-planted area in Iran. For the collection of field samples, a total of 53 pixels were selected by systematic randomized sampling. The total nitrogen content in corn leaf tissues in these pixels was evaluated. To predict corn canopy nitrogen content, different vegetation indices, such as normalized difference vegetation index (NDVI), soil-adjusted vegetation index (Savi), optimized soil-adjusted vegetation index (Osavi), modified chlorophyll absorption ratio index 2 (MCARI2), and modified triangle vegetation index 2 (MTVI2), were investigated. The supervised classification technique using the spectral angle mapper classifier (SAM) was performed to generate a nitrogen fertilization map. The MTVI2 presented the highest correlation (R²=0.87) and is a good predictor of corn canopy nitrogen content in the V13 stage, at 60 days after cultivating. Aster imagery can be used to predict nitrogen status in corn canopy. Classification results indicate three levels of required nitrogen per pixel: low (0-2.5 kg), medium (2.5-3 kg), and high (3-3.3 kg).

Using an aerial system of remote sensing to detect different nutritional status in Brachiaria decumbens

The aim of this study was to use digital images acquired by cameras attached to a helium balloon to detect variation of the nutritional status in Brachiaria decumbens. The treatments consisted of five doses of nitrogen (0, 50, 100, 150 e 200kg ha-1) with six replications each, evaluated in a completely randomized statistical design. A remote sensing system composed of digital cameras and microcomputers was used for image acquisition, and a helium balloon lifted the cameras to the heights of 15, 20, 25 and 30m. A portable chlorophyll meter and analyses of leaf nitrogen content were used to make comparisons with data obtained by the remote sensing system. Data was acquired in two phases, in different climatic conditions. At the end of each phase, dry matter production was measured. Three vegetation indices were used to evaluate the detection of different nutritional status. The three indices were able to detect the effects of N doses. The indices constructed with the Green spectral band showed to be more efficient.

Using GPS, GIS & remote sensing to understand Niagara Terroir : Pinot noir in the Four Mile Creek & St. David's Bench sub-appellations

The relationships between vine water status, soil texture, and vine size were observed in four Niagara, Ontario Pinot noir vineyards in 2008 and 2009. The vineyards were divided into water status zones using geographic information systems (GIS) software to map the seasonal mean midday leaf water potential (,P), and dormant pruning shoot weights following the 2008 season. Fruit was harvested from all sentinel vines, bulked by water status zones and made into wine. Sensory analysis included a multidimensional sorting (MDS) task and descriptive analysis (DA) of the 2008 wines. Airborne multispectral images, with a spatial resolution of 38 cm, were captured four times in 2008 and three times in 2009, with the final flights around veraison. A semi-automatic process was developed to extract NDVI from the images, and a masking procedure was identified to create a vine-only NDVI image. 2008 and 2009 were cooler and wetter than mean years, and the range of water status zones was narrow. Yield per vine, vine size, anthocyanins and phenols were the least consistent variables. Divided by water status or vine size, there were no variables with differences between zones in all four vineyards in either year. Wines were not different between water status zones in any chemical analysis, and HPLC revealed that there were no differences in individual anthocyanins or phenolic compounds between water status zones within the vineyard sites. There were some notable correlations between vineyard and grape composition variables, and spatial trends were observed to be qualitatively related for many of the variables. The MDS task revealed that wines from each vineyard were more affected by random fermentation effects than water status effects. This was confirmed by the DA; there were no differences between wines from the water status zones within vineyard sites for any attribute. Remotely sensed NDVI (normalized difference vegetation index) correlated reasonably well with a number of grape composition variables, as well as soil type. Resampling to a lower spatial resolution did not appreciably affect the strength of correlations, and corresponded to the information contained in the masked images, while maintaining the range of values of NDVI. This study showed that in cool climates, there is the potential for using precision viticulture techniques to understand the variability in vineyards, but the variable weather presents a challenge for understanding the driving forces of that variability.