Data-driven clustering : new methods and applications

Abstract : This work is concerned with the development and application of novel unsupervised learning methods, having in mind two target applications: the analysis of forensic case data and the classification of remote sensing images. First, a method based on a symbolic optimization of the inter-sample distance measure is proposed to improve the flexibility of spectral clustering algorithms, and applied to the problem of forensic case data. This distance is optimized using a loss function related to the preservation of neighborhood structure between the input space and the space of principal components, and solutions are found using genetic programming. Results are compared to a variety of state-of--the-art clustering algorithms. Subsequently, a new large-scale clustering method based on a joint optimization of feature extraction and classification is proposed and applied to various databases, including two hyperspectral remote sensing images. The algorithm makes uses of a functional model (e.g., a neural network) for clustering which is trained by stochastic gradient descent. Results indicate that such a technique can easily scale to huge databases, can avoid the so-called out-of-sample problem, and can compete with or even outperform existing clustering algorithms on both artificial data and real remote sensing images. This is verified on small databases as well as very large problems. Résumé : Ce travail de recherche porte sur le développement et l'application de méthodes d'apprentissage dites non supervisées. Les applications visées par ces méthodes sont l'analyse de données forensiques et la classification d'images hyperspectrales en télédétection. Dans un premier temps, une méthodologie de classification non supervisée fondée sur l'optimisation symbolique d'une mesure de distance inter-échantillons est proposée. Cette mesure est obtenue en optimisant une fonction de coût reliée à la préservation de la structure de voisinage d'un point entre l'espace des variables initiales et l'espace des composantes principales. Cette méthode est appliquée à l'analyse de données forensiques et comparée à un éventail de méthodes déjà existantes. En second lieu, une méthode fondée sur une optimisation conjointe des tâches de sélection de variables et de classification est implémentée dans un réseau de neurones et appliquée à diverses bases de données, dont deux images hyperspectrales. Le réseau de neurones est entraîné à l'aide d'un algorithme de gradient stochastique, ce qui rend cette technique applicable à des images de très haute résolution. Les résultats de l'application de cette dernière montrent que l'utilisation d'une telle technique permet de classifier de très grandes bases de données sans difficulté et donne des résultats avantageusement comparables aux méthodes existantes.

Characterization and discrimination of soils by their reflected electromagnetic energy

The objective of this work was to verify if reflected energy of soils can characterize and discriminate them. A spectroradiometer (Spectral reflectance between: 400-2,500 nm) was utilized in laboratory. The soils evaluated are located in Bauru region, SP, Brazil, and are classified as Typic Argiudoll (TR), Typic Eutrorthox (LR), Typic Argiudoll (PE), Typic Haplortox (LE), Typic Paleudalf (PV) and Typic Quartzipsamment (AQ). They were characterized by their spectral reflectance as for descriptive conventional methods (Brazilian and International) according to the types of spectral curves. A method for the spectral descriptive evaluation of soils was established. It was possible to characterize and discriminate the soils by their spectral reflectance, with exception for LR and TR. The spectral differences were better identified by the general shape of spectral curves, by the intensity of band absorption and angle tendencies. These characteristics were mainly influenced by organic matter, iron, granulometry and mineralogy constituents. A reduction of iron and clay contents, which influenced higher reflectance intensity and shape variations, occurred on the soils LR/TR, PE, LE, PV and AQ, on that sequence. Soils of the same group with different clay textures could be discriminated. The conventional descriptive evaluation of spectral curves was less efficient on discriminating soils. Simulated orbital data discriminated soils mainly by bands 5 and 7.

Remote collaborative multi-user informal learning experiences: design and evaluation

This paper presents a customizable system used to develop a collaborative multi-user problem solving game. It addresses the increasing demand for appealing informal learning experiences in museum-like settings. The system facilitates remote collaboration by allowing groups of learners tocommunicate through a videoconferencing system and by allowing them to simultaneously interact through a shared multi-touch interactive surface. A user study with 20 user groups indicates that the game facilitates collaboration between local and remote groups of learners. The videoconference and multitouch surface acted as communication channels, attracted students’ interest, facilitated engagement, and promoted inter- and intra-group collaboration—favoring intra-group collaboration. Our findings suggest that augmentingvideoconferencing systems with a shared multitouch space offers newpossibilities and scenarios for remote collaborative environments and collaborative learning.

Risk and global change : developing scientific methods for advocacy and awareness raising

Les catastrophes sont souvent perçues comme des événements rapides et aléatoires. Si les déclencheurs peuvent être soudains, les catastrophes, elles, sont le résultat d'une accumulation des conséquences d'actions et de décisions inappropriées ainsi que du changement global. Pour modifier cette perception du risque, des outils de sensibilisation sont nécessaires. Des méthodes quantitatives ont été développées et ont permis d'identifier la distribution et les facteurs sous- jacents du risque.¦Le risque de catastrophes résulte de l'intersection entre aléas, exposition et vulnérabilité. La fréquence et l'intensité des aléas peuvent être influencées par le changement climatique ou le déclin des écosystèmes, la croissance démographique augmente l'exposition, alors que l'évolution du niveau de développement affecte la vulnérabilité. Chacune de ses composantes pouvant changer, le risque est dynamique et doit être réévalué périodiquement par les gouvernements, les assurances ou les agences de développement. Au niveau global, ces analyses sont souvent effectuées à l'aide de base de données sur les pertes enregistrées. Nos résultats montrent que celles-ci sont susceptibles d'être biaisées notamment par l'amélioration de l'accès à l'information. Elles ne sont pas exhaustives et ne donnent pas d'information sur l'exposition, l'intensité ou la vulnérabilité. Une nouvelle approche, indépendante des pertes reportées, est donc nécessaire.¦Les recherches présentées ici ont été mandatées par les Nations Unies et par des agences oeuvrant dans le développement et l'environnement (PNUD, l'UNISDR, la GTZ, le PNUE ou l'UICN). Ces organismes avaient besoin d'une évaluation quantitative sur les facteurs sous-jacents du risque, afin de sensibiliser les décideurs et pour la priorisation des projets de réduction des risques de désastres.¦La méthode est basée sur les systèmes d'information géographique, la télédétection, les bases de données et l'analyse statistique. Une importante quantité de données (1,7 Tb) et plusieurs milliers d'heures de calculs ont été nécessaires. Un modèle de risque global a été élaboré pour révéler la distribution des aléas, de l'exposition et des risques, ainsi que pour l'identification des facteurs de risque sous- jacent de plusieurs aléas (inondations, cyclones tropicaux, séismes et glissements de terrain). Deux indexes de risque multiples ont été générés pour comparer les pays. Les résultats incluent une évaluation du rôle de l'intensité de l'aléa, de l'exposition, de la pauvreté, de la gouvernance dans la configuration et les tendances du risque. Il apparaît que les facteurs de vulnérabilité changent en fonction du type d'aléa, et contrairement à l'exposition, leur poids décroît quand l'intensité augmente.¦Au niveau local, la méthode a été testée pour mettre en évidence l'influence du changement climatique et du déclin des écosystèmes sur l'aléa. Dans le nord du Pakistan, la déforestation induit une augmentation de la susceptibilité des glissements de terrain. Les recherches menées au Pérou (à base d'imagerie satellitaire et de collecte de données au sol) révèlent un retrait glaciaire rapide et donnent une évaluation du volume de glace restante ainsi que des scénarios sur l'évolution possible.¦Ces résultats ont été présentés à des publics différents, notamment en face de 160 gouvernements. Les résultats et les données générées sont accessibles en ligne (http://preview.grid.unep.ch). La méthode est flexible et facilement transposable à des échelles et problématiques différentes, offrant de bonnes perspectives pour l'adaptation à d'autres domaines de recherche.¦La caractérisation du risque au niveau global et l'identification du rôle des écosystèmes dans le risque de catastrophe est en plein développement. Ces recherches ont révélés de nombreux défis, certains ont été résolus, d'autres sont restés des limitations. Cependant, il apparaît clairement que le niveau de développement configure line grande partie des risques de catastrophes. La dynamique du risque est gouvernée principalement par le changement global.¦Disasters are often perceived as fast and random events. If the triggers may be sudden, disasters are the result of an accumulation of actions, consequences from inappropriate decisions and from global change. To modify this perception of risk, advocacy tools are needed. Quantitative methods have been developed to identify the distribution and the underlying factors of risk.¦Disaster risk is resulting from the intersection of hazards, exposure and vulnerability. The frequency and intensity of hazards can be influenced by climate change or by the decline of ecosystems. Population growth increases the exposure, while changes in the level of development affect the vulnerability. Given that each of its components may change, the risk is dynamic and should be reviewed periodically by governments, insurance companies or development agencies. At the global level, these analyses are often performed using databases on reported losses. Our results show that these are likely to be biased in particular by improvements in access to information. International losses databases are not exhaustive and do not give information on exposure, the intensity or vulnerability. A new approach, independent of reported losses, is necessary.¦The researches presented here have been mandated by the United Nations and agencies working in the development and the environment (UNDP, UNISDR, GTZ, UNEP and IUCN). These organizations needed a quantitative assessment of the underlying factors of risk, to raise awareness amongst policymakers and to prioritize disaster risk reduction projects.¦The method is based on geographic information systems, remote sensing, databases and statistical analysis. It required a large amount of data (1.7 Tb of data on both the physical environment and socio-economic parameters) and several thousand hours of processing were necessary. A comprehensive risk model was developed to reveal the distribution of hazards, exposure and risk, and to identify underlying risk factors. These were performed for several hazards (e.g. floods, tropical cyclones, earthquakes and landslides). Two different multiple risk indexes were generated to compare countries. The results include an evaluation of the role of the intensity of the hazard, exposure, poverty, governance in the pattern and trends of risk. It appears that the vulnerability factors change depending on the type of hazard, and contrary to the exposure, their weight decreases as the intensity increases.¦Locally, the method was tested to highlight the influence of climate change and the ecosystems decline on the hazard. In northern Pakistan, deforestation exacerbates the susceptibility of landslides. Researches in Peru (based on satellite imagery and ground data collection) revealed a rapid glacier retreat and give an assessment of the remaining ice volume as well as scenarios of possible evolution.¦These results were presented to different audiences, including in front of 160 governments. The results and data generated are made available online through an open source SDI (http://preview.grid.unep.ch). The method is flexible and easily transferable to different scales and issues, with good prospects for adaptation to other research areas. The risk characterization at a global level and identifying the role of ecosystems in disaster risk is booming. These researches have revealed many challenges, some were resolved, while others remained limitations. However, it is clear that the level of development, and more over, unsustainable development, configures a large part of disaster risk and that the dynamics of risk is primarily governed by global change.

Liquid fructose down-regulates liver insulin receptor substrate 2 and gluconeogeneic enzymes by modifying nutrient sensing factors in rats

High consumption of fructose-sweetened beverages has been linked to a high prevalence of chronic metabolic diseases. We have previously shown that a short course of fructose supplementation as a liquid solution induces glucose intolerance in female rats. In the present work, we characterized the fructose-driven changes in the liver and the molecular pathways involved. To this end, female rats were supplemented or not with liquid fructose (10%, w/v) for 7 or 14 days. Glucose and pyruvate tolerance tests were performed, and the expression of genes related to insulin signaling, gluconeogenesis and nutrient sensing pathways was evaluated. Fructose-supplemented rats showed increased plasma glucose excursions in glucose and pyruvate tolerance tests and reduced hepatic expression of several genes related to insulin signaling, including insulin receptor substrate 2 (IRS-2). However, the expression of key gluconeogenic enzymes, glucose-6-phosphatase and phosphoenolpyruvate carboxykinase, was reduced. These effects were caused by an inactivation of hepatic forkhead box O1 (FoxO1) due to an increase in its acetylation state driven by a reduced expression and activity of sirtuin 1 (SIRT1). Further contributing to FoxO1 inactivation, fructose consumption elevated liver expression of the spliced form of X-box-binding-protein-1 as a consequence of an increase in the activity of the mammalian target of rapamycin 1 and protein 38-mitogen activated protein kinase (p38-MAPK). Liquid fructose affects both insulin signaling (IRS-2 and FoxO1) and nutrient sensing pathways (p38-MAPK, mTOR and SIRT1), thus disrupting hepatic insulin signaling without increasing the expression of key gluconeogenic enzymes.

Linear and nonlinear terrain deformation maps from a reduced set of interferometric SAR images

In this paper, an advanced technique for the generation of deformation maps using synthetic aperture radar (SAR) data is presented. The algorithm estimates the linear and nonlinear components of the displacement, the error of the digital elevation model (DEM) used to cancel the topographic terms, and the atmospheric artifacts from a reduced set of low spatial resolution interferograms. The pixel candidates are selected from those presenting a good coherence level in the whole set of interferograms and the resulting nonuniform mesh tessellated with the Delauney triangulation to establish connections among them. The linear component of movement and DEM error are estimated adjusting a linear model to the data only on the connections. Later on, this information, once unwrapped to retrieve the absolute values, is used to calculate the nonlinear component of movement and atmospheric artifacts with alternate filtering techniques in both the temporal and spatial domains. The method presents high flexibility with respect to the required number of images and the baselines length. However, better results are obtained with large datasets of short baseline interferograms. The technique has been tested with European Remote Sensing SAR data from an area of Catalonia (Spain) and validated with on-field precise leveling measurements.

Polarimetric radar interferometry for improved mine detection and surface clutter rejection

A recently developed technique, polarimetric radar interferometry, is applied to tackle the problem of the detection of buried objects embedded in surface clutter. An experiment with a fully polarimetric radar in an anechoic chamber has been carried out using different frequency bands and baselines. The processed results show the ability of this technique to detect buried plastic mines and to measure their depth. This technique enables the detection of plastic mines even if their backscatter response is much lower than that of the surface clutter.

Predicting soil erosion using Rusle and NDVI time series from TM Landsat 5

The objective of this work was to evaluate the seasonal variation of soil cover and rainfall erosivity, and their influences on the revised universal soil loss equation (Rusle), in order to estimate watershed soil losses in a temporal scale. Twenty-two TM Landsat 5 images from 1986 to 2009 were used to estimate soil use and management factor (C factor). A corresponding rainfall erosivity factor (R factor) was considered for each image, and the other factors were obtained using the standard Rusle method. Estimated soil losses were grouped into classes and ranged from 0.13 Mg ha-1 on May 24, 2009 (dry season) to 62.0 Mg ha-1 on March 11, 2007 (rainy season). In these dates, maximum losses in the watershed were 2.2 and 781.5 Mg ha-1 , respectively. Mean annual soil loss in the watershed was 109.5 Mg ha-1 , but the central area, with a loss of nearly 300.0 Mg ha-1 , was characterized as a site of high water-erosion risk. The use of C factor obtained from remote sensing data, associated to corresponding R factor, was fundamental to evaluate the soil erosion estimated by the Rusle in different seasons, unlike of other studies which keep these factors constant throughout time.

Transparent and secure remote network storage system using an untrusted server

Työssä kehitettin läpinäkyvä Internet Small Computer Systems Interface-verkkolevyä (iSCSI) käyttävä varmistusjärjestelmä. Verkkolevyn sisältö suojattiin asiakaspään salauskerroksella (dm-crypt). Järjestely mahdollisti sen, että verkkolevylle tallennetut varmuuskopiot pysyivät luottamuksellisina, vaikka levypalvelinta tarjoava taho oli joko epäluotettava tai suorastaan vihamielinen. Järjestelmän hyötykäyttöä varten kehitettiin helppokäyttöinen prototyyppisovellus. Järjestelmän riskit ja haavoittuvuudet käytiin läpi ja analysoitiin. Järjestelmälle tehtiin myös karkea kryptoanalyysi sen teknistenominaisuuksien pohjalta. Suorituskykymittaukset tehtiin sekä salatulle että salaamattomalle iSCSI-liikenteelle. Näistä todettiin, että salauksen vaikutus suorituskykyyn oli häviävän pieni jopa 100 megabittiä sekunnissa siirtävillä verkkonopeuksilla. Lisäksi pohdittiin teknologian muita sovelluskohteita ja tulevia tutkimusalueita.

Image-Based Coral Reef Classification and Thematic Mapping

This paper presents a novel image classification scheme for benthic coral reef images that can be applied to both single image and composite mosaic datasets. The proposed method can be configured to the characteristics (e.g., the size of the dataset, number of classes, resolution of the samples, color information availability, class types, etc.) of individual datasets. The proposed method uses completed local binary pattern (CLBP), grey level co-occurrence matrix (GLCM), Gabor filter response, and opponent angle and hue channel color histograms as feature descriptors. For classification, either k-nearest neighbor (KNN), neural network (NN), support vector machine (SVM) or probability density weighted mean distance (PDWMD) is used. The combination of features and classifiers that attains the best results is presented together with the guidelines for selection. The accuracy and efficiency of our proposed method are compared with other state-of-the-art techniques using three benthic and three texture datasets. The proposed method achieves the highest overall classification accuracy of any of the tested methods and has moderate execution time. Finally, the proposed classification scheme is applied to a large-scale image mosaic of the Red Sea to create a completely classified thematic map of the reef benthos

Adaptive MCMC methods with applications in environmental and geophysical models

This work presents new, efficient Markov chain Monte Carlo (MCMC) simulation methods for statistical analysis in various modelling applications. When using MCMC methods, the model is simulated repeatedly to explore the probability distribution describing the uncertainties in model parameters and predictions. In adaptive MCMC methods based on the Metropolis-Hastings algorithm, the proposal distribution needed by the algorithm learns from the target distribution as the simulation proceeds. Adaptive MCMC methods have been subject of intensive research lately, as they open a way for essentially easier use of the methodology. The lack of user-friendly computer programs has been a main obstacle for wider acceptance of the methods. This work provides two new adaptive MCMC methods: DRAM and AARJ. The DRAM method has been built especially to work in high dimensional and non-linear problems. The AARJ method is an extension to DRAM for model selection problems, where the mathematical formulation of the model is uncertain and we want simultaneously to fit several different models to the same observations. The methods were developed while keeping in mind the needs of modelling applications typical in environmental sciences. The development work has been pursued while working with several application projects. The applications presented in this work are: a winter time oxygen concentration model for Lake Tuusulanjärvi and adaptive control of the aerator; a nutrition model for Lake Pyhäjärvi and lake management planning; validation of the algorithms of the GOMOS ozone remote sensing instrument on board the Envisat satellite of European Space Agency and the study of the effects of aerosol model selection on the GOMOS algorithm.

Lidar measurement of surface melt for a temperate Alpine glacier at the seasonal and hourly scales

This study shows how a new generation of terrestrial laser scanners can be used to investigate glacier surface ablation and other elements of glacial hydrodynamics at exceptionally high spatial and temporal resolution. The study area is an Alpine valley glacier, Haut Glacier d'Arolla, Switzerland. Here we use an ultra-long-range lidar RIEGL VZ-6000 scanner, having a laser specifically designed for measurement of snow- and ice-cover surfaces. We focus on two timescales: seasonal and daily. Our results show that a near-infrared scanning laser system can provide high-precision elevation change and ablation data from long ranges, and over relatively large sections of the glacier surface. We use it to quantify spatial variations in the patterns of surface melt at the seasonal scale, as controlled by both aspect and differential debris cover. At the daily scale, we quantify the effects of ogive-related differences in ice surface debris content on spatial patterns of ablation. Daily scale measurements point to possible hydraulic jacking of the glacier associated with short-term water pressure rises. This latter demonstration shows that this type of lidar may be used to address subglacial hydrologic questions, in addition to motion and ablation measurements.

Engineering Geology for Society and Territory: volume 2: landslide processes

This book is one out of 8 IAEG XII Congress volumes, and deals with Landslide processes, including: field data and monitoring techniques, prediction and forecasting of landslide occurrence, regional landslide inventories and dating studies, modeling of slope instabilities and secondary hazards (e.g. impulse waves and landslide-induced tsunamis, landslide dam failures and breaching), hazard and risk assessment, earthquake and rainfall induced landslides, instabilities of volcanic edifices, remedial works and mitigation measures, development of innovative stabilization techniques and applicability to specific engineering geological conditions, use of geophysical techniques for landslide characterization and investigation of triggering mechanisms. Focuses is given to innovative techniques, well documented case studies in different environments, critical components of engineering geological and geotechnical investigations, hydrological and hydrogeological investigations, remote sensing and geophysical techniques, modeling of triggering, collapse, runout and landslide reactivation, geotechnical design and construction procedures in landslide zones, interaction of landslides with structures and infrastructures and possibility of domino effects. The Engineering Geology for Society and Territory volumes of the IAEG XII Congress held in Torino from September 15-19, 2014, analyze the dynamic role of engineering geology in our changing world and build on the four main themes of the congress: environment, processes, issues, and approaches.

Auto Poisoning of the Respiratory Chain by a Quorum-Sensing-Regulated Molecule Favors Biofilm Formation and Antibiotic Tolerance.

Bacterial programmed cell death and quorum sensing are direct examples of prokaryote group behaviors, wherein cells coordinate their actions to function cooperatively like one organism for the benefit of the whole culture. We demonstrate here that 2-n-heptyl-4-hydroxyquinoline-N-oxide (HQNO), a Pseudomonas aeruginosa quorum-sensing-regulated low-molecular-weight excreted molecule, triggers autolysis by self-perturbing the electron transfer reactions of the cytochrome bc1 complex. HQNO induces specific self-poisoning by disrupting the flow of electrons through the respiratory chain at the cytochrome bc1 complex, causing a leak of reducing equivalents to O2 whereby electrons that would normally be passed to cytochrome c are donated directly to O2. The subsequent mass production of reactive oxygen species (ROS) reduces membrane potential and disrupts membrane integrity, causing bacterial cell autolysis and DNA release. DNA subsequently promotes biofilm formation and increases antibiotic tolerance to beta-lactams, suggesting that HQNO-dependent cell autolysis is advantageous to the bacterial populations. These data identify both a new programmed cell death system and a novel role for HQNO as a critical inducer of biofilm formation and antibiotic tolerance. This newly identified pathway suggests intriguing mechanistic similarities with the initial mitochondrial-mediated steps of eukaryotic apoptosis.

Large slope deformations detection and monitoring along shores of the Potrerillos dam reservoir, Argentina, based on a small-baseline InSAR approach

The Argentina National Road 7 that crosses the Andes Cordillera within the Mendoza province to connect Santiago de Chile and Buenos Aires is particularly affected by natural hazards requiring risk management. Integrated in a research plan that intends to produce landslide susceptibility maps, we aimed in this study to detect large slope movements by applying a satellite radar interferometric analysis using Envisat data, acquired between 2005 and 2010. We were finally able to identify two large slope deformations in sandstone and clay deposits along gentle shores of the Potrerillos dam reservoir, with cumulated displacements higher than 25mm in 5years and towards the reservoir. There is also a body of evidences that these large slope deformations are actually influenced by the seasonal reservoir level variations. This study shows that very detailed information, such as surface displacements and above all water level variation, can be extracted from spaceborne remote sensing techniques; nevertheless, the limitations of InSAR for the present dataset are discussed here. Such analysis can then lead to further field investigations to understand more precisely the destabilising processes acting on these slope deformations.