Machine learning for geospatial data : algorithms, software tools and case studies

Résumé Cette thèse est consacrée à l'analyse, la modélisation et la visualisation de données environnementales à référence spatiale à l'aide d'algorithmes d'apprentissage automatique (Machine Learning). L'apprentissage automatique peut être considéré au sens large comme une sous-catégorie de l'intelligence artificielle qui concerne particulièrement le développement de techniques et d'algorithmes permettant à une machine d'apprendre à partir de données. Dans cette thèse, les algorithmes d'apprentissage automatique sont adaptés pour être appliqués à des données environnementales et à la prédiction spatiale. Pourquoi l'apprentissage automatique ? Parce que la majorité des algorithmes d'apprentissage automatiques sont universels, adaptatifs, non-linéaires, robustes et efficaces pour la modélisation. Ils peuvent résoudre des problèmes de classification, de régression et de modélisation de densité de probabilités dans des espaces à haute dimension, composés de variables informatives spatialisées (« géo-features ») en plus des coordonnées géographiques. De plus, ils sont idéaux pour être implémentés en tant qu'outils d'aide à la décision pour des questions environnementales allant de la reconnaissance de pattern à la modélisation et la prédiction en passant par la cartographie automatique. Leur efficacité est comparable au modèles géostatistiques dans l'espace des coordonnées géographiques, mais ils sont indispensables pour des données à hautes dimensions incluant des géo-features. Les algorithmes d'apprentissage automatique les plus importants et les plus populaires sont présentés théoriquement et implémentés sous forme de logiciels pour les sciences environnementales. Les principaux algorithmes décrits sont le Perceptron multicouches (MultiLayer Perceptron, MLP) - l'algorithme le plus connu dans l'intelligence artificielle, le réseau de neurones de régression généralisée (General Regression Neural Networks, GRNN), le réseau de neurones probabiliste (Probabilistic Neural Networks, PNN), les cartes auto-organisées (SelfOrganized Maps, SOM), les modèles à mixture Gaussiennes (Gaussian Mixture Models, GMM), les réseaux à fonctions de base radiales (Radial Basis Functions Networks, RBF) et les réseaux à mixture de densité (Mixture Density Networks, MDN). Cette gamme d'algorithmes permet de couvrir des tâches variées telle que la classification, la régression ou l'estimation de densité de probabilité. L'analyse exploratoire des données (Exploratory Data Analysis, EDA) est le premier pas de toute analyse de données. Dans cette thèse les concepts d'analyse exploratoire de données spatiales (Exploratory Spatial Data Analysis, ESDA) sont traités selon l'approche traditionnelle de la géostatistique avec la variographie expérimentale et selon les principes de l'apprentissage automatique. La variographie expérimentale, qui étudie les relations entre pairs de points, est un outil de base pour l'analyse géostatistique de corrélations spatiales anisotropiques qui permet de détecter la présence de patterns spatiaux descriptible par une statistique. L'approche de l'apprentissage automatique pour l'ESDA est présentée à travers l'application de la méthode des k plus proches voisins qui est très simple et possède d'excellentes qualités d'interprétation et de visualisation. Une part importante de la thèse traite de sujets d'actualité comme la cartographie automatique de données spatiales. Le réseau de neurones de régression généralisée est proposé pour résoudre cette tâche efficacement. Les performances du GRNN sont démontrées par des données de Comparaison d'Interpolation Spatiale (SIC) de 2004 pour lesquelles le GRNN bat significativement toutes les autres méthodes, particulièrement lors de situations d'urgence. La thèse est composée de quatre chapitres : théorie, applications, outils logiciels et des exemples guidés. Une partie importante du travail consiste en une collection de logiciels : Machine Learning Office. Cette collection de logiciels a été développée durant les 15 dernières années et a été utilisée pour l'enseignement de nombreux cours, dont des workshops internationaux en Chine, France, Italie, Irlande et Suisse ainsi que dans des projets de recherche fondamentaux et appliqués. Les cas d'études considérés couvrent un vaste spectre de problèmes géoenvironnementaux réels à basse et haute dimensionnalité, tels que la pollution de l'air, du sol et de l'eau par des produits radioactifs et des métaux lourds, la classification de types de sols et d'unités hydrogéologiques, la cartographie des incertitudes pour l'aide à la décision et l'estimation de risques naturels (glissements de terrain, avalanches). Des outils complémentaires pour l'analyse exploratoire des données et la visualisation ont également été développés en prenant soin de créer une interface conviviale et facile à l'utilisation. Machine Learning for geospatial data: algorithms, software tools and case studies Abstract The thesis is devoted to the analysis, modeling and visualisation of spatial environmental data using machine learning algorithms. In a broad sense machine learning can be considered as a subfield of artificial intelligence. It mainly concerns with the development of techniques and algorithms that allow computers to learn from data. In this thesis machine learning algorithms are adapted to learn from spatial environmental data and to make spatial predictions. Why machine learning? In few words most of machine learning algorithms are universal, adaptive, nonlinear, robust and efficient modeling tools. They can find solutions for the classification, regression, and probability density modeling problems in high-dimensional geo-feature spaces, composed of geographical space and additional relevant spatially referenced features. They are well-suited to be implemented as predictive engines in decision support systems, for the purposes of environmental data mining including pattern recognition, modeling and predictions as well as automatic data mapping. They have competitive efficiency to the geostatistical models in low dimensional geographical spaces but are indispensable in high-dimensional geo-feature spaces. The most important and popular machine learning algorithms and models interesting for geo- and environmental sciences are presented in details: from theoretical description of the concepts to the software implementation. The main algorithms and models considered are the following: multi-layer perceptron (a workhorse of machine learning), general regression neural networks, probabilistic neural networks, self-organising (Kohonen) maps, Gaussian mixture models, radial basis functions networks, mixture density networks. This set of models covers machine learning tasks such as classification, regression, and density estimation. Exploratory data analysis (EDA) is initial and very important part of data analysis. In this thesis the concepts of exploratory spatial data analysis (ESDA) is considered using both traditional geostatistical approach such as_experimental variography and machine learning. Experimental variography is a basic tool for geostatistical analysis of anisotropic spatial correlations which helps to understand the presence of spatial patterns, at least described by two-point statistics. A machine learning approach for ESDA is presented by applying the k-nearest neighbors (k-NN) method which is simple and has very good interpretation and visualization properties. Important part of the thesis deals with a hot topic of nowadays, namely, an automatic mapping of geospatial data. General regression neural networks (GRNN) is proposed as efficient model to solve this task. Performance of the GRNN model is demonstrated on Spatial Interpolation Comparison (SIC) 2004 data where GRNN model significantly outperformed all other approaches, especially in case of emergency conditions. The thesis consists of four chapters and has the following structure: theory, applications, software tools, and how-to-do-it examples. An important part of the work is a collection of software tools - Machine Learning Office. Machine Learning Office tools were developed during last 15 years and was used both for many teaching courses, including international workshops in China, France, Italy, Ireland, Switzerland and for realizing fundamental and applied research projects. Case studies considered cover wide spectrum of the real-life low and high-dimensional geo- and environmental problems, such as air, soil and water pollution by radionuclides and heavy metals, soil types and hydro-geological units classification, decision-oriented mapping with uncertainties, natural hazards (landslides, avalanches) assessments and susceptibility mapping. Complementary tools useful for the exploratory data analysis and visualisation were developed as well. The software is user friendly and easy to use.

In vivo time-resolved spectroscopy of the human bronchial early cancer autofluorescence.

Time-resolved measurements of tissue autofluorescence (AF) excited at 405 nm were carried out with an optical-fiber-based spectrometer in the bronchi of 11 patients. The objectives consisted of assessing the lifetime as a new tumor/normal (T/N) tissue contrast parameter and trying to explain the origin of the contrasts observed when using AF-based cancer detection imaging systems. No significant change in the AF lifetimes was found. AF bronchoscopy performed in parallel with an imaging device revealed both intensity and spectral contrasts. Our results suggest that the spectral contrast might be due to an enhanced blood concentration just below the epithelial layers of the lesion. The intensity contrast probably results from the thickening of the epithelium in the lesions. The absence of T/N lifetime contrast indicates that the quenching is not at the origin of the fluorescence intensity and spectral contrasts. These lifetimes (6.9 ns, 2.0 ns, and 0.2 ns) were consistent for all the examined sites. The fact that these lifetimes are the same for different emission domains ranging between 430 and 680 nm indicates that there is probably only one dominant fluorophore involved. The measured lifetimes suggest that this fluorophore is elastin.

Human Capital Questionnaire (PHCQ): Assessment of European nurses' perception as indicators of human capital quality

Healthcare accreditation models generally include indicators related to healthcare employees' perceptions (e.g. satisfaction, career development, and health safety). During the accreditation process, organizations are asked to demonstrate the methods with which assessments are made. However, none of the models provide standardized systems for the assessment of employees. In this study, we analyzed the psychometric properties of an instrument for the assessment of nurses' perceptions as indicators of human capital quality in healthcare organizations. The Human Capital Questionnaire was applied to a sample of 902 nurses in four European countries (Spain, Portugal, Poland, and the UK). Exploratory factor analysis identified six factors: satisfaction with leadership, identification and commitment, satisfaction with participation, staff well-being, career development opportunities, and motivation. The results showed the validity and reliability of the questionnaire, which when applied to healthcare organizations, provide a better understanding of nurses' perceptions, and is a parsimonious instrument for assessment and organizational accreditation. From a practical point of view, improving the quality of human capital, by analyzing nurses and other healthcare employees' perceptions, is related to workforce empowerment.

Beaming into the rat world: enabling real-time intereaction between rat and human each at their own scale

Immersive virtual reality (IVR) typically generates the illusion in participants that they are in the displayed virtual scene where they can experience and interact in events as if they were really happening. Teleoperator (TO) systems place people at a remote physical destination embodied as a robotic device, and where typically participants have the sensation of being at the destination, with the ability to interact with entities there. In this paper, we show how to combine IVR and TO to allow a new class of application. The participant in the IVR is represented in the destination by a physical robot (TO) and simultaneously the remote place and entities within it are represented to the participant in the IVR. Hence, the IVR participant has a normal virtual reality experience, but where his or her actions and behaviour control the remote robot and can therefore have physical consequences. Here, we show how such a system can be deployed to allow a human and a rat to operate together, but the human interacting with the rat on a human scale, and the rat interacting with the human on the rat scale. The human is represented in a rat arena by a small robot that is slaved to the human"s movements, whereas the tracked rat is represented to the human in the virtual reality by a humanoid avatar. We describe the system and also a study that was designed to test whether humans can successfully play a game with the rat. The results show that the system functioned well and that the humans were able to interact with the rat to fulfil the tasks of the game. This system opens up the possibility of new applications in the life sciences involving participant observation of and interaction with animals but at human scale.

Self-similar community structure in a network of human interactions

We propose a procedure for analyzing and characterizing complex networks. We apply this to the social network as constructed from email communications within a medium sized university with about 1700 employees. Email networks provide an accurate and nonintrusive description of the flow of information within human organizations. Our results reveal the self-organization of the network into a state where the distribution of community sizes is self-similar. This suggests that a universal mechanism, responsible for emergence of scaling in other self-organized complex systems, as, for instance, river networks, could also be the underlying driving force in the formation and evolution of social networks.

The establishment of communication systems depends on the scale of competition

How communication systems emerge and remain stable is an important question in both cognitive science and evolutionary biology. For communication to arise, not only must individuals cooperate by signaling reliable information, but they must also coordinate and perpetuate signals. Most studies on the emergence of communication in humans typically consider scenarios where individuals implicitly share the same interests. Likewise, most studies on human cooperation consider scenarios where shared conventions of signals and meanings cannot be developed de novo. Here, we combined both approaches with an economic experiment where participants could develop a common language, but under different conditions fostering or hindering cooperation. Participants endeavored to acquire a resource through a learning task in a computer-based environment. After this task, participants had the option to transmit a signal (a color) to a fellow group member, who would subsequently play the same learning task. We varied the way participants competed with each other (either global scale or local scale) and the cost of transmitting a signal (either costly or noncostly) and tracked the way in which signals were used as communication among players. Under global competition, players signaled more often and more consistently, scored higher individual payoffs, and established shared associations of signals and meanings. In addition, costly signals were also more likely to be used under global competition; whereas under local competition, fewer signals were sent and no effective communication system was developed. Our results demonstrate that communication involves both a coordination and a cooperative dilemma and show the importance of studying language evolution under different conditions influencing human cooperation.

Initial results on in vivo human coronary MR angiography at 7 T.

Seven tesla (T) MR imaging is potentially promising for the morphologic evaluation of coronary arteries because of the increased signal-to-noise ratio compared to lower field strengths, in turn allowing improved spatial resolution, improved temporal resolution, or reduced scanning times. However, there are a large number of technical challenges, including the commercial 7 T systems not being equipped with homogeneous body radiofrequency coils, conservative specific absorption rate constraints, and magnified sample-induced amplitude of radiofrequency field inhomogeneity. In the present study, an initial attempt was made to address these challenges and to implement coronary MR angiography at 7 T. A single-element radiofrequency transmit and receive coil was designed and a 7 T specific imaging protocol was implemented, including significant changes in scout scanning, contrast generation, and navigator geometry compared to current protocols at 3 T. With this methodology, the first human coronary MR images were successfully obtained at 7 T, with both qualitative and quantitative findings being presented.

Towards Machine Consciousness: Grounding Abstract Models as pi-Processes

We present a two-level model of concurrent communicating systems (CCS) to serve as a basis formachine consciousness. A language implementing threads within logic programming is ¯rstintroduced. This high-level framework allows for the de¯nition of abstract processes that can beexecuted on a virtual machine. We then look for a possible grounding of these processes into thebrain. Towards this end, we map abstract de¯nitions (including logical expressions representingcompiled knowledge) into a variant of the pi-calculus. We illustrate this approach through aseries of examples extending from a purely reactive behavior to patterns of consciousness.

The oxidative potential of differently charged silver and gold nanoparticles on three human lung epithelial cell types

Background: Nanoparticle (NPs) functionalization has been shown to affect their cellular toxicity. To study this, differently functionalized silver (Ag) and gold (Au) NPs were synthesised, characterised and tested using lung epithelial cell systems. Mehtods: Monodispersed Ag and Au NPs with a size range of 7 to 10 nm were coated with either sodium citrate or chitosan resulting in surface charges from ¿50 mV to +70 mV. NP-induced cytotoxicity and oxidative stress were determined using A549 cells, BEAS-2B cells and primary lung epithelial cells (NHBE cells). TEER measurements and immunofluorescence staining of tight junctions were performed to test the growth characteristics of the cells. Cytotoxicity was measured by means of the CellTiter-Blue ® and the lactate dehydrogenase assay and cellular and cell-free reactive oxygen species (ROS) production was measured using the DCFH-DA assay. Results: Different growth characteristics were shown in the three cell types used. A549 cells grew into a confluent mono-layer, BEAS-2B cells grew into a multilayer and NHBE cells did not form a confluent layer. A549 cells were least susceptible towards NPs, irrespective of the NP functionalization. Cytotoxicity in BEAS-2B cells increased when exposed to high positive charged (+65-75 mV) Au NPs. The greatest cytotoxicity was observed in NHBE cells, where both Ag and Au NPs with a charge above +40 mV induced cytotoxicity. ROS production was most prominent in A549 cells where Au NPs (+65-75 mV) induced the highest amount of ROS. In addition, cell-free ROS measurements showed a significant increase in ROS production with an increase in chitosan coating. Conclusions: Chitosan functionalization of NPs, with resultant high surface charges plays an important role in NP-toxicity. Au NPs, which have been shown to be inert and often non-cytotoxic, can become toxic upon coating with certain charged molecules. Notably, these effects are dependent on the core material of the particle, the cell type used for testing and the growth characteristics of these cell culture model systems.

Shallow-transfer rule-based machine translation for Czech to Polish

This article describes the developmentof an Open Source shallow-transfer machine translation system from Czech to Polish in theApertium platform. It gives details ofthe methods and resources used in contructingthe system. Although the resulting system has quite a high error rate, it is still competitive with other systems.

Hybrid model of a double-fed induction machine and back-to-back converter

This report details the port interconnection of two subsystems: a power electronics subsystem (a back-to-back AC/AC converter (B2B), coupled to a phase of the power grid), and an electromechanical subsystem (a doubly-fed induction machine (DFIM), coupled mechanically to a flywheel and electrically to the power grid and to a local varying load). Both subsystems have been essentially described in previous reports (deliverables D 0.5 and D 4.3.1), although some previously unpublished details are presented here. The B2B is a variable structure system (VSS), due to the presence of control-actuated switches: however from a modelling and simulation, as well as a control-design, point of view, it is sensible to consider modulated transformers (MTF in the bond-graph language) instead of the pairs of complementary switches. The port-Hamiltonian models of both subsystems are presents and coupled through a power-preserving interconnection, and the Hamiltonian description of the whole system is obtained; detailed bond-graphs of all the subsystems and the complete system are provided.

Expression and secretion of the atrial natriuretic peptide in human adipose tissue and preadipocytes.

OBJECTIVE: Atrial natriuretic peptide (ANP) is a secretory hormone displaying diuretic, natriuretic, and vasorelaxant activities. Recently, its lipolytic activity has been reported. Since the expression of ANP in adipose tissue has not been documented, we used real-time reverse transcriptase polymerase chain reaction (RT-PCR) to investigate the expression of ANP in human adipose tissue and preadipocytes. RESEARCH METHODS AND PROCEDURES: RNA was extracted from the human adipose tissue of severely obese premenopausal women as well as from human preadipocytes. For human preadipocytes, two cell systems were investigated: the human preadipose immortalized (Chub-S7) cells, a well-characterized human preadipose cell line, and primary preadipocytes derived from the stromal vascular fraction of the human adipose tissue. We measured the mRNA of ANP, of corin (a transmembrane serine protease involved in the conversion of pro-ANP to ANP) and of uncoupling protein 2 (UCP2; a control gene known to be ubiquitously expressed). The expression of ANP was also investigated using immunofluorescence and radioimmunoassay in Chub-S7 cells and human primary preadipocytes in culture. RESULTS: Our results indicate that ANP and corin are expressed at the mRNA level in human adipose tissue and preadipocytes. Immunofluorescence experiments demonstrated that pro-ANP was expressed in Chub-S7 cells. In addition, ANP secretion could be measured in Chub-S7 cells and human primary preadipocytes in culture. Rosiglitazone, a selective peroxisome proliferator-activated receptor type gamma (PPAR-gamma) agonist promoting adipocyte differentiation, was found to modulate both ANP expression and secretion in preadipocytes. DISCUSSION: Our findings suggest the existence of an autocrine/paracrine system for ANP in the human adipose tissue whose implications in lipolysis and cardiovascular function need to be further explored.

Machine vision measurement system for paper printability assessments

This work had two primary objectives: 1) to produce a working prototype for automated printability assessment and 2) to perform a study of available machine vision and other necessary hardware solutions. The three printability testing methods, IGT Picking,He¬liotest, and mottling, considered in this work have several different requirements and the task was to produce a single automated testing system suitable for all methods. A system was designed and built and its performance was tested using the Heliotest. Working proto¬types are important tools for implementing theoretical methods into practical systems and testing and demonstrating the methodsin real life conditions. The system was found to be sufficient for the Heliotest method. Further testing and possible modifications related to other two test methods were left for future works. A short study of available systems and solutions concerning image acquisition of machine vision was performed. The theoretical part of this study includes lighting systems, optical systems and image acquisition tools, mainly cameras and the underlying physical aspects for each portion.

Beaming into the rat world: enabling real-time intereaction between rat and human each at their own scale

Immersive virtual reality (IVR) typically generates the illusion in participants that they are in the displayed virtual scene where they can experience and interact in events as if they were really happening. Teleoperator (TO) systems place people at a remote physical destination embodied as a robotic device, and where typically participants have the sensation of being at the destination, with the ability to interact with entities there. In this paper, we show how to combine IVR and TO to allow a new class of application. The participant in the IVR is represented in the destination by a physical robot (TO) and simultaneously the remote place and entities within it are represented to the participant in the IVR. Hence, the IVR participant has a normal virtual reality experience, but where his or her actions and behaviour control the remote robot and can therefore have physical consequences. Here, we show how such a system can be deployed to allow a human and a rat to operate together, but the human interacting with the rat on a human scale, and the rat interacting with the human on the rat scale. The human is represented in a rat arena by a small robot that is slaved to the human"s movements, whereas the tracked rat is represented to the human in the virtual reality by a humanoid avatar. We describe the system and also a study that was designed to test whether humans can successfully play a game with the rat. The results show that the system functioned well and that the humans were able to interact with the rat to fulfil the tasks of the game. This system opens up the possibility of new applications in the life sciences involving participant observation of and interaction with animals but at human scale.

Beaming into the rat world: enabling real-time intereaction between rat and human each at their own scale

Immersive virtual reality (IVR) typically generates the illusion in participants that they are in the displayed virtual scene where they can experience and interact in events as if they were really happening. Teleoperator (TO) systems place people at a remote physical destination embodied as a robotic device, and where typically participants have the sensation of being at the destination, with the ability to interact with entities there. In this paper, we show how to combine IVR and TO to allow a new class of application. The participant in the IVR is represented in the destination by a physical robot (TO) and simultaneously the remote place and entities within it are represented to the participant in the IVR. Hence, the IVR participant has a normal virtual reality experience, but where his or her actions and behaviour control the remote robot and can therefore have physical consequences. Here, we show how such a system can be deployed to allow a human and a rat to operate together, but the human interacting with the rat on a human scale, and the rat interacting with the human on the rat scale. The human is represented in a rat arena by a small robot that is slaved to the human"s movements, whereas the tracked rat is represented to the human in the virtual reality by a humanoid avatar. We describe the system and also a study that was designed to test whether humans can successfully play a game with the rat. The results show that the system functioned well and that the humans were able to interact with the rat to fulfil the tasks of the game. This system opens up the possibility of new applications in the life sciences involving participant observation of and interaction with animals but at human scale.