Machine learning for geospatial data : algorithms, software tools and case studies

Résumé Cette thèse est consacrée à l'analyse, la modélisation et la visualisation de données environnementales à référence spatiale à l'aide d'algorithmes d'apprentissage automatique (Machine Learning). L'apprentissage automatique peut être considéré au sens large comme une sous-catégorie de l'intelligence artificielle qui concerne particulièrement le développement de techniques et d'algorithmes permettant à une machine d'apprendre à partir de données. Dans cette thèse, les algorithmes d'apprentissage automatique sont adaptés pour être appliqués à des données environnementales et à la prédiction spatiale. Pourquoi l'apprentissage automatique ? Parce que la majorité des algorithmes d'apprentissage automatiques sont universels, adaptatifs, non-linéaires, robustes et efficaces pour la modélisation. Ils peuvent résoudre des problèmes de classification, de régression et de modélisation de densité de probabilités dans des espaces à haute dimension, composés de variables informatives spatialisées (« géo-features ») en plus des coordonnées géographiques. De plus, ils sont idéaux pour être implémentés en tant qu'outils d'aide à la décision pour des questions environnementales allant de la reconnaissance de pattern à la modélisation et la prédiction en passant par la cartographie automatique. Leur efficacité est comparable au modèles géostatistiques dans l'espace des coordonnées géographiques, mais ils sont indispensables pour des données à hautes dimensions incluant des géo-features. Les algorithmes d'apprentissage automatique les plus importants et les plus populaires sont présentés théoriquement et implémentés sous forme de logiciels pour les sciences environnementales. Les principaux algorithmes décrits sont le Perceptron multicouches (MultiLayer Perceptron, MLP) - l'algorithme le plus connu dans l'intelligence artificielle, le réseau de neurones de régression généralisée (General Regression Neural Networks, GRNN), le réseau de neurones probabiliste (Probabilistic Neural Networks, PNN), les cartes auto-organisées (SelfOrganized Maps, SOM), les modèles à mixture Gaussiennes (Gaussian Mixture Models, GMM), les réseaux à fonctions de base radiales (Radial Basis Functions Networks, RBF) et les réseaux à mixture de densité (Mixture Density Networks, MDN). Cette gamme d'algorithmes permet de couvrir des tâches variées telle que la classification, la régression ou l'estimation de densité de probabilité. L'analyse exploratoire des données (Exploratory Data Analysis, EDA) est le premier pas de toute analyse de données. Dans cette thèse les concepts d'analyse exploratoire de données spatiales (Exploratory Spatial Data Analysis, ESDA) sont traités selon l'approche traditionnelle de la géostatistique avec la variographie expérimentale et selon les principes de l'apprentissage automatique. La variographie expérimentale, qui étudie les relations entre pairs de points, est un outil de base pour l'analyse géostatistique de corrélations spatiales anisotropiques qui permet de détecter la présence de patterns spatiaux descriptible par une statistique. L'approche de l'apprentissage automatique pour l'ESDA est présentée à travers l'application de la méthode des k plus proches voisins qui est très simple et possède d'excellentes qualités d'interprétation et de visualisation. Une part importante de la thèse traite de sujets d'actualité comme la cartographie automatique de données spatiales. Le réseau de neurones de régression généralisée est proposé pour résoudre cette tâche efficacement. Les performances du GRNN sont démontrées par des données de Comparaison d'Interpolation Spatiale (SIC) de 2004 pour lesquelles le GRNN bat significativement toutes les autres méthodes, particulièrement lors de situations d'urgence. La thèse est composée de quatre chapitres : théorie, applications, outils logiciels et des exemples guidés. Une partie importante du travail consiste en une collection de logiciels : Machine Learning Office. Cette collection de logiciels a été développée durant les 15 dernières années et a été utilisée pour l'enseignement de nombreux cours, dont des workshops internationaux en Chine, France, Italie, Irlande et Suisse ainsi que dans des projets de recherche fondamentaux et appliqués. Les cas d'études considérés couvrent un vaste spectre de problèmes géoenvironnementaux réels à basse et haute dimensionnalité, tels que la pollution de l'air, du sol et de l'eau par des produits radioactifs et des métaux lourds, la classification de types de sols et d'unités hydrogéologiques, la cartographie des incertitudes pour l'aide à la décision et l'estimation de risques naturels (glissements de terrain, avalanches). Des outils complémentaires pour l'analyse exploratoire des données et la visualisation ont également été développés en prenant soin de créer une interface conviviale et facile à l'utilisation. Machine Learning for geospatial data: algorithms, software tools and case studies Abstract The thesis is devoted to the analysis, modeling and visualisation of spatial environmental data using machine learning algorithms. In a broad sense machine learning can be considered as a subfield of artificial intelligence. It mainly concerns with the development of techniques and algorithms that allow computers to learn from data. In this thesis machine learning algorithms are adapted to learn from spatial environmental data and to make spatial predictions. Why machine learning? In few words most of machine learning algorithms are universal, adaptive, nonlinear, robust and efficient modeling tools. They can find solutions for the classification, regression, and probability density modeling problems in high-dimensional geo-feature spaces, composed of geographical space and additional relevant spatially referenced features. They are well-suited to be implemented as predictive engines in decision support systems, for the purposes of environmental data mining including pattern recognition, modeling and predictions as well as automatic data mapping. They have competitive efficiency to the geostatistical models in low dimensional geographical spaces but are indispensable in high-dimensional geo-feature spaces. The most important and popular machine learning algorithms and models interesting for geo- and environmental sciences are presented in details: from theoretical description of the concepts to the software implementation. The main algorithms and models considered are the following: multi-layer perceptron (a workhorse of machine learning), general regression neural networks, probabilistic neural networks, self-organising (Kohonen) maps, Gaussian mixture models, radial basis functions networks, mixture density networks. This set of models covers machine learning tasks such as classification, regression, and density estimation. Exploratory data analysis (EDA) is initial and very important part of data analysis. In this thesis the concepts of exploratory spatial data analysis (ESDA) is considered using both traditional geostatistical approach such as_experimental variography and machine learning. Experimental variography is a basic tool for geostatistical analysis of anisotropic spatial correlations which helps to understand the presence of spatial patterns, at least described by two-point statistics. A machine learning approach for ESDA is presented by applying the k-nearest neighbors (k-NN) method which is simple and has very good interpretation and visualization properties. Important part of the thesis deals with a hot topic of nowadays, namely, an automatic mapping of geospatial data. General regression neural networks (GRNN) is proposed as efficient model to solve this task. Performance of the GRNN model is demonstrated on Spatial Interpolation Comparison (SIC) 2004 data where GRNN model significantly outperformed all other approaches, especially in case of emergency conditions. The thesis consists of four chapters and has the following structure: theory, applications, software tools, and how-to-do-it examples. An important part of the work is a collection of software tools - Machine Learning Office. Machine Learning Office tools were developed during last 15 years and was used both for many teaching courses, including international workshops in China, France, Italy, Ireland, Switzerland and for realizing fundamental and applied research projects. Case studies considered cover wide spectrum of the real-life low and high-dimensional geo- and environmental problems, such as air, soil and water pollution by radionuclides and heavy metals, soil types and hydro-geological units classification, decision-oriented mapping with uncertainties, natural hazards (landslides, avalanches) assessments and susceptibility mapping. Complementary tools useful for the exploratory data analysis and visualisation were developed as well. The software is user friendly and easy to use.

Promotion of learning skills in the study of economics. pilot project in the subject area of

This communication is part of a larger teaching innovation project financed by the University ofBarcelona, whose objective is to develop and evaluate transversal competences of the UB, learningability and responsibility. The competence is divided into several sub-competencies being the ability toanalyze and synthesis the most intensely worked in the first year. The work presented here part fromthe results obtained in phase 1 and 2 previously implemented in other subjects (Mathematics andHistory) in the first year of the degree of Business Administration Degree. In these subjects’ previousexperiences there were deficiencies in the acquisition of learning skills by the students. The work inthe subject of Mathematics facilitated that students become aware of the deficit. The work on thesubject of History insisted on developing readings schemes and with the practical exercises wassought to go deeply in the development of this competence.The third phase presented here is developed in the framework of the second year degree, in the WorldEconomy subject. The objective of this phase is the development and evaluation of the same crosscompetence of the previous phases, from a practice that includes both, quantitative analysis andcritical reflection. Specifically the practice focuses on the study of the dynamic relationship betweeneconomic growth and the dynamics in the distribution of wealth. The activity design as well as theselection of materials to make it, has been directed to address gaps in the ability to analyze andsynthesize detected in the subjects of the first year in the previous phases of the project.The realization of the practical case is considered adequate methodology to improve the acquisition ofcompetence of the students, then it is also proposed how to evaluate the acquisition of suchcompetence. The practice is evaluated based on a rubric developed in the framework of the projectobjectives. Thus at the end of phase 3 we can analyze the process that have followed the students,detect where they have had major difficulties and identify those aspects of teaching that can help toimprove the acquisition of skills by the students. The interest of this phase resides in the possibility tovalue whether tracing of learning through competences, organized in a collaborative way, is a goodtool to develop the acquisition of these skills and facilitate their evaluation.

Gestión de la actividad no presencial y autoevaluación de competencias = Management of student learning outside the classroom and the self-evaluation of competences

La asignatura troncal “Evaluación Psicológica” de los estudios de Psicología y delestudio de grado “Desarrollo humano en la sociedad de la información” de laUniversidad de Girona consta de 12 créditos según la Ley Orgánica de Universidades.Hasta el año académico 2004-05 el trabajo no presencial del alumno consistía en larealización de una evaluación psicológica que se entregaba por escrito a final de curso yde la cual el estudiante obtenía una calificación y revisión si se solicitaba. En el caminohacia el Espacio Europeo de Educación Superior, esta asignatura consta de 9 créditosque equivalen a un total de 255 horas de trabajo presencial y no presencial delestudiante. En los años académicos 2005-06 y 2006-07 se ha creado una guía de trabajopara la gestión de la actividad no presencial con el objetivo de alcanzar aprendizajes anivel de aplicación y solución de problemas/pensamiento crítico (Bloom, 1975)siguiendo las recomendaciones de la Agencia para la Calidad del Sistema Universitariode Cataluña (2005). La guía incorpora: los objetivos de aprendizaje, los criterios deevaluación, la descripción de las actividades, el cronograma semanal de trabajos paratodo el curso, la especificación de las tutorías programadas para la revisión de losdiversos pasos del proceso de evaluación psicológica y el uso del foro para elconocimiento, análisis y crítica constructiva de las evaluaciones realizadas por loscompañeros

Introducing blended learning into a Master Program in Nursing Sciences: a first exploration of a holistic evaluation framework

This contribution presents the first stage of a project to assist the transition of a traditional to a blended program in higher nursing education. We shall describe the goals and context of this project, present the evaluation framework, discuss some early results and then discuss the usefulness of the first version of the evaluation framework.

Faculty-librarians collaboration in an e-learning experience : resources management and training in Open University of Catalonia (UOC)

The traditional model of learning based on knowledge transfer doesn't promote the acquisition of information-related competencies and development of autonomous learning. More needs to be done to embrace learner-centred approaches, based on constructivism, collaboration and co-operation. This new learning paradigm is aligned with the European Higher Education Area (EHEA) requirements. In this sense, a learning experience based in faculty' librarian collaboration was seen as the best option for promoting student engagement and also a way to increase information-related competences in Open University of Catalonia (UOC) academic context. This case study outlines the benefits of teacher-librarian collaboration in terms of pedagogy innovation, resources management and introduction of open educational resources (OER) in virtual classrooms, Information literacy (IL) training and use of 2.0 tools in teaching. Our faculty-librarian's collaboration aims to provide an example of technology-enhanced learning and demonstrate how working together improves the quality and relevance of educational resources in UOC's virtual classrooms. Under this new approach, while teachers change their role from instructors to facilitators of the learning process and extend their reach to students, libraries acquire an important presence in the academic learning communities.

Learning in Product Development Projects - Responding to challenges in global industrial company

Verkostoitunut kansainvälinen tuotekehitys on tärkeä osa menestystä nykypäivän muuttuvassa yritysmaailmassa. Toimintojen tehostamiseksi myös projektitoiminnot on sopeutettava kansainväliseen toimintaympäristöön. Kilpailukyvyn säilyttämiseksi projektitoimintoja on lisäksi jatkuvasti tehostettava. Yhtenäkeinona nähdään projektioppiminen, jota voidaan edistää monin eri tavoin. Tässätyössä keskitytään projektitiedonhallinnan kehittämisen tuomiin oppimismahdollisuuksiin. Kirjallisuudessa kerrotaan, että projektitiedon jakaminen ja sen hyödyntäminen seuraavissa projekteissa on eräs projektioppimisen edellytyksistä. Tämäon otettu keskeiseksi näkökulmaksi tässä tutkimuksessa. Lisäksi tutkimusalueen rajaamiseksi työ tarkastelee erityisesti projektioppimista kansainvälisten tuotekehitysprojektien välillä. Työn tavoitteena on esitellä keskeisiä projektioppimisen haasteita ja etsiä konkreettinen ratkaisu vastaamaan näihin haasteisiin. Tuotekehitystoiminnot ja kansainvälinen hajautettu projektiorganisaatio kohtaavat lisäksi erityisiä haasteita, kuten tiedon hajautuneisuus, projektihenkilöstön vaihtuvuus, tiedon luottamuksellisuus ja maantieteelliset haasteet (esim. aikavyöhykkeet ja toimipisteen sijainti). Nämä erityishaasteet on otettu huomioon ratkaisua etsittäessä. Haasteisiin päädyttiin vastaamaan tietotekniikkapohjaisella ratkaisulla, joka suunniteltiin erityisesti huomioiden esimerkkiorganisaation tarpeet ja haasteet. Työssä tarkastellaan suunnitellun ratkaisun vaikutusta projektioppimiseen ja kuinka se vastaa havaittuihin haasteisiin. Tuloksissa huomattiin, että projektioppimista tapahtui, vaikka oppimista oli vaikea suoranaisesti huomata tutkimusorganisaation jäsenten keskuudessa. Projektioppimista voidaan kuitenkin sanoa tapahtuvan, jos projektitieto on helposti koko projektiryhmän saatavilla ja se on hyvin järjesteltyä. Muun muassa nämä ehdot täyttyivät. Projektioppiminen nähdään yleisesti haastavana kehitysalueena esimerkkiorganisaatiossa. Suuri osa tietämyksestä on niin sanottua hiljaistatietoa, jota on hankala tai mahdoton saattaa kirjalliseen muotoon. Näin olleen tiedon siirtäminen jää suurelta osin henkilökohtaisen vuorovaikutuksen varaan. Siitä huolimatta projektioppimista on mahdollista kehittää erilaisin toimintamallein ja menetelmin. Kehitys vaatii kuitenkin resursseja, pitkäjänteisyyttä ja aikaa. Monet muutokset voivat vaatia myös organisaatiokulttuurin muutoksen ja vaikuttamista organisaation jäseniin. Motivaatio, positiiviset mielikuvat ja selkeät strategiset tavoitteet luovat vakaan pohjan projektioppimisen kehittämiselle.

Gestión de la actividad no presencial y autoevaluación de competencias = Management of Student Learning Outside the Classroom and the Self-evaluation of Competences

Psychological Assessment is a core subject of Psychology studies, and of the university degree Human development, at the University of Girona and according to the University regulations, had 12 credits. Until the 2005-06 academic years, the student work conducted outside the classroom consisted of undertaking a psychological assessment that was written and handed in at the end of the course. From this the student obtained a qualification and a review if they applied for it In accordance with the European Credits for Higher Education, this subject was reduced to 9 credits, which is the equivalent of a total of 255 hours of in-class work and outside the classroom. In the 2006-07 academic year we created a guide to manage the student’s experiences outside the classroom, with the objective of encouraging the application of problem solving/critical thinking (Bloom, 1975), in line with the recommendations of the Catalonia Agency for University System Quality (2005). The guide includes: learning objectives, evaluation criterions, a description of activities, work week timetable for the whole course, programmed tutorials to review all steps of the psychological assessment process, and the use of a web-based virtual forum for the transfer of knowledge, analysis and constructive critiques of the assessment done by themselves and their colleagues

eLab, a Personal Learning Environment for the Green Open Innovation Platform

Open Innovation is a relatively new concept which involves a change of paradigm in the R+D+i processes of companies whose aim is to create new technologies or new processes. If to this change, we add the need for innovation in the new green and sustainability economy, and we set out to create a collaborative platform with a learning space where this can happen, we will be facing an overwhelming challenge which requires the application of intelligent programming technologies and languages at the service of education.The aim of the Green IDI (Green Open Innovation) ¿ Economic development and job creation vector in SMEs, based on the environment and sustainability project is to create a platform where companies and individual researchers can perform open innovation processes in the field of sustainability and the environment.The Green IDI (Green Open Innovation) project is funded under the program INNPACTO by the Ministry of Science and Innovation of Spain and is being developed through a consortium formed by the following institutions: GRUPO ICA; COMPARTIA; GRUPO INTERCOM; CETAQUA and the Instituto de Investigación en Inteligencia Artificial (IIIA) from Consejo Superior de Investigaciones Científicas (CSIC). Also the consortium include FUNDACIÓ PRIVADA BARCELONA DIGITAL; PIMEC and UNIVERSITAT OBERTA DE CATALUNYA (UOC).Sustainability and positive action for the environment are considered the principle vector of economic development for companies. As Nicolás Scoli says (2007) ¿in short, preventing unnecessary consumption and the efficient consumption of resources means producing greater wealth with less. Both effects lead to reduced pollution linked to production and consumption¿.The Spanish Sustainable Development Strategy (EEDS) plan defends consumption and sustainable production linked to social and economic development by adhering to the commitment not to endanger ecosystems and abolishing the idea that economic growth is directly proportional to the deterioration of the environment.Uniting the Open Innovation and New Green Economy concepts leads to the "Green Open Innovation¿ Platform creation project.This article analyses the concept of open innovation and defines the importance of the new green and sustainable economy. Lastly, it proposes the creation of eLab. The eLab is defined as an Open Green Innovation Platform personal and collaborative education space which is fed by the interactions of users and which enables innovation processes based on new green economy concepts to be carried out.The creation of a personal learning environment such as eLab on the Green Open Innovation Platform meets the need to offer a collaborative space where platform users can improve their skills regarding the environment and sustainability based on collaborative synergies through Information and Communication Technologies.

Learning Preferences with Kernel-Based Methods

Learning of preference relations has recently received significant attention in machine learning community. It is closely related to the classification and regression analysis and can be reduced to these tasks. However, preference learning involves prediction of ordering of the data points rather than prediction of a single numerical value as in case of regression or a class label as in case of classification. Therefore, studying preference relations within a separate framework facilitates not only better theoretical understanding of the problem, but also motivates development of the efficient algorithms for the task. Preference learning has many applications in domains such as information retrieval, bioinformatics, natural language processing, etc. For example, algorithms that learn to rank are frequently used in search engines for ordering documents retrieved by the query. Preference learning methods have been also applied to collaborative filtering problems for predicting individual customer choices from the vast amount of user generated feedback. In this thesis we propose several algorithms for learning preference relations. These algorithms stem from well founded and robust class of regularized least-squares methods and have many attractive computational properties. In order to improve the performance of our methods, we introduce several non-linear kernel functions. Thus, contribution of this thesis is twofold: kernel functions for structured data that are used to take advantage of various non-vectorial data representations and the preference learning algorithms that are suitable for different tasks, namely efficient learning of preference relations, learning with large amount of training data, and semi-supervised preference learning. Proposed kernel-based algorithms and kernels are applied to the parse ranking task in natural language processing, document ranking in information retrieval, and remote homology detection in bioinformatics domain. Training of kernel-based ranking algorithms can be infeasible when the size of the training set is large. This problem is addressed by proposing a preference learning algorithm whose computation complexity scales linearly with the number of training data points. We also introduce sparse approximation of the algorithm that can be efficiently trained with large amount of data. For situations when small amount of labeled data but a large amount of unlabeled data is available, we propose a co-regularized preference learning algorithm. To conclude, the methods presented in this thesis address not only the problem of the efficient training of the algorithms but also fast regularization parameter selection, multiple output prediction, and cross-validation. Furthermore, proposed algorithms lead to notably better performance in many preference learning tasks considered.

Inter organizational learning within and by innovation networks

The thesis deals with the phenomenon of learning between organizations in innovation networks that develop new products, services or processes. Inter organizational learning is studied especially at the level of the network. The role of the network can be seen as twofold: either the network is a context for inter organizational learning, if the learner is something else than the network (organization, group, individual), or the network itself is the learner. Innovations are regarded as a primary source of competitiveness and renewal in organizations. Networking has become increasingly common particularly because of the possibility to extend the resource base of the organization through partnerships and to concentrate on core competencies. Especially in innovation activities, networks provide the possibility to answer the complex needs of the customers faster and to share the costs and risks of the development work. Networked innovation activities are often organized in practice as distributed virtual teams, either within one organization or as cross organizational co operation. The role of technology is considered in the research mainly as an enabling tool for collaboration and learning. Learning has been recognized as one important collaborative process in networks or as a motivation for networking. It is even more important in the innovation context as an enabler of renewal, since the essence of the innovation process is creating new knowledge, processes, products and services. The thesis aims at providing enhanced understanding about the inter organizational learning phenomenon in and by innovation networks, especially concentrating on the network level. The perspectives used in the research are the theoretical viewpoints and concepts, challenges, and solutions for learning. The methods used in the study are literature reviews and empirical research carried out with semi structured interviews analyzed with qualitative content analysis. The empirical research concentrates on two different areas, firstly on the theoretical approaches to learning that are relevant to innovation networks, secondly on learning in virtual innovation teams. As a result, the research identifies insights and implications for learning in innovation networks from several viewpoints on organizational learning. Using multiple perspectives allows drawing a many sided picture of the learning phenomenon that is valuable because of the versatility and complexity of situations and challenges of learning in the context of innovation and networks. The research results also show some of the challenges of learning and possible solutions for supporting especially network level learning.

Student experiences in a course blended learning

Fascination is a project for design students, developed jointly by the Technical University of Catalonia (UPC) and the University of Technology Thonburi (KMUTT), which works with two groups of students, one group of participants in Spain and another group in Thailand where, hands-on activities, a range of technologies are used to prepare students for the lessons, through learning activities and content. This research paper presents the test of both a general model and a tool for measuring the participants’ experiences in a course that uses a blended learning methodology, with the aim of collecting empirical evidence to justify the effort of applying this methodology, based on the participants’ satisfaction. The procedure used in the conceptualization of the survey, the generation of topics, the collection of data, and the validation of the scale of various items are described here. The information, provided by the 26 people surveyed about the course and the virtual environment that was used, was analyzed to measure their perceptions and explore possible relations. Finally the conclusions of the research and the future work are presented.

Blended learning and student time-use in engineering education

Aiheen laajempi artikkeli on julkaistu konferenssi-CD:llä.