Development of a tool for the construction of "ground truth" for complex color images with text

Aquesta memoria resumeix el treball de final de carrera d’Enginyeria Superior d’Informàtica. Explicarà les principals raons que han motivat el projecte així com exemples que il·lustren l’aplicació resultant. En aquest cas el software intentarà resoldre la actual necessitat que hi ha de tenir dades de Ground Truth per als algoritmes de segmentació de text per imatges de color complexes. Tots els procesos seran explicats en els diferents capítols partint de la definició del problema, la planificació, els requeriments i el disseny fins a completar la il·lustració dels resultats del programa i les dades de Ground Truth resultants.

Intestinal content detection in capsule endoscopy using robust features

This work covers two aspects. First, it generally compares and summarizes the similarities and differences of state of the art feature detector and descriptor and second it presents a novel approach of detecting intestinal content (in particular bubbles) in capsule endoscopy images. Feature detectors and descriptors providing invariance to change of perspective, scale, signal-noise-ratio and lighting conditions are important and interesting topics in current research and the number of possible applications seems to be numberless. After analysing a selection of in the literature presented approaches, this work investigates in their suitability for applications information extraction in capsule endoscopy images. Eventually, a very good performing detector of intestinal content in capsule endoscopy images is presented. A accurate detection of intestinal content is crucial for all kinds of machine learning approaches and other analysis on capsule endoscopy studies because they occlude the field of view of the capsule camera and therefore those frames need to be excluded from analysis. As a so called “byproduct” of this investigation a graphical user interface supported Feature Analysis Tool is presented to execute and compare the discussed feature detectors and descriptor on arbitrary images, with configurable parameters and visualized their output. As well the presented bubble classifier is part of this tool and if a ground truth is available (or can also be generated using this tool) a detailed visualization of the validation result will be performed.

Simulador de conducció enfocat a la investigació

El desenvolupament de sistemes d’assistència a la conducció (ADAS) és, avui dia, una de les àrees de recerca de més interès pel Centre de Visió per Computador. A partir de la informació adquirida per sensors instal·lats en un vehicle, els ADAS assisteixen al conductor per tal d’evitar situacions de perill. La validació d’aquests sistemes però, requereix de l’obtenció "manual" de les dades que defineixen l’entorn de conducció de forma precisa: una tasca costosa i subjecta a l’error humà. Per tal de resoldre aquest problema, en aquest projecte s’ha implementat IOCS, un simulador de conducció creat a partir d’un de robots, capaç de crear entorns realistes de conducció i d’obtenir, simultàniament, les dades sobre l’entorn inferides per un ADAS i les que el descriuen objectivament. Aquesta funcionalitat facilita extremadament el procés de validació actual dels sistemes d’assistència a la conducció.

Model-Free Reconstruction of Excitatory Neuronal Connectivity from Calcium Imaging Signals

A systematic assessment of global neural network connectivity through direct electrophysiological assays has remained technically infeasible, even in simpler systems like dissociated neuronal cultures. We introduce an improved algorithmic approach based on Transfer Entropy to reconstruct structural connectivity from network activity monitored through calcium imaging. We focus in this study on the inference of excitatory synaptic links. Based on information theory, our method requires no prior assumptions on the statistics of neuronal firing and neuronal connections. The performance of our algorithm is benchmarked on surrogate time series of calcium fluorescence generated by the simulated dynamics of a network with known ground-truth topology. We find that the functional network topology revealed by Transfer Entropy depends qualitatively on the time-dependent dynamic state of the network (bursting or non-bursting). Thus by conditioning with respect to the global mean activity, we improve the performance of our method. This allows us to focus the analysis to specific dynamical regimes of the network in which the inferred functional connectivity is shaped by monosynaptic excitatory connections, rather than by collective synchrony. Our method can discriminate between actual causal influences between neurons and spurious non-causal correlations due to light scattering artifacts, which inherently affect the quality of fluorescence imaging. Compared to other reconstruction strategies such as cross-correlation or Granger Causality methods, our method based on improved Transfer Entropy is remarkably more accurate. In particular, it provides a good estimation of the excitatory network clustering coefficient, allowing for discrimination between weakly and strongly clustered topologies. Finally, we demonstrate the applicability of our method to analyses of real recordings of in vitro disinhibited cortical cultures where we suggest that excitatory connections are characterized by an elevated level of clustering compared to a random graph (although not extreme) and can be markedly non-local.

How we experience immersive virtual environments: the concept of presence and its measurement

This paper reviews the concept of presence in immersive virtual environments, the sense of being there signalled by people acting and responding realistically to virtual situations and events. We argue that presence is a unique phenomenon that must be distinguished from the degree of engagement, involvement in the portrayed environment. We argue that there are three necessary conditions for presence: the (a) consistent low latency sensorimotor loop between sensory data and proprioception; (b) statistical plausibility: images must be statistically plausible in relation to the probability distribution of images over natural scenes. A constraint on this plausibility is the level of immersion;(c) behaviour-response correlations: Presence may be enhanced and maintained over time by appropriate correlations between the state and behaviour of participants and responses within the environment, correlations that show appropriate responses to the activity of the participants. We conclude with a discussion of methods for assessing whether presence occurs, and in particular recommend the approach of comparison with ground truth and give some examples of this.

Aplicación de imágenes radar de satélite a la cartografía de la vegetación en zonas boreales

El presente estudio se enmarca en el proyecto europeo SIBERIA. Trata de explorar el uso de imágenes radar de satélite (ERS y JERS) para la actualización de la cartografía de vegetación de zonas boreales. Se dispone de 8 imágenes de amplitud y coherencia tomadas en 1998, así como de un inventario de vegetación georreferenciado de dos pequeñas zonas. Se proponen tres tipos de clasificaciones supervisadas por el método de máxima verosimilitud. La primera con las imágenes de satélite, la segunda añadiendo algunas imágenes texturales, y la tercera utilizando sólo las imágenes de los componentes principales más significativos. Se siguen los criterios establecidos en el proyecto SIBERIA para la obtención de áreas de entrenamiento. Se propone una doble validación, por una parte vía matrices de confusión a partir de áreas de verdad-terreno obtenidas por el mismo método que las áreas de entrenamiento, y por otra parte contrastando y correlacionando las clasificaciones con los parámetros de inventario disponibles para dos pequeñas áreas de verdad-terreno. Los resultados indican una sensible mejora en la clasificación con la incorporación de imágenes texturales (la precisión aumenta de un 66% a un 75%), y señalan el parámetro biomasa como el mejor correlacionado con las clasificaciones derivadas (coeficiente de correlación r de hasta 0,49). Diferentes fuentes de error permiten augurar un margen de mejora para posteriores estudios.

How we experience immersive virtual environments: the concept of presence and its measurement

This paper reviews the concept of presence in immersive virtual environments, the sense of being there signalled by people acting and responding realistically to virtual situations and events. We argue that presence is a unique phenomenon that must be distinguished from the degree of engagement, involvement in the portrayed environment. We argue that there are three necessary conditions for presence: the (a) consistent low latency sensorimotor loop between sensory data and proprioception; (b) statistical plausibility: images must be statistically plausible in relation to the probability distribution of images over natural scenes. A constraint on this plausibility is the level of immersion;(c) behaviour-response correlations: Presence may be enhanced and maintained over time by appropriate correlations between the state and behaviour of participants and responses within the environment, correlations that show appropriate responses to the activity of the participants. We conclude with a discussion of methods for assessing whether presence occurs, and in particular recommend the approach of comparison with ground truth and give some examples of this.

Trace me if you can: the use of intrinsic biogeochemical markers in marine top predators

Human activities have serious impacts on marine apex predators. Inadequate knowledge of the spatial and trophic ecology of these marine animals ultimately compromises the viability of their populations and impedes our ability to use them as environmental biomonitors. Intrinsic biogeochemical markers, such as stable isotopes, fatty acids, trace elements, and chemical pollutants, are increasingly being used to trace the spatial and trophic ecology of marine top predators. Notable advances include the emergence of the first oceanographic"isoscapes" (isotopic geographic gradients), the advent of compound-specific isotopic analyses, improvements in diet reconstruction through Bayesian statistics, and tissue analysis of tracked animals to ground-truth biogeochemical profiles. However, most researchers still focus on only a few tracers. Moreover, insufficient knowledge of the biogeochemical integration in tissues, fractionation and routing processes, and geographic and temporal variability in baseline levels continue to hamper the resolution and potential of these markers in studying the spatial and feeding ecology of top predators.

Mosaico mediterráneo. El Arte como herramienta de diálogo intercultural

El presente trabajo de investigación doctoral reflexiona sobre el aporte de las prácticas artísticas contemporáneas en los procesos de diálogo entre culturas en el Mediterráneo. En las dinámicas de percepción, acercamiento y (re)conocimiento del otro y de las culturas otras, todos los medios informativos y de comunicación pueden ser, por un lado, válidos y efectivos como, por otro, pueden desviar de la verdad y difundir fácilmente numerosos prejuicios. Frente a la “síntesis” operada por los medios de comunicación tradicionales, donde “el Otro” es a menudo objeto de representaciones estereotipadas, las prácticas artísticas, en su sentido más amplio, contraponen un “análisis” que puede permitir, en diferentes casos, la eliminación de las barreras y un mayor acercamiento a la cultura otra. En la presente investigación se quiere trazar un itinerario teórico que parte de las hipótesis orientalistas, pasa por las filosofías del encuentro con el otro; los estudios sobre la participación; las actuales reflexiones sobre la estética relacional; las definiciones históricas y socio-políticas del Mediterráneo; hasta llegar a reconocer en el arte, en la creación artística, el medio de comunicación más eficaz y penetrante a la hora de refinar el conocimiento y (re)descubrir los diferentes aspectos de las culturas de los países y de los pueblos del Mediterráneo. En el espacio plural del Mediterráneo las prácticas artísticas y creativas actuales actúan como un campo de experimentación y un territorio de debate valioso e importante para el desarrollo del discurso intercultural.

Stone-ground wood pulp-reinforced polypropylene composites: water uptake and thermal properties

Two of the drawbacks of using natural-based composites in industrial applications are thermal instability and water uptake capacity. In this work, mechanical wood pulp was used to reinforce polypropylene at a level of 20 to 50 wt. %. Composites were mixed by means of a Brabender internal mixer for both non-coupled and coupled formulations. Differential scanning calorimetry (DSC) and thermogravimetric analysis (TGA) were used to determine the thermal properties of the composites. The water uptake behavior was evaluated by immersion of the composites in water until an equilibrium state was reached. Results of water absorption tests revealed that the amount of water absorption was clearly dependent upon the fiber content. The coupled composites showed lower water absorption compared to the uncoupled composites. The incorporation of mechanical wood pulp into the polypropylene matrix produced a clear nucleating effect by increasing the crystallinity degree of the polymer and also increasing the temperature of polymer degradation. The maximum degradation temperature for stone ground wood pulp–reinforced composites was in the range of 330 to 345 ºC

Improved earthquake response via simulation and integrated space- and ground-based technologies: the TREMOR proposal

Earthquakes occurring around the world each year cause thousands ofdeaths, millions of dollars in damage to infrastructure, and incalculablehuman suffering. In recent years, satellite technology has been asignificant boon to response efforts following an earthquake and itsafter-effects by providing mobile communications between response teamsand remote sensing of damaged areas to disaster management organizations.In 2007, an international team of students and professionals assembledduring theInternational Space University’s Summer Session Program in Beijing, Chinato examine how satellite and ground-based technology could be betterintegrated to provide an optimised response in the event of an earthquake.The resulting Technology Resources for Earthquake MOnitoring and Response(TREMOR) proposal describes an integrative prototype response system thatwill implement mobile satellite communication hubs providing telephone anddata links between response teams, onsite telemedicine consultation foremergency first-responders, and satellite navigation systems that willlocate and track emergency vehicles and guide search-and-rescue crews. Aprototype earthquake simulation system is also proposed, integratinghistorical data, earthquake precursor data, and local geomatics andinfrastructure information to predict the damage that could occur in theevent of an earthquake. The backbone of these proposals is a comprehensiveeducation and training program to help individuals, communities andgovernments prepare in advance. The TREMOR team recommends thecoordination of these efforts through a centralised, non-governmentalorganization.

Feature Extraction from Whole-Sky Ground-Based Images for Cloud-Type Recognition

Several features that can be extracted from digital images of the sky and that can be useful for cloud-type classification of such images are presented. Some features are statistical measurements of image texture, some are based on the Fourier transform of the image and, finally, others are computed from the image where cloudy pixels are distinguished from clear-sky pixels. The use of the most suitable features in an automatic classification algorithm is also shown and discussed. Both the features and the classifier are developed over images taken by two different camera devices, namely, a total sky imager (TSI) and a whole sky imager (WSC), which are placed in two different areas of the world (Toowoomba, Australia; and Girona, Spain, respectively). The performance of the classifier is assessed by comparing its image classification with an a priori classification carried out by visual inspection of more than 200 images from each camera. The index of agreement is 76% when five different sky conditions are considered: clear, low cumuliform clouds, stratiform clouds (overcast), cirriform clouds, and mottled clouds (altocumulus, cirrocumulus). Discussion on the future directions of this research is also presented, regarding both the use of other features and the use of other classification techniques

Ground-state self-consistent calculation of quantum dots under magnetic fields: Addition spectrum

A density-functional self-consistent calculation of the ground-state electronic density of quantum dots under an arbitrary magnetic field is performed. We consider a parabolic lateral confining potential. The addition energy, E(N+1)-E(N), where N is the number of electrons, is compared with experimental data and the different contributions to the energy are analyzed. The Hamiltonian is modeled by a density functional, which includes the exchange and correlation interactions and the local formation of Landau levels for different equilibrium spin populations. We obtain an analytical expression for the critical density under which spontaneous polarization, induced by the exchange interaction, takes place.