Algorithms for on-line image registration from multiple views

Images of a scene, static or dynamic, are generally acquired at different epochs from different viewpoints. They potentially gather information about the whole scene and its relative motion with respect to the acquisition device. Data from different (in the spatial or temporal domain) visual sources can be fused together to provide a unique consistent representation of the whole scene, even recovering the third dimension, permitting a more complete understanding of the scene content. Moreover, the pose of the acquisition device can be achieved by estimating the relative motion parameters linking different views, thus providing localization information for automatic guidance purposes. Image registration is based on the use of pattern recognition techniques to match among corresponding parts of different views of the acquired scene. Depending on hypotheses or prior information about the sensor model, the motion model and/or the scene model, this information can be used to estimate global or local geometrical mapping functions between different images or different parts of them. These mapping functions contain relative motion parameters between the scene and the sensor(s) and can be used to integrate accordingly informations coming from the different sources to build a wider or even augmented representation of the scene. Accordingly, for their scene reconstruction and pose estimation capabilities, nowadays image registration techniques from multiple views are increasingly stirring up the interest of the scientific and industrial community. Depending on the applicative domain, accuracy, robustness, and computational payload of the algorithms represent important issues to be addressed and generally a trade-off among them has to be reached. Moreover, on-line performance is desirable in order to guarantee the direct interaction of the vision device with human actors or control systems. This thesis follows a general research approach to cope with these issues, almost independently from the scene content, under the constraint of rigid motions. This approach has been motivated by the portability to very different domains as a very desirable property to achieve. A general image registration approach suitable for on-line applications has been devised and assessed through two challenging case studies in different applicative domains. The first case study regards scene reconstruction through on-line mosaicing of optical microscopy cell images acquired with non automated equipment, while moving manually the microscope holder. By registering the images the field of view of the microscope can be widened, preserving the resolution while reconstructing the whole cell culture and permitting the microscopist to interactively explore the cell culture. In the second case study, the registration of terrestrial satellite images acquired by a camera integral with the satellite is utilized to estimate its three-dimensional orientation from visual data, for automatic guidance purposes. Critical aspects of these applications are emphasized and the choices adopted are motivated accordingly. Results are discussed in view of promising future developments.

Reconstruction from image correspondences

A single picture provides a largely incomplete representation of the scene one is looking at. Usually it reproduces only a limited spatial portion of the scene according to the standpoint and the viewing angle, besides it contains only instantaneous information. Thus very little can be understood on the geometrical structure of the scene, the position and orientation of the observer with respect to it remaining also hard to guess. When multiple views, taken from different positions in space and time, observe the same scene, then a much deeper knowledge is potentially achievable. Understanding inter-views relations enables construction of a collective representation by fusing the information contained in every single image. Visual reconstruction methods confront with the formidable, and still unanswered, challenge of delivering a comprehensive representation of structure, motion and appearance of a scene from visual information. Multi-view visual reconstruction deals with the inference of relations among multiple views and the exploitation of revealed connections to attain the best possible representation. This thesis investigates novel methods and applications in the field of visual reconstruction from multiple views. Three main threads of research have been pursued: dense geometric reconstruction, camera pose reconstruction, sparse geometric reconstruction of deformable surfaces. Dense geometric reconstruction aims at delivering the appearance of a scene at every single point. The construction of a large panoramic image from a set of traditional pictures has been extensively studied in the context of image mosaicing techniques. An original algorithm for sequential registration suitable for real-time applications has been conceived. The integration of the algorithm into a visual surveillance system has lead to robust and efficient motion detection with Pan-Tilt-Zoom cameras. Moreover, an evaluation methodology for quantitatively assessing and comparing image mosaicing algorithms has been devised and made available to the community. Camera pose reconstruction deals with the recovery of the camera trajectory across an image sequence. A novel mosaic-based pose reconstruction algorithm has been conceived that exploit image-mosaics and traditional pose estimation algorithms to deliver more accurate estimates. An innovative markerless vision-based human-machine interface has also been proposed, so as to allow a user to interact with a gaming applications by moving a hand held consumer grade camera in unstructured environments. Finally, sparse geometric reconstruction refers to the computation of the coarse geometry of an object at few preset points. In this thesis, an innovative shape reconstruction algorithm for deformable objects has been designed. A cooperation with the Solar Impulse project allowed to deploy the algorithm in a very challenging real-world scenario, i.e. the accurate measurements of airplane wings deformations.

Recognizing cultural concepts: Joyce, Woolf, Mann and Musil

The purpose of this thesis is to establish a direct relationship between literature and fields of knowledge such as science and technology, by focusing on some concepts that were fundamental for both science and the humanities at the beginning of the 20th century. The concepts are those of simultaneity, multiple points of view, map, relativity and acausality. In the spirit of several recent ideas, for example Katherine Hayles’ isomorphism notion, the dissertation shows how writers such as James Joyce, Virginia Woolf, Thomas Mann and Robert Musil developed the mentioned concepts within their narratives. The working hypothesis is that those concepts were at a crossroad of human activities, and that those authors used them extensively within their narratives. It is further argued that those same concepts – as developed by Joyce in Ulysses, Woolf’s shorts stories and novels from the end of the 1910’s until the end of the1920’s, Mann’s Der Zauberberg (The Magic Mountain), and Musil’s Der Mann ohne Eigenschaften (The Man Without Qualities) — are still fundamental for our conception of time and space today. The thesis is divided into two parts. The first two chapters will analyse the concepts of simultaneity and multiple points of view and their relationship to cartography as developed within English literature and culture. The next two chapters will address the concepts of relativity and acausality, as developed within German literature and culture.

Design and Setup of a New HPGe Detector Based Body Counter Capable of Detecting Also Low Energy Photon Emitters

The present work describes the development of a new body-counter system based on HPGe detectors and installed at IVM of KIT. The goal, achieved, was the improvement of the ability to detect internal contaminations in the human body, especially the ones concerning low-energy emitters and multiple nuclides. The development of the system started with the characterisation of detectors purchased for this specific task, with the optimisation of the different desired measurement configurations following and ending with the installation and check of the results. A new software has been developed to handle the new detectors.

Who can (not) be Greek? Citizenship, Identity and Belonging among youth of sub-Saharan African background in Athens

‘Who can be Greek?’ This was the question posed to the Greek society for the first time before the implementation of the Act 3838 in March 2010 which gave the right to access the Greek citizenship -under specific preconditions- to all children of legal migrants born or schooled in Greece. This change of the Nationality Code in order to include all those children was coincided by the economic crisis resulting into the rise of xenophobia, racism and extreme-right rhetoric. The outcome was the cancellation of the Act 3838 by the State Council in February 2013. Under this particular framework, the notions of identity and belonging formed among the youth of African background in Athens are explored. The ways those youngsters perceive not only themselves but also their peers, their countries of origin and the country they live in, are crucial elements of their self-identification. Researches have shown that the integration of the second generation is highly connected to their legal and social status. However, integration is a rather complex process, influenced and shaped by many variables and multiple factors. It is not linear; therefore, its outcomes are difficult to be predicted. Yet, I argue that citizenship acquisition facilitates the process as it transforms those children from ‘aliens’ to ‘citizens’. How these youngsters are perceived by the majority society and the State is one of the core questions of the research, focusing on the imposed dual ‘otherness’ they are subject to. On the one hand, they have to deal with the ‘otherness’ originating from the migrant status inherited to them by their parents, and on the other with the ‘otherness’ deriving from their different phenotypic characteristics. Race matters and becomes a means of discrimination against youth of African background who are perceived as inassimilable and ‘forever others’.

New computational biology tools for the systematic analysis of the structure and expression of human genes

From the late 1980s, the automation of sequencing techniques and the computer spread gave rise to a flourishing number of new molecular structures and sequences and to proliferation of new databases in which to store them. Here are presented three computational approaches able to analyse the massive amount of publicly avalilable data in order to answer to important biological questions. The first strategy studies the incorrect assignment of the first AUG codon in a messenger RNA (mRNA), due to the incomplete determination of its 5' end sequence. An extension of the mRNA 5' coding region was identified in 477 in human loci, out of all human known mRNAs analysed, using an automated expressed sequence tag (EST)-based approach. Proof-of-concept confirmation was obtained by in vitro cloning and sequencing for GNB2L1, QARS and TDP2 and the consequences for the functional studies are discussed. The second approach analyses the codon bias, the phenomenon in which distinct synonymous codons are used with different frequencies, and, following integration with a gene expression profile, estimates the total number of codons present across all the expressed mRNAs (named here "codonome value") in a given biological condition. Systematic analyses across different pathological and normal human tissues and multiple species shows a surprisingly tight correlation between the codon bias and the codonome bias. The third approach is useful to studies the expression of human autism spectrum disorder (ASD) implicated genes. ASD implicated genes sharing microRNA response elements (MREs) for the same microRNA are co-expressed in brain samples from healthy and ASD affected individuals. The different expression of a recently identified long non coding RNA which have four MREs for the same microRNA could disrupt the equilibrium in this network, but further analyses and experiments are needed.

Hydrodynamic induced by an array of wave energy converters. Experimental and numerical analysis

The thesis analyses the hydrodynamic induced by an array of Wave energy Converters (WECs), under an experimental and numerical point of view. WECs can be considered an innovative solution able to contribute to the green energy supply and –at the same time– to protect the rear coastal area under marine spatial planning considerations. This research activity essentially rises due to this combined concept. The WEC under exam is a floating device belonging to the Wave Activated Bodies (WAB) class. Experimental data were performed at Aalborg University in different scales and layouts, and the performance of the models was analysed under a variety of irregular wave attacks. The numerical simulations performed with the codes MIKE 21 BW and ANSYS-AQWA. Experimental results were also used to calibrate the numerical parameters and/or to directly been compared to numerical results, in order to extend the experimental database. Results of the research activity are summarized in terms of device performance and guidelines for a future wave farm installation. The device length should be “tuned” based on the local climate conditions. The wave transmission behind the devices is pretty high, suggesting that the tested layout should be considered as a module of a wave farm installation. Indications on the minimum inter-distance among the devices are provided. Furthermore, a CALM mooring system leads to lower wave transmission and also larger power production than a spread mooring. The two numerical codes have different potentialities. The hydrodynamics around single and multiple devices is obtained with MIKE 21 BW, while wave loads and motions for a single moored device are derived from ANSYS-AQWA. Combining the experimental and numerical it is suggested –for both coastal protection and energy production– to adopt a staggered layout, which will maximise the devices density and minimize the marine space required for the installation.

Towards the Enabling City: Intermediate Places between Practices and Planning for Social Innovation in Bologna

The research investigates the interaction between social innovation practices and urban planning, assuming as a case study and field of application the city of Bologna, observed from the point of view of the production of urban policies and with respect to the places where it is practiced. Social innovation are localised actions tackling current urban complexities with micro-scale practices of service and urban production, by which new urban actors find answers to social needs, which are less afforded by the market and the public sectors. Planning and social innovation practices are two dimensions working in the city in different but complementary ways, subject to a mismatch. Through the lenses of interaction, the research explores the context of Bologna, a paradigmatic study and application field, a laboratory of innovative policies where a tradition of collective civic initiatives intertwines with a more responsible institutional planning framework. After drawing from area-based policies of Berlin and Barcelona, the thesis reads the role of specific intermediate places, mediators in bridging the level of institutions and the practices. Through an inventory and a cross-cutting taxonomy of intermediate places, the research draws the knowledge to inform a new urban model for the city of Bologna, aimed at overtake the mismatches by enabling the practices to act, allowing urban planning to frame them in a cross-fertilisation dimension. The proposed urban diagrammatic model, foresees intermediate places as local socio-urban observatories for research and development, interacting with both institutions and communities. The goal is to critically explore the limits and widen the meaning of the capacity of action of social innovation practices engaging in mutual-learning with the city. The model suggests a new possibility for reflection on urban planning as a more flexible approach, which translates the numerous experiences of the city into alternatives and multiple visions.

Evaluation of alpha-synuclein RT-QuIC for an early and differential diagnosis of Lewy body disease

Synucleinopathies are a group of neurodegenerative diseases characterized by tissue deposition of insoluble aggregates of the protein α-synuclein. Currently, the clinical diagnosis of these diseases, including Parkinson’s disease (PD), dementia with Lewy bodies (DLB), and multiple system atrophy (MSA), is very challenging, especially at an early disease stage, due to the heterogeneous and often non-specific clinical manifestations. Therefore, identifying specific biomarkers to aid the diagnosis and improve the clinical management of patients with these disorders represents a primary goal in the field. Pursuing this aim, we applied the α-Syn Real-Time Quaking-Induced Conversion (RT-QuIC), an ultrasensitive technique able to detect minute amounts of amyloidogenic proteins, to a large cohort of 953 CSF samples from clinically well-characterized (“clinical” group), or neuropathologically verified (“NP” group) patients with parkinsonism or dementia. Of significance, we also studied patients with prodromal synucleinopathies (“prodromal” group), such as pure autonomic failure (PAF) (n = 28), isolated REM sleep behavior disorder (iRBD) (n = 18), and mild cognitive impairment due to probable Lewy body (LB) disease (MCI-LB) (n = 81). Our findings show that α-syn RT-QuIC can accurately detect α-Syn seeding activity across the whole spectrum of LB-related disorders (LBD), exhibiting a mean sensitivity of 95.2% in the “clinical” and “NP” group, while ranging between 89.3% (PAF) and 100% (RBD) in the “prodromal group”. Moreover, we observed 95.1% sensitivity and 96.6% specificity in the distinction between MCI-LB patients and cognitively unimpaired controls, demonstrating the solid diagnostic potential of α-Syn RT-QuIC in the early phase of the disease. Finally, 13.3% of MCI-AD patients also had a positive test, suggesting an underlying LB co-pathology. This work demonstrated that α-Syn RT-QuIC is an efficient assay for accurate and early diagnosis of LBD, which should be implemented for clinical management and recruitment for clinical trials in memory clinics.

Distributed optimization and games over networks: a system theoretical perspective

Several decision and control tasks involve networks of cyber-physical systems that need to be coordinated and controlled according to a fully-distributed paradigm involving only local communications without any central unit. This thesis focuses on distributed optimization and games over networks from a system theoretical perspective. In the addressed frameworks, we consider agents communicating only with neighbors and running distributed algorithms with optimization-oriented goals. The distinctive feature of this thesis is to interpret these algorithms as dynamical systems and, thus, to resort to powerful system theoretical tools for both their analysis and design. We first address the so-called consensus optimization setup. In this context, we provide an original system theoretical analysis of the well-known Gradient Tracking algorithm in the general case of nonconvex objective functions. Then, inspired by this method, we provide and study a series of extensions to improve the performance and to deal with more challenging settings like, e.g., the derivative-free framework or the online one. Subsequently, we tackle the recently emerged framework named distributed aggregative optimization. For this setup, we develop and analyze novel schemes to handle (i) online instances of the problem, (ii) ``personalized'' optimization frameworks, and (iii) feedback optimization settings. Finally, we adopt a system theoretical approach to address aggregative games over networks both in the presence or absence of linear coupling constraints among the decision variables of the players. In this context, we design and inspect novel fully-distributed algorithms, based on tracking mechanisms, that outperform state-of-the-art methods in finding the Nash equilibrium of the game.