Real-time mobile 3D temperature mapping

The ability to measure surface temperature and represent it on a metrically accurate 3D model has proven applications in many areas such as medical imaging, building energy auditing, and search and rescue. A system is proposed that enables this task to be performed with a handheld sensor, and for the first time with results able to be visualized and analyzed in real-time. A device comprising a thermal-infrared camera and range sensor is calibrated geometrically and used for data capture. The device is localized using a combination of ICP and video-based pose estimation from the thermal-infrared video footage which is shown to reduce the occurrence of failure modes. Furthermore, the problem of misregistration which can introduce severe distortions in assigned surface temperatures is avoided through the use of a risk-averse neighborhood weighting mechanism. Results demonstrate that the system is more stable and accurate than previous approaches, and can be used to accurately model complex objects and environments for practical tasks.

Efficiently capturing large, complex cultural heritage sites with a handheld mobile 3D laser mapping system

Accurate three-dimensional representations of cultural heritage sites are highly valuable for scientific study, conservation, and educational purposes. In addition to their use for archival purposes, 3D models enable efficient and precise measurement of relevant natural and architectural features. Many cultural heritage sites are large and complex, consisting of multiple structures spatially distributed over tens of thousands of square metres. The process of effectively digitising such geometrically complex locations requires measurements to be acquired from a variety of viewpoints. While several technologies exist for capturing the 3D structure of objects and environments, none are ideally suited to complex, large-scale sites, mainly due to their limited coverage or acquisition efficiency. We explore the use of a recently developed handheld mobile mapping system called Zebedee in cultural heritage applications. The Zebedee system is capable of efficiently mapping an environment in three dimensions by continually acquiring data as an operator holding the device traverses through the site. The system was deployed at the former Peel Island Lazaret, a culturally significant site in Queensland, Australia, consisting of dozens of buildings of various sizes spread across an area of approximately 400 × 250 m. With the Zebedee system, the site was scanned in half a day, and a detailed 3D point cloud model (with over 520 million points) was generated from the 3.6 hours of acquired data in 2.6 hours. We present results demonstrating that Zebedee was able to accurately capture both site context and building detail comparable in accuracy to manual measurement techniques, and at a greatly increased level of efficiency and scope. The scan allowed us to record derelict buildings that previously could not be measured because of the scale and complexity of the site. The resulting 3D model captures both interior and exterior features of buildings, including structure, materials, and the contents of rooms.

Capturing natural-colour 3D models of insects for species discovery and diagnostics

Collections of biological specimens are fundamental to scientific understanding and characterization of natural diversity - past, present and future. This paper presents a system for liberating useful information from physical collections by bringing specimens into the digital domain so they can be more readily shared, analyzed, annotated and compared. It focuses on insects and is strongly motivated by the desire to accelerate and augment current practices in insect taxonomy which predominantly use text, 2D diagrams and images to describe and characterize species. While these traditional kinds of descriptions are informative and useful, they cannot cover insect specimens "from all angles" and precious specimens are still exchanged between researchers and collections for this reason. Furthermore, insects can be complex in structure and pose many challenges to computer vision systems. We present a new prototype for a practical, cost-effective system of off-the-shelf components to acquire natural-colour 3D models of insects from around 3 mm to 30 mm in length. ("Natural-colour" is used to contrast with "false-colour", i.e., colour generated from, or applied to, gray-scale data post-acquisition.) Colour images are captured from different angles and focal depths using a digital single lens reflex (DSLR) camera rig and two-axis turntable. These 2D images are processed into 3D reconstructions using software based on a visual hull algorithm. The resulting models are compact (around 10 megabytes), afford excellent optical resolution, and can be readily embedded into documents and web pages, as well as viewed on mobile devices. The system is portable, safe, relatively affordable, and complements the sort of volumetric data that can be acquired by computed tomography. This system provides a new way to augment the description and documentation of insect species holotypes, reducing the need to handle or ship specimens. It opens up new opportunities to collect data for research, education, art, entertainment, biodiversity assessment and biosecurity control. © 2014 Nguyen et al.

1-D hydrogen-bonded organization of hexanuclear {3d-4f-5d} complexes: evidence for slow relaxation of the magnetization for [{LMe2Ni(H2O)Ln(H2O)4.5}2{W(CN)8}2] with Ln = Tb and Dy

Heterometallic {3d-4f-5d} aggregates with formula [{LMe2Ni(H2O)Ln(H2O)4.5}2{W(CN)8}2]·15H2O, (LMe2 stands for N,N-2,2-dimethylpropylenedi(3-methoxysalicylideneiminato) Schiff-base ligand) with Ln = Gd, Tb, Dy, have been obtained by reacting bimetallic [LMe2Ni(H2O)2Ln(NO3)3] and Cs3{W(CN)8} in H2O. The hexanuclear complexes are organized in 1-D arrays by means of hydrogen bonds established between the solvent molecules coordinated to Ln and the CN ligands of an octacyanometallate moiety. The X-ray structure was solved for the Tb derivative. Magnetic behavior indicates ferromagnetic {W–Ni} and {Ni–Ln} interactions (JNiW = 18.5 cm-1, JNiGd = 1.85 cm-1) as well as ferromagnetic intermolecular interactions mediated by the H-bonds. Dynamic magnetic susceptibility studies reveal slow magnetic relaxation processes for the Tb and Dy derivatives, suggesting SMM type behavior for these compounds.

The heart of a dragon: 3D anatomical reconstruction of the 'scaly-foot gastropod' (Mollusca: Gastropoda: Neomphalina) reveals its extraordinary circulatory system

Introduction: The 'scaly-foot gastropod' (Chrysomallon squamiferum Chen et al., 2015) from deep-sea hydrothermal vent ecosystems of the Indian Ocean is an active mobile gastropod occurring in locally high densities, and it is distinctive for the dermal scales covering the exterior surface of its foot. These iron-sulfide coated sclerites, and its nutritional dependence on endosymbiotic bacteria, are both noted as adaptations to the extreme environment in the flow of hydrogen sulfide. We present evidence for other adaptations of the 'scaly-foot gastropod' to life in an extreme environment, investigated through dissection and 3D tomographic reconstruction of the internal anatomy.

Results: Our anatomical investigations of juvenile and adult specimens reveal a large unganglionated nervous system, a simple and reduced digestive system, and that the animal is a simultaneous hermaphrodite. We show that Chrysomallon squamiferum relies on endosymbiotic bacteria throughout post-larval life. Of particular interest is the circulatory system: Chrysomallon has a very large ctenidium supported by extensive blood sinuses filled with haemocoel. The ctenidium provides oxygen for the host but the circulatory system is enlarged beyond the scope of other similar vent gastropods. At the posterior of the ctenidium is a remarkably large and well-developed heart. Based on the volume of the auricle and ventricle, the heart complex represents approximately 4 % of the body volume. This proportionally giant heart primarily sucks blood through the ctenidium and supplies the highly vascularised oesophageal gland. Thus we infer the elaborate cardiovascular system most likely evolved to oxygenate the endosymbionts in an oxygen poor environment and/or to supply hydrogen sulfide to the endosymbionts.

Conclusions: This study exemplifies how understanding the autecology of an organism can be enhanced by detailed investigation of internal anatomy. This gastropod is a large and active species that is abundant in its hydrothermal vent field ecosystem. Yet all of its remarkable features-protective dermal sclerites, circulatory system, high fecundity-can be viewed as adaptations beneficial to its endosymbiont microbes. We interpret these results to show that, as a result of specialisation to resolve energetic needs in an extreme chemosynthetic environment, this dramatic dragon-like species has become a carrying vessel for its bacteria.

A frontal view gait recognition based on 3D imaging using a time of flight camera

Studies have been carried out to recognize individuals from a frontal view using their gait patterns. In previous work, gait sequences were captured using either single or stereo RGB camera systems or the Kinect 1.0 camera system. In this research, we used a new frontal view gait recognition method using a laser based Time of Flight (ToF) camera. In addition to the new gait data set, other contributions include enhancement of the silhouette segmentation, gait cycle estimation and gait image representations. We propose four new gait image representations namely Gait Depth Energy Image (GDE), Partial GDE (PGDE), Discrete Cosine Transform GDE (DGDE) and Partial DGDE (PDGDE). The experimental results show that all the proposed gait image representations produce better accuracy than the previous methods. In addition, we have also developed Fusion GDEs (FGDEs) which achieve better overall accuracy and outperform the previous methods.

Contrôle de l'organisation moléculaire en 2D et 3D par l’utilisation de liaisons hydrogène, de coordination métallique et d'autres interactions

La stratégie de la tectonique moléculaire a montré durant ces dernières années son utilité dans la construction de nouveaux matériaux. Elle repose sur l’auto-assemblage spontané de molécule dite intelligente appelée tecton. Ces molécules possèdent l’habilité de se reconnaitre entre elles en utilisant diverses interactions intermoléculaires. L'assemblage résultant peut donner lieu à des matériaux moléculaires avec une organisation prévisible. Cette stratégie exige la création de nouveaux tectons, qui sont parfois difficiles à synthétiser et nécessitent dans la plupart des cas de nombreuses étapes de synthèse, ce qui empêche ou limite leur mise en application pratique. De plus, une fois formées, les liaisons unissant le corps central du tecton avec ces groupements de reconnaissance moléculaire ne peuvent plus être rompues, ce qui ne permet pas de remodeler le tecton par une procédure synthétique simple. Afin de contourner ces obstacles, nous proposons d’utiliser une stratégie hybride qui se sert de la coordination métallique pour construire le corps central du tecton, combinée avec l'utilisation des interactions plus faibles pour contrôler l'association. Nous appelons une telle entité métallotecton du fait de la présence du métal. Pour explorer cette stratégie, nous avons construit une série de ligands ditopiques comportant soit une pyridine, une bipyridine ou une phénantroline pour favoriser la coordination métallique, substitués avec des groupements diaminotriazinyles (DAT) pour permettre aux complexes de s'associer par la formation de ponts hydrogène. En plus de la possibilité de créer des métallotectons par coordination, ces ligands ditopiques ont un intérêt intrinsèque en chimie supramoléculaire en tant qu'entités pouvant s'associer en 3D et en 2D. En parallèle à notre étude de la chimie de coordination, nous avons ii examiné l'association des ligands, ainsi que celle des analogues, par la diffraction des rayons-X (XRD) et par la microscopie de balayage à effet tunnel (STM). L'adsorption de ces molécules sur la surface de graphite à l’interface liquide-solide donne lieu à la formation de différents réseaux 2D par un phénomène de nanopatterning. Pour comprendre les détails de l'adsorption moléculaire, nous avons systématiquement comparé l’organisation observée en 2D par STM avec celle favorisée dans les structures 3D déterminées par XRD. Nous avons également simulé l'adsorption par des calculs théoriques. Cette approche intégrée est indispensable pour bien caractériser l’organisation moléculaire en 2D et pour bien comprendre l'origine des préférences observées. Ces études des ligands eux-mêmes pourront donc servir de référence lorsque nous étudierons l'association des métallotectons dérivés des ligands par coordination. Notre travail a démontré que la stratégie combinant la chimie de coordination et la reconnaissance moléculaire est une méthode de construction rapide et efficace pour créer des réseaux supramoléculaires. Nous avons vérifié que la stratégie de la tectonique moléculaire est également efficace pour diriger l'organisation en 3D et en 2D, qui montre souvent une homologie importante. Nous avons trouvé que nos ligands hétérocycliques ont une aptitude inattendue à s’adsorber fortement sur la surface de graphite, créant ainsi des réseaux organisés à l'échelle du nanomètre. L’ensemble de ces résultats promet d’offrir des applications dans plusieurs domaines, dont la catalyse hétérogène et la nanotechnologie. Mots clés : tectonique moléculaire, interactions intermoléculaires, stratégie hybride, coordination métallique, diffraction des rayons-X, microscopie de balayage à effet tunnel, graphite, phénomène de nanopatterning, calculs théoriques, ponts hydrogène, chimie supramoléculaire, ligands hétérocycliques, groupements DAT, catalyse hétérogène, nanotechnologie.

Une application mobile pour les victimes d'intimidation par les pairs : examen des récits d'expérience et perceptions d'utilité.

Au Canada, la prévalence de l'intimidation par les pairs (IPP) est estimée à environ 20 %. L'IPP est associée à de nombreuses difficultés sur le rendement scolaire et le fonctionnement émotionnel, cognitif et comportemental de la victime. Afin de s'investir dans la lutte contre l'IPP, le Québec a promulgué en 2012 la Loi visant à lutter contre l'intimidation et la violence à l'école. Ainsi, les écoles ont pour obligation d'instaurer un plan d'action contre l'intimidation. Toutefois, les services d'aide aux victimes sont parfois limités. C'est pourquoi l'application mobile « +Fort » a été développée. +Fort vise à soutenir les victimes d'IPP à réduire leurs expériences et à prévenir les difficultés associées. Le présent mémoire a trois objectifs: (1) décrire l'expérience des victimes d'IPP ayant utilisé +Fort pendant quatre semaines, (2) effectuer une première appréciation de l'utilité de +Fort à partir des récits des victimes et (3) décrire comment +Fort soutien les jeunes à réduire leurs expériences d'intimidation. Des entrevues semi-dirigées ont été menées auprès de 12 victimes d'IPP (12 à 16 ans) de la région de Montréal puis analysées thématiquement. Les résultats suggèrent que +Fort agirait comme un facilitateur dans les démarches de changement des victimes pour réduire l'IPP. Les ressources offertes par +Fort procureraient aussi une impression de soutien aux victimes qui influencerait ensuite leur désir et leur motivation à entreprendre des actions pour que cesse l'intimidation. Ainsi, les technologies mobiles représenteraient une plateforme attrayante pour soutenir le mieux-être des jeunes vivant de l'intimidation.

Mòdul de visualització 3D d’ ajuda al diagnòstic de les neoplàsies rectals

El diagnòstic mitjançant la imatge mèdica s’ha convertit en una eina fonamental en la pràctica clínica, permet entre altres coses, reconstruir a partir d’un conjunt d’imatges 2D, obtingudes a partir d’aparells de captació, qualsevol part de l’organisme d’un pacient i representar-lo en un model 3D. Sobre aquest model 3D poden realitzar-se diferents operacions que faciliten el diagnòstic i la presa de decisions als especialistes. El projecte que es presenta forma part del desenvolupament de la plataforma informàtica de visualització i tractament de dades mèdiques, anomenada Starviewer, que desenvolupen conjuntament el laboratori de Gràfics i Imatge (GiLab) de la Universitat de Girona i l’ Institut de Diagnòstic per la Imatge (IDI) de l’Hospital Josep Trueta de Girona. En particular, en aquest projecte es centra en el diagnòstic del càncer colorectal i el desenvolupament de mètodes i tècniques de suport al seu diagnòstic. Els dos punts claus en el tractament d’aqueta patologia són: la detecció de les lesions I l’estudi de l’evolució d’aquestes lesions, una vegada s’ha iniciat el tractament tumoral. L’objectiu principal d’aquest projecte és implementar i integrar en la plataforma Starviewer les tècniques de visualització i processament de dades necessàries per donar suport als especialistes en el diagnòstic de les lesions del colon. Donada la dificultat en el processament de les dades reals del budell ens proposem: dissenyar i implementar un sistema per crear models sintètics del budell; estudiar, implementar i avaluar les tècniques de processament d’imatge que calen per segmentar lesions de budell; dissenyar i implementar un sistema d’exploració del budell iintegrar de tots els mòduls implementats en la plataforma starviewer

Pose-based SLAM with probabilistic scan matching algorithm using a mechanical scanned imaging sonar

This paper proposes a pose-based algorithm to solve the full SLAM problem for an autonomous underwater vehicle (AUV), navigating in an unknown and possibly unstructured environment. The technique incorporate probabilistic scan matching with range scans gathered from a mechanical scanning imaging sonar (MSIS) and the robot dead-reckoning displacements estimated from a Doppler velocity log (DVL) and a motion reference unit (MRU). The proposed method utilizes two extended Kalman filters (EKF). The first, estimates the local path travelled by the robot while grabbing the scan as well as its uncertainty and provides position estimates for correcting the distortions that the vehicle motion produces in the acoustic images. The second is an augment state EKF that estimates and keeps the registered scans poses. The raw data from the sensors are processed and fused in-line. No priory structural information or initial pose are considered. The algorithm has been tested on an AUV guided along a 600 m path within a marina environment, showing the viability of the proposed approach

Overview of coded light projection techniques for automatic 3D profiling

Obtaining automatic 3D profile of objects is one of the most important issues in computer vision. With this information, a large number of applications become feasible: from visual inspection of industrial parts to 3D reconstruction of the environment for mobile robots. In order to achieve 3D data, range finders can be used. Coded structured light approach is one of the most widely used techniques to retrieve 3D information of an unknown surface. An overview of the existing techniques as well as a new classification of patterns for structured light sensors is presented. This kind of systems belong to the group of active triangulation method, which are based on projecting a light pattern and imaging the illuminated scene from one or more points of view. Since the patterns are coded, correspondences between points of the image(s) and points of the projected pattern can be easily found. Once correspondences are found, a classical triangulation strategy between camera(s) and projector device leads to the reconstruction of the surface. Advantages and constraints of the different patterns are discussed