Lag Camera: A Moving Multi-Camera Array for Scene-Acquisition

Many applications, such as telepresence, virtual reality, and interactive walkthroughs, require a three-dimensional(3D)model of real-world environments. Methods, such as lightfields, geometric reconstruction and computer vision use cameras to acquire visual samples of the environment and construct a model. Unfortunately, obtaining models of real-world locations is a challenging task. In particular, important environments are often actively in use, containing moving objects, such as people entering and leaving the scene. The methods previously listed have difficulty in capturing the color and structure of the environment while in the presence of moving and temporary occluders. We describe a class of cameras called lag cameras. The main concept is to generalize a camera to take samples over space and time. Such a camera, can easily and interactively detect moving objects while continuously moving through the environment. Moreover, since both the lag camera and occluder are moving, the scene behind the occluder is captured by the lag camera even from viewpoints where the occluder lies in between the lag camera and the hidden scene. We demonstrate an implementation of a lag camera, complete with analysis and captured environments.

Advanced background modeling with RGB-D sensors through classifiers combination and inter-frame foreground prediction

An innovative background modeling technique that is able to accurately segment foreground regions in RGB-D imagery (RGB plus depth) has been presented in this paper. The technique is based on a Bayesian framework that efficiently fuses different sources of information to segment the foreground. In particular, the final segmentation is obtained by considering a prediction of the foreground regions, carried out by a novel Bayesian Network with a depth-based dynamic model, and, by considering two independent depth and color-based mixture of Gaussians background models. The efficient Bayesian combination of all these data reduces the noise and uncertainties introduced by the color and depth features and the corresponding models. As a result, more compact segmentations, and refined foreground object silhouettes are obtained. Experimental results with different databases suggest that the proposed technique outperforms existing state-of-the-art algorithms.

Hybrid Background Subtraction in Video using Bi-level CodeBook Model

Detection of Objects in Video is a highly demanding area of research. The Background Subtraction Algorithms can yield better results in Foreground Object Detection. This work presents a Hybrid CodeBook based Background Subtraction to extract the foreground ROI from the background. Codebooks are used to store compressed information by demanding lesser memory usage and high speedy processing. This Hybrid method which uses Block-Based and Pixel-Based Codebooks provide efficient detection results; the high speed processing capability of block based background subtraction as well as high Precision Rate of pixel based background subtraction are exploited to yield an efficient Background Subtraction System. The Block stage produces a coarse foreground area, which is then refined by the Pixel stage. The system’s performance is evaluated with different block sizes and with different block descriptors like 2D-DCT, FFT etc. The Experimental analysis based on statistical measurements yields precision, recall, similarity and F measure of the hybrid system as 88.74%, 91.09%, 81.66% and 89.90% respectively, and thus proves the efficiency of the novel system.

Face Detection and Facial Feature Localization for multi-pose faces and complex backgroundimages

The objective of this thesis work, is to propose an algorithm to detect the faces in a digital image with complex background. A lot of work has already been done in the area of face detection, but drawback of some face detection algorithms is the lack of ability to detect faces with closed eyes and open mouth. Thus facial features form an important basis for detection. The current thesis work focuses on detection of faces based on facial objects. The procedure is composed of three different phases: segmentation phase, filtering phase and localization phase. In segmentation phase, the algorithm utilizes color segmentation to isolate human skin color based on its chrominance properties. In filtering phase, Minkowski addition based object removal (Morphological operations) has been used to remove the non-skin regions. In the last phase, Image Processing and Computer Vision methods have been used to find the existence of facial components in the skin regions.This method is effective on detecting a face region with closed eyes, open mouth and a half profile face. The experiment’s results demonstrated that the detection accuracy is around 85.4% and the detection speed is faster when compared to neural network method and other techniques.

Restauração de imagens digitais com texturas utilizando técnicas de decomposição e equações diferenciais parciais

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Versatile Bayesian classifier for moving object detection by non-parametric background-foreground modeling

Along the recent years, several moving object detection strategies by non-parametric background-foreground modeling have been proposed. To combine both models and to obtain the probability of a pixel to belong to the foreground, these strategies make use of Bayesian classifiers. However, these classifiers do not allow to take advantage of additional prior information at different pixels. So, we propose a novel and efficient alternative Bayesian classifier that is suitable for this kind of strategies and that allows the use of whatever prior information. Additionally, we present an effective method to dynamically estimate prior probability from the result of a particle filter-based tracking strategy.

Removal of a Partial Denture from the Esophagus with the Aid of an Endoscope

Swallowed prostheses have been described in the literature, and in some cases, the diagnosis can be challenging, especially if the partial or complete denture is metal-free. This article presents a case of a swallowed partial denture and points to the importance of early diagnosis. A man was admitted to the emergency room complaining of progressive breathing difficulty while presenting with an extra volume in his neck. After inconclusive image examinations, endoscopy under sedation was used to identify and retrieve the foreign object, which was a metal-free acrylic partial denture. Early diagnosis and the correct treatment can avoid serious sequelae, such as edematous reactions, mucosal infection, and necrosis. Patients should be scheduled for regular recall visits for evaluation of prosthesis fit and retention, condition of the abutments, and nocturnal wear. Int J Prosthodont 2010;23:339-341.

A type system for access control in an object-oriented language

Trabalho apresentado no âmbito do Mestrado em Engenharia Informática, como requisito parcial para obtenção do grau de Mestre em Engenharia Informática

Accurate memory for object location by individuals with intellectual disability: Absolute spatial tagging instead of configural processing?

Using head-mounted eye tracker material, we assessed spatial recognition abilities (e.g., reaction to object permutation, removal or replacement with a new object) in participants with intellectual disabilities. The "Intellectual Disabilities (ID)" group (n=40) obtained a score totalling a 93.7% success rate, whereas the "Normal Control" group (n=40) scored 55.6% and took longer to fix their attention on the displaced object. The participants with an intellectual disability thus had a more accurate perception of spatial changes than controls. Interestingly, the ID participants were more reactive to object displacement than to removal of the object. In the specific test of novelty detection, however, the scores were similar, the two groups approaching 100% detection. Analysis of the strategies expressed by the ID group revealed that they engaged in more systematic object checking and were more sensitive than the control group to changes in the structure of the environment. Indeed, during the familiarisation phase, the "ID" group explored the collection of objects more slowly, and fixed their gaze for a longer time upon a significantly lower number of fixation points during visual sweeping.

Bag-of-Features Approach to Unsupervised Visual Object Categorisation

The large and growing number of digital images is making manual image search laborious. Only a fraction of the images contain metadata that can be used to search for a particular type of image. Thus, the main research question of this thesis is whether it is possible to learn visual object categories directly from images. Computers process images as long lists of pixels that do not have a clear connection to high-level semantics which could be used in the image search. There are various methods introduced in the literature to extract low-level image features and also approaches to connect these low-level features with high-level semantics. One of these approaches is called Bag-of-Features which is studied in the thesis. In the Bag-of-Features approach, the images are described using a visual codebook. The codebook is built from the descriptions of the image patches using clustering. The images are described by matching descriptions of image patches with the visual codebook and computing the number of matches for each code. In this thesis, unsupervised visual object categorisation using the Bag-of-Features approach is studied. The goal is to find groups of similar images, e.g., images that contain an object from the same category. The standard Bag-of-Features approach is improved by using spatial information and visual saliency. It was found that the performance of the visual object categorisation can be improved by using spatial information of local features to verify the matches. However, this process is computationally heavy, and thus, the number of images must be limited in the spatial matching, for example, by using the Bag-of-Features method as in this study. Different approaches for saliency detection are studied and a new method based on the Hessian-Affine local feature detector is proposed. The new method achieves comparable results with current state-of-the-art. The visual object categorisation performance was improved by using foreground segmentation based on saliency information, especially when the background could be considered as clutter.

Topological triangle characterization with application to object detection from images

A novel mathematical framework inspired on Morse Theory for topological triangle characterization in 2D meshes is introduced that is useful for applications involving the creation of mesh models of objects whose geometry is not known a priori. The framework guarantees a precise control of topological changes introduced as a result of triangle insertion/removal operations and enables the definition of intuitive high-level operators for managing the mesh while keeping its topological integrity. An application is described in the implementation of an innovative approach for the detection of 2D objects from images that integrates the topological control enabled by geometric modeling with traditional image processing techniques. (C) 2008 Published by Elsevier B.V.

Patch-based local histograms and contour estimation for static foreground classification

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

EDGE-PRESERVING SPECKLE TEXTURE REMOVAL BY INTERFERENCE-BASED SPECKLE FILTERING FOLLOWED BY ANISOTROPIC DIFFUSION

Ultrasonography has an inherent noise pattern, called speckle, which is known to hamper object recognition for both humans and computers. Speckle noise is produced by the mutual interference of a set of scattered wavefronts. Depending on the phase of the wavefronts, the interference may be constructive or destructive, which results in brighter or darker pixels, respectively. We propose a filter that minimizes noise fluctuation while simultaneously preserving local gray level information. It is based on steps to attenuate the destructive and constructive interference present in ultrasound images. This filter, called interference-based speckle filter followed by anisotropic diffusion (ISFAD), was developed to remove speckle texture from B-mode ultrasound images, while preserving the edges and the gray level of the region. The ISFAD performance was compared with 10 other filters. The evaluation was based on their application to images simulated by Field II (developed by Jensen et al.) and the proposed filter presented the greatest structural similarity, 0.95. Functional improvement of the segmentation task was also measured, comparing rates of true positive, false positive and accuracy. Using three different segmentation techniques, ISFAD also presented the best accuracy rate (greater than 90% for structures with well-defined borders). (E-mail: fernando.okara@gmail.com) (C) 2012 World Federation for Ultrasound in Medicine & Biology.

Outdoor bronze conservation: assessment of protective treatments by accelerated aging and of treatment removal procedures by laser cleaning

Outdoor bronzes exposed to the environment form naturally a layer called patina, which may be able to protect the metallic substrate. However, since the last century, with the appearance of acid rains, a strong change in the nature and properties of the copper based patinas occurred [1]. Studies and general observations have established that bronze corrosion patinas created by acid rain are not only disfiguring in terms of loss of detail and homogeneity, but are also unstable [2]. The unstable patina is partially leached away by rainwater. This leaching is represented by green streaking on bronze monuments [3]. Because of the instability of the patina, conservation techniques are usually required. On a bronze object exposed to the outdoor environment, there are different actions of the rainfall and other atmospheric agents as a function of the monument shape. In fact, we recognize sheltered and unsheltered areas as regards exposure to rainwater [4]. As a consequence of these different actions, two main patina types are formed on monuments exposed to the outdoor environment. These patinas have different electrochemical, morphological and compositional characteristics [1]. In the case of sheltered areas, the patina contains mainly copper products, stratified above a layer strongly enriched in insoluble Sn oxides, located at the interface with the uncorroded metal. Moreover, different colors of the patina result from the exposure geometry. The surface color may be pale green for unsheltered areas, and green and mat black for sheltered areas [4]. Thus, in real outdoor bronze monuments, the corrosion behavior is strongly influenced by the exposure geometry. This must be taken into account when designing conservation procedures, since the patina is in most cases the support on which corrosion inhibitors are applied. Presently, for protecting outdoor bronzes against atmospheric corrosion, inhibitors and protective treatments are used. BTA and its derivatives, which are the most common inhibitors used for copper and its alloy, were found to be toxic for the environment and human health [5, 6]. Moreover, it has been demonstrated that BTA is efficient when applied on bare copper but not as efficient when applied on bare bronze [7]. Thus it was necessary to find alternative compounds. Silane-based inhibitors (already successfully tested on copper and other metallic substrates [8]), were taken into consideration as a non-toxic, environmentally friendly alternative to BTA derivatives for bronze protection. The purpose of this thesis was based on the assessment of the efficiency of a selected compound, to protect the bronze against corrosion, which is the 3-mercapto-propyl-trimethoxy-silane (PropS-SH). It was selected thanks to the collaboration with the Corrosion Studies Centre “Aldo Daccò” at the Università di Ferrara. Since previous studies [9, 10, 11] demonstrated that the addition of nanoparticles to silane-based inhibitors leads to an increase of the protective efficiency, we also wanted to evaluate the influence of the addition of CeO2, La2O3, TiO2 nanoparticles on the protective efficiency of 3-mercapto-propyl-trimethoxy-silane, applied on pre-patinated bronze surfaces. This study is the first section of the thesis. Since restorers have to work on patinated bronzes and not on bare metal (except for contemporary art), it is important to be able to recreate the patina, under laboratory conditions, either in sheltered or unsheltered conditions to test the coating and to obtain reliable results. Therefore, at the University of Bologna, different devices have been designed to simulate the real outdoor conditions and to create a patina which is representative of real application conditions of inhibitor or protective treatments. In particular, accelerated ageing devices by wet & dry (simulating the action of stagnant rain in sheltered areas [12]) and by dropping (simulating the leaching action of the rain in unsheltered areas [1]) tests were used. In the present work, we used the dropping test as a method to produce pre-patinated bronze surfaces for the application of a candidate inhibitor as well as for evaluating its protective efficiency on aged bronze (unsheltered areas). In this thesis, gilded bronzes were also studied. When they are exposed to the outside environment, a corrosion phenomenon appears which is due to the electrochemical couple gold/copper where copper is the anode. In the presence of an electrolyte, this phenomenon results in the formation of corrosion products than will cause a blistering of the gold (or a break-up and loss of the film in some cases). Moreover, because of the diffusion of the copper salts to the surface, aggregates and a greenish film will be formed on the surface of the sample [13]. By coating gilded samples with PropS-SH and PropS-SH containing nano-particles and carrying out accelerated ageing by the dropping test, a discussion is possible on the effectiveness of this coating, either with nano-particles or not, against the corrosion process. This part is the section 2 of this thesis. Finally, a discussion about laser treatment aiming at the assessment of reversibility/re-applicability of the PropS-SH coating can be found in section 3 of this thesis. Because the protective layer loses its efficiency with time, it is necessary to find a way of removing the silane layer, before applying a new one on the “bare” patina. One request is to minimize the damages that a laser treatment would create on the patina. Therefore, different laser fluences (energy/surface) were applied on the sample surface during the treatment process in order to find the best range of fluence. In particular, we made a characterization of surfaces before and after removal of PropS-SH (applied on a naturally patinated surface, and subsequently aged by natural exposure) with laser methods. The laser removal treatment was done by the CNR Institute of Applied Physics “Nello Carrara” of Sesto Fiorentino in Florence. In all the three sections of the thesis, a range of non-destructive spectroscopic methods (Scanning Electron Microscopy with Energy Dispersive Spectroscopy (SEM-EDS), μ-Raman spectroscopy, X-Ray diffractometry (XRD)) were used for characterizing the corroded surfaces. AAS (Atomic Absorption Spectroscopy) was used to analyze the ageing solutions from the dropping test in sections 1 and 2.

Moving Object Detection for Real-Time High-Quality Lightweight Applications on Smart Cameras

Here, a novel and efficient strategy for moving object detection by non-parametric modeling on smart cameras is presented. Whereas the background is modeled using only color information, the foreground model combines color and spatial information. The application of a particle filter allows the update of the spatial information and provides a priori information about the areas to analyze in the following images, enabling an important reduction in the computational requirements and improving the segmentation results