Image-Based View Synthesis

We present a new method for rendering novel images of flexible 3D objects from a small number of example images in correspondence. The strength of the method is the ability to synthesize images whose viewing position is significantly far away from the viewing cone of the example images ("view extrapolation"), yet without ever modeling the 3D structure of the scene. The method relies on synthesizing a chain of "trilinear tensors" that governs the warping function from the example images to the novel image, together with a multi-dimensional interpolation function that synthesizes the non-rigid motions of the viewed object from the virtual camera position. We show that two closely spaced example images alone are sufficient in practice to synthesize a significant viewing cone, thus demonstrating the ability of representing an object by a relatively small number of model images --- for the purpose of cheap and fast viewers that can run on standard hardware.

Parallel Monte Carlo approach for integration of the rendering equation

This paper is addressed to the numerical solving of the rendering equation in realistic image creation. The rendering equation is integral equation describing the light propagation in a scene accordingly to a given illumination model. The used illumination model determines the kernel of the equation under consideration. Nowadays, widely used are the Monte Carlo methods for solving the rendering equation in order to create photorealistic images. In this work we consider the Monte Carlo solving of the rendering equation in the context of the parallel sampling scheme for hemisphere. Our aim is to apply this sampling scheme to stratified Monte Carlo integration method for parallel solving of the rendering equation. The domain for integration of the rendering equation is a hemisphere. We divide the hemispherical domain into a number of equal sub-domains of orthogonal spherical triangles. This domain partitioning allows to solve the rendering equation in parallel. It is known that the Neumann series represent the solution of the integral equation as a infinity sum of integrals. We approximate this sum with a desired truncation error (systematic error) receiving the fixed number of iteration. Then the rendering equation is solved iteratively using Monte Carlo approach. At each iteration we solve multi-dimensional integrals using uniform hemisphere partitioning scheme. An estimate of the rate of convergence is obtained using the stratified Monte Carlo method. This domain partitioning allows easy parallel realization and leads to convergence improvement of the Monte Carlo method. The high performance and Grid computing of the corresponding Monte Carlo scheme are discussed.

A new solution of the rendering equation with stratified Monte Carlo approach

This paper is turned to the advanced Monte Carlo methods for realistic image creation. It offers a new stratified approach for solving the rendering equation. We consider the numerical solution of the rendering equation by separation of integration domain. The hemispherical integration domain is symmetrically separated into 16 parts. First 9 sub-domains are equal size of orthogonal spherical triangles. They are symmetric each to other and grouped with a common vertex around the normal vector to the surface. The hemispherical integration domain is completed with more 8 sub-domains of equal size spherical quadrangles, also symmetric each to other. All sub-domains have fixed vertices and computable parameters. The bijections of unit square into an orthogonal spherical triangle and into a spherical quadrangle are derived and used to generate sampling points. Then, the symmetric sampling scheme is applied to generate the sampling points distributed over the hemispherical integration domain. The necessary transformations are made and the stratified Monte Carlo estimator is presented. The rate of convergence is obtained and one can see that the algorithm is of super-convergent type.

Quasi Monte Carlo approach with uniform separation for solving of the rendering equation, ICNAAM 2007

This paper is directed to the advanced parallel Quasi Monte Carlo (QMC) methods for realistic image synthesis. We propose and consider a new QMC approach for solving the rendering equation with uniform separation. First, we apply the symmetry property for uniform separation of the hemispherical integration domain into 24 equal sub-domains of solid angles, subtended by orthogonal spherical triangles with fixed vertices and computable parameters. Uniform separation allows to apply parallel sampling scheme for numerical integration. Finally, we apply the stratified QMC integration method for solving the rendering equation. The superiority our QMC approach is proved.

A critical evaluation of the ability of the Spinning Enhanced Visible and Infrared Imager (SEVIRI) thermal infrared red-green-blue rendering to identify dust events: theoretical analysis

Using a combination of idealized radiative transfer simulations and a case study from the first field campaign of the Saharan Mineral Dust Experiment (SAMUM) in southern Morocco, this paper provides a systematic assessment of the limitations of the widely used Spinning Enhanced Visible and Infrared Imager (SEVIRI) red-green-blue (RGB) thermal infrared dust product. Both analyses indicate that the ability of the product to identify dust, via its characteristic pink coloring, is strongly dependent on the column water vapor, the lower tropospheric lapse rate, and dust altitude. In particular, when column water vapor exceeds ∼20–25 mm, dust presence, even for visible optical depths of the order 0.8, is effectively masked. Variability in dust optical properties also has a marked impact on the imagery, primarily as a result of variability in dust composition. There is a moderate sensitivity to the satellite viewing geometry, particularly in moist conditions. The underlying surface can act to confound the signal seen through variations in spectral emissivity, which are predominantly manifested in the 8.7μm SEVIRI channel. In addition, if a temperature inversion is present, typical of early morning conditions over the Sahara and Sahel, an increased dust loading can actually reduce the pink coloring of the RGB image compared to pristine conditions. Attempts to match specific SEVIRI observations to simulations using SAMUM measurements are challenging because of high uncertainties in surface skin temperature and emissivity. Recommendations concerning the use and interpretation of the SEVIRI RGB imagery are provided on the basis of these findings.

Implant image quality in dental radiographs recorded using a customized imaging guide or a standard film holder

Objective: To compare a customized imaging guide and a standard film holder for obtaining optimally projected intraoral radiographs of dental implants.Material and methods: Intraoral radiographs of four screw-type implants with different inclination placed in an upper or lower dental phantom model were recorded by 32 groups of examiners after a short instruction in the use of the RB-RB/LB-LB mnemonic rule. Half of the examiners recorded the images using a standard film holder and the other half used a customized imaging guide. Each radiograph was assessed under blinded conditions with regard to rendering of the implant threads and was assigned to one of four quality categories: (1) perfect, (2) not perfect, but clinically acceptable, (3) not acceptable, and (4) hopeless.Results: For the upper jaw, the same number of exposures per implant were made to achieve an acceptable image (P = 0.86) by the standard film holder method (median = 2) and the imaging guide method (median = 2). For the lower jaw, medians for the imaging guide method and the film holder method were 1 and 2, respectively (P = 0.004). For the imaging guide method, the first exposure was rated as perfect/acceptable in 62% of the cases and for the film holder method in 41% of the cases (P = 0.013). After <= 2 exposures, 78% (imaging guide method) and 69% (film holder method) of the implant images were perfect/acceptable (P=0.23). The implant inclination did not have a major influence on the outcomes.Conclusion: Perfect or acceptable images were achieved after two exposures with the same frequency either using a customized imaging guide method or a standard film holder method. However, the use of a customized imaging guide method was overall significantly superior to a standard film holder method in terms of obtaining perfect or acceptable images with only one exposure.

Development and applications of three-dimensional gamma ray tomography system using ray casting volume rendering techniques

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Comparison between multiplanar and rendering modes in the assessment of fetal atrioventricular valve areas by 3D/4D ultrasonography

Objective: To compare the agreement of multiplanar and rendering modes in the assessment fetal atrioventricular valves (mitral and tricuspid) areas by three-dimensional (3D) ultrasonography using the software spatio-temporal image correlation (STIC). Methods: We conducted a prospective cross-sectional study with normal pregnant women, with single fetuses, between 18-33 weeks. To measure the areas, we used the plan of four-chamber view. In the case of multiplanar, the plane was rotated on the axis "Z" form the heart to position at 9h. For rendering, the green line (region of interest - ROI) was placed from the atria of the heart perpendicular to the crux. The agreement was assessed by a Bland-Altman (limits of agreement) using the relative difference between the measures: ((rendering mode) - (multiplanar mode)) / (average). Results: 328 fetuses were evaluated. We have not identified the occurrence of systematic error between methods: the average relative difference was 1.62% (-2.07% to 5.32%, confidence interval 95%) in the mitral and 1.77% (- 1.08% to 4.62%) in the tricuspid valve. The limits of agreement between methods were -65.26% to 68.51% for the mitral and -49.91% to 53.45% for the tricuspid. Conclusions: There was no systematic error between modes and thus the observed values for the area of fetal atrioventricular valves can be used for comparisons needs to be corrected. However, relatively large variations may be observed when repeating the measurement area by different modes.

Sviluppo di funzionalità di Image Targeting con apps basate su realtà aumentata

Dopo una breve introduzione sulla realtà aumentata (definizione, storia e stato dell’arte) viene effettuata un'analisi delle librerie esistenti per l’implementazione su dispositivi mobile. Considerando compatibilità con i recenti SO, frequenza degli aggiornamenti, costi per le licenze e funzionalità offerte viene scelta la libreria Vuforia, originariamente sviluppata da Qualcomm e poi acquistata da PTC inc. Si conviene poi che le apps basate su realtà aumentata creano il contenuto “aumentato” in due maniere: o tramite riconoscimento di una specifica immagine oppure tramite localizzazione GPS. Di questi due metodi descritti, il primo risulta molto più affidabile e per questo viene sviluppata una app che crea un contenuto in 3D (aumentato) riconoscendo una immagine: funzionalità di Image Targeting. Il progetto considera le seguenti varianti: l’immagine da riconoscere, chiamata “target”, può essere in un database locale oppure cloud mentre il contenuto in 3D aumentato può essere sia statico che animato. Durante la fase di implementazione vengono fornite anche alcuni nozioni di base di Computer Graphic per il rendering del modello 3D. La tesi si conclude con una panoramica di apps presenti sullo store che funzionano secondo questo principio di Image Targeting, i possibili utilizzi in ambito educativo/ludico ed i costi di realizzazione.

Non-photorealistic rendering of virtual implant models for computer-assisted fluoroscopy-based surgical procedures

Surgical navigation systems visualize the positions and orientations of surgical instruments and implants as graphical overlays onto a medical image of the operated anatomy on a computer monitor. The orthopaedic surgical navigation systems could be categorized according to the image modalities that are used for the visualization of surgical action. In the so-called CT-based systems or 'surgeon-defined anatomy' based systems, where a 3D volume or surface representation of the operated anatomy could be constructed from the preoperatively acquired tomographic data or through intraoperatively digitized anatomy landmarks, a photorealistic rendering of the surgical action has been identified to greatly improve usability of these navigation systems. However, this may not hold true when the virtual representation of surgical instruments and implants is superimposed onto 2D projection images in a fluoroscopy-based navigation system due to the so-called image occlusion problem. Image occlusion occurs when the field of view of the fluoroscopic image is occupied by the virtual representation of surgical implants or instruments. In these situations, the surgeon may miss part of the image details, even if transparency and/or wire-frame rendering is used. In this paper, we propose to use non-photorealistic rendering to overcome this difficulty. Laboratory testing results on foamed plastic bones during various computer-assisted fluoroscopybased surgical procedures including total hip arthroplasty and long bone fracture reduction and osteosynthesis are shown.

A Survey of Image-based Relighting Techniques

Image-based Relighting (IBRL) has recently attracted a lot of research interest for its ability to relight real objects or scenes, from novel illuminations captured in natural/synthetic environments. Complex lighting effects such as subsurface scattering, interreflection, shadowing, mesostructural self-occlusion, refraction and other relevant phenomena can be generated using IBRL. The main advantage of image-based graphics is that the rendering time is independent of scene complexity as the rendering is actually a process of manipulating image pixels, instead of simulating light transport. The goal of this paper is to provide a complete and systematic overview of the research in Imagebased Relighting. We observe that essentially all IBRL techniques can be broadly classified into three categories (Fig. 9), based on how the scene/illumination information is captured: Reflectance function-based, Basis function-based and Plenoptic function-based. We discuss the characteristics of each of these categories and their representative methods. We also discuss about the sampling density and types of light source(s), relevant issues of IBRL.

3D Conversion using Vanishing Points and Image Warping

We describe a user assisted technique for 3D stereo conversion from 2D images. Our approach exploits the geometric structure of perspective images including vanishing points. We allow a user to indicate lines, planes, and vanishing points in the input image, and directly employ these as constraints in an image warping framework to produce a stereo pair. By sidestepping explicit construction of a depth map, our approach is applicable to more general scenes and avoids potential artifacts of depth-image-based rendering. Our method is most suitable for scenes with large scale structures such as buildings.

Recent Advances in Adaptive Sampling and Reconstruction for Monte Carlo Rendering

Monte Carlo integration is firmly established as the basis for most practical realistic image synthesis algorithms because of its flexibility and generality. However, the visual quality of rendered images often suffers from estimator variance, which appears as visually distracting noise. Adaptive sampling and reconstruction algorithms reduce variance by controlling the sampling density and aggregating samples in a reconstruction step, possibly over large image regions. In this paper we survey recent advances in this area. We distinguish between “a priori” methods that analyze the light transport equations and derive sampling rates and reconstruction filters from this analysis, and “a posteriori” methods that apply statistical techniques to sets of samples to drive the adaptive sampling and reconstruction process. They typically estimate the errors of several reconstruction filters, and select the best filter locally to minimize error. We discuss advantages and disadvantages of recent state-of-the-art techniques, and provide visual and quantitative comparisons. Some of these techniques are proving useful in real-world applications, and we aim to provide an overview for practitioners and researchers to assess these approaches. In addition, we discuss directions for potential further improvements.

Denoising Your Monte Carlo Renders: Recent Advances in Image Space-Adaptive Sampling and Reconstruction

With the ongoing shift in the computer graphics industry toward Monte Carlo rendering, there is a need for effective, practical noise-reduction techniques that are applicable to a wide range of rendering effects and easily integrated into existing production pipelines. This course surveys recent advances in image-space adaptive sampling and reconstruction algorithms for noise reduction, which have proven very effective at reducing the computational cost of Monte Carlo techniques in practice. These approaches leverage advanced image-filtering techniques with statistical methods for error estimation. They are attractive because they can be integrated easily into conventional Monte Carlo rendering frameworks, they are applicable to most rendering effects, and their computational overhead is modest.