A Survey of Image-based Relighting Techniques

Image-based Relighting (IBRL) has recently attracted a lot of research interest for its ability to relight real objects or scenes, from novel illuminations captured in natural/synthetic environments. Complex lighting effects such as subsurface scattering, interreflection, shadowing, mesostructural self-occlusion, refraction and other relevant phenomena can be generated using IBRL. The main advantage of image-based graphics is that the rendering time is independent of scene complexity as the rendering is actually a process of manipulating image pixels, instead of simulating light transport. The goal of this paper is to provide a complete and systematic overview of the research in Imagebased Relighting. We observe that essentially all IBRL techniques can be broadly classified into three categories (Fig. 9), based on how the scene/illumination information is captured: Reflectance function-based, Basis function-based and Plenoptic function-based. We discuss the characteristics of each of these categories and their representative methods. We also discuss about the sampling density and types of light source(s), relevant issues of IBRL.

Reflectance Transfer for Material Editing and Relighting

We present a new approach to diffuse reflectance estimation for dynamic scenes. Non-parametric image statistics are used to transfer reflectance properties from a static example set to a dynamic image sequence. The approach allows diffuse reflectance estimation for surface materials with inhomogeneous appearance, such as those which commonly occur with patterned or textured clothing. Material editing is also possible by transferring edited reflectance properties. Material reflectance properties are initially estimated from static images of the subject under multiple directional illuminations using photometric stereo. The estimated reflectance together with the corresponding image under uniform ambient illumination form a prior set of reference material observations. Material reflectance properties are then estimated for video sequences of a moving person captured under uniform ambient illumination by matching the observed local image statistics to the reference observations. Results demonstrate that the transfer of reflectance properties enables estimation of the dynamic surface normals and subsequent relighting combined with material editing. This approach overcomes limitations of previous work on material transfer and relighting of dynamic scenes which was limited to surfaces with regions of homogeneous reflectance. We evaluate our approach for relighting 3D model sequences reconstructed from multiple view video. Comparison to previous model relighting demonstrates improved reproduction of detailed texture and shape dynamics.

Lithographiebasierte Fertigung keramischer Bauteile

Im Rahmen des EU-Projektes PHOCAM entwickelt das beteiligte Konsortium Anlagen und Materialien für die generative Fertigung keramischer Bauteile auf Basis der Photopolymerisation. Das Kernelement der verwendeten Fertigungsanlagen, der DLP Projektor, erzeugt mittels leistungsstarker LEDs und einem 1080p DMD (Digital Micromirror Device) Bilder mit 1920x1080 Bildpunkten und der Pixelgröße von 40µm, woraus sich die Baufeldgröße von 76,8x43,2mm ergibt. Ein hochviskoser Schlicker, bestehen aus einem gefülltem fotosensitiven Harzsystem, wird von unten durch die gläserne Materialwanne belichtet, wodurch der Schlicker lokal aushärtet (polymerisiert). Auf diese Weise entsteht der Grünling, der in schichtbauweise (Standardschichtdicke von 25-50µm) aufgebaut ist. Im nachfolgenden Sinterprozess werden die Grünlinge zu den fertigen Keramikteilen gebrannt. Als keramisches Basismaterial für den Schlicker wurde vorwiegend Aluminiumoxid in Pulverform verwendet. Mit dem entwickelten System konnten bislang Schlicker mit einem Füllgrad (Keramikanteil) bis zu 50Vol% erfolgreich verarbeitet und zu Keramikteilen mit einer theoretischen Dichte von 99,6% gesintert werden.

Voter Participation in the 1998 Bundestag Elections: A Theoretical Modification and Empirical Application of Downs’ Theory of Voter Participation

This article seeks to contribute to the illumination of the so-called 'paradox of voting' using the German Bundestag elections of 1998 as an empirical case. Downs' model of voter participation will be extended to include elements of the theory of subjective expected utility (SEU). This will allow a theoretical and empirical exploration of the crucial mechanisms of individual voters' decisions to participate, or abstain from voting, in the German general election of 1998. It will be argued that the infinitely low probability of an individual citizen's vote to decide the election outcome will not necessarily reduce the probability of electoral participation. The empirical analysis is largely based on data from the ALLBUS 1998. It confirms the predictions derived from SEU theory. The voters' expected benefits and their subjective expectation to be able to influence government policy by voting are the crucial mechanisms to explain participation. By contrast, the explanatory contribution of perceived information and opportunity costs is low.

OPTiSPIM: integrating optical projection tomography in light sheet microscopy extends specimen characterization to nonfluorescent contrasts.

Mesoscopic 3D imaging has become a widely used optical imaging technique to visualize intact biological specimens. Selective plane illumination microscopy (SPIM) visualizes samples up to a centimeter in size with micrometer resolution by 3D data stitching but is limited to fluorescent contrast. Optical projection tomography (OPT) works with fluorescent and nonfluorescent contrasts, but its resolution is limited in large samples. We present a hybrid setup (OPTiSPIM) combining the advantages of each technique. The combination of fluorescent and nonfluorescent high-resolution 3D data into integrated datasets enables a more extensive representation of mesoscopic biological samples. The modular concept of the OPTiSPIM facilitates incorporation of the transmission OPT modality into already established light sheet based imaging setups.

A Closed-Form, Consistent and Robust Solution to Uncalibrated Photometric Stereo Via Local Diffuse Reflectance Maxima

Images of an object under different illumination are known to provide strong cues about the object surface. A mathematical formalization of how to recover the normal map of such a surface leads to the so-called uncalibrated photometric stereo problem. In the simplest instance, this problem can be reduced to the task of identifying only three parameters: the so-called generalized bas-relief (GBR) ambiguity. The challenge is to find additional general assumptions about the object, that identify these parameters uniquely. Current approaches are not consistent, i.e., they provide different solutions when run multiple times on the same data. To address this limitation, we propose exploiting local diffuse reflectance (LDR) maxima, i.e., points in the scene where the normal vector is parallel to the illumination direction (see Fig. 1). We demonstrate several noteworthy properties of these maxima: a closed-form solution, computational efficiency and GBR consistency. An LDR maximum yields a simple closed-form solution corresponding to a semi-circle in the GBR parameters space (see Fig. 2); because as few as two diffuse maxima in different images identify a unique solution, the identification of the GBR parameters can be achieved very efficiently; finally, the algorithm is consistent as it always returns the same solution given the same data. Our algorithm is also remarkably robust: It can obtain an accurate estimate of the GBR parameters even with extremely high levels of outliers in the detected maxima (up to 80 % of the observations). The method is validated on real data and achieves state-of-the-art results.

SIGNALING MECHANISMS THAT CONTROL GAP JUNCTIONAL COUPLING BETWEEN RETINAL NEURONS

Gap junctions between neurons form the structural substrate for electrical synapses. Connexin 36 (Cx36, and its non-mammalian ortholog connexin 35) is the major neuronal gap junction protein in the central nervous system (CNS), and contributes to several important neuronal functions including neuronal synchronization, signal averaging, network oscillations, and motor learning. Connexin 36 is strongly expressed in the retina, where it is an obligatory component of the high-sensitivity rod photoreceptor pathway. A fundamental requirement of the retina is to adapt to broadly varying inputs in order to maintain a dynamic range of signaling output. Modulation of the strength of electrical coupling between networks of retinal neurons, including the Cx36-coupled AII amacrine cell in the primary rod circuit, is a hallmark of retinal luminance adaptation. However, very little is known about the mechanisms regulating dynamic modulation of Cx36-mediated coupling. The primary goal of this work was to understand how cellular signaling mechanisms regulate coupling through Cx36 gap junctions. We began by developing and characterizing phospho-specific antibodies against key regulatory phosphorylation sites on Cx36. Using these tools we showed that phosphorylation of Cx35 in fish models varies with light adaptation state, and is modulated by acute changes in background illumination. We next turned our focus to the well-studied and readily identifiable AII amacrine cell in mammalian retina. Using this model we showed that increased phosphorylation of Cx36 is directly related to increased coupling through these gap junctions, and that the dopamine-stimulated uncoupling of the AII network is mediated by dephosphorylation of Cx36 via protein kinase A-stimulated protein phosphatase 2A activity. We then showed that increased phosphorylation of Cx36 on the AII amacrine network is driven by depolarization of presynaptic ON-type bipolar cells as well as background light increments. This increase in phosphorylation is mediated by activation of extrasynaptic NMDA receptors associated with Cx36 gap junctions on AII amacrine cells and by Ca2+-calmodulin-dependent protein kinase II activation. Finally, these studies indicated that coupling is regulated locally at individual gap junction plaques. This work provides a framework for future study of regulation of Cx36-mediated coupling, in which increased phosphorylation of Cx36 indicates increased neuronal coupling.

Mapping material distribution in a heterogeneous sand tank by image analysis

Water flow and solute transport through soils are strongly influenced by the spatial arrangement of soil materials with different hydraulic and chemical properties. Knowing the specific or statistical arrangement of these materials is considered as a key toward improved predictions of solute transport. Our aim was to obtain two-dimensional material maps from photographs of exposed profiles. We developed a segmentation and classification procedure and applied it to the images of a very heterogeneous sand tank, which was used for a series of flow and transport experiments. The segmentation was based on thresholds of soil color, estimated from local median gray values, and of soil texture, estimated from local coefficients of variation of gray values. Important steps were the correction of inhomogeneous illumination and reflection, and the incorporation of prior knowledge in filters used to extract the image features and to smooth the results morphologically. We could check and confirm the success of our mapping by comparing the estimated with the designed sand distribution in the tank. The resulting material map was used later as input to model flow and transport through the sand tank. Similar segmentation procedures may be applied to any high-density raster data, including photographs or spectral scans of field profiles.

Sensory regulation of network components underlying ciliary locomotion in Hermissenda.

Ciliary locomotion in the nudibranch mollusk Hermissenda is modulated by the visual and graviceptive systems. Components of the neural network mediating ciliary locomotion have been identified including aggregates of polysensory interneurons that receive monosynaptic input from identified photoreceptors and efferent neurons that activate cilia. Illumination produces an inhibition of type I(i) (off-cell) spike activity, excitation of type I(e) (on-cell) spike activity, decreased spike activity in type III(i) inhibitory interneurons, and increased spike activity of ciliary efferent neurons. Here we show that pairs of type I(i) interneurons and pairs of type I(e) interneurons are electrically coupled. Neither electrical coupling or synaptic connections were observed between I(e) and I(i) interneurons. Coupling is effective in synchronizing dark-adapted spontaneous firing between pairs of I(e) and pairs of I(i) interneurons. Out-of-phase burst activity, occasionally observed in dark-adapted and light-adapted pairs of I(e) and I(i) interneurons, suggests that they receive synaptic input from a common presynaptic source or sources. Rhythmic activity is typically not a characteristic of dark-adapted, light-adapted, or light-evoked firing of type I interneurons. However, burst activity in I(e) and I(i) interneurons may be elicited by electrical stimulation of pedal nerves or generated at the offset of light. Our results indicate that type I interneurons can support the generation of both rhythmic activity and changes in tonic firing depending on sensory input. This suggests that the neural network supporting ciliary locomotion may be multifunctional. However, consistent with the nonmuscular and nonrhythmic characteristics of visually modulated ciliary locomotion, type I interneurons exhibit changes in tonic activity evoked by illumination.

Incidental detection of an occult oral malignancy with autofluorescence imaging: a case report.

BACKGROUND: Autofluorescence imaging is used widely for diagnostic evaluation of various epithelial malignancies. Cancerous lesions display loss of autofluorescence due to malignant changes in epithelium and subepithelial stroma. Carcinoma of unknown primary site presents with lymph node or distant metastasis, for which the site of primary tumour is not detectable. We describe here the use of autofluorescence imaging for detecting a clinically innocuous appearing occult malignancy of the palate which upon pathological examination was consistent with a metastatic squamous cell carcinoma. CASE DESCRIPTION: A submucosal nodule was noted on the right posterior hard palate of a 59-year-old white female during clinical examination. Examination of this lesion using a multispectral oral cancer screening device revealed loss of autofluorescence at 405 nm illumination. An excisional biopsy of this nodule, confirmed the presence of a metastatic squamous cell carcinoma. Four years ago, this patient was diagnosed with metastatic squamous cell carcinoma of the right mid-jugular lymph node of unknown primary. She was treated with external beam irradiation and remained disease free until current presentation. CONCLUSION: This case illustrates the important role played by autofluorescence tissue imaging in diagnosing a metastatic palatal tumour that appeared clinically innocuous and otherwise would not have been biopsied.

Small-Scale Features of Marine Sediments and Their Importance to the Study of Deposit-Feeding

Techniques currently in use by sedimentologists for the study of marine sedment microfabric are of limited use for understandmg the relationship between sediment organic matter and mineral grains. In this article it is shown that by combining standard histological protocols for fixation and dehydration with petrological protocols for resin embedding and thin sectioning, very fine details of the sediment structure can be seen. Because of the ubiquitous presence of the organic matrix, organicmineral aggregates are not seen in situ. Other features of the sediment of importance to deposit-feeders, such as the presence of intact chloroplasts, can be observed through the use of epifluorescence illumination, while partially crossed polarizers help to delimit the grain boundaries. It is suggested that if these procedures can be combined with histological staining techniques, it may be possible to determine the potential food value of sedment on a scale equivalent to that perceived by infaunal deposit-feeders.

Implementing the plasma-lasing potential for tabletop nano-imaging

Implementing the plasma-lasing potential for tabletop nano-imaging on across a hot plasma medium drives short-wavelength lasing, promising for "turnkey" nano-imaging setups. A systematic study of the illumination characteristics, combined with design-adapted objectives, is presented. It is shown how the ultimate nano-scale feature is dictated by either the diffraction-limited or the wavefront-limited resolution, which imposed a combined study of both the source and the optics. For nano-imaging, the spatial homogeneity of the illumination (spot noise) was shown as critical. Plasma-lasing from a triple grazing-incidence pumping scheme compensated for the missing spot homogeneity in classical schemes. We demonstrate that a collimating mirror pre-conditions both the pointing stability and the divergence below half a mrad.

Minimally invasive photopolymerization in intervertebral disc tissue cavities

Photopolymerized hydrogels are commonly used for a broad range of biomedical applications. As long as the polymer volume is accessible, gels can easily be hardened using light illumination. However, in clinics, especially for minimally invasive surgery, it becomes highly challenging to control photopolymerization. The ratios between polymerization- volume and radiating-surface-area are several orders of magnitude higher than for ex-vivo settings. Also tissue scattering occurs and influences the reaction. We developed a Monte Carlo model for photopolymerization, which takes into account the solid/liquid phase changes, moving solid/liquid-boundaries and refraction on these boundaries as well as tissue scattering in arbitrarily designable tissue cavities. The model provides a tool to tailor both the light probe and the scattering/absorption properties of the photopolymer for applications such as medical implants or tissue replacements. Based on the simulations, we have previously shown that by adding scattering additives to the liquid monomer, the photopolymerized volume was considerably increased. In this study, we have used bovine intervertebral disc cavities, as a model for spinal degeneration, to study photopolymerization in-vitro. The cavity is created by enzyme digestion. Using a custom designed probe, hydrogels were injected and photopolymerized. Magnetic resonance imaging (MRI) and visual inspection tools were employed to investigate the successful photopolymerization outcomes. The results provide insights for the development of novel endoscopic light-scattering polymerization probes paving the way for a new generation of implantable hydrogels.

Monte Carlo modeling of polarized light propagation: Stokes vs Jones - Part II

In this second part of our comparative study inspecting the (dis)similarities between “Stokes” and “Jones,” we present simulation results yielded by two independent Monte Carlo programs: (i) one developed in Bern with the Jones formalism and (ii) the other implemented in Ulm with the Stokes notation. The simulated polarimetric experiments involve suspensions of polystyrene spheres with varying size. Reflection and refraction at the sample/air interfaces are also considered. Both programs yield identical results when propagating pure polarization states, yet, with unpolarized illumination, second order statistical differences appear, thereby highlighting the pre-averaged nature of the Stokes parameters. This study serves as a validation for both programs and clarifies the misleading belief according to which “Jones cannot treat depolarizing effects.”

Effect of irradiation distance on image contrast in epi-optoacoustic imaging of human volunteers

In combined clinical optoacoustic (OA) and ultrasound (US) imaging, epi-mode irradiation and detection integrated into one single probe offers flexible imaging of the human body. The imaging depth in epi-illumination is, however, strongly affected by clutter. As shown in previous phantom experiments, the location of irradiation plays an important role in clutter generation. We investigated the influence of the irradiation geometry on the local image contrast of clinical images, by varying the separation distance between the irradiated area and the acoustic imaging plane of a linear ultrasound transducer in an automated scanning setup. The results for different volunteers show that the image contrast can be enhanced on average by 25% and locally by more than a factor of two, when the irradiated area is slightly separated from the probe. Our findings have an important impact on the design of future optoacoustic probes for clinical application.