Estimation and Prediction of Evolving Color Distributions for Skin Segmentation Under Varying Illumination

A novel approach for real-time skin segmentation in video sequences is described. The approach enables reliable skin segmentation despite wide variation in illumination during tracking. An explicit second order Markov model is used to predict evolution of the skin color (HSV) histogram over time. Histograms are dynamically updated based on feedback from the current segmentation and based on predictions of the Markov model. The evolution of the skin color distribution at each frame is parameterized by translation, scaling and rotation in color space. Consequent changes in geometric parameterization of the distribution are propagated by warping and re-sampling the histogram. The parameters of the discrete-time dynamic Markov model are estimated using Maximum Likelihood Estimation, and also evolve over time. Quantitative evaluation of the method was conducted on labeled ground-truth video sequences taken from popular movies.

Identification of image attributes that are most affected with changes in displayed image size

This paper describes an investigation of changes in image appearance when images are viewed at different image sizes on a high-end LCD device. Two digital image capturing devices of different overall image quality were used for recording identical natural scenes with a variety of pictorial contents. From each capturing device, a total of sixty four captured scenes, including architecture, nature, portraits, still and moving objects and artworks under various illumination conditions and recorded noise level were selected. The test set included some images where camera shake was purposefully introduced. An achromatic version of the image set that contained only lightness information was obtained by processing the captured images in CIELAB space. Rank order experiments were carried out to determine which image attribute(s) were most affected when the displayed image size was altered. These evaluations were carried out for both chromatic and achromatic versions of the stimuli. For the achromatic stimuli, attributes such as contrast, brightness, sharpness and noisiness were rank-ordered by the observers in terms of the degree of change. The same attributes, as well as hue and colourfulness, were investigated for the chromatic versions of the stimuli. Results showed that sharpness and contrast were the two most affected attributes with changes in displayed image size. The ranking of the remaining attributes varied with image content and illumination conditions. Further, experiments were carried out to link original scene content to the attributes that changed mostly with changes in image size.

Just noticeable differences in perceived image contrast with changes in displayed image size

An evaluation of the change in perceived image contrast with changes in displayed image size was carried out. This was achieved using data from four psychophysical investigations, which employed techniques to match the perceived contrast of displayed images of five different sizes. A total of twenty-four S-shape polynomial functions were created and applied to every original test image to produce images with different contrast levels. The objective contrast related to each function was evaluated from the gradient of the mid-section of the curve (gamma). The manipulation technique took into account published gamma differences that produced a just-noticeable-difference (JND) in perceived contrast. The filters were designed to achieve approximately half a JND, whilst keeping the mean image luminance unaltered. The processed images were then used as test series in a contrast matching experiment. Sixty-four natural scenes, with varying scene content acquired under various illumination conditions, were selected from a larger set captured for the purpose. Results showed that the degree of change in contrast between images of different sizes varied with scene content but was not as important as equivalent perceived changes in sharpness.

Classification of textures seen from different distances and under varying illumination direction

Changes in the angle of illumination incident upon a 3D surface texture can significantly alter its appearance, implying variations in the image texture. These texture variations produce displacements of class members in the feature space, increasing the failure rates of texture classifiers. To avoid this problem, a model-based texture recognition system which classifies textures seen from different distances and under different illumination directions is presented in this paper. The system works on the basis of a surface model obtained by means of 4-source colour photometric stereo, used to generate 2D image textures under different illumination directions. The recognition system combines coocurrence matrices for feature extraction with a Nearest Neighbour classifier. Moreover, the recognition allows one to guess the approximate direction of the illumination used to capture the test image

Achieving illumination invariance using image filters

In this chapter we described a novel framework for automatic face recognition in the presence of varying illumination, primarily applicable to matching face sets or sequences. The framework is based on simple image processing filters that compete with unprocessed greyscale input to yield a single matching score between individuals. By performing all numerically consuming computation offline, our method both (i) retains the matching efficiency of simple image filters, but (ii) with a greatly increased robustness, as all online processing is performed in closed-form. Evaluated on a large, real-world data corpus, the proposed framework was shown to be successful in video-based recognition across a wide range of illumination, pose and face motion pattern changes

NMR spectroscopy in studies of light-induced structural changes in mammalian rhodopsin: Applicability of solution 19F NMR

We report high resolution solution 19F NMR spectra of fluorine-labeled rhodopsin mutants in detergent micelles. Single cysteine substitution mutants in the cytoplasmic face of rhodopsin were labeled by attachment of the trifluoroethylthio (TET), CF3-CH2-S, group through a disulfide linkage. TET-labeled cysteine mutants at amino acid positions 67, 140, 245, 248, 311, and 316 in rhodopsin were thus prepared. Purified mutant rhodopsins (6–10 mg), in dodecylmaltoside, were analyzed at 20°C by solution 19F NMR spectroscopy. The spectra recorded in the dark showed the following chemical shifts relative to trifluoroacetate: Cys-67, 9.8 ppm; Cys-140, 10.6 ppm; Cys-245, 9.9 ppm; Cys-248, 9.5 ppm; Cys-311, 9.9 ppm; and Cys-316, 10.0 ppm. Thus, all mutants showed chemical shifts downfield that of free TET (6.5 ppm). On illumination to form metarhodopsin II, upfield changes in chemical shift were observed for 19F labels at positions 67 (−0.2 ppm) and 140 (−0.4 ppm) and downfield changes for positions 248 (+0.1 ppm) and 316 (+0.1 ppm) whereas little or no change was observed at positions 311 and 245. On decay of metarhodopsin II, the chemical shifts reverted largely to those originally observed in the dark. The results demonstrate the applicability of solution 19F NMR spectroscopy to studies of the tertiary structures in the cytoplasmic face of intact rhodopsin in the dark and on light activation.

Light-Induced Changes in Hydrogen, Calcium, Potassium, and Chloride Ion Fluxes and Concentrations from the Mesophyll and Epidermal Tissues of Bean Leaves. Understanding the Ionic Basis of Light-Induced Bioelectrogenesis1

Noninvasive, ion-selective vibrating microelectrodes were used to measure the kinetics of H+, Ca2+, K+, and Cl− fluxes and the changes in their concentrations caused by illumination near the mesophyll and attached epidermis of bean (Vicia faba L.). These flux measurements were related to light-induced changes in the plasma membrane potential. The influx of Ca2+ was the main depolarizing agent in electrical responses to light in the mesophyll. Changes in the net fluxes of H+, K+, and Cl− occurred only after a significant delay of about 2 min, whereas light-stimulated influx of Ca2+ began within the time resolution of our measurements (5 s). In the absence of H+ flux, light caused an initial quick rise of external pH near the mesophyll and epidermal tissues. In the mesophyll this fast alkalinization was followed by slower, oscillatory pH changes (5–15 min); in the epidermis the external pH increased steadily and reached a plateau 3 min later. We explain the initial alkalinization of the medium as a result of CO2 uptake by photosynthesizing tissue, whereas activation of the plasma membrane H+ pump occurred 1.5 to 2 min later. The epidermal layer seems to be a substantial barrier for ion fluxes but not for CO2 diffusion into the leaf.

Light-Regulated Transcription of Genes Encoding Peridinin Chlorophyll a Proteins and the Major Intrinsic Light-Harvesting Complex Proteins in the Dinoflagellate Amphidinium carterae Hulburt (Dinophycae)1 : Changes in Cytosine Methylation Accompany Photoadaptation

In the dinoflagellate Amphidinium carterae, photoadaptation involves changes in the transcription of genes encoding both of the major classes of light-harvesting proteins, the peridinin chlorophyll a proteins (PCPs) and the major a/c-containing intrinsic light-harvesting proteins (LHCs). PCP and LHC transcript levels were increased up to 86- and 6-fold higher, respectively, under low-light conditions relative to cells grown at high illumination. These increases in transcript abundance were accompanied by decreases in the extent of methylation of CpG and CpNpG motifs within or near PCP- and LHC-coding regions. Cytosine methylation levels in A. carterae are therefore nonstatic and may vary with environmental conditions in a manner suggestive of involvement in the regulation of gene expression. However, chemically induced undermethylation was insufficient in activating transcription, because treatment with two methylation inhibitors had no effect on PCP mRNA or protein levels. Regulation of gene activity through changes in DNA methylation has traditionally been assumed to be restricted to higher eukaryotes (deuterostomes and green plants); however, the atypically large genomes of dinoflagellates may have generated the requirement for systems of this type in a relatively “primitive” organism. Dinoflagellates may therefore provide a unique perspective on the evolution of eukaryotic DNA-methylation systems.

Kinetic coupling between electron and proton transfer in cytochrome c oxidase: simultaneous measurements of conductance and absorbance changes.

Bovine heart cytochrome c oxidase is an electron-current driven proton pump. To investigate the mechanism by which this pump operates it is important to study individual electron- and proton-transfer reactions in the enzyme, and key reactions in which they are kinetically and thermodynamically coupled. In this work, we have simultaneously measured absorbance changes associated with electron-transfer reactions and conductance changes associated with protonation reactions following pulsed illumination of the photolabile complex of partly reduced bovine cytochrome c oxidase and carbon monoxide. Following CO dissociation, several kinetic phases in the absorbance changes were observed with time constants ranging from approximately 3 microseconds to several milliseconds, reflecting internal electron-transfer reactions within the enzyme. The data show that the rate of one of these electron-transfer reactions, from cytochrome a3 to a on a millisecond time scale, is controlled by a proton-transfer reaction. These results are discussed in terms of a model in which cytochrome a3 interacts electrostatically with a protonatable group, L, in the vicinity of the binuclear center, in equilibrium with the bulk through a proton-conducting pathway, which determines the rate of proton transfer (and indirectly also of electron transfer). The interaction energy of cytochrome a3 with L was determined independently from the pH dependence of the extent of the millisecond-electron transfer and the number of protons released, as determined from the conductance measurements. The magnitude of the interaction energy, 70 meV (1 eV = 1.602 x 10(-19) J), is consistent with a distance of 5-10 A between cytochrome a3 and L. Based on the recently determined high-resolution x-ray structures of bovine and a bacterial cytochrome c oxidase, possible candidates for L and a physiological role for L are discussed.

Overexpression of guanylate cyclase activating protein 2 in rod photoreceptors in vivo leads to morphological changes at the synaptic ribbon

Guanylate cyclase activating proteins are EF-hand containing proteins that confer calcium sensitivity to retinal guanylate cyclase at the outer segment discs of photoreceptor cells. By making the rate of cGMP synthesis dependent on the free intracellular calcium levels set by illumination, GCAPs play a fundamental role in the recovery of the light response and light adaptation. The main isoforms GCAP1 and GCAP2 also localize to the synaptic terminal, where their function is not known. Based on the reported interaction of GCAP2 with Ribeye, the major component of synaptic ribbons, it was proposed that GCAP2 could mediate the synaptic ribbon dynamic changes that happen in response to light. We here present a thorough ultrastructural analysis of rod synaptic terminals in loss-of-function (GCAP1/GCAP2 double knockout) and gain-of-function (transgenic overexpression) mouse models of GCAP2. Rod synaptic ribbons in GCAPs−/− mice did not differ from wildtype ribbons when mice were raised in constant darkness, indicating that GCAPs are not required for ribbon early assembly or maturation. Transgenic overexpression of GCAP2 in rods led to a shortening of synaptic ribbons, and to a higher than normal percentage of club-shaped and spherical ribbon morphologies. Restoration of GCAP2 expression in the GCAPs−/− background (GCAP2 expression in the absence of endogenous GCAP1) had the striking result of shortening ribbon length to a much higher degree than overexpression of GCAP2 in the wildtype background, as well as reducing the thickness of the outer plexiform layer without affecting the number of rod photoreceptor cells. These results indicate that preservation of the GCAP1 to GCAP2 relative levels is relevant for maintaining the integrity of the synaptic terminal. Our demonstration of GCAP2 immunolocalization at synaptic ribbons at the ultrastructural level would support a role of GCAPs at mediating the effect of light on morphological remodeling changes of synaptic ribbons.

Changes in morphology and physiology of an East Mediterranean sponge in different habitats

The sponge Tetilla sp. (Tetractinomorpha: Tetillidae) is a common species in the eastern Mediterranean. This sponge inhabits four different habitat types differing in wave impact and irradiance levels. Two of these habitats (a shallow cave and deep water) are characterized by relatively calm water, whereas the other two (shallow exposed site and tide pools) are in turbulent water with high energy flow. The present study examined the influence of physical (depth, illumination and water motion) and biotic factors on morphology, skeletal plasticity and reproductive traits among the four spatially separated populations. Sponges from tidal pools had significantly larger body volume than sponges from deep water and from shallow caves (ANOVA: tidal-deep P< 0.0001; tidal-shallow caves P< 0.05). Sponges from exposed habitats were significantly larger than deep-water sponges (ANOVA: P=0.01). In addition, individuals from tide pools and from the exposed habitat had a significantly higher proportion of structural silica than sponges from the calmer deep water and from the cave sites. Oxea spicules in sponges from the calm habitats were significantly shorter than in those from the tidal pools and the exposed habitats. The percentage of spicules out of a sponge's dry weight in individuals transplanted from deep (calm) to shallow (turbulent) water significantly increased by 21.9&PLUSMN; 12.9%. The new spicule percentage did not differ significantly from that of sponges originally from shallow water. Oocyte diameter differed significantly between habitats. The maximal size of mature eggs was found in deep-water sponges in June (97&PLUSMN; 5 μ m). In the shallow habitats, a smaller maximal oocyte diameter was found in the cave, in May (56.5&PLUSMN; 3 μ m). Furthermore, oocyte density in shallow-water sponges was highest in May and decreased in June (with 88.2&PLUSMN; 9 and 19.3&PLUSMN; 9 oocytes mm(-2), respectively). At the same time (June), oocyte density of deep-water sponges had just reached its maximum (155&PLUSMN; 33.7 oocytes mm(-2)). The difference in oocyte size and density between deep- and shallow-water individuals indicates an earlier gamete release in the shallow sponge population. The results suggest that plasticity in skeletal design of this sponge indicates a trade off between spicule production and investment in reproduction.

A generative model for separating illumination and reflectance from images

It is well known that even slight changes in nonuniform illumination lead to a large image variability and are crucial for many visual tasks. This paper presents a new ICA related probabilistic model where the number of sources exceeds the number of sensors to perform an image segmentation and illumination removal, simultaneously. We model illumination and reflectance in log space by a generalized autoregressive process and Hidden Gaussian Markov random field, respectively. The model ability to deal with segmentation of illuminated images is compared with a Canny edge detector and homomorphic filtering. We apply the model to two problems: synthetic image segmentation and sea surface pollution detection from intensity images.

Contrast- and illumination-invariant object recognition from active sensation

It has been suggested that the deleterious effect of contrast reversal on visual recognition is unique to faces, not objects. Here we show from priming, supervised category learning, and generalization that there is no such thing as general invariance of recognition of non-face objects against contrast reversal and, likewise, changes in direction of illumination. However, when recognition varies with rendering conditions, invariance may be restored, and effects of continuous learning may be reduced, by providing prior object knowledge from active sensation. Our findings suggest that the degree of contrast invariance achieved reflects functional characteristics of object representations learned in a task-dependent fashion.

Radiative Behaviour of Gd2O3:Er/Yb nanoparticles under near infrared illumination

Upconverting nanoparticles have attracted much attention in science recently, specifically in view of medical and biological applications such as live imaging of cell temperatures or cancer treatment. The previously studied system of gadolinium oxide nanorods co-doped with erbium and ytterbium and decorated with different number densities of gold nanoparticles has been studied. So far, these particles have been proven as efficient nanothermometers in a temperature range from 300 up to 2000 K. In this work, a more detailed study on the morphological and radiative behaviour of these particles has been conducted. It was found that the laser power threshold for the onset of the black body radiation decreases strongly with the increase in the gold concentration. The temperature of the onset itself seems to remain approximately constant. The heating efficiency was determined to increase significantly with the gold concentration. The morphological study revealed that the temperature at the black body radiation threshold was not enough to induce any significant transformation in neither the nanorods nor the gold nanoparticles, as was expected from comparison with literature. However, significant changes in radiative properties and the morphology were detected for powders that underwent strong laser heating until the emission of brightly visible black body radiation.