Color constancy and the functional significance of McCollough effects

A central problem in visual perception concerns how humans perceive stable and uniform object colors despite variable lighting conditions (i.e. color constancy). One solution is to 'discount' variations in lighting across object surfaces by encoding color contrasts, and utilize this information to 'fill in' properties of the entire object surface. Implicit in this solution is the caveat that the color contrasts defining object boundaries must be distinguished from the spurious color fringes that occur naturally along luminance-defined edges in the retinal image (i.e. optical chromatic aberration). In the present paper, we propose that the neural machinery underlying color constancy is complemented by an 'error-correction' procedure which compensates for chromatic aberration, and suggest that error-correction may be linked functionally to the experimentally induced illusory colored aftereffects known as McCollough effects (MEs). To test these proposals, we develop a neural network model which incorporates many of the receptive-field (RF) profiles of neurons in primate color vision. The model is composed of two parallel processing streams which encode complementary sets of stimulus features: one stream encodes color contrasts to facilitate filling-in and color constancy; the other stream selectively encodes (spurious) color fringes at luminance boundaries, and learns to inhibit the filling-in of these colors within the first stream. Computer simulations of the model illustrate how complementary color-spatial interactions between error-correction and filling-in operations (a) facilitate color constancy, (b) reveal functional links between color constancy and the ME, and (c) reconcile previously reported anomalies in the local (edge) and global (spreading) properties of the ME. We discuss the broader implications of these findings by considering the complementary functional roles performed by RFs mediating color-spatial interactions in the primate visual system. (C) 2002 Elsevier Science Ltd. All rights reserved.

Parallel detection of violations of color constancy

The perceived colors of reflecting surfaces generally remain stable despite changes in the spectrum of the illuminating light. This color constancy can be measured operationally by asking observers to distinguish illuminant changes on a scene from changes in the reflecting properties of the surfaces comprising it. It is shown here that during fast illuminant changes, simultaneous changes in spectral reflectance of one or more surfaces in an array of other surfaces can be readily detected almost independent of the numbers of surfaces, suggesting a preattentive, spatially parallel process. This process, which is perfect over a spatial window delimited by the anatomical fovea, may form an early input to a multistage analysis of surface color, providing the visual system with information about a rapidly changing world in advance of the generation of a more elaborate and stable perceptual representation.

The Computation of Color

This thesis takes an interdisciplinary approach to the study of color vision, focussing on the phenomenon of color constancy formulated as a computational problem. The primary contributions of the thesis are (1) the demonstration of a formal framework for lightness algorithms; (2) the derivation of a new lightness algorithm based on regularization theory; (3) the synthesis of an adaptive lightness algorithm using "learning" techniques; (4) the development of an image segmentation algorithm that uses luminance and color information to mark material boundaries; and (5) an experimental investigation into the cues that human observers use to judge the color of the illuminant. Other computational approaches to color are reviewed and some of their links to psychophysics and physiology are explored.

The neurological basis of conscious color perception in a blind patient

We have studied patient PB, who, after an electric shock that led to vascular insufficiency, became virtually blind, although he retained a capacity to see colors consciously. For our psychophysical studies, we used a simplified version of the Land experiments [Land, E. (1974) Proc. R. Inst. G. B. 47, 23–58] to learn whether color constancy mechanisms are intact in him, which amounts to learning whether he can assign a constant color to a surface in spite of changes in the precise wavelength composition of the light reflected from that surface. We supplemented our psychophysical studies with imaging ones, using functional magnetic resonance, to learn something about the location of areas that are active in his brain when he perceives colors. The psychophysical results suggested that color constancy mechanisms are severely defective in PB and that his color vision is wavelength-based. The imaging results showed that, when he viewed and recognized colors, significant increases in activity were restricted mainly to V1-V2. We conclude that a partly defective color system operating on its own in a severely damaged brain is able to mediate a conscious experience of color in the virtually total absence of other visual abilities.

Color-based surface reflectance separation for scene illumination estimation and rendering

Given the importance of color processing in computer vision and computer graphics, estimating and rendering illumination spectral reflectance of image scenes is important to advance the capability of a large class of applications such as scene reconstruction, rendering, surface segmentation, object recognition, and reflectance estimation. Consequently, this dissertation proposes effective methods for reflection components separation and rendering in single scene images. Based on the dichromatic reflectance model, a novel decomposition technique, named the Mean-Shift Decomposition (MSD) method, is introduced to separate the specular from diffuse reflectance components. This technique provides a direct access to surface shape information through diffuse shading pixel isolation. More importantly, this process does not require any local color segmentation process, which differs from the traditional methods that operate by aggregating color information along each image plane. ^ Exploiting the merits of the MSD method, a scene illumination rendering technique is designed to estimate the relative contributing specular reflectance attributes of a scene image. The image feature subset targeted provides a direct access to the surface illumination information, while a newly introduced efficient rendering method reshapes the dynamic range distribution of the specular reflectance components over each image color channel. This image enhancement technique renders the scene illumination reflection effectively without altering the scene’s surface diffuse attributes contributing to realistic rendering effects. ^ As an ancillary contribution, an effective color constancy algorithm based on the dichromatic reflectance model was also developed. This algorithm selects image highlights in order to extract the prominent surface reflectance that reproduces the exact illumination chromaticity. This evaluation is presented using a novel voting scheme technique based on histogram analysis. ^ In each of the three main contributions, empirical evaluations were performed on synthetic and real-world image scenes taken from three different color image datasets. The experimental results show over 90% accuracy in illumination estimation contributing to near real world illumination rendering effects. ^

Colourful objects through animal eyes

To understand how bees, birds, and fish may use colour vision for food selection and mate choice, we reconstructed views of biologically important objects taking into account the receptor spectral sensitivities. Reflectance spectra a of flowers, bird plumage, and fish skin were used to calculate receptor quantum catches. The quantum catches were then coded by red, green, and blue of a computer monitor; and powers, birds, and fish were visualized in animal colours. Calculations were performed for different illumination conditions. To simulate colour constancy, we used a von Kries algorithm, i.e., the receptor quantum catches were scaled so that the colour of illumination remained invariant. We show that on land this algorithm compensates reasonably well for changes of object appearance caused by natural changes of illumination, while in water failures of von Kries colour constancy are prominent. (C) 2000 John Wiley & Sons, Inc.

Highlight Removal in Spectral Images

Monissasovelluksissa on hyvin tärkeää vähentää valolähteen vaikutusta kohteen oikean värin havainnoimiseksi. Tämä on tarpeen mm. virtuaalisissa museoissa, telelääketieteessä, verkkokaupassa ja verkkorahassa. Tässä tutkielmassa on kehitetty tekniikkaa kirkkaiden heijastusten poistoon spektrikuvista. Työ sisältää katsauksen yleisen värillisen kuvan ymmärtämiseen, mihin perustuen analysoitiin erilaisia kirkkaiden heijastusten poistO'tekniikoita. Työssä kehitettiin uusi kirkkaiden heijastusten poistO'menetelmä, joka perustuu dikromaattiseen heijastus-malliin, joka kuvaa spektrisen datan objektin omaan väriin ja valaisevan valon väriin perustuen. Ehdotettu kirkkaiden heijastusten poistO'menetelmä hyödyntää erilaisia olemassaolevia menetelmiä, kuten pääkomponenttimenetelmää ja tiedon luokittelu-menetelmää. Yritys kehittää nopeasti toimiva algoritmi, joka myös suoriutuu tehtävästä hyvin, on onnistunut. Kokeet toteutettiin ehdotetun menetelmän mukaisesti ja toimivalla algoritmilla saatiin halutut lopputulokset. Edelleentyö sisältää ehdotuksia esitetyn algoritmin parantamiseksi.

Computational Techniques for Spectral Image Analysis

Multispectral images are becoming more common in the field of remote sensing, computer vision, and industrial applications. Due to the high accuracy of the multispectral information, it can be used as an important quality factor in the inspection of industrial products. Recently, the development on multispectral imaging systems and the computational analysis on the multispectral images have been the focus of a growing interest. In this thesis, three areas of multispectral image analysis are considered. First, a method for analyzing multispectral textured images was developed. The method is based on a spectral cooccurrence matrix, which contains information of the joint distribution of spectral classes in a spectral domain. Next, a procedure for estimating the illumination spectrum of the color images was developed. Proposed method can be used, for example, in color constancy, color correction, and in the content based search from color image databases. Finally, color filters for the optical pattern recognition were designed, and a prototype of a spectral vision system was constructed. The spectral vision system can be used to acquire a low dimensional component image set for the two dimensional spectral image reconstruction. The data obtained by the spectral vision system is small and therefore convenient for storing and transmitting a spectral image.

Farbkonstanz und Farbkontrast – eine Untersuchung mit Hilfe der farbigen Schatten

Zusammenfassung der Dissertation von Anatol Julian Kallmann Farbkonstanz und Farbkontrast – eine Untersuchung mit Hilfeder farbigen Schatten Die farbigen Schatten werden als ein Spezialfall dessimultanen Farbkontrastes angesehen. Um herauszufinden,warum die farbigen Schatten im Vergleich zur gewöhnlichenDarstellung des simultanen Farbkontrastes so intensiv farbigerscheinen, wurde das Phänomen hinsichtlich derFarbparameter Helligkeit, Sättigung und Farbton analysiert. Der Induktionseffekt scheint weniger von der Sättigung desUmfeldes als vom Leuchtdichtekontrast zwischen dem Umfeldund dem Infeld abhängig zu sein.Das farbig beleuchtete Umfeld wurde von den Versuchspersonenmit einer geringeren Farbsättigung im Verhältnis zurtatsächlichen Umfeldsättigung eingestellt. Die Farbe desUmfeldes wurde unterschiedlich wahrgenommen, wenn keinzentrales Testfeld präsentiert wurde.Dichromaten nahmen das physikalisch weiße Infeld ebenfallsfarbig wahr. Sie stellten Farben auf dem Abgleichbildschirmein, deren Farborte in der CIE-Farbtafel auf denVerwechslungslinien liegen und somit denen der Trichromatenentsprechen. Die Farbbenennungen wichen jedoch von denen derTrichromaten ab. Das Phänomen der farbigen Schatten scheint ein Spezialfallder Farbkonstanz zu sein: Vermutlich dient das Umfeld alshellste Fläche im Gesichtsfeld dem visuellen System alsReferenz. Wenn die Helligkeit des zentralen Infeldeszunimmt, so dass dieses letztlich im visuellen Felddominiert, dann ist das visuelle System in der Lage, es als'weiß' wahrzunehmen. Es verwendet dann wahrscheinlich diesesFeld als Weißreferenz, welches die übrigen Farben imGesichtsfeld bestimmt.

Flower constancy of the stingless bee Trigona carbonaria Smith (Hymenoptera : Apidae : Meliponini)

We tested the constancy of floral choice by Trigona carbonaria Smith in a garden by examining, using a scanning electron microscope, the composition of the pollen loads of individual foragers over time. Constancy was tested on three levels. Within a single trip, 88% of the samples examined comprised pure pollen loads (97% or more of one pollen type). Within a single day, 88% of bees visited the same species across trips sampled. Across 2 and 3 days, 82% and 73%, respectively, of individual bees foraged on a single pollen type. The majority of the remaining bees collected only two species of pollen. This pattern is consistent with that of other highly social bees. It enhances the pollinator efficacy of these insects by increasing the chances of pollen being transferred to stigmas of the same plant species. This increases the ecological importance of these bees and their value in crop pollination.

Linear color correction for multiple illumination changes and non-overlapping cameras

Many image processing methods, such as techniques for people re-identification, assume photometric constancy between different images. This study addresses the correction of photometric variations based upon changes in background areas to correct foreground areas. The authors assume a multiple light source model where all light sources can have different colours and will change over time. In training mode, the authors learn per-location relations between foreground and background colour intensities. In correction mode, the authors apply a double linear correction model based on learned relations. This double linear correction includes a dynamic local illumination correction mapping as well as an inter-camera mapping. The authors evaluate their illumination correction by computing the similarity between two images based on the earth mover's distance. The authors compare the results to a representative auto-exposure algorithm found in the recent literature plus a colour correction one based on the inverse-intensity chromaticity. Especially in complex scenarios the authors’ method outperforms these state-of-the-art algorithms.

Effect of staining solutions and repolishing on color stability of direct composites

OBJECTIVES: The purpose of this study was to assess the color change of three types of composite resins exposed to coffee and cola drink, and the effect of repolishing on the color stability of these composites after staining. MATERIALS AND METHODS: Fifteen specimens (15 mm diameter and 2 mm thick) were fabricated from microhybrid (Esthet-X; Dentsply and Filtek Z-250; 3M ESPE) and high-density hybrid (Surefil; Dentsply) composites, and were finished and polished with aluminum oxide discs (Sof-Lex; 3M ESPE). Color of the specimens was measured according to the CIE L*a*b* system in a refection spectrophotometer (PCB 6807; BYK Gardner). After baseline color measurements, 5 specimens of each resin were immersed in different staining solutions for 15 days: G1 - distilled water (control), G2 - coffee, G3 - cola soft drink. Afterwards, new color measurement was performed and the specimens were repolished and submitted to new color reading. Color stability was determined by the difference (ΔE) between the coordinates L*, a*, and b* obtained from the specimens before and after immersion into the solutions and after repolishing. RESULTS: There was no statistically signifcant difference (ANOVA, Tukey's test; p>0.05) among the ΔE values for the different types of composites after staining or repolishing. For all composite resins, coffee promoted more color change (ΔE>3.3) than distilled water and the cola soft drink. After repolishing, the ΔE values of the specimens immersed in coffee decreased to clinically acceptable values (ΔE<3.3), but remained signifcantly higher than those of the other groups. CONCLUSIONS: No signifcant difference was found among composite resins or between color values before and after repolishing of specimens immersed in distilled water and cola. Immersing specimens in coffee caused greater color change in all types of composite resins tested in this study and repolishing contributed to decrease staining to clinically acceptable ΔE values.

Composite resin color stability: influence of light sources and immersion media

OBJECTIVE: This study evaluated the influence of light sources and immersion media on the color stability of a nanofilled composite resin. MATERIAL AND METHODS: Conventional halogen, high-power-density halogen and high-power-density light-emitting diode (LED) units were used. There were 4 immersion media: coffee, tea, Coke® and artificial saliva. A total of 180 specimens (10 mm x 2 mm) were prepared, immersed in artificial saliva for 24 h at 37±1ºC, and had their initial color measured with a spectrophotometer according to the CIELab system. Then, the specimens were immersed in the 4 media during 60 days. Data from the color change and luminosity were collected and subjected to statistical analysis by the Kruskall-Wallis test (p<0.05). For immersion time, the data were subjected to two-way ANOVA test and Fisher's test (p<0.05). RESULTS: High-power-density LED (ΔE=1.91) promoted similar color stability of the composite resin to that of the tested halogen curing units (Jet Lite 4000 plus - ΔE=2.05; XL 3000 - ΔE=2.28). Coffee (ΔE=8.40; ΔL=-5.21) showed the highest influence on color stability of the studied composite resin. CONCLUSION: There was no significant difference in color stability regardless of the light sources, and coffee was the immersion medium that promoted the highest color changes on the tested composite resin.

Evaluation of iris color stability in ocular prosthesis

Accurate iris reproduction in the fabrication of ocular prosthesis in order to match the remaining eye is a key factor to mask the loss and achieve an esthetic outcome for anophthalmic patients. This study evaluated the stability of acrylic paints used for replicating iris color in ocular prostheses by the analysis of two factors: the temperature of the acrylic resin polymerization cycle during prosthesis fabrication and the incidence of sun light, which is the main photodegrading agent undermining the longevity of ocular prostheses. An accelerated aging assay was used for both analyses. Specimens simulating the prosthetic iris in the colors blue, yellow, black, brown and green were fabricated, and were submitted to a colorimetric reading before and after undergoing the thermal conditions of acrylic resin polymerization. Next, the specimens were submitted to an artificial accelerated aging assay with ultraviolet radiation A and weekly colorimetric readings during a 3-week period. The color change (??*) values for the four specimens painted with the same color paint were averaged and the resulting values were considered for statistical analysis. Levine's test and Student's t-test were used to analyze the influence of the temperature of the polymerization cycle during prosthesis fabrication on the color stability of each acrylic resin paint. Friedman's test for three dependent samples was used for analysis of color photodegradation as function of time. Significance level was set at 0.05 for all analyses. It was observed that, after the action of the temperature of the polymerization cycle, alteration above clinically acceptable level of ??*> 3.3 was observed only for the yellow color. After the accelerated aging assay, there were statistically significant differences (p<0.05) as a function of time in the green, brown, black and blue colors. Changes were clinically acceptable for the brown and black colors; slightly above the clinically acceptable limit for the green color; and significantly high and impracticable from a clinical standpoint for the blue color. There was no statistically significant differences (p>0.05) for the yellow color, which presented color change only a little above the clinically acceptable limit. In conclusion: 1. Only the yellow color presented alterations above the clinically acceptable levels after the polymerization cycle; 2. After accelerated aging, there was no changes in the yellow color above the clinically acceptable levels; 3. For the green color, degradation was significant and slightly above the clinically acceptable levels; 4. The black, brown and blue colors presented significant alterations as function of time; the alterations of the brown and black colors were within acceptable clinical levels, while the blue color presented a more accentuated degradation over time.

Diagnostic agreement between panoramic radiographs and color doppler images of carotid atheroma

The aim of this study was to investigate the agreement between diagnoses of calcified atheroma seen on panoramic radiographs and color Doppler images. Our interest stems from the fact that panoramic images can show the presence of atheroma regardless of the level of obstruction detected by color Doppler images. Panoramic and color Doppler images of 16 patients obtained from the archives of the Health Department of the city of Valença, RJ, Brazil, were analyzed in this study. Both sides of each patient were observed on the images, with a total of 32 analyzed cervical regions. The level of agreement between diagnoses was analyzed using the Kappa statistics. There was a high level of agreement, with a Kappa value of 0.78. In conclusion, panoramic radiographs can help detecting calcifications in the cervical region of patients susceptible to vascular diseases predisposing to myocardial infarction and cerebrovascular accidents. If properly trained and informed, dentists can refer their patients to a physician for a cardiovascular evaluation in order to receive proper and timely medical treatment.