Color-based surface reflectance separation for scene illumination estimation and rendering

Given the importance of color processing in computer vision and computer graphics, estimating and rendering illumination spectral reflectance of image scenes is important to advance the capability of a large class of applications such as scene reconstruction, rendering, surface segmentation, object recognition, and reflectance estimation. Consequently, this dissertation proposes effective methods for reflection components separation and rendering in single scene images. Based on the dichromatic reflectance model, a novel decomposition technique, named the Mean-Shift Decomposition (MSD) method, is introduced to separate the specular from diffuse reflectance components. This technique provides a direct access to surface shape information through diffuse shading pixel isolation. More importantly, this process does not require any local color segmentation process, which differs from the traditional methods that operate by aggregating color information along each image plane. ^ Exploiting the merits of the MSD method, a scene illumination rendering technique is designed to estimate the relative contributing specular reflectance attributes of a scene image. The image feature subset targeted provides a direct access to the surface illumination information, while a newly introduced efficient rendering method reshapes the dynamic range distribution of the specular reflectance components over each image color channel. This image enhancement technique renders the scene illumination reflection effectively without altering the scene’s surface diffuse attributes contributing to realistic rendering effects. ^ As an ancillary contribution, an effective color constancy algorithm based on the dichromatic reflectance model was also developed. This algorithm selects image highlights in order to extract the prominent surface reflectance that reproduces the exact illumination chromaticity. This evaluation is presented using a novel voting scheme technique based on histogram analysis. ^ In each of the three main contributions, empirical evaluations were performed on synthetic and real-world image scenes taken from three different color image datasets. The experimental results show over 90% accuracy in illumination estimation contributing to near real world illumination rendering effects. ^

Correlates of leaf optical properties in tropical forest sun and extreme-shade plants

Thirteens hade-adaptedr ain forest species were comparedw ith twelve sun-adaptedt ropical forest species for correlates to leaf optical properties (described previously in Amer. J. Bot. 73: 1100-1108). The two samples were similar in absorptance of quanta for photosynthesis, but the shade-adaptedt axa: 1) had significantlyl ower specificl eaf weights,i ndicatinga more metabolically efficient production of surface for quantum capture; 2) synthesized less chlorophyll per unit area; and 3) used less chlorophyll for capturing the same quanta for photosynthesis. The anatomical features that best correlate with this increased efficiency are palisade cell shape and chloroplast distribution. Palisade cells with more equal dimensions have more chloroplasts on their abaxial surfaces. This dense layer of chloroplasts maximizes the light capture efficiency limited by sieve effects. The more columnar palisade cells of sun-adapted taxa allow light to pass through the central vacuoles and spaces between cells, making chloroplasts less efficient in energy capture, but allowing light to reach chloroplasts in the spongy mesophyll. Pioneer species may be an exception to these two groups of species. Three pioneer taxa included in this study have columnar palisade cells that are extremely narrow and packed closely together. This layer allows little penetration of light, but exposure of the leaf undersurface may provide illumination of spongy mesophyll chloroplasts in these plants.

Why Leaves Turn Red in Autumn. The Role of Anthocyanins in Senescing Leaves of Red-Osier Dogwood

Why the leaves of many woody species accumulate anthocyanins prior to being shed has long puzzled biologists because it is unclear what effects anthocyanins may have on leaf function. Here, we provide evidence for red-osier dogwood (Cornus stolonifera) that anthocyanins form a pigment layer in the palisade mesophyll layer that decreases light capture by chloroplasts. Measurements of leaf absorbance demonstrated that red-senescing leaves absorbed more light of blue-green to orange wavelengths (495–644 nm) compared with yellow-senescing leaves. Using chlorophyll a fluorescence measurements, we observed that maximum photosystem II (PSII) photon yield of red-senescing leaves recovered from a high-light stress treatment, whereas yellow-senescing leaves failed to recover after 6 h of dark adaptation, which suggests photo-oxidative damage. Because no differences were observed in light response curves of effective PSII photon yield for red- and yellow-senescing leaves, differences between red- and yellow-senescing cannot be explained by differences in the capacities for photochemical and non-photochemical light energy dissipation. A role of anthocyanins as screening pigments was explored further by measuring the responses PSII photon yield to blue light, which is preferentially absorbed by anthocyanins, versus red light, which is poorly absorbed. We found that dark-adapted PSII photon yield of red-senescing leaves recovered rapidly following illumination with blue light. However, red light induced a similar, prolonged decrease in PSII photon yield in both red- and yellow-senescing leaves. We suggest that optical masking of chlorophyll by anthocyanins reduces risk of photo-oxidative damage to leaf cells as they senesce, which otherwise may lower the efficiency of nutrient retrieval from senescing autumn leaves.

Photocatalytic decomposition of organophosphonates and fluorophenols in irradiated titanium dioxide suspensions

Dimethyl methyl phosphonate (DMMP), diethyl methyl phosphonate (DEMP), and fluorophenols undergo rapid decomposition upon TiO$\sb2$ catalyzed photooxidation in air saturated aqueous solution. The degradation rates of DMMP were determined over a range of temperatures, under solar and artificial irradiation with and without simultaneous sonication. Solar illumination is effective for the degradation and the use of low energy of sonication increases the rate of mineralization. The surface area and the type of TiO$\sb2$ dramatically affect the photoactivity of the catalyst. A number of intermediate products are formed and ultimately oxidized to phosphate and carbon dioxide. Possible reaction mechanisms and pathways for DMMP and DEMP are proposed. The Langmuir-Hinshelwood kinetic parameters for the photocatalysis of fluorophenols suggest modestly different reactivity for each isomer. The adsorption constant is largest for the ortho isomer consistent with the adsorption onto TiO$\sb2$ through both hydroxyl and fluoride groups to form a chelated type structure. ^

Numerical calculation of diffraction coefficients from building edges using FDTD method

Finite Difference Time Domain (FDTD) Method and software are applied to obtain diffraction waves from modulated Gaussian plane wave illumination for right angle wedges and Fast Fourier Transform (FFT) is used to get diffraction coefficients in a wideband in the illuminated lit region. Theta and Phi polarization in 3-dimensional, TM and TE polarization in 2-dimensional cases are considered respectively for soft and hard diffraction coefficients. Results using FDTD method of perfect electric conductor (PEC) wedge are compared with asymptotic expressions from Uniform Theory of Diffraction (UTD). Extend the PEC wedges to some homogenous conducting and dielectric building materials for diffraction coefficients that are not available analytically in practical conditions. ^

The significance of chloroplast movement in leaves of tropical plants

The purpose of this research project was to contribute to the understanding of chloroplast movement in plants. Chloroplast movement in leaves from twenty tropical plant species ranging from cycads to monocots and varying in shade tolerance was examined by measuring changes in transmittance following 30 min. of exposure to white light at 1000 μmol m−2 s −1 in the wavelength range of 400–700 nm (photosynthetically active radiation, PAR). Leaf anatomical characteristics were also measured. Eighteen species increased significantly in transmittance (Δ T) at this level of illumination. ^ Chloroplast movement was significantly correlated with palisade cell width suggesting that cell dimensions are a significant constraint on chloroplast movement in the species examined. In addition, Δ T values were strongly correlated with values of an index of shade tolerance. ^ To further examine the relationship between palisade width and chloroplast movement, additional studies were conducted with a tropical aroid vine, Scindapsus aureus Schott. Scindapsus plants were grown under three different light treatments: 63% (control), 9.0% and 2.7% of full sunlight. Under these growing conditions plants produced markedly different palisade cell widths. Palisade cell width was again found to be correlated with transmittance changes. In addition, the observed increases in transmittance following exposure to the above illumination condition were correlated with absorbance of PAR. Fluorescence studies demonstrated that chloroplast movement helps protect Scindapsus aureus from the effects of photoinhibition when it is exposed to light at a higher intensity relative to the intensity of its normal environment. Ratios of variable fluorescence (Fv) to maximal fluorescence (Fm ) were higher in plants exposed to high light when chloroplasts moved than in plants where chloroplasts did not. ^ To further explore the role of chloroplast movement, studies were conducted to determine if transmittance changes could be induced in ten xerophytes at (1000 μmol m−2 s−1), as well as two stronger light intensities (1800 μmol m−2 s−1 and 2200 μmol m−2 s −1). Transmittance changes in the ten xerophytes were dependent upon the illumination intensity; nine out of the ten xerophytes changed in transmittance at 1800 μmol m−2 s−1. For the other two intensity levels, only three out of the ten xerophytes tested exhibited transmittance changes, and for two species, a negative Δ T value was obtained at 1000 μmol m−2 s−1 . No relationship was found between cell dimensions and chloroplast movement, although all species had large enough chlorenchyma cells to allow such movements. ^ The results of the study clearly show that in non-xerophytes, palisade cell anatomy is a strong constraint on chloroplast movement. This relationship may be the basis for the relationship between chloroplast movement and shade tolerance. Although absorbance changes are relatively small, chloroplast movement was clearly shown to reduce photoinhibition. ^

An integrative approach to face and expression recognition from 3D scans

Biometrics is afield of study which pursues the association of a person's identity with his/her physiological or behavioral characteristics.^ As one aspect of biometrics, face recognition has attracted special attention because it is a natural and noninvasive means to identify individuals. Most of the previous studies in face recognition are based on two-dimensional (2D) intensity images. Face recognition based on 2D intensity images, however, is sensitive to environment illumination and subject orientation changes, affecting the recognition results. With the development of three-dimensional (3D) scanners, 3D face recognition is being explored as an alternative to the traditional 2D methods for face recognition.^ This dissertation proposes a method in which the expression and the identity of a face are determined in an integrated fashion from 3D scans. In this framework, there is a front end expression recognition module which sorts the incoming 3D face according to the expression detected in the 3D scans. Then, scans with neutral expressions are processed by a corresponding 3D neutral face recognition module. Alternatively, if a scan displays a non-neutral expression, e.g., a smiling expression, it will be routed to an appropriate specialized recognition module for smiling face recognition.^ The expression recognition method proposed in this dissertation is innovative in that it uses information from 3D scans to perform the classification task. A smiling face recognition module was developed, based on the statistical modeling of the variance between faces with neutral expression and faces with a smiling expression.^ The proposed expression and face recognition framework was tested with a database containing 120 3D scans from 30 subjects (Half are neutral faces and half are smiling faces). It is shown that the proposed framework achieves a recognition rate 10% higher than attempting the identification with only the neutral face recognition module.^

Rigid and non-rigid point-based medical image registration

The primary goal of this dissertation is to develop point-based rigid and non-rigid image registration methods that have better accuracy than existing methods. We first present point-based PoIRe, which provides the framework for point-based global rigid registrations. It allows a choice of different search strategies including (a) branch-and-bound, (b) probabilistic hill-climbing, and (c) a novel hybrid method that takes advantage of the best characteristics of the other two methods. We use a robust similarity measure that is insensitive to noise, which is often introduced during feature extraction. We show the robustness of PoIRe using it to register images obtained with an electronic portal imaging device (EPID), which have large amounts of scatter and low contrast. To evaluate PoIRe we used (a) simulated images and (b) images with fiducial markers; PoIRe was extensively tested with 2D EPID images and images generated by 3D Computer Tomography (CT) and Magnetic Resonance (MR) images. PoIRe was also evaluated using benchmark data sets from the blind retrospective evaluation project (RIRE). We show that PoIRe is better than existing methods such as Iterative Closest Point (ICP) and methods based on mutual information. We also present a novel point-based local non-rigid shape registration algorithm. We extend the robust similarity measure used in PoIRe to non-rigid registrations adapting it to a free form deformation (FFD) model and making it robust to local minima, which is a drawback common to existing non-rigid point-based methods. For non-rigid registrations we show that it performs better than existing methods and that is less sensitive to starting conditions. We test our non-rigid registration method using available benchmark data sets for shape registration. Finally, we also explore the extraction of features invariant to changes in perspective and illumination, and explore how they can help improve the accuracy of multi-modal registration. For multimodal registration of EPID-DRR images we present a method based on a local descriptor defined by a vector of complex responses to a circular Gabor filter.

A digital signal processing approach for affective sensing of a computer user through pupil diameter monitoring

Recent research has indicated that the pupil diameter (PD) in humans varies with their affective states. However, this signal has not been fully investigated for affective sensing purposes in human-computer interaction systems. This may be due to the dominant separate effect of the pupillary light reflex (PLR), which shrinks the pupil when light intensity increases. In this dissertation, an adaptive interference canceller (AIC) system using the H∞ time-varying (HITV) adaptive algorithm was developed to minimize the impact of the PLR on the measured pupil diameter signal. The modified pupil diameter (MPD) signal, obtained from the AIC was expected to reflect primarily the pupillary affective responses (PAR) of the subject. Additional manipulations of the AIC output resulted in a processed MPD (PMPD) signal, from which a classification feature, PMPDmean, was extracted. This feature was used to train and test a support vector machine (SVM), for the identification of stress states in the subject from whom the pupil diameter signal was recorded, achieving an accuracy rate of 77.78%. The advantages of affective recognition through the PD signal were verified by comparatively investigating the classification of stress and relaxation states through features derived from the simultaneously recorded galvanic skin response (GSR) and blood volume pulse (BVP) signals, with and without the PD feature. The discriminating potential of each individual feature extracted from GSR, BVP and PD was studied by analysis of its receiver operating characteristic (ROC) curve. The ROC curve found for the PMPDmean feature encompassed the largest area (0.8546) of all the single-feature ROCs investigated. The encouraging results seen in affective sensing based on pupil diameter monitoring were obtained in spite of intermittent illumination increases purposely introduced during the experiments. Therefore, these results confirmed the benefits of using the AIC implementation with the HITV adaptive algorithm to isolate the PAR and the potential of using PD monitoring to sense the evolving affective states of a computer user.

Distribution of light in the human retina under natural viewing conditions

Age-related macular degeneration (AMD) is the leading cause of blindness inAmerica. The fact that AMD wreaks most of the damage in the center of the retina raises the question of whether light, integrated over long periods, is more concentrated in the macula. A method, based on eye-tracking, was developed to measure the distribution of light in the retina under natural viewing conditions. The hypothesis was that integrated over time, retinal illumination peaked in the macula. Additionally a possible relationship between age and retinal illumination was investigated. The eye tracker superimposed the subject's gaze position on a video recorded by a scene camera. Five informed subjects were employed in feasibility tests, and 58 naïve subjects participated in 5 phases. In phase 1 the subjects viewed a gray-scale image. In phase 2, they observed a sequence of photographic images. In phase 3 they viewed a video. In phase 4, they worked on a computer; in phase 5, the subjects walked around freely. The informed subjects were instructed to gaze at bright objects in the field of view and then at dark objects. Naïve subjects were allowed to gaze freely for all phases. Using the subject's gaze coordinates, and the video provided by the scene camera, the cumulative light distribution on the retina was calculated for ∼15° around the fovea. As expected for control subjects, cumulative retinal light distributions peaked and dipped in the fovea when they gazed at bright or dark objects respectively. The light distribution maps obtained from the naïve subjects presented a tendency to peak in the macula for phases 1, 2, and 3, a consistent tendency in phase 4 and a variable tendency in phase 5. The feasibility of using an eye-tracker system to measure the distribution of light in the retina was demonstrated, thus helping to understand the role played by light exposure in the etiology of AMD. Results showed that a tendency for light to peak in the macula is a characteristic of some individuals and of certain tasks. In these situations, risk of AMD could be increased. No significant difference was observed based on age.

Modeling, simulation, and characterization of space debris in low-Earth orbit

Every space launch increases the overall amount of space debris. Satellites have limited awareness of nearby objects that might pose a collision hazard. Astrometric, radiometric, and thermal models for the study of space debris in low-Earth orbit have been developed. This modeled approach proposes analysis methods that provide increased Local Area Awareness for satellites in low-Earth and geostationary orbit. Local Area Awareness is defined as the ability to detect, characterize, and extract useful information regarding resident space objects as they move through the space environment surrounding a spacecraft. The study of space debris is of critical importance to all space-faring nations. Characterization efforts are proposed using long-wave infrared sensors for space-based observations of debris objects in low-Earth orbit. Long-wave infrared sensors are commercially available and do not require solar illumination to be observed, as their received signal is temperature dependent. The characterization of debris objects through means of passive imaging techniques allows for further studies into the origination, specifications, and future trajectory of debris objects. Conclusions are made regarding the aforementioned thermal analysis as a function of debris orbit, geometry, orientation with respect to time, and material properties. Development of a thermal model permits the characterization of debris objects based upon their received long-wave infrared signals. Information regarding the material type, size, and tumble-rate of the observed debris objects are extracted. This investigation proposes the utilization of long-wave infrared radiometric models of typical debris to develop techniques for the detection and characterization of debris objects via signal analysis of unresolved imagery. Knowledge regarding the orbital type and semi-major axis of the observed debris object are extracted via astrometric analysis. This knowledge may aid in the constraint of the admissible region for the initial orbit determination process. The resultant orbital information is then fused with the radiometric characterization analysis enabling further characterization efforts of the observed debris object. This fused analysis, yielding orbital, material, and thermal properties, significantly increases a satellite's Local Area Awareness via an intimate understanding of the debris environment surrounding the spacecraft.

Photocatalytic decomposition of organophosphonates fluorophenols in irradiated titanium dioxide suspensions

Dimethyl methyl phosphonate (DMMP), diethyl methyl phosphonate (DEMP), and fluorophenols undergo rapid decomposition upon TiO2 catalyzed photooxidation in air saturated aqueous solution. The degradation rates of DMMP were determined over a range of temperatures, under solar and artificial irradiation with and without simultaneous sonication. Solar illumination is effective for the degradation and the use of low energy of sonication increases the rate of mineralization. The surface area and the type of TiO2 dramatically affect the photoactivity of the catalyst. A number of intermediate products are formed and ultimately oxidized to phosphate and carbon dioxide. Possible reaction mechanisms and pathways for DMMP and DEMP are proposed. The Langmuir- Hinshelwood kinetic parameters for the photocatalysis of fluorophenols suggest modestly different reactivity for each isomer. The adsorption constant is largest for the ortho isomer consistent with the adsorption onto TiO2 through both hydroxyl and fluoride groups to form a chelated type structure.

A Digital Signal Processing Approach for Affective Sensing of a Computer User through Pupil Diameter Monitoring

Recent research has indicated that the pupil diameter (PD) in humans varies with their affective states. However, this signal has not been fully investigated for affective sensing purposes in human-computer interaction systems. This may be due to the dominant separate effect of the pupillary light reflex (PLR), which shrinks the pupil when light intensity increases. In this dissertation, an adaptive interference canceller (AIC) system using the H∞ time-varying (HITV) adaptive algorithm was developed to minimize the impact of the PLR on the measured pupil diameter signal. The modified pupil diameter (MPD) signal, obtained from the AIC was expected to reflect primarily the pupillary affective responses (PAR) of the subject. Additional manipulations of the AIC output resulted in a processed MPD (PMPD) signal, from which a classification feature, PMPDmean, was extracted. This feature was used to train and test a support vector machine (SVM), for the identification of stress states in the subject from whom the pupil diameter signal was recorded, achieving an accuracy rate of 77.78%. The advantages of affective recognition through the PD signal were verified by comparatively investigating the classification of stress and relaxation states through features derived from the simultaneously recorded galvanic skin response (GSR) and blood volume pulse (BVP) signals, with and without the PD feature. The discriminating potential of each individual feature extracted from GSR, BVP and PD was studied by analysis of its receiver operating characteristic (ROC) curve. The ROC curve found for the PMPDmean feature encompassed the largest area (0.8546) of all the single-feature ROCs investigated. The encouraging results seen in affective sensing based on pupil diameter monitoring were obtained in spite of intermittent illumination increases purposely introduced during the experiments. Therefore, these results confirmed the benefits of using the AIC implementation with the HITV adaptive algorithm to isolate the PAR and the potential of using PD monitoring to sense the evolving affective states of a computer user.

Rigid and Non-rigid Point-based Medical Image Registration

The primary goal of this dissertation is to develop point-based rigid and non-rigid image registration methods that have better accuracy than existing methods. We first present point-based PoIRe, which provides the framework for point-based global rigid registrations. It allows a choice of different search strategies including (a) branch-and-bound, (b) probabilistic hill-climbing, and (c) a novel hybrid method that takes advantage of the best characteristics of the other two methods. We use a robust similarity measure that is insensitive to noise, which is often introduced during feature extraction. We show the robustness of PoIRe using it to register images obtained with an electronic portal imaging device (EPID), which have large amounts of scatter and low contrast. To evaluate PoIRe we used (a) simulated images and (b) images with fiducial markers; PoIRe was extensively tested with 2D EPID images and images generated by 3D Computer Tomography (CT) and Magnetic Resonance (MR) images. PoIRe was also evaluated using benchmark data sets from the blind retrospective evaluation project (RIRE). We show that PoIRe is better than existing methods such as Iterative Closest Point (ICP) and methods based on mutual information. We also present a novel point-based local non-rigid shape registration algorithm. We extend the robust similarity measure used in PoIRe to non-rigid registrations adapting it to a free form deformation (FFD) model and making it robust to local minima, which is a drawback common to existing non-rigid point-based methods. For non-rigid registrations we show that it performs better than existing methods and that is less sensitive to starting conditions. We test our non-rigid registration method using available benchmark data sets for shape registration. Finally, we also explore the extraction of features invariant to changes in perspective and illumination, and explore how they can help improve the accuracy of multi-modal registration. For multimodal registration of EPID-DRR images we present a method based on a local descriptor defined by a vector of complex responses to a circular Gabor filter.

Distribution of Light in the Human Retina under Natural Viewing Conditions

Age-related macular degeneration (AMD) is the leading cause of blindness inAmerica. The fact that AMD wreaks most of the damage in the center of the retina raises the question of whether light, integrated over long periods, is more concentrated in the macula. A method, based on eye-tracking, was developed to measure the distribution of light in the retina under natural viewing conditions. The hypothesis was that integrated over time, retinal illumination peaked in the macula. Additionally a possible relationship between age and retinal illumination was investigated. The eye tracker superimposed the subject’s gaze position on a video recorded by a scene camera. Five informed subjects were employed in feasibility tests, and 58 naïve subjects participated in 5 phases. In phase 1 the subjects viewed a gray-scale image. In phase 2, they observed a sequence of photographic images. In phase 3 they viewed a video. In phase 4, they worked on a computer; in phase 5, the subjects walked around freely. The informed subjects were instructed to gaze at bright objects in the field of view and then at dark objects. Naïve subjects were allowed to gaze freely for all phases. Using the subject’s gaze coordinates, and the video provided by the scene camera, the cumulative light distribution on the retina was calculated for ~15° around the fovea. As expected for control subjects, cumulative retinal light distributions peaked and dipped in the fovea when they gazed at bright or dark objects respectively. The light distribution maps obtained from the naïve subjects presented a tendency to peak in the macula for phases 1, 2, and 3, a consistent tendency in phase 4 and a variable tendency in phase 5. The feasibility of using an eye-tracker system to measure the distribution of light in the retina was demonstrated, thus helping to understand the role played by light exposure in the etiology of AMD. Results showed that a tendency for light to peak in the macula is a characteristic of some individuals and of certain tasks. In these situations, risk of AMD could be increased. No significant difference was observed based on age.