An integrative approach to face and expression recognition from 3D scans

Biometrics is afield of study which pursues the association of a person's identity with his/her physiological or behavioral characteristics.^ As one aspect of biometrics, face recognition has attracted special attention because it is a natural and noninvasive means to identify individuals. Most of the previous studies in face recognition are based on two-dimensional (2D) intensity images. Face recognition based on 2D intensity images, however, is sensitive to environment illumination and subject orientation changes, affecting the recognition results. With the development of three-dimensional (3D) scanners, 3D face recognition is being explored as an alternative to the traditional 2D methods for face recognition.^ This dissertation proposes a method in which the expression and the identity of a face are determined in an integrated fashion from 3D scans. In this framework, there is a front end expression recognition module which sorts the incoming 3D face according to the expression detected in the 3D scans. Then, scans with neutral expressions are processed by a corresponding 3D neutral face recognition module. Alternatively, if a scan displays a non-neutral expression, e.g., a smiling expression, it will be routed to an appropriate specialized recognition module for smiling face recognition.^ The expression recognition method proposed in this dissertation is innovative in that it uses information from 3D scans to perform the classification task. A smiling face recognition module was developed, based on the statistical modeling of the variance between faces with neutral expression and faces with a smiling expression.^ The proposed expression and face recognition framework was tested with a database containing 120 3D scans from 30 subjects (Half are neutral faces and half are smiling faces). It is shown that the proposed framework achieves a recognition rate 10% higher than attempting the identification with only the neutral face recognition module.^

Estrogen and lithium: Facilitating factors involved in brain cell signaling pathways

Learning and memory in adult females decline during menopause and estrogen replacement therapy is commonly prescribed during menopause. Post-menopausal women tend to suffer from depression and are prescribed antidepressants – in addition to hormone therapy. Estrogen replacement therapy is a topic that engenders debate since several studies contradict its efficacy as a palliative therapy for cognitive decline and neurodegenerative diseases. Signaling transduction pathways can alter brain cell activity, survival, and morphology by facilitating transcription factor DNA binding and protein production. The steroidal hormone estrogen and the anti-depressant drug lithium interact through these signaling transduction pathways facilitating transcription factor activation. The paucity of data on how combined hormones and antidepressants interact in regulating gene expression led me to hypothesize that in primary mixed brain cell cultures, combined 17β-estradiol (E2) and lithium chloride (LiCl) (E2/LiCl) will alter genetic expression of markers involved in synaptic plasticity and neuroprotection. Results from these studies indicated that a 48 h treatment of E2/LiCl reduced glutamate receptor subunit genetic expression, but increased neurotrophic factor and estrogen receptor genetic expression. Combined treatment also failed to protect brain cell cultures from glutamate excitotoxicity. If lithium facilitates protein signaling pathways mediated by estrogen, can lithium alone serve as a palliative treatment for post-menopause? This question led me to hypothesize that in estrogen-deficient mice, lithium alone will increase episodic memory (tested via object recognition), and enhance expression in the brain of factors involved in anti-apoptosis, learning and memory. I used bilaterally ovariectomized (bOVX) C57BL/6J mice treated with LiCl for one month. Results indicated that LiCl-treated bOVX mice increased performance in object recognition compared with non-treated bOVX. Increased performance in LiCl-treated bOVX mice coincided with augmented genetic and protein expression in the brain. Understanding the molecular pathways of estrogen will assist in identifying a palliative therapy for menopause-related dementia, and lithium may serve this purpose by acting as a selective estrogen-mediated signaling modulator.

Digital surveillance based on video CODEC System-on-a-Chip (SoC) platforms

Today, most conventional surveillance networks are based on analog system, which has a lot of constraints like manpower and high-bandwidth requirements. It becomes the barrier for today's surveillance network development. This dissertation describes a digital surveillance network architecture based on the H.264 coding/decoding (CODEC) System-on-a-Chip (SoC) platform. The proposed digital surveillance network architecture includes three major layers: software layer, hardware layer, and the network layer. The following outlines the contributions to the proposed digital surveillance network architecture. (1) We implement an object recognition system and an object categorization system on the software layer by applying several Digital Image Processing (DIP) algorithms. (2) For better compression ratio and higher video quality transfer, we implement two new modules on the hardware layer of the H.264 CODEC core, i.e., the background elimination module and the Directional Discrete Cosine Transform (DDCT) module. (3) Furthermore, we introduce a Digital Signal Processor (DSP) sub-system on the main bus of H.264 SoC platforms as the major hardware support system for our software architecture. Thus we combine the software and hardware platforms to be an intelligent surveillance node. Lab results show that the proposed surveillance node can dramatically save the network resources like bandwidth and storage capacity.

Color-based surface reflectance separation for scene illumination estimation and rendering

Given the importance of color processing in computer vision and computer graphics, estimating and rendering illumination spectral reflectance of image scenes is important to advance the capability of a large class of applications such as scene reconstruction, rendering, surface segmentation, object recognition, and reflectance estimation. Consequently, this dissertation proposes effective methods for reflection components separation and rendering in single scene images. Based on the dichromatic reflectance model, a novel decomposition technique, named the Mean-Shift Decomposition (MSD) method, is introduced to separate the specular from diffuse reflectance components. This technique provides a direct access to surface shape information through diffuse shading pixel isolation. More importantly, this process does not require any local color segmentation process, which differs from the traditional methods that operate by aggregating color information along each image plane. ^ Exploiting the merits of the MSD method, a scene illumination rendering technique is designed to estimate the relative contributing specular reflectance attributes of a scene image. The image feature subset targeted provides a direct access to the surface illumination information, while a newly introduced efficient rendering method reshapes the dynamic range distribution of the specular reflectance components over each image color channel. This image enhancement technique renders the scene illumination reflection effectively without altering the scene’s surface diffuse attributes contributing to realistic rendering effects. ^ As an ancillary contribution, an effective color constancy algorithm based on the dichromatic reflectance model was also developed. This algorithm selects image highlights in order to extract the prominent surface reflectance that reproduces the exact illumination chromaticity. This evaluation is presented using a novel voting scheme technique based on histogram analysis. ^ In each of the three main contributions, empirical evaluations were performed on synthetic and real-world image scenes taken from three different color image datasets. The experimental results show over 90% accuracy in illumination estimation contributing to near real world illumination rendering effects. ^

Estrogen and Lithium: Facilitating Factors Involved in Brain Cell Signaling Pathways

Learning and memory in adult females decline during menopause and estrogen replacement therapy is commonly prescribed during menopause. Post-menopausal women tend to suffer from depression and are prescribed antidepressants – in addition to hormone therapy. Estrogen replacement therapy is a topic that engenders debate since several studies contradict its efficacy as a palliative therapy for cognitive decline and neurodegenerative diseases. Signaling transduction pathways can alter brain cell activity, survival, and morphology by facilitating transcription factor DNA binding and protein production. The steroidal hormone estrogen and the anti-depressant drug lithium interact through these signaling transduction pathways facilitating transcription factor activation. The paucity of data on how combined hormones and antidepressants interact in regulating gene expression led me to hypothesize that in primary mixed brain cell cultures, combined 17beta-estradiol (E2) and lithium chloride (LiCl) (E2/LiCl) will alter genetic expression of markers involved in synaptic plasticity and neuroprotection. Results from these studies indicated that a 48 h treatment of E2/LiCl reduced glutamate receptor subunit genetic expression, but increased neurotrophic factor and estrogen receptor genetic expression. Combined treatment also failed to protect brain cell cultures from glutamate excitotoxicity. If lithium facilitates protein signaling pathways mediated by estrogen, can lithium alone serve as a palliative treatment for post-menopause? This question led me to hypothesize that in estrogen-deficient mice, lithium alone will increase episodic memory (tested via object recognition), and enhance expression in the brain of factors involved in anti-apoptosis, learning and memory. I used bilaterally ovariectomized (bOVX) C57BL/6J mice treated with LiCl for one month. Results indicated that LiCl-treated bOVX mice increased performance in object recognition compared with non-treated bOVX. Increased performance in LiCl-treated bOVX mice coincided with augmented genetic and protein expression in the brain. Understanding the molecular pathways of estrogen will assist in identifying a palliative therapy for menopause-related dementia, and lithium may serve this purpose by acting as a selective estrogen-mediated signaling modulator.

An incremental multilinear system for human face learning and recognition

This dissertation establishes a novel system for human face learning and recognition based on incremental multilinear Principal Component Analysis (PCA). Most of the existing face recognition systems need training data during the learning process. The system as proposed in this dissertation utilizes an unsupervised or weakly supervised learning approach, in which the learning phase requires a minimal amount of training data. It also overcomes the inability of traditional systems to adapt to the testing phase as the decision process for the newly acquired images continues to rely on that same old training data set. Consequently when a new training set is to be used, the traditional approach will require that the entire eigensystem will have to be generated again. However, as a means to speed up this computational process, the proposed method uses the eigensystem generated from the old training set together with the new images to generate more effectively the new eigensystem in a so-called incremental learning process. In the empirical evaluation phase, there are two key factors that are essential in evaluating the performance of the proposed method: (1) recognition accuracy and (2) computational complexity. In order to establish the most suitable algorithm for this research, a comparative analysis of the best performing methods has been carried out first. The results of the comparative analysis advocated for the initial utilization of the multilinear PCA in our research. As for the consideration of the issue of computational complexity for the subspace update procedure, a novel incremental algorithm, which combines the traditional sequential Karhunen-Loeve (SKL) algorithm with the newly developed incremental modified fast PCA algorithm, was established. In order to utilize the multilinear PCA in the incremental process, a new unfolding method was developed to affix the newly added data at the end of the previous data. The results of the incremental process based on these two methods were obtained to bear out these new theoretical improvements. Some object tracking results using video images are also provided as another challenging task to prove the soundness of this incremental multilinear learning method.

3D Navigation with Six Degrees-of-Freedom using a Multi-Touch Display

With the introduction of new input devices, such as multi-touch surface displays, the Nintendo WiiMote, the Microsoft Kinect, and the Leap Motion sensor, among others, the field of Human-Computer Interaction (HCI) finds itself at an important crossroads that requires solving new challenges. Given the amount of three-dimensional (3D) data available today, 3D navigation plays an important role in 3D User Interfaces (3DUI). This dissertation deals with multi-touch, 3D navigation, and how users can explore 3D virtual worlds using a multi-touch, non-stereo, desktop display. The contributions of this dissertation include a feature-extraction algorithm for multi-touch displays (FETOUCH), a multi-touch and gyroscope interaction technique (GyroTouch), a theoretical model for multi-touch interaction using high-level Petri Nets (PeNTa), an algorithm to resolve ambiguities in the multi-touch gesture classification process (Yield), a proposed technique for navigational experiments (FaNS), a proposed gesture (Hold-and-Roll), and an experiment prototype for 3D navigation (3DNav). The verification experiment for 3DNav was conducted with 30 human-subjects of both genders. The experiment used the 3DNav prototype to present a pseudo-universe, where each user was required to find five objects using the multi-touch display and five objects using a game controller (GamePad). For the multi-touch display, 3DNav used a commercial library called GestureWorks in conjunction with Yield to resolve the ambiguity posed by the multiplicity of gestures reported by the initial classification. The experiment compared both devices. The task completion time with multi-touch was slightly shorter, but the difference was not statistically significant. The design of experiment also included an equation that determined the level of video game console expertise of the subjects, which was used to break down users into two groups: casual users and experienced users. The study found that experienced gamers performed significantly faster with the GamePad than casual users. When looking at the groups separately, casual gamers performed significantly better using the multi-touch display, compared to the GamePad. Additional results are found in this dissertation.