Color-based surface reflectance separation for scene illumination estimation and rendering

Given the importance of color processing in computer vision and computer graphics, estimating and rendering illumination spectral reflectance of image scenes is important to advance the capability of a large class of applications such as scene reconstruction, rendering, surface segmentation, object recognition, and reflectance estimation. Consequently, this dissertation proposes effective methods for reflection components separation and rendering in single scene images. Based on the dichromatic reflectance model, a novel decomposition technique, named the Mean-Shift Decomposition (MSD) method, is introduced to separate the specular from diffuse reflectance components. This technique provides a direct access to surface shape information through diffuse shading pixel isolation. More importantly, this process does not require any local color segmentation process, which differs from the traditional methods that operate by aggregating color information along each image plane. ^ Exploiting the merits of the MSD method, a scene illumination rendering technique is designed to estimate the relative contributing specular reflectance attributes of a scene image. The image feature subset targeted provides a direct access to the surface illumination information, while a newly introduced efficient rendering method reshapes the dynamic range distribution of the specular reflectance components over each image color channel. This image enhancement technique renders the scene illumination reflection effectively without altering the scene’s surface diffuse attributes contributing to realistic rendering effects. ^ As an ancillary contribution, an effective color constancy algorithm based on the dichromatic reflectance model was also developed. This algorithm selects image highlights in order to extract the prominent surface reflectance that reproduces the exact illumination chromaticity. This evaluation is presented using a novel voting scheme technique based on histogram analysis. ^ In each of the three main contributions, empirical evaluations were performed on synthetic and real-world image scenes taken from three different color image datasets. The experimental results show over 90% accuracy in illumination estimation contributing to near real world illumination rendering effects. ^

Thermal imaging as a biometrics approach to facial signature authentication

This dissertation develops an image processing framework with unique feature extraction and similarity measurements for human face recognition in the thermal mid-wave infrared portion of the electromagnetic spectrum. The goals of this research is to design specialized algorithms that would extract facial vasculature information, create a thermal facial signature and identify the individual. The objective is to use such findings in support of a biometrics system for human identification with a high degree of accuracy and a high degree of reliability. This last assertion is due to the minimal to no risk for potential alteration of the intrinsic physiological characteristics seen through thermal infrared imaging. The proposed thermal facial signature recognition is fully integrated and consolidates the main and critical steps of feature extraction, registration, matching through similarity measures, and validation through testing our algorithm on a database, referred to as C-X1, provided by the Computer Vision Research Laboratory at the University of Notre Dame. Feature extraction was accomplished by first registering the infrared images to a reference image using the functional MRI of the Brain’s (FMRIB’s) Linear Image Registration Tool (FLIRT) modified to suit thermal infrared images. This was followed by segmentation of the facial region using an advanced localized contouring algorithm applied on anisotropically diffused thermal images. Thermal feature extraction from facial images was attained by performing morphological operations such as opening and top-hat segmentation to yield thermal signatures for each subject. Four thermal images taken over a period of six months were used to generate thermal signatures and a thermal template for each subject, the thermal template contains only the most prevalent and consistent features. Finally a similarity measure technique was used to match signatures to templates and the Principal Component Analysis (PCA) was used to validate the results of the matching process. Thirteen subjects were used for testing the developed technique on an in-house thermal imaging system. The matching using an Euclidean-based similarity measure showed 88% accuracy in the case of skeletonized signatures and templates, we obtained 90% accuracy for anisotropically diffused signatures and templates. We also employed the Manhattan-based similarity measure and obtained an accuracy of 90.39% for skeletonized and diffused templates and signatures. It was found that an average 18.9% improvement in the similarity measure was obtained when using diffused templates. The Euclidean- and Manhattan-based similarity measure was also applied to skeletonized signatures and templates of 25 subjects in the C-X1 database. The highly accurate results obtained in the matching process along with the generalized design process clearly demonstrate the ability of the thermal infrared system to be used on other thermal imaging based systems and related databases. A novel user-initialization registration of thermal facial images has been successfully implemented. Furthermore, the novel approach at developing a thermal signature template using four images taken at various times ensured that unforeseen changes in the vasculature did not affect the biometric matching process as it relied on consistent thermal features.

Integrity-based kernel malware detection

Kernel-level malware is one of the most dangerous threats to the security of users on the Internet, so there is an urgent need for its detection. The most popular detection approach is misuse-based detection. However, it cannot catch up with today's advanced malware that increasingly apply polymorphism and obfuscation. In this thesis, we present our integrity-based detection for kernel-level malware, which does not rely on the specific features of malware. ^ We have developed an integrity analysis system that can derive and monitor integrity properties for commodity operating systems kernels. In our system, we focus on two classes of integrity properties: data invariants and integrity of Kernel Queue (KQ) requests. ^ We adopt static analysis for data invariant detection and overcome several technical challenges: field-sensitivity, array-sensitivity, and pointer analysis. We identify data invariants that are critical to system runtime integrity from Linux kernel 2.4.32 and Windows Research Kernel (WRK) with very low false positive rate and very low false negative rate. We then develop an Invariant Monitor to guard these data invariants against real-world malware. In our experiment, we are able to use Invariant Monitor to detect ten real-world Linux rootkits and nine real-world Windows malware and one synthetic Windows malware. ^ We leverage static and dynamic analysis of kernel and device drivers to learn the legitimate KQ requests. Based on the learned KQ requests, we build KQguard to protect KQs. At runtime, KQguard rejects all the unknown KQ requests that cannot be validated. We apply KQguard on WRK and Linux kernel, and extensive experimental evaluation shows that KQguard is efficient (up to 5.6% overhead) and effective (capable of achieving zero false positives against representative benign workloads after appropriate training and very low false negatives against 125 real-world malware and nine synthetic attacks). ^ In our system, Invariant Monitor and KQguard cooperate together to protect data invariants and KQs in the target kernel. By monitoring these integrity properties, we can detect malware by its violation of these integrity properties during execution.^

Estrogen and lithium: Facilitating factors involved in brain cell signaling pathways

Learning and memory in adult females decline during menopause and estrogen replacement therapy is commonly prescribed during menopause. Post-menopausal women tend to suffer from depression and are prescribed antidepressants – in addition to hormone therapy. Estrogen replacement therapy is a topic that engenders debate since several studies contradict its efficacy as a palliative therapy for cognitive decline and neurodegenerative diseases. Signaling transduction pathways can alter brain cell activity, survival, and morphology by facilitating transcription factor DNA binding and protein production. The steroidal hormone estrogen and the anti-depressant drug lithium interact through these signaling transduction pathways facilitating transcription factor activation. The paucity of data on how combined hormones and antidepressants interact in regulating gene expression led me to hypothesize that in primary mixed brain cell cultures, combined 17β-estradiol (E2) and lithium chloride (LiCl) (E2/LiCl) will alter genetic expression of markers involved in synaptic plasticity and neuroprotection. Results from these studies indicated that a 48 h treatment of E2/LiCl reduced glutamate receptor subunit genetic expression, but increased neurotrophic factor and estrogen receptor genetic expression. Combined treatment also failed to protect brain cell cultures from glutamate excitotoxicity. If lithium facilitates protein signaling pathways mediated by estrogen, can lithium alone serve as a palliative treatment for post-menopause? This question led me to hypothesize that in estrogen-deficient mice, lithium alone will increase episodic memory (tested via object recognition), and enhance expression in the brain of factors involved in anti-apoptosis, learning and memory. I used bilaterally ovariectomized (bOVX) C57BL/6J mice treated with LiCl for one month. Results indicated that LiCl-treated bOVX mice increased performance in object recognition compared with non-treated bOVX. Increased performance in LiCl-treated bOVX mice coincided with augmented genetic and protein expression in the brain. Understanding the molecular pathways of estrogen will assist in identifying a palliative therapy for menopause-related dementia, and lithium may serve this purpose by acting as a selective estrogen-mediated signaling modulator.

Digital surveillance based on video CODEC System-on-a-Chip (SoC) platforms

Today, most conventional surveillance networks are based on analog system, which has a lot of constraints like manpower and high-bandwidth requirements. It becomes the barrier for today's surveillance network development. This dissertation describes a digital surveillance network architecture based on the H.264 coding/decoding (CODEC) System-on-a-Chip (SoC) platform. The proposed digital surveillance network architecture includes three major layers: software layer, hardware layer, and the network layer. The following outlines the contributions to the proposed digital surveillance network architecture. (1) We implement an object recognition system and an object categorization system on the software layer by applying several Digital Image Processing (DIP) algorithms. (2) For better compression ratio and higher video quality transfer, we implement two new modules on the hardware layer of the H.264 CODEC core, i.e., the background elimination module and the Directional Discrete Cosine Transform (DDCT) module. (3) Furthermore, we introduce a Digital Signal Processor (DSP) sub-system on the main bus of H.264 SoC platforms as the major hardware support system for our software architecture. Thus we combine the software and hardware platforms to be an intelligent surveillance node. Lab results show that the proposed surveillance node can dramatically save the network resources like bandwidth and storage capacity.

ASDN : Automated Software Design Notebook tool

Software Engineering is one of the most widely researched areas of Computer Science. The ability to reuse software, much like reuse of hardware components is one of the key issues in software development. The object-oriented programming methodology is revolutionary in that it promotes software reusability. This thesis describes the development of a tool that helps programmers to design and implement software from within the Smalltalk Environment (an Object- Oriented programming environment). The ASDN tool is part of the PEREAM (Programming Environment for the Reuse and Evolution of Abstract Models) system, which advocates incremental development of software. The Asdn tool along with the PEREAM system seeks to enhance the Smalltalk programming environment by providing facilities for structured development of abstractions (concepts). It produces a document that describes the abstractions that are developed using this tool. The features of the ASDN tool are illustrated by an example.

Estrogen and Lithium: Facilitating Factors Involved in Brain Cell Signaling Pathways

Learning and memory in adult females decline during menopause and estrogen replacement therapy is commonly prescribed during menopause. Post-menopausal women tend to suffer from depression and are prescribed antidepressants – in addition to hormone therapy. Estrogen replacement therapy is a topic that engenders debate since several studies contradict its efficacy as a palliative therapy for cognitive decline and neurodegenerative diseases. Signaling transduction pathways can alter brain cell activity, survival, and morphology by facilitating transcription factor DNA binding and protein production. The steroidal hormone estrogen and the anti-depressant drug lithium interact through these signaling transduction pathways facilitating transcription factor activation. The paucity of data on how combined hormones and antidepressants interact in regulating gene expression led me to hypothesize that in primary mixed brain cell cultures, combined 17beta-estradiol (E2) and lithium chloride (LiCl) (E2/LiCl) will alter genetic expression of markers involved in synaptic plasticity and neuroprotection. Results from these studies indicated that a 48 h treatment of E2/LiCl reduced glutamate receptor subunit genetic expression, but increased neurotrophic factor and estrogen receptor genetic expression. Combined treatment also failed to protect brain cell cultures from glutamate excitotoxicity. If lithium facilitates protein signaling pathways mediated by estrogen, can lithium alone serve as a palliative treatment for post-menopause? This question led me to hypothesize that in estrogen-deficient mice, lithium alone will increase episodic memory (tested via object recognition), and enhance expression in the brain of factors involved in anti-apoptosis, learning and memory. I used bilaterally ovariectomized (bOVX) C57BL/6J mice treated with LiCl for one month. Results indicated that LiCl-treated bOVX mice increased performance in object recognition compared with non-treated bOVX. Increased performance in LiCl-treated bOVX mice coincided with augmented genetic and protein expression in the brain. Understanding the molecular pathways of estrogen will assist in identifying a palliative therapy for menopause-related dementia, and lithium may serve this purpose by acting as a selective estrogen-mediated signaling modulator.