Achieving robust face recognition from video by combining a weak photometric model and a learnt generic face invariant

In spite of over two decades of intense research, illumination and pose invariance remain prohibitively challenging aspects of face recognition for most practical applications. The objective of this work is to recognize faces using video sequences both for training and recognition input, in a realistic, unconstrained setup in which lighting, pose and user motion pattern have a wide variability and face images are of low resolution. The central contribution is an illumination invariant, which we show to be suitable for recognition from video of loosely constrained head motion. In particular there are three contributions: (i) we show how a photometric model of image formation can be combined with a statistical model of generic face appearance variation to exploit the proposed invariant and generalize in the presence of extreme illumination changes; (ii) we introduce a video sequence re-illumination algorithm to achieve fine alignment of two video sequences; and (iii) we use the smoothness of geodesically local appearance manifold structure and a robust same-identity likelihood to achieve robustness to unseen head poses. We describe a fully automatic recognition system based on the proposed method and an extensive evaluation on 323 individuals and 1474 video sequences with extreme illumination, pose and head motion variation. Our system consistently achieved a nearly perfect recognition rate (over 99.7% on all four databases). © 2012 Elsevier Ltd All rights reserved.

Scale-invariant vote-based 3D recognition and registration from point clouds

This chapter presents a method for vote-based 3D shape recognition and registration, in particular using mean shift on 3D pose votes in the space of direct similarity transformations for the first time. We introduce a new distance between poses in this spacethe SRT distance. It is left-invariant, unlike Euclidean distance, and has a unique, closed-form mean, in contrast to Riemannian distance, so is fast to compute. We demonstrate improved performance over the state of the art in both recognition and registration on a (real and) challenging dataset, by comparing our distance with others in a mean shift framework, as well as with the commonly used Hough voting approach. © 2013 Springer-Verlag Berlin Heidelberg.

Syllable language models for Mandarin speech recognition: exploiting character language models.

Mandarin Chinese is based on characters which are syllabic in nature and morphological in meaning. All spoken languages have syllabiotactic rules which govern the construction of syllables and their allowed sequences. These constraints are not as restrictive as those learned from word sequences, but they can provide additional useful linguistic information. Hence, it is possible to improve speech recognition performance by appropriately combining these two types of constraints. For the Chinese language considered in this paper, character level language models (LMs) can be used as a first level approximation to allowed syllable sequences. To test this idea, word and character level n-gram LMs were trained on 2.8 billion words (equivalent to 4.3 billion characters) of texts from a wide collection of text sources. Both hypothesis and model based combination techniques were investigated to combine word and character level LMs. Significant character error rate reductions up to 7.3% relative were obtained on a state-of-the-art Mandarin Chinese broadcast audio recognition task using an adapted history dependent multi-level LM that performs a log-linearly combination of character and word level LMs. This supports the hypothesis that character or syllable sequence models are useful for improving Mandarin speech recognition performance.

User target intention recognition from cursor position using kalman filter

This paper discusses user target intention recognition algorithms for pointing - clicking tasks to reduce users' pointing time and difficulty. Predicting targets by comparing the bearing angles to targets proposed as one of the first algorithms [1] is compared with a Kalman Filter prediction algorithm. Accuracy and sensitivity of prediction are used as performance criteria. The outcomes of a standard point and click experiment are used for performance comparison, collected from both able-bodied and impaired users. © 2013 Springer-Verlag Berlin Heidelberg.

Multi scale shape index for 3D object recognition

We present Multi Scale Shape Index (MSSI), a novel feature for 3D object recognition. Inspired by the scale space filtering theory and Shape Index measure proposed by Koenderink & Van Doorn [6], this feature associates different forms of shape, such as umbilics, saddle regions, parabolic regions to a real valued index. This association is useful for representing an object based on its constituent shape forms. We derive closed form scale space equations which computes a characteristic scale at each 3D point in a point cloud without an explicit mesh structure. This characteristic scale is then used to estimate the Shape Index. We quantitatively evaluate the robustness and repeatability of the MSSI feature for varying object scales and changing point cloud density. We also quantify the performance of MSSI for object category recognition on a publicly available dataset. © 2013 Springer-Verlag.

Kernelized log linear models for continuous speech recognition

Large margin criteria and discriminative models are two effective improvements for HMM-based speech recognition. This paper proposed a large margin trained log linear model with kernels for CSR. To avoid explicitly computing in the high dimensional feature space and to achieve the nonlinear decision boundaries, a kernel based training and decoding framework is proposed in this work. To make the system robust to noise a kernel adaptation scheme is also presented. Previous work in this area is extended in two directions. First, most kernels for CSR focus on measuring the similarity between two observation sequences. The proposed joint kernels defined a similarity between two observation-label sequence pairs on the sentence level. Second, this paper addresses how to efficiently employ kernels in large margin training and decoding with lattices. To the best of our knowledge, this is the first attempt at using large margin kernel-based log linear models for CSR. The model is evaluated on a noise corrupted continuous digit task: AURORA 2.0. © 2013 IEEE.

Zebrafish peptidoglycan recognition protein SC (zfPGRP-SC) mediates multiple intracellular signaling pathways

Insect PGRPs can function as bacterial recognition molecules triggering proteolytic and/or signal transduction pathways, with the resultant production of antimicrobial peptides. To explore if zebrafish peptidoglycan recognition protein SC (zfPGRP-SC) has such effects, RNA interference (siRNA) and high-density oligonucleotide microarray analysis were used to identify differentially expressed genes regulated by zfPGRP-SC. The mRNA levels for a set of genes involved in Toll-like receptor signaling pathway, such as TLRs, SARM, MyD88, TRAF6 and nuclear factor (NF)-kappa B2 (p100/p52), were examined by quantitative RT-PCR (QT-PCR). The results from the arrays and QT-PCR showed that the expression of 133 genes was involved in signal transduction pathways, which included Toll-like receptor signaling, Wnt signaling, BMP signaling, insulin receptor signaling, TGF-beta signaling, GPCR signaling, small GTPase signaling, second-messenger-mediated signaling, MAPK signaling, JAK/STAT signaling, apoptosis and anti-apoptosis signaling and other signaling cascades. These signaling pathways may connect with each other to form a complex network to regulate not just immune responses but also other processes such as development and apoptosis. When transiently over-expressed in HEK293T cells, zfPGRP-SC inhibited NF-kappa B activity with and without lipopolysacharide (LPS) stimulation. (C) 2008 Elsevier Ltd. All rights reserved.

RNAi suppression of zebrafish peptidoglycan recognition protein 6 (zfPGRP6) mediated differentially expressed genes involved in Toll-like receptor signaling pathway and caused increased susceptibility to Flavobacterium columnare

In Drosophila, Toll signaling cascade, which resembles the mammalian Toll-like receptor (TLR)/IL-1R signaling pathways and regulates the expression of anti-microbial peptide genes, mainly relies on peptidoglycan recognition proteins (PGRPs) for the detection of bacterial pathogens. To explore the effect of zebrafish peptidoglycan recognition protein 6 (zfPGRP6) on Toll-like receptor signaling pathway, RNA interference (siRNA) and real time quantitative PCR (RQ-PCR) methods were used to identify differentially expressed genes regulated by zfPGRP6. The target genes included TLR2, TLR3, TLR5, TLR7, TLR8, IL1R, Sterile-alpha and Armadillo motif containing protein (SARM), myeloid differentiation factor 88 (MyD88) and nuclear factor (NF)-kappa B2 (p100/p52). The results of RQ-PCR showed that RNAi-mediated Suppression of zfPGRP6 significantly down-regulated the expression of TLR2, TLR5, IL1R, SARM, MyD88 and p100/p52. The expression of beta-defensin-1 was also down-regulated in those embryos silenced by zfPGRP6. In challenge experiments to determine the anti-bacterial response to Gram-negative bacteria, RNAi knock-down of zfPGRP6 markedly increased susceptibility to Flavobacterium columnare. (C) 2008 Elsevier B.V. All rights reserved.

Short and long peptidoglycan recognition proteins (PGRPs) in zebrafish, with findings of multiple PGRP homologs in teleost fish

Peptidoglycan recognition protein (PGRP) specifically binds to peptidoglycan and is considered to be one of the pattern recognition proteins in the innate immunity of insect and mammals. Using a database mining approach and RT-PCR, multiple peptidoglycan recognition protein (PGRP) like genes have been discovered in fish including zebrafish Danio rerio, Japanese pufferfish TakiFugu rubripes and spotted green pufferfish Tetraodon nigroviridis. They share the common features of those PGRPs in arthropod and mammals, by containing a conserved PGRP domain. Based on the predicted structures, the identified zebrafish PGRP homologs resemble short and long PGRP members in arthropod and mammals. The identified PGRP genes in T. nigroviridis and TakiFugu rubripes resemble the long PGRPs, and the short PGRP genes have not been found in T. nigroviridis and TakiFugu rubripes databases. Computer modelling of these molecules revealed the presence of three alpha-helices and five or six beta-strands in all fish PGRPs reported in the present study. The long PGRP in teleost fish have multiple alternatively spliced forms, and some of the identified spliced variants, e.g., tnPGRP-L3 and tnPGRP-L4 (in: Tetraodon nigroviridis), exhibited no characters present in the PGRP homologs domain. The coding regions of zfPGRP6 (zf: zebrafish), zfPGRP2-A, zfPGRP2-B and zfPGRP-L contain five exons and four introns; however, the other PGRP-like genes including zfPGRPSC1a, zfPGRPSC2, tnPGRP-L1-, tnPGRP-L2 and frPGRP-L (fr: Takifugu rubripes) contain four exons and three introns. In zebrafish, long and short PGRP genes identified are located in different chromosomes, and an unknown locus containing another long PGRP-like gene has also been found in zebrafish, demonstrating that multiple PGRP loci may be present in fish. In zebrafish, the constitutive expressions of zfPGRP-L, zfPGRP-6 and zfPGRP-SC during ontogeny from unfertilized eggs to larvae, in different organs of adult, and the inductive expression following stimulation by Flavobacterium columnare, were detected by real-time PCR, but the levels and patterns varied for different PGRP genes, implying that different short and long PGRPs may play different roles in innate immune response. (c) 2007 Elsevier Ltd. All rights reserved.

Robust recognition of chess-boards under deformation

Current methods for formation of detected chess-board vertices into a grid structure tend to be weak in situations with a warped grid, and false and missing vertex-features. In this paper we present a highly robust, yet efficient, scheme suitable for inference of regular 2D square mesh structure from vertices recorded both during projection of a chess-board pattern onto 3D objects, and in the more simple case of camera calibration. Examples of the method's performance in a lung function measuring application, observing chess-boards projected on to patients' chests, are given. The method presented is resilient to significant surface deformation, and tolerates inexact vertex-feature detection. This robustness results from the scheme's novel exploitation of feature orientation information. © 2013 IEEE.