Emotion Recognition in Human-Computer Interaction

The authors are concerned with the development of computer systems that are capable of using information from faces and voices to recognise people's emotions in real-life situations. The paper addresses the nature of the challenges that lie ahead, and provides an assessment of the progress that has been made in the areas of signal processing and analysis techniques (with regard to speech and face), and the psychological and linguistic analyses of emotion. Ongoing developmental work by the authors in each of these areas is described.

Multimodal Biometric Human Recognition for Perceptual Human-Computer Interaction

In this paper, a novel video-based multimodal biometric verification scheme using the subspace-based low-level feature fusion of face and speech is developed for specific speaker recognition for perceptual human--computer interaction (HCI). In the proposed scheme, human face is tracked and face pose is estimated to weight the detected facelike regions in successive frames, where ill-posed faces and false-positive detections are assigned with lower credit to enhance the accuracy. In the audio modality, mel-frequency cepstral coefficients are extracted for voice-based biometric verification. In the fusion step, features from both modalities are projected into nonlinear Laplacian Eigenmap subspace for multimodal speaker recognition and combined at low level. The proposed approach is tested on the video database of ten human subjects, and the results show that the proposed scheme can attain better accuracy in comparison with the conventional multimodal fusion using latent semantic analysis as well as the single-modality verifications. The experiment on MATLAB shows the potential of the proposed scheme to attain the real-time performance for perceptual HCI applications.

The mouse and human IGSF6 (DORA) genes map to the inflammatory bowel disease 1 locus and are embedded in an intron of a gene of unknown function.

We have previously characterized IGSF6 (DORA), a novel member of the immunoglobulin superfamily (IGSF) from human and rat expressed in dendritic and myeloid cells. Using a probe from the open reading frame of the rat cDNA, we isolated a cosmid which contains the entire mouse gene. By comparative analysis and reverse transcriptase polymerase chain reaction, we defined the intron/exon structure and the mRNA of the mouse gene and, with respect to human BAC clones, the human gene. The genes span 10 kb (mouse) and 12 kb (human), with six exons arranged in a manner similar to other members of the IGSF. All intron/exon boundaries follow the GT-AG rule. Expression of the mouse Igsf6 gene is restricted to cells of the immune system, particularly macrophages. Northern blot revealed a single mRNA of 2.5 kb, in contrast to the human gene which is expressed as two mRNAs of 1 and 2.5 kb. The human and mouse genes were localized to a locus associated with inflammatory bowel disease. Analysis of the flanking regions of the Igsf6 gene revealed the presence of an unrelated gene, transcribed from the opposite strand of the DNA and oriented such that the Igsf6 gene is encoded entirely within an intron. An identical organization is seen in human. This gene of unknown function is transcribed and processed, contains homologues in Caenorhabditis elegans and prokaryotes, and is expressed in most organs in the mouse.