Multimodal Biometric Human Recognition for Perceptual Human-Computer Interaction

In this paper, a novel video-based multimodal biometric verification scheme using the subspace-based low-level feature fusion of face and speech is developed for specific speaker recognition for perceptual human--computer interaction (HCI). In the proposed scheme, human face is tracked and face pose is estimated to weight the detected facelike regions in successive frames, where ill-posed faces and false-positive detections are assigned with lower credit to enhance the accuracy. In the audio modality, mel-frequency cepstral coefficients are extracted for voice-based biometric verification. In the fusion step, features from both modalities are projected into nonlinear Laplacian Eigenmap subspace for multimodal speaker recognition and combined at low level. The proposed approach is tested on the video database of ten human subjects, and the results show that the proposed scheme can attain better accuracy in comparison with the conventional multimodal fusion using latent semantic analysis as well as the single-modality verifications. The experiment on MATLAB shows the potential of the proposed scheme to attain the real-time performance for perceptual HCI applications.

Conceptual and Perceptual Priming and Dissociation in Chronic Posttraumatic Stress Disorder.

Cognitive models of posttraumatic stress disorder (PTSD) assert that memory processes play a significant role in PTSD (see e.g., Ehlers & Clark, 2000). Intrusive reexperiencing in PTSD has been linked to perceptual processing of trauma-related material with a corresponding hypothesized lack of conceptual processing. In an experimental study that included clinical participants with and without PTSD (N = 50), perceptual priming and conceptual priming for trauma-related, general threat, and neutral words were investigated in a population with chronic trauma-induced complaints as a result of the Troubles in Northern Ireland. The study used a new version of the word-stem completion task (Michael, Ehlers, & Halligan, 2005) and a word-cue association task. It also assessed the role of dissociation in threat processing. Further evidence of enhanced perceptual priming in PTSD for trauma stimuli was found, along with evidence of lack of conceptual priming for such stimuli. Furthermore, this pattern of priming for trauma-related words was associated with PTSD severity, and state dissociation and PTSD group made significant contributions to predicting perceptual priming for trauma words. The findings shed light on the importance of state dissociation in trauma-related information processing and posttraumatic symptoms.

PicSOr - An objective test of perceptual skill that predicts laparoscopic technical skill in three initial studies of laparoscopic performance

Background: Laparoscopic surgery requires surgeons to infer the shape of 3-D structures, such as the internal organs of patients, from 2-D displays on a video monitor. Recent evidence indicates that the issue is not resolved by the use of contemporary 3-D camera systems. It is therefore crucial to find ways of measuring differences in aptitude for recovering 3-D structure from 2-D images, and assessing its impact on performance. Our aim was to test empirically for a relationship between laparoscopic ability and the perceptual skill of recovering information about 3-D structures from 2-D monitor displays.

Perceptual investigation of image placement with Ambisonics for non-centred listeners

Ambisonics is a scalable spatial audio technique that attempts to present a sound scene to listeners over as large an area as possi- ble. A localisation experiment was carried out to investigate the performance of a first and third order system at three listening positions - one in the centre and two off-centre. The test used a reverse target-pointer adjustment method to determine the error, both signed and absolute, for each combination of listening posi- tion and system. The signed error was used to indicate the direc- tion and magnitude of the shifts in panning angle introduced for the off-centre listening positions. The absolute error was used as a measure of the performance of the listening position and systems combinations for a comparison of their overall performance. A comparison was made between the degree of image shifting be- tween the two systems and the robustness of their off-centre per- formance.

The detection of repetitions in noise before and after perceptual learning.

In noise repetition-detection tasks, listeners have to distinguish trials of continuously running noise from trials in which noise tokens are repeated in a cyclic manner. Recently, it has been shown that using the exact same noise token across several trials (“reference noise”) facilitates the detection of repetitions for this token [Agus et al. (2010). Neuron 66, 610–618]. This was attributed to perceptual learning. Here, the nature of the learning was investigated. In experiment 1, reference noise tokens were embedded in trials with or without cyclic presentation. Naïve listeners reported repetitions in both cases, thus responding to the reference noise even in the absence of an actual repetition. Experiment 2, with the same listeners, showed a similar pattern of results even after the design of the experiment was made explicit, ruling out a misunderstanding of the task. Finally, in experiment 3, listeners reported repetitions in trials containing the reference noise, even before ever hearing it presented cyclically. The results show that listeners were able to learn and recognize noise tokens in the absence of an immediate repetition. Moreover, the learning mandatorily interfered with listeners' ability to detect repetitions. It is concluded that salient perceptual changes accompany the learning of noise.