On-line Emotion Recognition in a 3-D Activation-Valence-Time Continuum using Acoustic and Linguistic Cues

For many applications of emotion recognition, such as virtual agents, the system must select responses while the user is speaking. This requires reliable on-line recognition of the user’s affect. However most emotion recognition systems are based on turnwise processing. We present a novel approach to on-line emotion recognition from speech using Long Short-Term Memory Recurrent Neural Networks. Emotion is recognised frame-wise in a two-dimensional valence-activation continuum. In contrast to current state-of-the-art approaches, recognition is performed on low-level signal frames, similar to those used for speech recognition. No statistical functionals are applied to low-level feature contours. Framing at a higher level is therefore unnecessary and regression outputs can be produced in real-time for every low-level input frame. We also investigate the benefits of including linguistic features on the signal frame level obtained by a keyword spotter.

Preconception counselling for women with diabetes: An online resource

Pre-pregnancy care impacts positively on pregnancy outcome, yet the majority of women continue to receive suboptimal support in this area owing to a lack of awareness about the importance of pregnancy planning. An innovative preconception counselling resource has been developed in Northern Ireland (originally as a DVD and later in an online format), in collaboration with end users to raise awareness of planning for pregnancy. This educational resource is now embedded in routine care in the region as a preconception counselling tool, being adopted by all diabetes care teams and many GP practices. It also recently received national recognition, winning the “Best improvement programme for pregnancy and maternity” category at the 2013 Quality in Care Diabetes awards. This article presents the background to the resource’s development, as well as experiences from its production and roll-out.

3D Morphable Model Construction for Robust Ear and Face Recognition

Recent work suggests that the human ear varies significantly between different subjects and can be used for identification. In principle, therefore, using ears in addition to the face within a recognition system could improve accuracy and robustness, particularly for non-frontal views. The paper describes work that investigates this hypothesis using an approach based on the construction of a 3D morphable model of the head and ear. One issue with creating a model that includes the ear is that existing training datasets contain noise and partial occlusion. Rather than exclude these regions manually, a classifier has been developed which automates this process. When combined with a robust registration algorithm the resulting system enables full head morphable models to be constructed efficiently using less constrained datasets. The algorithm has been evaluated using registration consistency, model coverage and minimalism metrics, which together demonstrate the accuracy of the approach. To make it easier to build on this work, the source code has been made available online.