Segmentation and Alignment of Speech and Sketching in a Design Environment

Sketches are commonly used in the early stages of design. Our previous system allows users to sketch mechanical systems that the computer interprets. However, some parts of the mechanical system might be too hard or too complicated to express in the sketch. Adding speech recognition to create a multimodal system would move us toward our goal of creating a more natural user interface. This thesis examines the relationship between the verbal and sketch input, particularly how to segment and align the two inputs. Toward this end, subjects were recorded while they sketched and talked. These recordings were transcribed, and a set of rules to perform segmentation and alignment was created. These rules represent the knowledge that the computer needs to perform segmentation and alignment. The rules successfully interpreted the 24 data sets that they were given.

The Unsupervised Acquisition of a Lexicon from Continuous Speech

We present an unsupervised learning algorithm that acquires a natural-language lexicon from raw speech. The algorithm is based on the optimal encoding of symbol sequences in an MDL framework, and uses a hierarchical representation of language that overcomes many of the problems that have stymied previous grammar-induction procedures. The forward mapping from symbol sequences to the speech stream is modeled using features based on articulatory gestures. We present results on the acquisition of lexicons and language models from raw speech, text, and phonetic transcripts, and demonstrate that our algorithm compares very favorably to other reported results with respect to segmentation performance and statistical efficiency.

Visual Speech Synthesis by Morphing Visemes

We present MikeTalk, a text-to-audiovisual speech synthesizer which converts input text into an audiovisual speech stream. MikeTalk is built using visemes, which are a small set of images spanning a large range of mouth shapes. The visemes are acquired from a recorded visual corpus of a human subject which is specifically designed to elicit one instantiation of each viseme. Using optical flow methods, correspondence from every viseme to every other viseme is computed automatically. By morphing along this correspondence, a smooth transition between viseme images may be generated. A complete visual utterance is constructed by concatenating viseme transitions. Finally, phoneme and timing information extracted from a text-to-speech synthesizer is exploited to determine which viseme transitions to use, and the rate at which the morphing process should occur. In this manner, we are able to synchronize the visual speech stream with the audio speech stream, and hence give the impression of a photorealistic talking face.

Perceptual Evaluation of Video-Realistic Speech

abstract With many visual speech animation techniques now available, there is a clear need for systematic perceptual evaluation schemes. We describe here our scheme and its application to a new video-realistic (potentially indistinguishable from real recorded video) visual-speech animation system, called Mary 101. Two types of experiments were performed: a) distinguishing visually between real and synthetic image- sequences of the same utterances, ("Turing tests") and b) gauging visual speech recognition by comparing lip-reading performance of the real and synthetic image-sequences of the same utterances ("Intelligibility tests"). Subjects that were presented randomly with either real or synthetic image-sequences could not tell the synthetic from the real sequences above chance level. The same subjects when asked to lip-read the utterances from the same image-sequences recognized speech from real image-sequences significantly better than from synthetic ones. However, performance for both, real and synthetic, were at levels suggested in the literature on lip-reading. We conclude from the two experiments that the animation of Mary 101 is adequate for providing a percept of a talking head. However, additional effort is required to improve the animation for lip-reading purposes like rehabilitation and language learning. In addition, these two tasks could be considered as explicit and implicit perceptual discrimination tasks. In the explicit task (a), each stimulus is classified directly as a synthetic or real image-sequence by detecting a possible difference between the synthetic and the real image-sequences. The implicit perceptual discrimination task (b) consists of a comparison between visual recognition of speech of real and synthetic image-sequences. Our results suggest that implicit perceptual discrimination is a more sensitive method for discrimination between synthetic and real image-sequences than explicit perceptual discrimination.

Psychometric properties of the Spanish version of the Work Group Emotional Intelligence Profi le-Short version

Resumen tomado de la publicaci??n

Cognitive appraisals, emotional reactions, and their associations with three forms of peer-victimization

Resumen tomado de la publicaci??n

An fMRI Study of Emotional engagement in decicion-making

It has been suggested that decision making depends on sensitive feelings associated with cognitive processing rather than cognitive processing alone. From human lesions, we know the medial anterior inferior-ventral prefrontal cortex processes the sensitivity associated with cognitive processing, it being essentially responsible for decision making. In this fMRI (functional Magnetic Resonance Image) study 15 subjects were analyzed using moral dilemmas as probes to investigate the neural basis for painful-emotional sensitivity associated with decision making. We found that a network comprising the posterior and anterior cingulate and the medial anterior prefrontal cortex was significantly and specifically activated by painful moral dilemmas, but not by non-painful dilemmas. These findings provide new evidence that the cingulate and medial anterior prefrontal are involved in processing painful emotional sensibility, in particular, when decision making takes place. We speculate that decision making has a cognitive component processed by cognitive brain areas and a sensitivity component processed by emotional brain areas. The structures activated suggest that decision making depends on painful emotional feeling processing rather than cognitive processing when painful feeling processing happens

The role of the amygdala in facial emotional expression during a discrimination task. 'El papel de la am??gdala en una tarea de discriminaci??n de expresiones emocionales'

Resumen tomado de la publicaci??n. Resumen tambi??n en ingl??s

Fictional characters' emotional state representation : What is its degree of specificity?

Resumen tomado de la publicaci??n

Emotional stimuli reduce the attentional blink in sub-clinical anxious subjects. 'Los est??mulos emocionales reducen el parpadeo atencional (attentional blink) en sujetos con ansiedad subcl??nica'

Resumen tomado de la publicaci??n

How spatial attention and attentional resources influence the processing of emotional visual scenes

Resumen tomado de la publicaci??n

Embedding Emotional Context in Recommender Systems

Emotions are crucial for user's decision making in recommendation processes. We first introduce ambient recommender systems, which arise from the analysis of new trends on the exploitation of the emotional context in the next generation of recommender systems. We then explain some results of these new trends in real-world applications through the smart prediction assistant (SPA) platform in an intelligent learning guide with more than three million users. While most approaches to recommending have focused on algorithm performance. SPA makes recommendations to users on the basis of emotional information acquired in an incremental way. This article provides a cross-disciplinary perspective to achieve this goal in such recommender systems through a SPA platform. The methodology applied in SPA is the result of a bunch of technology transfer projects for large real-world rccommender systems

Emotional processing- Information sheet

Information sheet for mature students participating in the Emotional processing study. Please read before you attend the data collection session you have scheduled. Many thanks.

Emotional characteristics of psychology students: a study based on the formative research perspective

In the formative research scheme, the author built a psychological scale, with the purpose of analyzing psychological characteristics of the School of Psychology students. The instrument showed a high reliability coefficient (α=0,86), the exploratory factorial analysis found five variables which allowed to predict some aspects of sex and career level through a logistic regression; the ALSCAL showed two emotional dimensions. The author recommends to improve the instrument and to continue its application in the School. It is also necessary to develop qualitative research to acquire new data about the topic of the research.