Neural representation and clinically relevant moderators of individualised self-criticism in healthy subjects

Many people routinely criticise themselves. While self-criticism is largely unproblematic for most individuals, depressed patients exhibit excessive self-critical thinking, which leads to strong negative affects. We used functional magnetic resonance imaging in healthy subjects (N = 20) to investigate neural correlates and possible psychological moderators of self-critical processing. Stimuli consisted of individually selected adjectives of personally negative content and were contrasted with neutral and negative non-self-referential adjectives. We found that confrontation with self-critical material yielded neural activity in regions involved in emotions (anterior insula/hippocampus-amygdala formation) and in anterior and posterior cortical midline structures, which are associated with self-referential and autobiographical memory processing. Furthermore, contrasts revealed an extended network of bilateral frontal brain areas. We suggest that the co-activation of superior and inferior lateral frontal brain regions reflects the recruitment of a frontal top-down pathway, representing cognitive reappraisal strategies for dealing with evoked negative affects. In addition, activation of right superior frontal areas was positively associated with neuroticism and negatively associated with cognitive reappraisal. Although these findings may not be specific to negative stimuli, they support a role for clinically relevant personality traits in successful regulation of emotion during confrontation with self-critical material.

Tracking the trajectory of shame, guilt, and pride across the life span

The authors examined age differences in shame, guilt, and 2 forms of pride (authentic and hubristic) from age 13 years to age 89 years, using cross-sectional data from 2,611 individuals. Shame decreased from adolescence into middle adulthood, reaching a nadir around age 50 years, and then increased in old age. Guilt increased from adolescence into old age, reaching a plateau at about age 70 years. Authentic pride increased from adolescence into old age, whereas hubristic pride decreased from adolescence into middle adulthood, reaching a minimum around age 65 years, and then increased in old age. On average, women reported experiencing more shame and guilt; Blacks reported experiencing less shame and Asians more hubristic pride than other ethnicities. Across the life span, shame and hubristic pride tended to be negatively related to psychological well-being, and shame-free guilt and authentic pride showed positive relations with well-being. Overall, the findings support the maturity principle of personality development and suggest that as people age they become more prone to experiencing psychologically adaptive self-conscious emotions, such as guilt and authentic pride, and less prone to experiencing psychologically maladaptive ones, such as shame and hubristic pride.

Restoring balance within cognitive unit or deservingness evaluation? The role of attitudes and deservingness in shaping emotional reactions to others’ outcomes

Based on Heider’s theory I persumed that personal attitudes are stronger predictors of emotional responses to others’ outcomes than deservingness evaluation. I manipulated outcome, attitude and deservingness experimentally, and measured specific emotions. It appeared deservingness to play a secondary role in eliciting joy and sorrow when interpersonal attitudes were involved.

Joy, Schadenfreude, Sorrow, and Resentment as Responses Restoring Balance in Cognitive Units

Based on Heider’s (1958) balance theory we hypothesize that emotional responses to other persons’ outcomes depend on attitudes towards these persons. Positive attitudes towards others lead to empathic responses to their outcomes– joy after a success and sorrow after a failure. Negative attitudes result in paradoxical responses – negative to a success (resentment) and positive to a failure (schadenfreude). These emotions function as responses restoring balance within cognitive units consisting of the perceiver, other persons and their outcomes. Three studies supported these hypotheses and showed that deservingness considerations play a weaker role in shaping emotional responses of joy and sorrow to others’ outcomes when strong interpersonal attitudes are involved. However, deservingness plays an independent role in shaping the emotional response of resentment.

Descriptive/Inferential Cognitive Processes and Evaluative Cognitive Processes: Relationships Among Each Other and with Emotional Distress

We aimed to delineate key constructs from two forms of cognitive-behavioral therapy: cognitive therapy and rational-emotive behavior therapy. Furthermore, we aimed to investigate the interrelations among each other and with emotional distress. The key constructs of the underlying theories of these therapies (i.e., descriptive/inferential beliefs, evaluative beliefs) are often treated together as distorted cognitions and included as such in various scales. We used a cross-sectional design. Seventy-four undergraduate students (mean age = 24.68) completed measures of automatic thoughts and emotional distress. Three therapists trained in cognitive-behavioral therapy divided automatic thoughts into descriptive/inferential beliefs and evaluative beliefs by consensus. Correlation and mediation analyses were performed. These constructs showed medium to high associations to each other and to distress. The relationship between descriptive/inferential beliefs and distress was mediated by evaluative beliefs. Descriptive and inferential cognitions may not produce emotions without first being appraised in terms of personal relevance.

Acute mental stress and hemostasis: When physiology becomes vascular harm

Stress-induced activation of the sympathoadrenal medullary system activates both the coagulation and fibrinolysis system resulting in net hypercoagulability. The evolutionary interpretation of this physiology is that stress-hypercoagulability protects a healthy organism from excess bleeding should injury occur in fight-or-flight situations. In turn, acute mental stress, negative emotions and psychological trauma also are triggering factors of atherothrombotic events and possibly of venous thromboembolism. Individuals with pre-existent atherosclerosis and impaired endothelial anticoagulant function are the most vulnerable to experience onset of acute coronary events within two hours of intense emotions. A range of sociodemographic and psychosocial factors (e.g., chronic stress and negative affect) might critically intensify and prolong stress-induced hypercoagulability. In contrast, several pharmacological compounds, dietary flavanoids, and positive affect mitigate the acute prothrombotic stress response. Studies are needed to investigate whether attenuation of stress-hypercoagulability through medications and biobehavioral interventions reduce the risk of thrombotic incidents in at-risk populations.

Predictors for DSM-5 nonsuicidal self-injury in female adolescent inpatients: The role of childhood maltreatment, alexithymia, and dissociation

The purpose of this study was to examine the relationship between various adverse childhood experiences, alexithymia, and dissociation in predicting nonsuicidal self-injury (NSSI) in an inpatient sample of female adolescents. Seventy-two adolescents (aged 14–18 years) with NSSI disorder (n=46) or mental disorders without NSSI (n=26) completed diagnostic interviews and self-report measures to assess NSSI disorder according to the DSM-5 criteria, childhood maltreatment, alexithymia, and dissociation. Alexithymia and dissociation were highly prevalent in both study groups. Multivariate logistic regression analyses indicated that only alexithymia was a significant predictor for NSSI, whereas childhood maltreatment and dissociation had no predictive influence. The association between alexithymia and NSSI emphasizes the significance of emotion regulation training for female adolescents with NSSI. Efforts to reduce NSSI behavior should therefore foster skills to heighten the perception and recognition of one’s own emotions.

Social exclusion and shame in obesity

Weight bias often results in the social exclusion of individuals with obesity. The direct, short-term psychological effects of social exclusion in obesity have not been investigated yet. This study experimentally tests whether social exclusion elicits stronger negative emotions in individuals with obesity compared to normal-weight controls. Specifically, we test whether social exclusion has a specific impact on shame. In total, N = 299 individuals (n = 130 with body mass index [BMI] ≤ 30 and n = 169 with BMI N 30) were randomly assigned to a social exclusion condition or a control condition that was implemented with an online Cyberball paradigm. Before and after, they filled out questionnaires assessing state emotionality. Social exclusion increased negative emotionality in both groups compared to the control condition (p b 0.001) according to a multivariate ANOVA. However, the interaction of group and social exclusion was also significant (p = 0.035) and arose from a significant, specific increase of shame in the group with obesity during social exclusion (p b 0.001, Cohen's d = 0.7). When faced with social exclusion, individuals with obesity do not respond with more intensive negative emotions in general compared to controls, but with a specific increase in shame. As social exclusion is frequent in individuals with obesity, psychological interventions focussing shame-related emotional distress could be crucial.

Emotions, Not Just Decision-Making Processes, Are Critical to an Evolutionary Model of Human Behavior

An evolutionary model of human behavior should privilege emotions: essential, phylogenetically ancient behaviors that learning and decision making only subserve. Infants and non-mammals lack advanced cognitive powers but still survive. Decision making is only a means to emotional ends, which organize and prioritize behavior. The emotion of pride/shame, or dominance striving, bridges the social and biological sciences via internalization of cultural norms.

Gender Difference in Emotional and Behavioral Responses of Being Rendered Invisible

This study examined gender differences in emotional and behavioral responses to an experience of being invisible to others. Invisibility was defined as being ignored, slighted and overlooked by others. Participants recalled their own experience and answered questions about it and their responses on an anonymous web-based survey. Although such experiences could be very unpleasant, people may respond to such negative experiences very differently. It was hypothesized that in a patriarchal society like the United States in which men hold more power than women, that men would show emotion that was more aggressive such as anger, and respond more violently to incidents they were not respected. Women, on the other hand, were expected to be more subservient in their behavior and responses, show submissive emotions such as sadness, and respond less violently when they were not respected.

Lost in Translation: Emotion and Expression through Technology

My Thesis study was designed to bring to topic certain issues involved with CMC (computer-mediated communication.) Often we are presented with confusing or misleading situations when it comes to expressing our emotions through technological means. It is important that we are aware of certain issues such as the use of emoticons, expressing sarcasm, and the ongoing trend of Internet slang. These various aspects can create confusion in CMC, leading to a loss in translation. My survey study was designed to probe deeper into these issues by asking general questions and by analyzing sample CMC scenarios.

Computer Simulation of Crowd Dynamics and Destructive Crowd Behavior

The social processes that lead to destructive behavior in celebratory crowds can be studied through an agent-based computer simulation. Riots are an increasingly common outcome of sports celebrations, and pose the potential for harm to participants, bystanders, property, and the reputation of the groups with whom participants are associated. Rioting cannot necessarily be attributed to the negative emotions of individuals, such as anger, rage, frustration and despair. For instance, the celebratory behavior (e.g., chanting, cheering, singing) during UConn’s “Spring Weekend” and after the 2004 NCAA Championships resulted in several small fires and overturned cars. Further, not every individual in the area of a riot engages in violence, and those who do, do not do so continuously. Instead, small groups carry out the majority of violent acts in relatively short-lived episodes. Agent-based computer simulations are an ideal method for modeling complex group-level social phenomena, such as celebratory gatherings and riots, which emerge from the interaction of relatively “simple” individuals. By making simple assumptions about individuals’ decision-making and behaviors and allowing actors to affect one another, behavioral patterns emerge that cannot be predicted by the characteristics of individuals. The computer simulation developed here models celebratory riot behavior by repeatedly evaluating a single algorithm for each individual, the inputs of which are affected by the characteristics of nearby actors. Specifically, the simulation assumes that (a) actors possess 1 of 5 distinct social identities (group memberships), (b) actors will congregate with actors who possess the same identity, (c) the degree of social cohesion generated in the social context determines the stability of relationships within groups, and (d) actors’ level of aggression is affected by the aggression of other group members. Not only does this simulation provide a systematic investigation of the effects of the initial distribution of aggression, social identification, and cohesiveness on riot outcomes, but also an analytic tool others may use to investigate, visualize and predict how various individual characteristics affect emergent crowd behavior.

Planning for Emotional Labor and Secondary Traumatic Stress in Child Welfare Organizations

This analysis provides an emergent framework that emphasizes a neglected component of both direct practice with families and organizational development. Human emotions, both beneficial (positive emotional labor) and harmful (negative emotional labor), have received short shrift in leadership development, supervision, direct practice preparation and supports, and workforce stabilization, and professionalization. Significantly, a key indicator of negative emotional labor—secondary traumatic stress (STS)—often has been ignored and neglected, despite the fact that it may be endemic in the workforce. STS typically results from traumatic events in practice, but it also stems from workplace violence. Often undetected and untreated, STS is at least a hidden correlate and perhaps a probable cause of myriad problems such as questionable practice with families, life-work conflicts, undesirable workforce turnover, and a sub-optimal organizational climate. Special interventions are needed. At the same time, new organizational designs are needed to promote and reinforce positive emotional labor. Arguably, positive emotional labor and the positive organizational climates it facilitates are requisites for harmonious relations between jobs and personal lives, desirable workforce retention, and better outcomes for children and families. What’s more, specialized interventions for positive emotional labor constitute a key component in the prevention system for STS. A dual design for positive emotional labor and STS (and other negative emotional labor) prevention/intervention is provided herewith. Early detection and rapid response systems for STS, with social work leadership, receive special attention. Guidelines for new organizational designs for emotional labor in child welfare are offered in conclusion.

User-centric need-driven affect modeling for spoken conversational agents: design and evaluation

It is easy to get frustrated at spoken conversational agents (SCAs), perhaps because they seem to be callous. By and large, the quality of human-computer interaction is affected due to the inability of the SCAs to recognise and adapt to user emotional state. Now with the mass appeal of artificially-mediated communication, there has been an increasing need for SCAs to be socially and emotionally intelligent, that is, to infer and adapt to their human interlocutors’ emotions on the fly, in order to ascertain an affective, empathetic and naturalistic interaction. An enhanced quality of interaction would reduce users’ frustrations and consequently increase their satisfactions. These reasons have motivated the development of SCAs towards including socio-emotional elements, turning them into affective and socially-sensitive interfaces. One barrier to the creation of such interfaces has been the lack of methods for modelling emotions in a task-independent environment. Most emotion models for spoken dialog systems are task-dependent and thus cannot be used “as-is” in different applications. This Thesis focuses on improving this, in which it concerns computational modeling of emotion, personality and their interrelationship for task-independent autonomous SCAs. The generation of emotion is driven by needs, inspired by human’s motivational systems. The work in this Thesis is organised in three stages, each one with its own contribution. The first stage involved defining, integrating and quantifying the psychological-based motivational and emotional models sourced from. Later these were transformed into a computational model by implementing them into software entities. The computational model was then incorporated and put to test with an existing SCA host, a HiFi-control agent. The second stage concerned automatic prediction of affect, which has been the main challenge towards the greater aim of infusing social intelligence into the HiFi agent. In recent years, studies on affect detection from voice have moved on to using realistic, non-acted data, which is subtler. However, it is more challenging to perceive subtler emotions and this is demonstrated in tasks such as labelling and machine prediction. In this stage, we attempted to address part of this challenge by considering the roles of user satisfaction ratings and conversational/dialog features as the respective target and predictors in discriminating contentment and frustration, two types of emotions that are known to be prevalent within spoken human-computer interaction. The final stage concerned the evaluation of the emotional model through the HiFi agent. A series of user studies with 70 subjects were conducted in a real-time environment, each in a different phase and with its own conditions. All the studies involved the comparisons between the baseline non-modified and the modified agent. The findings have gone some way towards enhancing our understanding of the utility of emotion in spoken dialog systems in several ways; first, an SCA should not express its emotions blindly, albeit positive. Rather, it should adapt its emotions to user states. Second, low performance in an SCA may be compensated by the exploitation of emotion. Third, the expression of emotion through the exploitation of prosody could better improve users’ perceptions of an SCA compared to exploiting emotions through just lexical contents. Taken together, these findings not only support the success of the emotional model, but also provide substantial evidences with respect to the benefits of adding emotion in an SCA, especially in mitigating users’ frustrations and ultimately improving their satisfactions. Resumen Es relativamente fácil experimentar cierta frustración al interaccionar con agentes conversacionales (Spoken Conversational Agents, SCA), a menudo porque parecen ser un poco insensibles. En general, la calidad de la interacción persona-agente se ve en cierto modo afectada por la incapacidad de los SCAs para identificar y adaptarse al estado emocional de sus usuarios. Actualmente, y debido al creciente atractivo e interés de dichos agentes, surge la necesidad de hacer de los SCAs unos seres cada vez más sociales y emocionalmente inteligentes, es decir, con capacidad para inferir y adaptarse a las emociones de sus interlocutores humanos sobre la marcha, de modo que la interacción resulte más afectiva, empática y, en definitiva, natural. Una interacción mejorada en este sentido permitiría reducir la posible frustración de los usuarios y, en consecuencia, mejorar el nivel de satisfacción alcanzado por los mismos. Estos argumentos justifican y motivan el desarrollo de nuevos SCAs con capacidades socio-emocionales, dotados de interfaces afectivas y socialmente sensibles. Una de las barreras para la creación de tales interfaces ha sido la falta de métodos de modelado de emociones en entornos independientes de tarea. La mayoría de los modelos emocionales empleados por los sistemas de diálogo hablado actuales son dependientes de tarea y, por tanto, no pueden utilizarse "tal cual" en diferentes dominios o aplicaciones. Esta tesis se centra precisamente en la mejora de este aspecto, la definición de modelos computacionales de las emociones, la personalidad y su interrelación para SCAs autónomos e independientes de tarea. Inspirada en los sistemas motivacionales humanos en el ámbito de la psicología, la tesis propone un modelo de generación/producción de la emoción basado en necesidades. El trabajo realizado en la presente tesis está organizado en tres etapas diferenciadas, cada una con su propia contribución. La primera etapa incluyó la definición, integración y cuantificación de los modelos motivacionales de partida y de los modelos emocionales derivados a partir de éstos. Posteriormente, dichos modelos emocionales fueron plasmados en un modelo computacional mediante su implementación software. Este modelo computacional fue incorporado y probado en un SCA anfitrión ya existente, un agente con capacidad para controlar un equipo HiFi, de alta fidelidad. La segunda etapa se orientó hacia el reconocimiento automático de la emoción, aspecto que ha constituido el principal desafío en relación al objetivo mayor de infundir inteligencia social en el agente HiFi. En los últimos años, los estudios sobre reconocimiento de emociones a partir de la voz han pasado de emplear datos actuados a usar datos reales en los que la presencia u observación de emociones se produce de una manera mucho más sutil. El reconocimiento de emociones bajo estas condiciones resulta mucho más complicado y esta dificultad se pone de manifiesto en tareas tales como el etiquetado y el aprendizaje automático. En esta etapa, se abordó el problema del reconocimiento de las emociones del usuario a partir de características o métricas derivadas del propio diálogo usuario-agente. Gracias a dichas métricas, empleadas como predictores o indicadores del grado o nivel de satisfacción alcanzado por el usuario, fue posible discriminar entre satisfacción y frustración, las dos emociones prevalentes durante la interacción usuario-agente. La etapa final corresponde fundamentalmente a la evaluación del modelo emocional por medio del agente Hifi. Con ese propósito se llevó a cabo una serie de estudios con usuarios reales, 70 sujetos, interaccionando con diferentes versiones del agente Hifi en tiempo real, cada uno en una fase diferente y con sus propias características o capacidades emocionales. En particular, todos los estudios realizados han profundizado en la comparación entre una versión de referencia del agente no dotada de ningún comportamiento o característica emocional, y una versión del agente modificada convenientemente con el modelo emocional propuesto. Los resultados obtenidos nos han permitido comprender y valorar mejor la utilidad de las emociones en los sistemas de diálogo hablado. Dicha utilidad depende de varios aspectos. En primer lugar, un SCA no debe expresar sus emociones a ciegas o arbitrariamente, incluso aunque éstas sean positivas. Más bien, debe adaptar sus emociones a los diferentes estados de los usuarios. En segundo lugar, un funcionamiento relativamente pobre por parte de un SCA podría compensarse, en cierto modo, dotando al SCA de comportamiento y capacidades emocionales. En tercer lugar, aprovechar la prosodia como vehículo para expresar las emociones, de manera complementaria al empleo de mensajes con un contenido emocional específico tanto desde el punto de vista léxico como semántico, ayuda a mejorar la percepción por parte de los usuarios de un SCA. Tomados en conjunto, los resultados alcanzados no sólo confirman el éxito del modelo emocional, sino xv que constituyen además una evidencia decisiva con respecto a los beneficios de incorporar emociones en un SCA, especialmente en cuanto a reducir el nivel de frustración de los usuarios y, en última instancia, mejorar su satisfacción.

User Experience in Human-Technology Interaction. Communication, context and evaluation methodology

En esta Tesis se presentan dos líneas de investigación relacionadas y que contribuyen a las áreas de Interacción Hombre-Tecnología (o Máquina; siglas en inglés: HTI o HMI), lingüística computacional y evaluación de la experiencia del usuario. Las dos líneas en cuestión son el diseño y la evaluación centrada en el usuario de sistemas de Interacción Hombre-Máquina avanzados. En la primera parte de la Tesis (Capítulos 2 a 4) se abordan cuestiones fundamentales del diseño de sistemas HMI avanzados. El Capítulo 2 presenta una panorámica del estado del arte de la investigación en el ámbito de los sistemas conversacionales multimodales, con la que se enmarca el trabajo de investigación presentado en el resto de la Tesis. Los Capítulos 3 y 4 se centran en dos grandes aspectos del diseño de sistemas HMI: un gestor del diálogo generalizado para tratar la Interacción Hombre-Máquina multimodal y sensible al contexto, y el uso de agentes animados personificados (ECAs) para mejorar la robustez del diálogo, respectivamente. El Capítulo 3, sobre gestión del diálogo, aborda el tratamiento de la heterogeneidad de la información proveniente de las modalidades comunicativas y de los sensores externos. En este capítulo se propone, en un nivel de abstracción alto, una arquitectura para la gestión del diálogo con influjos heterogéneos de información, apoyándose en el uso de State Chart XML. En el Capítulo 4 se presenta una contribución a la representación interna de intenciones comunicativas, y su traducción a secuencias de gestos a ejecutar por parte de un ECA, diseñados específicamente para mejorar la robustez en situaciones de diálogo críticas que pueden surgir, por ejemplo, cuando se producen errores de entendimiento en la comunicación entre el usuario humano y la máquina. Se propone, en estas páginas, una extensión del Functional Mark-up Language definido en el marco conceptual SAIBA. Esta extensión permite representar actos comunicativos que realizan intenciones del emisor (la máquina) que no se pretende sean captadas conscientemente por el receptor (el usuario humano), pero con las que se pretende influirle a éste e influir el curso del diálogo. Esto se consigue mediante un objeto llamado Base de Intenciones Comunicativas (en inglés, Communication Intention Base, o CIB). La representación en el CIB de intenciones “no claradas” además de las explícitas permite la construcción de actos comunicativos que realizan simultáneamente varias intenciones comunicativas. En el Capítulo 4 también se describe un sistema experimental para el control remoto (simulado) de un asistente domótico, con autenticación de locutor para dar acceso, y con un ECA en el interfaz de cada una de estas tareas. Se incluye una descripción de las secuencias de comportamiento verbal y no verbal de los ECAs, que fueron diseñados específicamente para determinadas situaciones con objeto de mejorar la robustez del diálogo. Los Capítulos 5 a 7 conforman la parte de la Tesis dedicada a la evaluación. El Capítulo 5 repasa antecedentes relevantes en la literatura de tecnologías de la información en general, y de sistemas de interacción hablada en particular. Los principales antecedentes en el ámbito de la evaluación de la interacción sobre los cuales se ha desarrollado el trabajo presentado en esta Tesis son el Technology Acceptance Model (TAM), la herramienta Subjective Assessment of Speech System Interfaces (SASSI), y la Recomendación P.851 de la ITU-T. En el Capítulo 6 se describen un marco y una metodología de evaluación aplicados a la experiencia del usuario con sistemas HMI multimodales. Se desarrolló con este propósito un novedoso marco de evaluación subjetiva de la calidad de la experiencia del usuario y su relación con la aceptación por parte del mismo de la tecnología HMI (el nombre dado en inglés a este marco es Subjective Quality Evaluation Framework). En este marco se articula una estructura de clases de factores subjetivos relacionados con la satisfacción y aceptación por parte del usuario de la tecnología HMI propuesta. Esta estructura, tal y como se propone en la presente tesis, tiene dos dimensiones ortogonales. Primero se identifican tres grandes clases de parámetros relacionados con la aceptación por parte del usuario: “agradabilidad ” (likeability: aquellos que tienen que ver con la experiencia de uso, sin entrar en valoraciones de utilidad), rechazo (los cuales sólo pueden tener una valencia negativa) y percepción de utilidad. En segundo lugar, este conjunto clases se reproduce para distintos “niveles, o focos, percepción del usuario”. Éstos incluyen, como mínimo, un nivel de valoración global del sistema, niveles correspondientes a las tareas a realizar y objetivos a alcanzar, y un nivel de interfaz (en los casos propuestos en esta tesis, el interfaz es un sistema de diálogo con o sin un ECA). En el Capítulo 7 se presenta una evaluación empírica del sistema descrito en el Capítulo 4. El estudio se apoya en los mencionados antecedentes en la literatura, ampliados con parámetros para el estudio específico de los agentes animados (los ECAs), la auto-evaluación de las emociones de los usuarios, así como determinados factores de rechazo (concretamente, la preocupación por la privacidad y la seguridad). También se evalúa el marco de evaluación subjetiva de la calidad propuesto en el capítulo anterior. Los análisis de factores efectuados revelan una estructura de parámetros muy cercana conceptualmente a la división de clases en utilidad-agradabilidad-rechazo propuesta en dicho marco, resultado que da cierta validez empírica al marco. Análisis basados en regresiones lineales revelan estructuras de dependencias e interrelación entre los parámetros subjetivos y objetivos considerados. El efecto central de mediación, descrito en el Technology Acceptance Model, de la utilidad percibida sobre la relación de dependencia entre la intención de uso y la facilidad de uso percibida, se confirma en el estudio presentado en la presente Tesis. Además, se ha encontrado que esta estructura de relaciones se fortalece, en el estudio concreto presentado en estas páginas, si las variables consideradas se generalizan para cubrir más ampliamente las categorías de agradabilidad y utilidad contempladas en el marco de evaluación subjetiva de calidad. Se ha observado, asimismo, que los factores de rechazo aparecen como un componente propio en los análisis de factores, y además se distinguen por su comportamiento: moderan la relación entre la intención de uso (que es el principal indicador de la aceptación del usuario) y su predictor más fuerte, la utilidad percibida. Se presentan también resultados de menor importancia referentes a los efectos de los ECAs sobre los interfaces de los sistemas de diálogo y sobre los parámetros de percepción y las valoraciones de los usuarios que juegan un papel en conformar su aceptación de la tecnología. A pesar de que se observa un rendimiento de la interacción dialogada ligeramente mejor con ECAs, las opiniones subjetivas son muy similares entre los dos grupos experimentales (uno interactuando con un sistema de diálogo con ECA, y el otro sin ECA). Entre las pequeñas diferencias encontradas entre los dos grupos destacan las siguientes: en el grupo experimental sin ECA (es decir, con interfaz sólo de voz) se observó un efecto más directo de los problemas de diálogo (por ejemplo, errores de reconocimiento) sobre la percepción de robustez, mientras que el grupo con ECA tuvo una respuesta emocional más positiva cuando se producían problemas. Los ECAs parecen generar inicialmente expectativas más elevadas en cuanto a las capacidades del sistema, y los usuarios de este grupo se declaran más seguros de sí mismos en su interacción. Por último, se observan algunos indicios de efectos sociales de los ECAs: la “amigabilidad ” percibida los ECAs estaba correlada con un incremento la preocupación por la seguridad. Asimismo, los usuarios del sistema con ECAs tendían más a culparse a sí mismos, en lugar de culpar al sistema, de los problemas de diálogo que pudieran surgir, mientras que se observó una ligera tendencia opuesta en el caso de los usuarios del sistema con interacción sólo de voz. ABSTRACT This Thesis presents two related lines of research work contributing to the general fields of Human-Technology (or Machine) Interaction (HTI, or HMI), computational linguistics, and user experience evaluation. These two lines are the design and user-focused evaluation of advanced Human-Machine (or Technology) Interaction systems. The first part of the Thesis (Chapters 2 to 4) is centred on advanced HMI system design. Chapter 2 provides a background overview of the state of research in multimodal conversational systems. This sets the stage for the research work presented in the rest of the Thesis. Chapers 3 and 4 focus on two major aspects of HMI design in detail: a generalised dialogue manager for context-aware multimodal HMI, and embodied conversational agents (ECAs, or animated agents) to improve dialogue robustness, respectively. Chapter 3, on dialogue management, deals with how to handle information heterogeneity, both from the communication modalities or from external sensors. A highly abstracted architectural contribution based on State Chart XML is proposed. Chapter 4 presents a contribution for the internal representation of communication intentions and their translation into gestural sequences for an ECA, especially designed to improve robustness in critical dialogue situations such as when miscommunication occurs. We propose an extension of the functionality of Functional Mark-up Language, as envisaged in much of the work in the SAIBA framework. Our extension allows the representation of communication acts that carry intentions that are not for the interlocutor to know of, but which are made to influence him or her as well as the flow of the dialogue itself. This is achieved through a design element we have called the Communication Intention Base. Such r pr s ntation of “non- clar ” int ntions allows th construction of communication acts that carry several communication intentions simultaneously. Also in Chapter 4, an experimental system is described which allows (simulated) remote control to a home automation assistant, with biometric (speaker) authentication to grant access, featuring embodied conversation agents for each of the tasks. The discussion includes a description of the behavioural sequences for the ECAs, which were designed for specific dialogue situations with particular attention given to the objective of improving dialogue robustness. Chapters 5 to 7 form the evaluation part of the Thesis. Chapter 5 reviews evaluation approaches in the literature for information technologies, as well as in particular for speech-based interaction systems, that are useful precedents to the contributions of the present Thesis. The main evaluation precedents on which the work in this Thesis has built are the Technology Acceptance Model (TAM), the Subjective Assessment of Speech System Interfaces (SASSI) tool, and ITU-T Recommendation P.851. Chapter 6 presents the author’s work in establishing an valuation framework and methodology applied to the users’ experience with multimodal HMI systems. A novel user-acceptance Subjective Quality Evaluation Framework was developed by the author specifically for this purpose. A class structure arises from two orthogonal sets of dimensions. First we identify three broad classes of parameters related with user acceptance: likeability factors (those that have to do with the experience of using the system), rejection factors (which can only have a negative valence) and perception of usefulness. Secondly, the class structure is further broken down into several “user perception levels”; at the very least: an overall system-assessment level, task and goal-related levels, and an interface level (e.g., a dialogue system with or without an ECA). An empirical evaluation of the system described in Chapter 4 is presented in Chapter 7. The study was based on the abovementioned precedents in the literature, expanded with categories covering the inclusion of an ECA, the users’ s lf-assessed emotions, and particular rejection factors (privacy and security concerns). The Subjective Quality Evaluation Framework proposed in the previous chapter was also scrutinised. Factor analyses revealed an item structure very much related conceptually to the usefulness-likeability-rejection class division introduced above, thus giving it some empirical weight. Regression-based analysis revealed structures of dependencies, paths of interrelations, between the subjective and objective parameters considered. The central mediation effect, in the Technology Acceptance Model, of perceived usefulness on the dependency relationship of intention-to-use with perceived ease of use was confirmed in this study. Furthermore, the pattern of relationships was stronger for variables covering more broadly the likeability and usefulness categories in the Subjective Quality Evaluation Framework. Rejection factors were found to have a distinct presence as components in factor analyses, as well as distinct behaviour: they were found to moderate the relationship between intention-to-use (the main measure of user acceptance) and its strongest predictor, perceived usefulness. Insights of secondary importance are also given regarding the effect of ECAs on the interface of spoken dialogue systems and the dimensions of user perception and judgement attitude that may have a role in determining user acceptance of the technology. Despite observing slightly better performance values in the case of the system with the ECA, subjective opinions regarding both systems were, overall, very similar. Minor differences between two experimental groups (one interacting with an ECA, the other only through speech) include a more direct effect of dialogue problems (e.g., non-understandings) on perceived dialogue robustness for the voice-only interface test group, and a more positive emotional response for the ECA test group. Our findings further suggest that the ECA generates higher initial expectations, and users seem slightly more confident in their interaction with the ECA than do those without it. Finally, mild evidence of social effects of ECAs was also found: the perceived friendliness of the ECA increased security concerns, and ECA users may tend to blame themselves rather than the system when dialogue problems are encountered, while the opposite may be true for voice-only users.