Semantic-based middleware solutions to support context-aware service provisioning in pervasive environments

The dynamicity and heterogeneity that characterize pervasive environments raise new challenges in the design of mobile middleware. Pervasive environments are characterized by a significant degree of heterogeneity, variability, and dynamicity that conventional middleware solutions are not able to adequately manage. Originally designed for use in a relatively static context, such middleware systems tend to hide low-level details to provide applications with a transparent view on the underlying execution platform. In mobile environments, however, the context is extremely dynamic and cannot be managed by a priori assumptions. Novel middleware should therefore support mobile computing applications in the task of adapting their behavior to frequent changes in the execution context, that is, it should become context-aware. In particular, this thesis has identified the following key requirements for novel context-aware middleware that existing solutions do not fulfil yet. (i) Middleware solutions should support interoperability between possibly unknown entities by providing expressive representation models that allow to describe interacting entities, their operating conditions and the surrounding world, i.e., their context, according to an unambiguous semantics. (ii) Middleware solutions should support distributed applications in the task of reconfiguring and adapting their behavior/results to ongoing context changes. (iii) Context-aware middleware support should be deployed on heterogeneous devices under variable operating conditions, such as different user needs, application requirements, available connectivity and device computational capabilities, as well as changing environmental conditions. Our main claim is that the adoption of semantic metadata to represent context information and context-dependent adaptation strategies allows to build context-aware middleware suitable for all dynamically available portable devices. Semantic metadata provide powerful knowledge representation means to model even complex context information, and allow to perform automated reasoning to infer additional and/or more complex knowledge from available context data. In addition, we suggest that, by adopting proper configuration and deployment strategies, semantic support features can be provided to differentiated users and devices according to their specific needs and current context. This thesis has investigated novel design guidelines and implementation options for semantic-based context-aware middleware solutions targeted to pervasive environments. These guidelines have been applied to different application areas within pervasive computing that would particularly benefit from the exploitation of context. Common to all applications is the key role of context in enabling mobile users to personalize applications based on their needs and current situation. The main contributions of this thesis are (i) the definition of a metadata model to represent and reason about context, (ii) the definition of a model for the design and development of context-aware middleware based on semantic metadata, (iii) the design of three novel middleware architectures and the development of a prototypal implementation for each of these architectures, and (iv) the proposal of a viable approach to portability issues raised by the adoption of semantic support services in pervasive applications.

The impact of intraclonal heterogeneity on the outcomes of Multiple Myeloma patients treated with new drugs

Understanding the biology of Multiple Myeloma (MM) is of primary importance in the struggle to achieve a cure for this yet incurable neoplasm. A better knowledge of the mechanism underlying the development of MM can guide us in the development of new treatment strategies. Studies both on solid and haematological tumours have shown that cancer comprises a collection of related but subtly different clones, a feature that has been termed “intra-clonal heterogeneity”. This intra-clonal heterogeneity is likely, from a “Darwinian” natural selection perspective, to be the essential substrate for cancer evolution, disease progression and relapse. In this context the critical mechanism for tumour progression is competition between individual clones (and cancer stem cells) for the same microenvironmental “niche”, combined with the process of adaptation and natural selection. The Darwinian behavioural characteristics of cancer stem cells are applicable to MM. The knowledge that intra-clonal heterogeneity is an important feature of tumours’ biology has changed our way to addressing cancer, now considered as a composite mixture of clones and not as a linear evolving disease. In this variable therapeutic landscape it is important for clinicians and researchers to consider the impact that evolutionary biology and intra-clonal heterogeneity have on the treatment of myeloma and the emergence of treatment resistance. It is clear that if we want to effectively cure myeloma it is of primarily importance to understand disease biology and evolution. Only by doing so will we be able to effectively use all of the new tools we have at our disposal to cure myeloma and to use treatment in the most effective way possible. The aim of the present research project was to investigate at different levels the presence of intra-clonal heterogeneity in MM patients, and to evaluate the impact of treatment on clonal evolution and on patients’ outcomes.

Effect of Methodological and Ecological Approaches on Heterogeneity of Nest-Site Selection of a Long-Lived Vulture

The application of scientific-based conservation measures requires that sampling methodologies in studies modelling similar ecological aspects produce comparable results making easier their interpretation. We aimed to show how the choice of different methodological and ecological approaches can affect conclusions in nest-site selection studies along different Palearctic meta-populations of an indicator species. First, a multivariate analysis of the variables affecting nest-site selection in a breeding colony of cinereous vulture (Aegypius monachus) in central Spain was performed. Then, a meta-analysis was applied to establish how methodological and habitat-type factors determine differences and similarities in the results obtained by previous studies that have modelled the forest breeding habitat of the species. Our results revealed patterns in nesting-habitat modelling by the cinereous vulture throughout its whole range: steep and south-facing slopes, great cover of large trees and distance to human activities were generally selected. The ratio and situation of the studied plots (nests/random), the use of plots vs. polygons as sampling units and the number of years of data set determined the variability explained by the model. Moreover, a greater size of the breeding colony implied that ecological and geomorphological variables at landscape level were more influential. Additionally, human activities affected in greater proportion to colonies situated in Mediterranean forests. For the first time, a meta-analysis regarding the factors determining nest-site selection heterogeneity for a single species at broad scale was achieved. It is essential to homogenize and coordinate experimental design in modelling the selection of species' ecological requirements in order to avoid that differences in results among studies would be due to methodological heterogeneity. This would optimize best conservation and management practices for habitats and species in a global context.

Spatial heterogeneity of soil nutrients and plant species in herb-dominated communities of contrasting land use

Recent interest in spatial pattern in terrestrial ecosystems has come from an awareness of theintimate relationship between spatial heterogeneity of soil resources and maintenance of plant species diversity. Soil and vegetation can vary spatially inresponse to several state factors of the system. In this study, we examined fine-scale spatial variability of soil nutrients and vascular plant species in contrasting herb-dominated communities (a pasture and an oldfield) to determine degree of spatial dependenceamong soil variables and plant community characteristics within these communities by sampling at 1-m intervals. Each site was divided into 25 1-m 2 plots. Mineral soil was sampled (2-cm diameter, 5-cm depth) from each of four 0.25-m2 quarters and combined into a single composite sample per plot. Soil organic matter was measured as loss-on-ignition. Extractable NH4 and NO3 were determined before and after laboratory incubation to determine potential net N mineralization and nitrification. Cations were analyzed using inductively coupled plasma emission spectrometry. Vegetation was assessed using estimated percent cover. Most soiland plant variables exhibited sharp contrasts betweenpasture and old-field sites, with the old field having significantly higher net N mineralization/nitrification, pH, Ca, Mg, Al, plant cover, and species diversity, richness, and evenness. Multiple regressions revealedthat all plant variables (species diversity, richness,evenness, and cover) were significantly related to soil characteristics (available nitrogen, organic matter,moisture, pH, Ca, and Mg) in the pasture; in the old field only cover was significantly related to soil characteristics (organic matter and moisture). Both sites contrasted sharply with respect to spatial pattern of soil variables, with the old field exhibiting a higher degree of spatial dependence. These results demonstrate that land-use practices can exert profound influence on spatial heterogeneity of both soil properties and vegetation in herb-dominated communities.

Designed Extension of Survival Studies: Application to Clinical Trials with Unrecognized Heterogeneity

It is well known that unrecognized heterogeneity among patients, such as is conferred by genetic subtype, can undermine the power of randomized trial, designed under the assumption of homogeneity, to detect a truly beneficial treatment. We consider the conditional power approach to allow for recovery of power under unexplained heterogeneity. While Proschan and Hunsberger (1995) confined the application of conditional power design to normally distributed observations, we consider more general and difficult settings in which the data are in the framework of continuous time and are subject to censoring. In particular, we derive a procedure appropriate for the analysis of the weighted log rank test under the assumption of a proportional hazards frailty model. The proposed method is illustrated through application to a brain tumor trial.

INVESTIGATING THE IMPACTS OF STREAMBED HABITAT HETEROGENEITY ON ECOSYSTEM STRUCTURE AND PROCESSES USING BASIC AND APPLIED PERSPECTIVES

Stream restoration often focuses on increasing habitat heterogeneity to reverse ecosystem degradation. However, the connection between heterogeneity and ecosystem structure and processes is poorly understood. We looked to investigate this interaction from both applied and basic science perspectives. For the applied study, we examined two culvert replacements designed to mimic natural stream channels, to see if they were better at maintaining ecosystem processes within as well as upstream and downstream of culverts compared to non-replaced culverts. We measured three ecosystem processes (nutrient uptake, hydrologic characteristics, and coarse particulate organic matter retention) and found that stream simulation culvert restoration improved organic matter retention within culverts, and that there were no differences in processes measured upstream and downstream of both restoration designs. Our results suggest that measurements of ecosystem processes are more likely to show a response to restoration if they match the scale of the restoration activity. For the basic science study, we quantified the longitudinal spatial heterogeneity of physical and biofilm characteristics at microhabitat to segment scales on streams with different streambed variability. We found that all physical characteristics and biofilm characteristics were spatially independent at the macro-habitat scale and greater. Together, these studies demonstrate the importance of scale in ecological interactions and the value of incorporating considerations of scale into restoration activities.

Genetically determined heterogeneity of lung disease in a mouse model of airway mucus obstruction

Mucus clearance is an important airway innate defense mechanism. Airway-targeted overexpression of the epithelial Na(+) channel β-subunit [encoded by sodium channel nonvoltage gated 1, beta subunit (Scnn1b)] in mice [Scnn1b-transgenic (Tg) mice] increases transepithelial Na(+) absorption and dehydrates the airway surface, which produces key features of human obstructive lung diseases, including mucus obstruction, inflammation, and air-space enlargement. Because the first Scnn1b-Tg mice were generated on a mixed background, the impact of genetic background on disease phenotype in Scnn1b-Tg mice is unknown. To explore this issue, congenic Scnn1b-Tg mice strains were generated on C57BL/6N, C3H/HeN, BALB/cJ, and FVB/NJ backgrounds. All strains exhibited a two- to threefold increase in tracheal epithelial Na(+) absorption, and all developed airway mucus obstruction, inflammation, and air-space enlargement. However, there were striking differences in neonatal survival, ranging from 5 to 80% (FVB/NJcontext and timing of airway innate immune dysfunction critically determines lung disease phenotype. These mouse strains may be useful to identify key modifier genes and pathways.

THE ROLE OF MAP KINASES ON THE FUNCTIONAL HETEROGENEITY OF HUMAN CD8+ T CELL MATURATION SUBSETS

While prior studies have focused on naïve (CD45RA+CD27+) and early stage memory (CD45RA-CD27+) CD8+ T cells, late memory CD8+ T cells (CD45RA+CD27) have received less interest because this subset of T cells is generally recognized as effectors, which produce IFNγ (but no IL-2) and perforin. However, multiple studies suggest that late memory CD8+ T cells may provide inadequate protection in infectious diseases and cancer models. To better understand the unique function of late memory CD8+ T cells, I optimized multi-color flow cytometry techniques to assess the cytokine production of each human CD8+ T cell maturation subset. I demonstrated that late memory CD8+ T cells are the predominant producer of CC chemokines (e.g. MIP-1β), but rarely produce IL-2; therefore they do not co-produce IL-2/IFNγ (polyfunctionality), which has been shown to be critical for protective immunity against chronic viral infection. These data suggest that late memory CD8+ T cells are not just cytotoxic effectors, but may have unique functional properties. Determining the molecular signature of each CD8+ T cell maturation subset will help characterize the role of late memory CD8+ T cells. Prior studies suggest that ERK1 and ERK2 play a role in cytokine production including IL-2 in T cells. Therefore, I tested whether differential expression of ERK1 and ERK2 in CD8+ T cell maturation subsets contributes to their functional signature by a novel flow cytometry technique. I found that the expression of total ERK1, but not ERK2, is significantly diminished in late memory CD8+ T cells and that ERK1 expression is strongly associated with IL-2 production and CD28 expression. I also found that IL-2 production is increased in late memory CD8+ T cells by over-expressing ERK1. Collectively, these data suggest that ERK1 is required for IL-2 production in human CD8+ T cells. In summary, this dissertation demonstrated that ERK1 is down-regulated in human late memory CD8+ T cells, leading to decreased production of IL-2. The data in this dissertation also suggested that the functional heterogeneity in human CD8+ T cell maturation subsets results from their differential ERK1 expression.

Ethical Consumption and Social Context: Experimental Evidence from Germany and the United States

This research examines the role of social context in ethical consumption, specifically, the extent to which anonymity and social control influence individuals' decisions to purchase organic and Fair Trade coffee. Our research design overcomes biases of prior research by combining framing and discrete choice experiments in a survey. We systematically vary coffee growing method (organic or not), import status (Fair Trade or not), flavor, and price across four social contexts that vary in degree of anonymity and normative social control. The social contexts are buying coffee online, in a large grocery store, in a small neighborhood shop, and for a meeting of a human rights group. Subjects comprise 1,103 German and American undergraduate students. We find that social context indeed influences subjects' ethical consumer decisions, especially in situations with low anonymity and high social control. In addition, gender, coffee buying, and subjective social norms trigger heterogeneity regarding stated ethical consumption and the effects of social context. These results suggest previous research has underestimated the relevance of social context for ethical consumption and overestimated altruistic motives of ethical consumers. Our study demonstrates the great potential of discrete choice experiments for the study of social action and decision making processes in sociology.

Understanding heterogeneity in post-implementation enterprise system usage: towards a fit/misfit-experience-outcome typology

The overarching objective of this dissertation is to uncover why and how individually experienced fits and misfits translate into different outcomes of user behavior and satisfaction and whether these individual fit/misfit outcomes are in line with organizational intent. In search of patterns and possible archetype users in the context of ES PIPs, this dissertation is the first study that specifically links the theoretical concepts of the aggregated individual fit experiences with the individual and organizational outcome of these experiences (i.e. behavioral reaction, user satisfaction, and alignment with organizational intent). The case study’s findings provide preliminary support for four archetype users characterized by specific fit/misfit experience-outcome patterns.

Wage Premia in Employment Clusters: Agglomeration Economies or Worker Heterogeneity?

The correlation between wage premia and concentrations of firm activity may arise due to agglomeration economies or workers sorting by unobserved productivity. A worker's residential location is used as a proxy for their unobservable productivity attributes in order to test whether estimated work location wage premia are robust to the inclusion of these controls. Further, in a locational equilibrium, identical workers must receive equivalent compensation so that after controlling for residential location (housing prices) and commutes workers must be paid the same wages and only wage premia arising from unobserved productivity differences should remain unexplained. The models in this paper are estimated using a sample of male workers residing in 33 large metropolitan areas drawn from the 5% Public Use Microdata Sample (PUMS) from the 2000 U.S. Decennial Census. We find that wages are higher when an individual works in a location that has more workers or a greater density of workers. These agglomeration effects are robust to the inclusion of residential location controls and disappear with the inclusion of commute time suggesting that the effects are not caused by unobserved differences in worker productivity. Extended model specifications suggest that wages increase with the education level of nearby workers and the concentration of workers in an individual's own industry or occupation.

Dealing with Semantic Heterogeneity Issues on the Web

The Semantic Web is an extension of the traditional Web in which meaning of information is well defined, thus allowing a better interaction between people and computers. To accomplish its goals, mechanisms are required to make explicit the semantics of Web resources, to be automatically processed by software agents (this semantics being described by means of online ontologies). Nevertheless, issues arise caused by the semantic heterogeneity that naturally happens on the Web, namely redundancy and ambiguity. For tackling these issues, we present an approach to discover and represent, in a non-redundant way, the intended meaning of words in Web applications, while taking into account the (often unstructured) context in which they appear. To that end, we have developed novel ontology matching, clustering, and disambiguation techniques. Our work is intended to help bridge the gap between syntax and semantics for the Semantic Web construction

Semantic Heterogeneity Issues on the Web

The Semantic Web is an extension of the traditional Web in which meaning of information is well defined, thus allowing a better interaction between people and computers. To accomplish its goals, mechanisms are required to make explicit the semantics of Web resources, to be automatically processed by software agents (this semantics being described by means of online ontologies). Nevertheless, issues arise caused by the semantic heterogeneity that naturally happens on the Web, namely redundancy and ambiguity. For tackling these issues, we present an approach to discover and represent, in a non-redundant way, the intended meaning of words in Web applications, while taking into account the (often unstructured) context in which they appear. To that end, we have developed novel ontology matching, clustering, and disambiguation techniques. Our work is intended to help bridge the gap between syntax and semantics for the Semantic Web construction.

User Experience in Human-Technology Interaction. Communication, context and evaluation methodology

En esta Tesis se presentan dos líneas de investigación relacionadas y que contribuyen a las áreas de Interacción Hombre-Tecnología (o Máquina; siglas en inglés: HTI o HMI), lingüística computacional y evaluación de la experiencia del usuario. Las dos líneas en cuestión son el diseño y la evaluación centrada en el usuario de sistemas de Interacción Hombre-Máquina avanzados. En la primera parte de la Tesis (Capítulos 2 a 4) se abordan cuestiones fundamentales del diseño de sistemas HMI avanzados. El Capítulo 2 presenta una panorámica del estado del arte de la investigación en el ámbito de los sistemas conversacionales multimodales, con la que se enmarca el trabajo de investigación presentado en el resto de la Tesis. Los Capítulos 3 y 4 se centran en dos grandes aspectos del diseño de sistemas HMI: un gestor del diálogo generalizado para tratar la Interacción Hombre-Máquina multimodal y sensible al contexto, y el uso de agentes animados personificados (ECAs) para mejorar la robustez del diálogo, respectivamente. El Capítulo 3, sobre gestión del diálogo, aborda el tratamiento de la heterogeneidad de la información proveniente de las modalidades comunicativas y de los sensores externos. En este capítulo se propone, en un nivel de abstracción alto, una arquitectura para la gestión del diálogo con influjos heterogéneos de información, apoyándose en el uso de State Chart XML. En el Capítulo 4 se presenta una contribución a la representación interna de intenciones comunicativas, y su traducción a secuencias de gestos a ejecutar por parte de un ECA, diseñados específicamente para mejorar la robustez en situaciones de diálogo críticas que pueden surgir, por ejemplo, cuando se producen errores de entendimiento en la comunicación entre el usuario humano y la máquina. Se propone, en estas páginas, una extensión del Functional Mark-up Language definido en el marco conceptual SAIBA. Esta extensión permite representar actos comunicativos que realizan intenciones del emisor (la máquina) que no se pretende sean captadas conscientemente por el receptor (el usuario humano), pero con las que se pretende influirle a éste e influir el curso del diálogo. Esto se consigue mediante un objeto llamado Base de Intenciones Comunicativas (en inglés, Communication Intention Base, o CIB). La representación en el CIB de intenciones “no claradas” además de las explícitas permite la construcción de actos comunicativos que realizan simultáneamente varias intenciones comunicativas. En el Capítulo 4 también se describe un sistema experimental para el control remoto (simulado) de un asistente domótico, con autenticación de locutor para dar acceso, y con un ECA en el interfaz de cada una de estas tareas. Se incluye una descripción de las secuencias de comportamiento verbal y no verbal de los ECAs, que fueron diseñados específicamente para determinadas situaciones con objeto de mejorar la robustez del diálogo. Los Capítulos 5 a 7 conforman la parte de la Tesis dedicada a la evaluación. El Capítulo 5 repasa antecedentes relevantes en la literatura de tecnologías de la información en general, y de sistemas de interacción hablada en particular. Los principales antecedentes en el ámbito de la evaluación de la interacción sobre los cuales se ha desarrollado el trabajo presentado en esta Tesis son el Technology Acceptance Model (TAM), la herramienta Subjective Assessment of Speech System Interfaces (SASSI), y la Recomendación P.851 de la ITU-T. En el Capítulo 6 se describen un marco y una metodología de evaluación aplicados a la experiencia del usuario con sistemas HMI multimodales. Se desarrolló con este propósito un novedoso marco de evaluación subjetiva de la calidad de la experiencia del usuario y su relación con la aceptación por parte del mismo de la tecnología HMI (el nombre dado en inglés a este marco es Subjective Quality Evaluation Framework). En este marco se articula una estructura de clases de factores subjetivos relacionados con la satisfacción y aceptación por parte del usuario de la tecnología HMI propuesta. Esta estructura, tal y como se propone en la presente tesis, tiene dos dimensiones ortogonales. Primero se identifican tres grandes clases de parámetros relacionados con la aceptación por parte del usuario: “agradabilidad ” (likeability: aquellos que tienen que ver con la experiencia de uso, sin entrar en valoraciones de utilidad), rechazo (los cuales sólo pueden tener una valencia negativa) y percepción de utilidad. En segundo lugar, este conjunto clases se reproduce para distintos “niveles, o focos, percepción del usuario”. Éstos incluyen, como mínimo, un nivel de valoración global del sistema, niveles correspondientes a las tareas a realizar y objetivos a alcanzar, y un nivel de interfaz (en los casos propuestos en esta tesis, el interfaz es un sistema de diálogo con o sin un ECA). En el Capítulo 7 se presenta una evaluación empírica del sistema descrito en el Capítulo 4. El estudio se apoya en los mencionados antecedentes en la literatura, ampliados con parámetros para el estudio específico de los agentes animados (los ECAs), la auto-evaluación de las emociones de los usuarios, así como determinados factores de rechazo (concretamente, la preocupación por la privacidad y la seguridad). También se evalúa el marco de evaluación subjetiva de la calidad propuesto en el capítulo anterior. Los análisis de factores efectuados revelan una estructura de parámetros muy cercana conceptualmente a la división de clases en utilidad-agradabilidad-rechazo propuesta en dicho marco, resultado que da cierta validez empírica al marco. Análisis basados en regresiones lineales revelan estructuras de dependencias e interrelación entre los parámetros subjetivos y objetivos considerados. El efecto central de mediación, descrito en el Technology Acceptance Model, de la utilidad percibida sobre la relación de dependencia entre la intención de uso y la facilidad de uso percibida, se confirma en el estudio presentado en la presente Tesis. Además, se ha encontrado que esta estructura de relaciones se fortalece, en el estudio concreto presentado en estas páginas, si las variables consideradas se generalizan para cubrir más ampliamente las categorías de agradabilidad y utilidad contempladas en el marco de evaluación subjetiva de calidad. Se ha observado, asimismo, que los factores de rechazo aparecen como un componente propio en los análisis de factores, y además se distinguen por su comportamiento: moderan la relación entre la intención de uso (que es el principal indicador de la aceptación del usuario) y su predictor más fuerte, la utilidad percibida. Se presentan también resultados de menor importancia referentes a los efectos de los ECAs sobre los interfaces de los sistemas de diálogo y sobre los parámetros de percepción y las valoraciones de los usuarios que juegan un papel en conformar su aceptación de la tecnología. A pesar de que se observa un rendimiento de la interacción dialogada ligeramente mejor con ECAs, las opiniones subjetivas son muy similares entre los dos grupos experimentales (uno interactuando con un sistema de diálogo con ECA, y el otro sin ECA). Entre las pequeñas diferencias encontradas entre los dos grupos destacan las siguientes: en el grupo experimental sin ECA (es decir, con interfaz sólo de voz) se observó un efecto más directo de los problemas de diálogo (por ejemplo, errores de reconocimiento) sobre la percepción de robustez, mientras que el grupo con ECA tuvo una respuesta emocional más positiva cuando se producían problemas. Los ECAs parecen generar inicialmente expectativas más elevadas en cuanto a las capacidades del sistema, y los usuarios de este grupo se declaran más seguros de sí mismos en su interacción. Por último, se observan algunos indicios de efectos sociales de los ECAs: la “amigabilidad ” percibida los ECAs estaba correlada con un incremento la preocupación por la seguridad. Asimismo, los usuarios del sistema con ECAs tendían más a culparse a sí mismos, en lugar de culpar al sistema, de los problemas de diálogo que pudieran surgir, mientras que se observó una ligera tendencia opuesta en el caso de los usuarios del sistema con interacción sólo de voz. ABSTRACT This Thesis presents two related lines of research work contributing to the general fields of Human-Technology (or Machine) Interaction (HTI, or HMI), computational linguistics, and user experience evaluation. These two lines are the design and user-focused evaluation of advanced Human-Machine (or Technology) Interaction systems. The first part of the Thesis (Chapters 2 to 4) is centred on advanced HMI system design. Chapter 2 provides a background overview of the state of research in multimodal conversational systems. This sets the stage for the research work presented in the rest of the Thesis. Chapers 3 and 4 focus on two major aspects of HMI design in detail: a generalised dialogue manager for context-aware multimodal HMI, and embodied conversational agents (ECAs, or animated agents) to improve dialogue robustness, respectively. Chapter 3, on dialogue management, deals with how to handle information heterogeneity, both from the communication modalities or from external sensors. A highly abstracted architectural contribution based on State Chart XML is proposed. Chapter 4 presents a contribution for the internal representation of communication intentions and their translation into gestural sequences for an ECA, especially designed to improve robustness in critical dialogue situations such as when miscommunication occurs. We propose an extension of the functionality of Functional Mark-up Language, as envisaged in much of the work in the SAIBA framework. Our extension allows the representation of communication acts that carry intentions that are not for the interlocutor to know of, but which are made to influence him or her as well as the flow of the dialogue itself. This is achieved through a design element we have called the Communication Intention Base. Such r pr s ntation of “non- clar ” int ntions allows th construction of communication acts that carry several communication intentions simultaneously. Also in Chapter 4, an experimental system is described which allows (simulated) remote control to a home automation assistant, with biometric (speaker) authentication to grant access, featuring embodied conversation agents for each of the tasks. The discussion includes a description of the behavioural sequences for the ECAs, which were designed for specific dialogue situations with particular attention given to the objective of improving dialogue robustness. Chapters 5 to 7 form the evaluation part of the Thesis. Chapter 5 reviews evaluation approaches in the literature for information technologies, as well as in particular for speech-based interaction systems, that are useful precedents to the contributions of the present Thesis. The main evaluation precedents on which the work in this Thesis has built are the Technology Acceptance Model (TAM), the Subjective Assessment of Speech System Interfaces (SASSI) tool, and ITU-T Recommendation P.851. Chapter 6 presents the author’s work in establishing an valuation framework and methodology applied to the users’ experience with multimodal HMI systems. A novel user-acceptance Subjective Quality Evaluation Framework was developed by the author specifically for this purpose. A class structure arises from two orthogonal sets of dimensions. First we identify three broad classes of parameters related with user acceptance: likeability factors (those that have to do with the experience of using the system), rejection factors (which can only have a negative valence) and perception of usefulness. Secondly, the class structure is further broken down into several “user perception levels”; at the very least: an overall system-assessment level, task and goal-related levels, and an interface level (e.g., a dialogue system with or without an ECA). An empirical evaluation of the system described in Chapter 4 is presented in Chapter 7. The study was based on the abovementioned precedents in the literature, expanded with categories covering the inclusion of an ECA, the users’ s lf-assessed emotions, and particular rejection factors (privacy and security concerns). The Subjective Quality Evaluation Framework proposed in the previous chapter was also scrutinised. Factor analyses revealed an item structure very much related conceptually to the usefulness-likeability-rejection class division introduced above, thus giving it some empirical weight. Regression-based analysis revealed structures of dependencies, paths of interrelations, between the subjective and objective parameters considered. The central mediation effect, in the Technology Acceptance Model, of perceived usefulness on the dependency relationship of intention-to-use with perceived ease of use was confirmed in this study. Furthermore, the pattern of relationships was stronger for variables covering more broadly the likeability and usefulness categories in the Subjective Quality Evaluation Framework. Rejection factors were found to have a distinct presence as components in factor analyses, as well as distinct behaviour: they were found to moderate the relationship between intention-to-use (the main measure of user acceptance) and its strongest predictor, perceived usefulness. Insights of secondary importance are also given regarding the effect of ECAs on the interface of spoken dialogue systems and the dimensions of user perception and judgement attitude that may have a role in determining user acceptance of the technology. Despite observing slightly better performance values in the case of the system with the ECA, subjective opinions regarding both systems were, overall, very similar. Minor differences between two experimental groups (one interacting with an ECA, the other only through speech) include a more direct effect of dialogue problems (e.g., non-understandings) on perceived dialogue robustness for the voice-only interface test group, and a more positive emotional response for the ECA test group. Our findings further suggest that the ECA generates higher initial expectations, and users seem slightly more confident in their interaction with the ECA than do those without it. Finally, mild evidence of social effects of ECAs was also found: the perceived friendliness of the ECA increased security concerns, and ECA users may tend to blame themselves rather than the system when dialogue problems are encountered, while the opposite may be true for voice-only users.