Enhancing Interaction With Smart Objects Throught Mobile Devices

Interaction with smart objects can be accomplished with different technologies, such as tangible interfaces or touch computing, among others. Some of them require the object to be especially designed to be 'smart', and some other are limited in the variety and complexity of the possible actions. This paper describes a user-smart object interaction model and prototype based on the well known event-condition-action (ECA) reasoning, which can work, to a degree, independently of the intelligence embedded into the smart object. It has been designed for mobile devices to act as mediators between users and smart objects and provides an intuitive means for personalization of object's behavior. When the user is close to an object, this one publishes its 'event & action' capabilities to the user's device. The user may accept the object's module offering, which will enable him to configure and control that object, but also its actions with respect to other elements of the environment or the virtual world. The modular ECA interaction model facilitates the integration of different types of objects in a smart space, giving the user full control of their capabilities and facilitating creative mash-uping to build customized functionalities that combine physical and virtual actions

An attitude-based reasoning strategy to enhance interaction with augmented objects

This paper describes a mobile-based system to interact with objects in smart spaces, where the offer of resources may be extensive. The underlying idea is to use the augmentation capabilities of the mobile device to enable it as user-object mediator. In particular, the paper details how to build an attitude-based reasoning strategy that facilitates user-object interaction and resource filtering. The strategy prioritizes the available resources depending on the spatial history of the user, his real-time location and orientation and, finally, his active touch and focus interactions with the virtual overlay. The proposed reasoning method has been partially validated through a prototype that handles 2D and 3D visualization interfaces. This framework makes possible to develop in practice the IoT paradigm, augmenting the objects without physically modifying them.

Towards a lightweight mobile semantic-based approach for enhancing interaction with smart objects

This work describes a semantic extension for a user-smart object interaction model based on the ECA paradigm (Event-Condition-Action). In this approach, smart objects publish their sensing (event) and action capabilities in the cloud and mobile devices are prepared to retrieve them and act as mediators to configure personalized behaviours for the objects. In this paper, the information handled by this interaction system has been shaped according several semantic models that, together with the integration of an embedded ontological and rule-based reasoner, are exploited in order to (i) automatically detect incompatible ECA rules configurations and to (ii) support complex ECA rules definitions and execution. This semantic extension may significantly improve the management of smart spaces populated with numerous smart objects from mobile personal devices, as it facilitates the configuration of coherent ECA rules.

E-beam propagation and interaction with atmosphere

This study purports to investigate whether a conductive tether left uninsulated and electrically floating in LEO could serve as an effective e-beam source to produce artificial auroras. An electrically floating tether comes out biased highly negative over most of its length. Ambient ions impacting it with KeV energies liberate secondary electrons, which are locally accelerated through the 2D tether voltage-bias, race down magnetic lines, and result in peak auroral emissions at about 120-160 km altitude. Since no current flows at either tether end, a bare-tether e-beam is fully free of spacecraft charging problems. Beam propagation and beam-atmosphere interactions need be modelled in a simple but quantitative way so as to allow a satisfactory discussion of observational options and their feasibility. The evolution in the energy spectrum of secondary electrons, their pitch distribution, and beam broadening due to collisions with neutrals, which would result in a broader but weaker tether footprint in the E-layer, need be modelled. Relations between particle/energy flux values, and ionization and accompanying emission rates, are considered.

Dealing with traffic risk in Latin American toll roads

Análisis de los sistemas de mitigación del riesgo de tráfico en autopistas de peaje en diferentes países de Latinoamérica. This paper presents a cross-country analysis of traffic risk allocation in road concessions of Latin America. It shows that some countries such as Chile, Colombia, and Peru have been greatly concerned with mitigating traffic risk, either by putting into practice public guarantees, implementing flexible term concessions, or through availability payment concessions; whereas other countries such as Mexico and Brazil have assigned traffic risk to the private concessionaire by using fixed-term concession contracts without any traffic guarantees. Based on an analysis of data from 1990 to 2010, the paper finds that shifting traffic risk from the concessionaire to the government or users was not confined to the riskiest projects, as one might expect. The analysis also suggests that the implementation of traffic risk mitigation mechanisms in Latin American toll roads has not been very successful in reducing renegotiation rates or in increasing the number of bidders in the tenders

TIMPANO: Technology for complex Human-Machine conversational interaction with dynamic learning

El proyecto TIMPANO tiene por objetivo profundizar en el desarrollo de sistemas de comunicación oral hombre-máquina atendiendo principalmente a la capacidad de dar respuesta a múltiples requerimientos de los usuarios, como pueden ser el acceso a información, la extracción de información, o el análisis de grandes repositorios de información en audio. En el proyecto se hace especial énfasis en la adaptación dinámica de los modelos a diversos contextos, tanto de tipo acústico, como semántico o de idioma.

Towards an Active Design. An Approach on the Body Interaction with the Built Environment.

El impacto de la tecnología en el ambiente construido y en las actividades en él desarrolladas, es una de las causas de la progresiva sedentarización de la especie humana. Desde un enfoque que analiza la interacción del cuerpo con la arquitectura, a través de distintas referencias en escalas diversas, esta investigación intenta establecer la relación entre la evolución del ambiente pasivo y la sedentarización, proponiendo frente a un espacio mecanizado y digitalizado que disminuye la actividad física humana, la búsqueda de nuevos tipos de espacios arquitectónicos que promuevan el movimiento repercutiendo en el bienestar y la salud. Esta tesis estudia por tanto el impacto de la tecnología en el espacio, intentando aproximarse a estrategias que disminuyan el efecto pasivo y estimulen la actividad motora. Estas propuestas abarcan tanto la ciudad, como la edificación y el propio espacio doméstico afectando a los sistemas de circulación, a la configuración espacial y sobre todo a la incorporación de ”espacios activos”, en donde se contempla la posibilidad de un uso alternativo de la tecnología como un elemento positivo.

Polymer interaction with macroscopic carbon nanotube fibres and fabrication of nanostructured composites

El ensamblado de nanotubos de carbono (CNT) como una fibra macroscópica en la cual están orientados preferentemente paralelos entre sí y al eje de la fibra, ha dado como resultado un nuevo tipo de fibra de altas prestaciones derivadas de la explotación eficiente de las propiedades axiales de los CNTs, y que tiene un gran número de aplicaciones potenciales. Fibras continuas de CNTs se produjeron en el Instituto IMDEA Materiales mediante el proceso de hilado directo durante la reacción de síntesis por deposición química de vapores. Uno de los objetivos de esta tesis es el estudio de la estructura de estas fibras mediante técnicas del estado del arte de difracción de rayos X de sincrotrón y la elaboración de un modelo estructural de dicho material. Mediciones texturales de adsorción de gases, análisis de micrografías de electrones y dispersión de rayos X de ángulo alto y bajo (WAXS/SAXS) indican que el material tiene una estructura mesoporosa con una distribución de tamaño de poros ancha derivada del amplio rango de separaciones entre manojos de CNTs, así como una superficie específica de 170m2/g. Los valores de dimensión fractal obtenidos mediante SAXS y análisis Barrett-Joyner-Halenda (BJH) de mediciones texturales coinciden en 2.4 y 2.5, respectivamente, resaltando el carácter de red de la estructura de dichas fibras. La estructura mesoporosa y tipo hilo de las fibra de CNT es accesible a la infiltración de moléculas externas (líquidos o polímeros). En este trabajo se estudian los cambios en la estructura multiescala de las fibras de CNTs al interactuar con líquidos y polímeros. Los efectos de la densificación en la estructura de fibras secas de CNT son estudiados mediante WAXS/SAXS. El tratamiento de densificación junta los manojos de la fibra (los poros disminuyen de tamaño), resultando en un incremento de la densidad de la fibra. Sin embargo, los dominios estructurales correspondientes a la transferencia de esfuerzo mecánica y carga eléctrica en los nanotubos no son afectados durante este proceso de densificación; como consecuencia no se produce un efecto sustancial en las propiedades mecánicas y eléctricas. Mediciones de SAXS and fibra de CNT antes y después de infiltración de líquidos confirman la penetración de una gran cantidad de líquidos que llena los poros internos de la fibra pero no se intercalan entre capas de nanotubos adyacentes. La infiltración de cadenas poliméricas de bajo peso molecular tiende a expandir los manojos en la fibra e incrementar el ángulo de apertura de los poros. Los resultados de SAXS indican que la estructura interna de la fibra en términos de la organización de las capas de tubos y su orientación no es afectada cuando las muestras consisten en fibras infiltradas con polímeros de alto peso molecular. La cristalización de varios polímeros semicristalinos es acelerada por la presencia de fibras de CNTs alineados y produce el crecimiento de una capa transcristalina normal a la superficie de la fibra. Esto es observado directamente mediante microscopía óptica polarizada, y detectado mediante calorimetría DSC. Las lamelas en la capa transcristalina tienen orientación de la cadena polimérica paralela a la fibra y por lo tanto a los nanotubos, de acuerdo con los patrones de WAXS. Esta orientación preferencial se sugiere como parte de la fuerza impulsora en la nucleación. La nucleación del dominio cristalino polimérico en la superficie de los CNT no es epitaxial. Ocurre sin haber correspondencia entre las estructuras cristalinas del polímero y los nanotubos. Estas observaciones contribuyen a la compresión del fenómeno de nucleación en CNTs y otros nanocarbonos, y sientan las bases para el desarrollo de composites poliméricos de gran escala basados en fibra larga de CNTs alineados. ABSTRACT The assembly of carbon nanotubes into a macroscopic fibre material where they are preferentially aligned parallel to each other and to the fibre axis has resulted in a new class of high-performance fibres, which efficiently exploits the axial properties of the building blocks and has numerous applications. Long, continuous CNT fibres were produced in IMDEA Materials Institute by direct fibre spinning from a chemical vapour deposition reaction. These fibres have a complex hierarchical structure covering multiple length scales. One objective of this thesis is to reveal this structure by means of state-of-the-art techniques such as synchrotron X-ray diffraction, and to build a model to link the fibre structural elements. Texture and gas absorption measurements, using electron microscopy, wide angle and small angle X-ray scattering (WAXS/SAXS), and pore size distribution analysis by Barrett-Joyner-Halenda (BJH), indicate that the material has a mesoporous structure with a wide pore size distribution arising from the range of fibre bundle separation, and a high surface area _170m2/g. Fractal dimension values of 2.4_2.5 obtained from the SAXS and BJH measurements highlight the network structure of the fibre. Mesoporous and yarn-like structure of CNT fibres make them accessible to the infiltration of foreign molecules (liquid or polymer). This work studies multiscale structural changes when CNT fibres interact with liquids and polymers. The effects of densification on the structure of dry CNT fibres were measured by WAXS/SAXS. The densification treatment brings the fibre bundles closer (pores become smaller), leading to an increase in fibre density. However, structural domains made of the load and charge carrying nanotubes are not affected; consequently, it has no substantial effect on mechanical and electrical properties. SAXS measurements on the CNT fibres before and after liquid infiltration imply that most liquids are able to fill the internal pores but not to intercalate between nanotubes. Successful infiltration of low molecular weight polymer chains tends to expand the fibre bundles and increases the pore-opening angle. SAXS results indicate that the inner structure of the fibre, in terms of the nanotube layer arrangement and the fibre alignment, are not largely affected when infiltrated with polymers of relatively high molecular weight. The crystallisation of a variety of semicrystalline polymers is accelerated by the presence of aligned fibres of CNTs and results in the growth of a transcrystalline layer perpendicular to the fibre surface. This can be observed directly under polarised optical microscope, and detected by the exothermic peaks during differential scanning calorimetry. The discussion on the driving forces for the enhanced nucleation points out the preferential chain orientation of polymer lamella with the chain axis parallel to the fibre and thus to the nanotubes, which is confirmed by two-dimensional WAXS patterns. A non-epitaxial polymer crystal growth habit at the CNT-polymer interface is proposed, which is independent of lattice matching between the polymer and nanotubes. These findings contribute to the discussion on polymer nucleation on CNTs and other nanocarbons, and their implication for the development of large polymer composites based on long and aligned fibres of CNTs.

Pulsatile blood flow interaction with arterial walls of aorta : autoregulation and impedance pressure boundary condition and its biomedical applications

Para las decisiones urgentes sobre intervenciones quirúrgicas en el sistema cardiovascular se necesitan simulaciones computacionales con resultados fiables y que consuman un tiempo de cálculo razonable. Durante años los investigadores han trabajado en diversos métodos numéricos de cálculo que resulten atractivos para los cirujanos. Estos métodos, precisos pero costosos desde el punto de vista del coste computacional, crean un desajuste entre la oferta de los ingenieros que realizan las simulaciones y los médicos que operan en el quirófano. Por otra parte, los métodos de cálculo más simplificados reducen el tiempo de cálculo pero pueden proporcionar resultados no realistas. El objetivo de esta tesis es combinar los conceptos de autorregulación e impedancia del sistema circulatorio, la interacción flujo sanguíneo-pared arterial y modelos geométricos idealizados tridimensionales de las arterias pero sin pérdida de realismo, con objeto de proponer una metodología de simulación que proporcione resultados correctos y completos, con tiempos de cálculo moderados. En las simulaciones numéricas, las condiciones de contorno basadas en historias de presión presentan inconvenientes por ser difícil conocerlas con detalle, y porque los resultados son muy sensibles ante pequeñas variaciones de dichas historias. La metodología propuesta se basa en los conceptos de autorregulación, para imponer la demanda de flujo aguas abajo del modelo en el ciclo cardiaco, y la impedancia, para representar el efecto que ejerce el flujo en el resto del sistema circulatorio sobre las arterias modeladas. De este modo las historias de presión en el contorno son resultados del cálculo, que se obtienen de manera iterativa. El método propuesto se aplica en una geometría idealizada del arco aórtico sin patologías y en otra geometría correspondiente a una disección Stanford de tipo A, considerando la interacción del flujo pulsátil con las paredes arteriales. El efecto de los tejidos circundantes también se incorpora en los modelos. También se hacen aplicaciones considerando la interacción en una geometría especifica de un paciente anciano que proviene de una tomografía computarizada. Finalmente se analiza una disección Stanford tipo B con tres modelos que incluyen la fenestración del saco. Clinicians demand fast and reliable numerical results of cardiovascular biomechanic simulations for their urgent pre-surgery decissions. Researchers during many years have work on different numerical methods in order to attract the clinicians' confidence to their colorful contours. Though precise but expensive and time-consuming methodologies create a gap between numerical biomechanics and hospital personnel. On the other hand, simulation simplifications with the aim of reduction in computational time may cause in production of unrealistic outcomes. The main objective of the current investigation is to combine ideas such as autoregulation, impedance, fluid-solid interaction and idealized geometries in order to propose a computationally cheap methodology without excessive or unrealistic simplifications. The pressure boundary conditions are critical and polemic in numerical simulations of cardiovascular system, in which a specific arterial site is of interest and the rest of the netwrok is neglected but represented by a boundary condition. The proposed methodology is a pressure boundary condition which takes advantage of numerical simplicity of application of an imposed pressure boundary condition on outlets, while it includes more sophisticated concepts such as autoregulation and impedance to gain more realistic results. Incorporation of autoregulation and impedance converts the pressure boundary conditions to an active and dynamic boundary conditions, receiving feedback from the results during the numerical calculations and comparing them with the physiological requirements. On the other hand, the impedance boundary condition defines the shapes of the pressure history curves applied at outlets. The applications of the proposed method are seen on idealized geometry of the healthy arotic arch as well as idealized Stanford type A dissection, considering the interaction of the arterial walls with the pulsatile blood flow. The effect of surrounding tissues is incorporated and studied in the models. The simulations continue with FSI analysis of a patient-specific CT scanned geometry of an old individual. Finally, inspiring of the statistic results of mortality rates in Stanford type B dissection, three models of fenestrated dissection sac is studied and discussed. Applying the developed boundary condition, an alternative hypothesis is proposed by the author with respect to the decrease in mortality rates in patients with fenestrations.

Dynamic effect of high speed railway traffic loads on the ballast track settlement

The traditional ballast track structures are still being used in high speed railways lines with success, however technical problems or performance features have led to non-ballast track solution in some cases. A considerable maintenance work is needed for ballasted tracks due to the track deterioration. Therefore it is very important to understand the mechanism of track deterioration and to predict the track settlement or track irregularity growth rate in order to reduce track maintenance costs and enable new track structures to be designed. The objective of this work is to develop the most adequate and efficient models for calculation of dynamic traffic load effects on railways track infrastructure, and then evaluate the dynamic effect on the ballast track settlement, using a ballast track settlement prediction model, which consists of the vehicle/track dynamic model previously selected and a track settlement law. The calculations are based on dynamic finite element models with direct time integration, contact between wheel and rail and interaction with railway cars. A initial irregularity profile is used in the prediction model. The track settlement law is considered to be a function of number of loading cycles and the magnitude of the loading, which represents the long-term behavior of ballast settlement. The results obtained include the track irregularity growth and the contact force in the final interaction of numerical simulation

Space Debris Removal with an Ion Beam Shepherd Satellite: target-plasma interaction

A novel concept for active space debris removal known as Ion Beam Shepherd (IBS) which has been recently presented by our group is investigated. The concept makes use of a highly collimated ion beam to exert the necessary force on a generic debris to modify its orbit and/or attitude from a safe distance in a controlled manner, without the need of docking. After describing the main characteristics of the IBS system, some of the key aspects of thruster plasma and its interaction with the debris are studied, namely, (1) the modeling of the expansion of an plasma beam, based on the quasi-selfsimilarity exhibited by hypersonic plumes, (2) the characterization of the force and torque exerted upon the target debris, and (3) a preliminary evaluation of other plasma-body interactions.

Sharing Human-Generated Observations by Integrating HMI and the Semantic Sensor Web

Current “Internet of Things” concepts point to a future where connected objects gather meaningful information about their environment and share it with other objects and people. In particular, objects embedding Human Machine Interaction (HMI), such as mobile devices and, increasingly, connected vehicles, home appliances, urban interactive infrastructures, etc., may not only be conceived as sources of sensor information, but, through interaction with their users, they can also produce highly valuable context-aware human-generated observations. We believe that the great promise offered by combining and sharing all of the different sources of information available can be realized through the integration of HMI and Semantic Sensor Web technologies. This paper presents a technological framework that harmonizes two of the most influential HMI and Sensor Web initiatives: the W3C’s Multimodal Architecture and Interfaces (MMI) and the Open Geospatial Consortium (OGC) Sensor Web Enablement (SWE) with its semantic extension, respectively. Although the proposed framework is general enough to be applied in a variety of connected objects integrating HMI, a particular development is presented for a connected car scenario where drivers’ observations about the traffic or their environment are shared across the Semantic Sensor Web. For implementation and evaluation purposes an on-board OSGi (Open Services Gateway Initiative) architecture was built, integrating several available HMI, Sensor Web and Semantic Web technologies. A technical performance test and a conceptual validation of the scenario with potential users are reported, with results suggesting the approach is sound

Foundations of a New Interaction Paradigm for Immersive 3D Multimedia

Immersion and interaction have been identified as key factors influencing the quality of experience in stereoscopic video systems. The work presented here aims to create a new paradigm for 3D Multimedia consumption exploiting these factors in order to increase user involvement. We use a 5-sided CAVETM environment to support 3D panoramic video reproduction, real-time insertion of synthetic objects into the three-dimensional scene and real-time user interaction with the inserted elements. In this paper we describe our system requirements, functionalities, conceptual design and preliminary implementation results emphasizing the most relevant challenges accomplished. The focus is on three main issues: the generation of stereoscopic video panoramas; the synchronous reproduction of immersive 3D video across multiple screens; and, the real-time insertion algorithm implemented for the integration of synthetic objects into the stereoscopic video. These results have been successfully integrated into the graphic engine managing the operation of the CAVETM infrastructure.

User Experience in Human-Technology Interaction. Communication, context and evaluation methodology

En esta Tesis se presentan dos líneas de investigación relacionadas y que contribuyen a las áreas de Interacción Hombre-Tecnología (o Máquina; siglas en inglés: HTI o HMI), lingüística computacional y evaluación de la experiencia del usuario. Las dos líneas en cuestión son el diseño y la evaluación centrada en el usuario de sistemas de Interacción Hombre-Máquina avanzados. En la primera parte de la Tesis (Capítulos 2 a 4) se abordan cuestiones fundamentales del diseño de sistemas HMI avanzados. El Capítulo 2 presenta una panorámica del estado del arte de la investigación en el ámbito de los sistemas conversacionales multimodales, con la que se enmarca el trabajo de investigación presentado en el resto de la Tesis. Los Capítulos 3 y 4 se centran en dos grandes aspectos del diseño de sistemas HMI: un gestor del diálogo generalizado para tratar la Interacción Hombre-Máquina multimodal y sensible al contexto, y el uso de agentes animados personificados (ECAs) para mejorar la robustez del diálogo, respectivamente. El Capítulo 3, sobre gestión del diálogo, aborda el tratamiento de la heterogeneidad de la información proveniente de las modalidades comunicativas y de los sensores externos. En este capítulo se propone, en un nivel de abstracción alto, una arquitectura para la gestión del diálogo con influjos heterogéneos de información, apoyándose en el uso de State Chart XML. En el Capítulo 4 se presenta una contribución a la representación interna de intenciones comunicativas, y su traducción a secuencias de gestos a ejecutar por parte de un ECA, diseñados específicamente para mejorar la robustez en situaciones de diálogo críticas que pueden surgir, por ejemplo, cuando se producen errores de entendimiento en la comunicación entre el usuario humano y la máquina. Se propone, en estas páginas, una extensión del Functional Mark-up Language definido en el marco conceptual SAIBA. Esta extensión permite representar actos comunicativos que realizan intenciones del emisor (la máquina) que no se pretende sean captadas conscientemente por el receptor (el usuario humano), pero con las que se pretende influirle a éste e influir el curso del diálogo. Esto se consigue mediante un objeto llamado Base de Intenciones Comunicativas (en inglés, Communication Intention Base, o CIB). La representación en el CIB de intenciones “no claradas” además de las explícitas permite la construcción de actos comunicativos que realizan simultáneamente varias intenciones comunicativas. En el Capítulo 4 también se describe un sistema experimental para el control remoto (simulado) de un asistente domótico, con autenticación de locutor para dar acceso, y con un ECA en el interfaz de cada una de estas tareas. Se incluye una descripción de las secuencias de comportamiento verbal y no verbal de los ECAs, que fueron diseñados específicamente para determinadas situaciones con objeto de mejorar la robustez del diálogo. Los Capítulos 5 a 7 conforman la parte de la Tesis dedicada a la evaluación. El Capítulo 5 repasa antecedentes relevantes en la literatura de tecnologías de la información en general, y de sistemas de interacción hablada en particular. Los principales antecedentes en el ámbito de la evaluación de la interacción sobre los cuales se ha desarrollado el trabajo presentado en esta Tesis son el Technology Acceptance Model (TAM), la herramienta Subjective Assessment of Speech System Interfaces (SASSI), y la Recomendación P.851 de la ITU-T. En el Capítulo 6 se describen un marco y una metodología de evaluación aplicados a la experiencia del usuario con sistemas HMI multimodales. Se desarrolló con este propósito un novedoso marco de evaluación subjetiva de la calidad de la experiencia del usuario y su relación con la aceptación por parte del mismo de la tecnología HMI (el nombre dado en inglés a este marco es Subjective Quality Evaluation Framework). En este marco se articula una estructura de clases de factores subjetivos relacionados con la satisfacción y aceptación por parte del usuario de la tecnología HMI propuesta. Esta estructura, tal y como se propone en la presente tesis, tiene dos dimensiones ortogonales. Primero se identifican tres grandes clases de parámetros relacionados con la aceptación por parte del usuario: “agradabilidad ” (likeability: aquellos que tienen que ver con la experiencia de uso, sin entrar en valoraciones de utilidad), rechazo (los cuales sólo pueden tener una valencia negativa) y percepción de utilidad. En segundo lugar, este conjunto clases se reproduce para distintos “niveles, o focos, percepción del usuario”. Éstos incluyen, como mínimo, un nivel de valoración global del sistema, niveles correspondientes a las tareas a realizar y objetivos a alcanzar, y un nivel de interfaz (en los casos propuestos en esta tesis, el interfaz es un sistema de diálogo con o sin un ECA). En el Capítulo 7 se presenta una evaluación empírica del sistema descrito en el Capítulo 4. El estudio se apoya en los mencionados antecedentes en la literatura, ampliados con parámetros para el estudio específico de los agentes animados (los ECAs), la auto-evaluación de las emociones de los usuarios, así como determinados factores de rechazo (concretamente, la preocupación por la privacidad y la seguridad). También se evalúa el marco de evaluación subjetiva de la calidad propuesto en el capítulo anterior. Los análisis de factores efectuados revelan una estructura de parámetros muy cercana conceptualmente a la división de clases en utilidad-agradabilidad-rechazo propuesta en dicho marco, resultado que da cierta validez empírica al marco. Análisis basados en regresiones lineales revelan estructuras de dependencias e interrelación entre los parámetros subjetivos y objetivos considerados. El efecto central de mediación, descrito en el Technology Acceptance Model, de la utilidad percibida sobre la relación de dependencia entre la intención de uso y la facilidad de uso percibida, se confirma en el estudio presentado en la presente Tesis. Además, se ha encontrado que esta estructura de relaciones se fortalece, en el estudio concreto presentado en estas páginas, si las variables consideradas se generalizan para cubrir más ampliamente las categorías de agradabilidad y utilidad contempladas en el marco de evaluación subjetiva de calidad. Se ha observado, asimismo, que los factores de rechazo aparecen como un componente propio en los análisis de factores, y además se distinguen por su comportamiento: moderan la relación entre la intención de uso (que es el principal indicador de la aceptación del usuario) y su predictor más fuerte, la utilidad percibida. Se presentan también resultados de menor importancia referentes a los efectos de los ECAs sobre los interfaces de los sistemas de diálogo y sobre los parámetros de percepción y las valoraciones de los usuarios que juegan un papel en conformar su aceptación de la tecnología. A pesar de que se observa un rendimiento de la interacción dialogada ligeramente mejor con ECAs, las opiniones subjetivas son muy similares entre los dos grupos experimentales (uno interactuando con un sistema de diálogo con ECA, y el otro sin ECA). Entre las pequeñas diferencias encontradas entre los dos grupos destacan las siguientes: en el grupo experimental sin ECA (es decir, con interfaz sólo de voz) se observó un efecto más directo de los problemas de diálogo (por ejemplo, errores de reconocimiento) sobre la percepción de robustez, mientras que el grupo con ECA tuvo una respuesta emocional más positiva cuando se producían problemas. Los ECAs parecen generar inicialmente expectativas más elevadas en cuanto a las capacidades del sistema, y los usuarios de este grupo se declaran más seguros de sí mismos en su interacción. Por último, se observan algunos indicios de efectos sociales de los ECAs: la “amigabilidad ” percibida los ECAs estaba correlada con un incremento la preocupación por la seguridad. Asimismo, los usuarios del sistema con ECAs tendían más a culparse a sí mismos, en lugar de culpar al sistema, de los problemas de diálogo que pudieran surgir, mientras que se observó una ligera tendencia opuesta en el caso de los usuarios del sistema con interacción sólo de voz. ABSTRACT This Thesis presents two related lines of research work contributing to the general fields of Human-Technology (or Machine) Interaction (HTI, or HMI), computational linguistics, and user experience evaluation. These two lines are the design and user-focused evaluation of advanced Human-Machine (or Technology) Interaction systems. The first part of the Thesis (Chapters 2 to 4) is centred on advanced HMI system design. Chapter 2 provides a background overview of the state of research in multimodal conversational systems. This sets the stage for the research work presented in the rest of the Thesis. Chapers 3 and 4 focus on two major aspects of HMI design in detail: a generalised dialogue manager for context-aware multimodal HMI, and embodied conversational agents (ECAs, or animated agents) to improve dialogue robustness, respectively. Chapter 3, on dialogue management, deals with how to handle information heterogeneity, both from the communication modalities or from external sensors. A highly abstracted architectural contribution based on State Chart XML is proposed. Chapter 4 presents a contribution for the internal representation of communication intentions and their translation into gestural sequences for an ECA, especially designed to improve robustness in critical dialogue situations such as when miscommunication occurs. We propose an extension of the functionality of Functional Mark-up Language, as envisaged in much of the work in the SAIBA framework. Our extension allows the representation of communication acts that carry intentions that are not for the interlocutor to know of, but which are made to influence him or her as well as the flow of the dialogue itself. This is achieved through a design element we have called the Communication Intention Base. Such r pr s ntation of “non- clar ” int ntions allows th construction of communication acts that carry several communication intentions simultaneously. Also in Chapter 4, an experimental system is described which allows (simulated) remote control to a home automation assistant, with biometric (speaker) authentication to grant access, featuring embodied conversation agents for each of the tasks. The discussion includes a description of the behavioural sequences for the ECAs, which were designed for specific dialogue situations with particular attention given to the objective of improving dialogue robustness. Chapters 5 to 7 form the evaluation part of the Thesis. Chapter 5 reviews evaluation approaches in the literature for information technologies, as well as in particular for speech-based interaction systems, that are useful precedents to the contributions of the present Thesis. The main evaluation precedents on which the work in this Thesis has built are the Technology Acceptance Model (TAM), the Subjective Assessment of Speech System Interfaces (SASSI) tool, and ITU-T Recommendation P.851. Chapter 6 presents the author’s work in establishing an valuation framework and methodology applied to the users’ experience with multimodal HMI systems. A novel user-acceptance Subjective Quality Evaluation Framework was developed by the author specifically for this purpose. A class structure arises from two orthogonal sets of dimensions. First we identify three broad classes of parameters related with user acceptance: likeability factors (those that have to do with the experience of using the system), rejection factors (which can only have a negative valence) and perception of usefulness. Secondly, the class structure is further broken down into several “user perception levels”; at the very least: an overall system-assessment level, task and goal-related levels, and an interface level (e.g., a dialogue system with or without an ECA). An empirical evaluation of the system described in Chapter 4 is presented in Chapter 7. The study was based on the abovementioned precedents in the literature, expanded with categories covering the inclusion of an ECA, the users’ s lf-assessed emotions, and particular rejection factors (privacy and security concerns). The Subjective Quality Evaluation Framework proposed in the previous chapter was also scrutinised. Factor analyses revealed an item structure very much related conceptually to the usefulness-likeability-rejection class division introduced above, thus giving it some empirical weight. Regression-based analysis revealed structures of dependencies, paths of interrelations, between the subjective and objective parameters considered. The central mediation effect, in the Technology Acceptance Model, of perceived usefulness on the dependency relationship of intention-to-use with perceived ease of use was confirmed in this study. Furthermore, the pattern of relationships was stronger for variables covering more broadly the likeability and usefulness categories in the Subjective Quality Evaluation Framework. Rejection factors were found to have a distinct presence as components in factor analyses, as well as distinct behaviour: they were found to moderate the relationship between intention-to-use (the main measure of user acceptance) and its strongest predictor, perceived usefulness. Insights of secondary importance are also given regarding the effect of ECAs on the interface of spoken dialogue systems and the dimensions of user perception and judgement attitude that may have a role in determining user acceptance of the technology. Despite observing slightly better performance values in the case of the system with the ECA, subjective opinions regarding both systems were, overall, very similar. Minor differences between two experimental groups (one interacting with an ECA, the other only through speech) include a more direct effect of dialogue problems (e.g., non-understandings) on perceived dialogue robustness for the voice-only interface test group, and a more positive emotional response for the ECA test group. Our findings further suggest that the ECA generates higher initial expectations, and users seem slightly more confident in their interaction with the ECA than do those without it. Finally, mild evidence of social effects of ECAs was also found: the perceived friendliness of the ECA increased security concerns, and ECA users may tend to blame themselves rather than the system when dialogue problems are encountered, while the opposite may be true for voice-only users.

Performance assessment of an architecture with adaptative interfaces for people with special needs

People in industrial societies carry more and more portable electronic devices (e.g., smartphone or console) with some kind of wireles connectivity support. Interaction with auto-discovered target devices present in the environment (e.g., the air conditioning of a hotel) is not so easy since devices may provide inaccessible user interfaces (e.g., in a foreign language that the user cannot understand). Scalability for multiple concurrent users and response times are still problems in this domain. In this paper, we assess an interoperable architecture, which enables interaction between people with some kind of special need and their environment. The assessment, based on performance patterns and antipatterns, tries to detect performance issues and also tries to enhance the architecture design for improving system performance. As a result of the assessment, the initial design changed substantially. We refactorized the design according to the Fast Path pattern and The Ramp antipattern. Moreover, resources were correctly allocated. Finally, the required response time was fulfilled in all system scenarios. For a specific scenario, response time was reduced from 60 seconds to less than 6 seconds.