User experience with immersive and interactive media = Experiencia de usuario en entornos 3D inmersivos e interactivos

Estudios recientes promueven la integración de estímulos multisensoriales en activos multimedia con el fin de mejorar la experiencia de usuario mediante la estimulación de nuevos sentidos, más allá de la tradicional experiencia audiovisual. Del mismo modo, varios trabajos proponen la introducción de componentes de interacción capaces de complementar con nuevas características, funcionalidades y/o información la experiencia multimedia. Efectos sensoriales basados en el uso de nuevas técnicas de audio, olores, viento, vibraciones y control de la iluminación, han demostrado tener un impacto favorable en la sensación de Presencia, en el disfrute de la experiencia multimedia y en la calidad, relevancia y realismo de la misma percibidos por el usuario. Asimismo, los servicios basados en dos pantallas y la manipulación directa de (elementos en) la escena de video tienen el potencial de mejorar la comprensión, la concentración y la implicación proactiva del usuario en la experiencia multimedia. El deporte se encuentra entre los géneros con mayor potencial para integrar y explotar éstas soluciones tecnológicas. Trabajos previos han demostrado asimismo la viabilidad técnica de integrar éstas tecnologías con los estándares actualmente adoptados a lo largo de toda la cadena de transmisión de televisión. De este modo, los sistemas multimedia enriquecidos con efectos sensoriales, los servicios interactivos multiplataforma y un mayor control del usuario sobre la escena de vídeo emergen como nuevas formas de llevar la multimedia immersiva e interactiva al mercado de consumo de forma no disruptiva. Sin embargo, existen numerosas interrogantes relativas a los efectos sensoriales y/o soluciones interactivas más adecuadas para complementar un contenido audiovisual determinado o a la mejor manera de de integrar y combinar dichos componentes para mejorar la experiencia de usuario de un segmento de audiencia objetivo. Además, la evidencia científica sobre el impacto de factores humanos en la experiencia de usuario con estas nuevas formas de immersión e interacción en el contexto multimedia es aún insuficiente y en ocasiones, contradictoria. Así, el papel de éstos factores en el potencial de adopción de éstas tecnologías ha sido amplia-mente ignorado. La presente tesis analiza el impacto del audio binaural, efectos sensoriales (de iluminación y olfativos), interacción con objetos 3D integrados en la escena de vídeo e interacción con contenido adicional utilizando una segunda pantalla en la experiencia de usuario con contenidos de deporte. La posible influencia de dichos componentes en las variables dependientes se explora tanto a nivel global (efecto promedio) como en función de las características de los usuarios (efectos heterogéneos). Para ello, se ha llevado a cabo un experimento con usuarios orientado a explorar la influencia de éstos componentes immersivos e interactivos en dos grandes dimensiones de la experiencia multimedia: calidad y Presencia. La calidad de la experiencia multimedia se analiza en términos de las posibles variaciones asociadas a la calidad global y a la calidad del contenido, la imagen, el audio, los efectos sensoriales, la interacción con objetos 3D y la interacción con la segunda pantalla. El posible impacto en la Presencia considera dos de las dimensiones definidas por el cuestionario ITC-SOPI: Presencia Espacial (Spatial Presence) e Implicación (Engagement). Por último, los individuos son caracterizados teniendo en cuenta los siguientes atributos afectivos, cognitivos y conductuales: preferencias y hábitos en relación con el contenido, grado de conocimiento de las tecnologías integradas en el sistema, tendencia a involucrarse emocionalmente, tendencia a concentrarse en una actividad bloqueando estímulos externos y los cinco grandes rasgos de la personalidad: extroversión, amabilidad, responsabilidad, inestabilidad emocional y apertura a nuevas experiencias. A nivel global, nuestro estudio revela que los participantes prefieren el audio binaural frente al sistema estéreo y que los efectos sensoriales generan un aumento significativo del nivel de Presencia Espacial percibido por los usuarios. Además, las manipulaciones experimentales realizadas permitieron identificar una gran variedad de efectos heterogéneos. Un resultado interesante es que dichos efectos no se encuentran distribuidos de forma equitativa entre las medidas de calidad y Presencia. Nuestros datos revelan un impacto generalizado del audio binaural en la mayoría de las medidas de calidad y Presencia analizadas. En cambio, la influencia de los efectos sensoriales y de la interacción con la segunda pantalla se concentran en las medidas de Presencia y calidad, respectivamente. La magnitud de los efectos heterogéneos identificados está modulada por las siguientes características personales: preferencias en relación con el contenido, frecuencia con la que el usuario suele ver contenido similar, conocimiento de las tecnologías integradas en el demostrador, sexo, tendencia a involucrarse emocionalmente, tendencia a a concentrarse en una actividad bloqueando estímulos externos y niveles de amabilidad, responsabilidad y apertura a nuevas experiencias. Las características personales consideradas en nuestro experimento explicaron la mayor parte de la variación en las variables dependientes, confirmando así el importante (y frecuentemente ignorado) papel de las diferencias individuales en la experiencia multimedia. Entre las características de los usuarios con un impacto más generalizado se encuentran las preferencias en relación con el contenido, el grado de conocimiento de las tecnologías integradas en el sistema y la tendencia a involucrarse emocionalmente. En particular, los primeros dos factores parecen generar un conflicto de atención hacia el contenido versus las características/elementos técnicos del sistema, respectivamente. Asimismo, la experiencia multimedia de los fans del fútbol parece estar modulada por procesos emociona-les, mientras que para los no-fans predominan los procesos cognitivos, en particular aquellos directamente relacionados con la percepción de calidad. Abstract Recent studies encourage the integration of multi-sensorial stimuli into multimedia assets to enhance the user experience by stimulating other senses beyond sight and hearing. Similarly, the introduction of multi-modal interaction components complementing with new features, functionalities and/or information the multimedia experience is promoted. Sensory effects as odor, wind, vibration and light effects, as well as an enhanced audio quality, have been found to favour media enjoyment and to have a positive influence on the sense of Presence and on the perceived quality, relevance and reality of a multimedia experience. Two-screen services and a direct manipulation of (elements in) the video scene have the potential to enhance user comprehension, engagement and proactive involvement of/in the media experience. Sports is among the genres that could benefit the most from these solutions. Previous works have demonstrated the technical feasibility of implementing and deploying end-to-end solutions integrating these technologies into legacy systems. Thus, sensorially-enhanced media, two-screen services and an increased user control over the displayed scene emerge as means to deliver a new form of immersive and interactive media experiences to the mass market in a non-disruptive manner. However, many questions remain concerning issues as the specific interactive solutions or sensory effects that can better complement a given audiovisual content or the best way in which to integrate and combine them to enhance the user experience of a target audience segment. Furthermore, scientific evidence on the impact of human factors on the user experience with these new forms of immersive and interactive media is still insufficient and sometimes, contradictory. Thus, the role of these factors on the potential adoption of these technologies has been widely ignored. This thesis analyzes the impact of binaural audio, sensory (light and olfactory) effects, interaction with 3D objects integrated into the video scene and interaction with additional content using a second screen on the sports media experience. The potential influence of these components on the dependent variables is explored both at the overall level (average effect) and as a function of users’ characteristics (heterogeneous effects). To these aims, we conducted an experimental study exploring the influence of these immersive and interactive elements on the quality and Presence dimensions of the media experience. Along the quality dimension, we look for possible variations on the quality scores as-signed to the overall media experience and to the media components content, image, audio, sensory effects, interaction with 3D objects and interaction using the tablet device. The potential impact on Presence is analyzed by looking at two of the four dimensions defined by the ITC-SOPI questionnaire, namely Spatial Presence and Engagement. The users’ characteristics considered encompass the following personal affective, cognitive and behavioral attributes: preferences and habits in relation to the content, knowledge of the involved technologies, tendency to get emotionally involved and tendency to get absorbed in an activity and block out external distractors and the big five personality traits extraversion, agreeableness, conscientiousness, neuroticism and openness to experience. At the overall level, we found that participants preferred binaural audio than standard stereo audio and that sensory effects increase significantly the level of Spatial Presence. Several heterogeneous effects were also revealed as a result of our experimental manipulations. Interestingly, these effects were not equally distributed across the quality and Presence measures analyzed. Whereas binaural audio was foud to have an influence on the majority of the quality and Presence measures considered, the effects of sensory effects and of interaction with additional content through the tablet device concentrate mainly on the dimensions of Presence and on quality measures, respectively. The magnitude of these effects was modulated by individual’s characteristics, such as: preferences in relation to the content, frequency of viewing similar content, knowledge of involved technologies, gender, tendency to get emotionally involved, tendency to absorption and levels of agreeableness, conscientiousness and openness to experience. The personal characteristics collected in our experiment explained most of the variation in the dependent variables, confirming the frequently neglected role of individual differences on the media experience. Preferences in relation to the content, knowledge of involved technologies and tendency to get emotionally involved were among the user variables with the most generalized influence. In particular, the former two features seem to present a conflict in the allocation of attentional resources towards the media content versus the technical features of the system, respectively. Additionally, football fans’ experience seems to be modulated by emotional processes whereas for not fans, cognitive processes (and in particular those related to quality judgment) prevail.

CrashEd – A live immersive, learning experience embedding STEM subjects in a realistic, interactive crime scene

Interactive experiences are rapidly becoming popular via the surge of ‘escape rooms’; part game and part theatre, the ‘escape’ experience is exploding globally, having gone from zero offered at the outset of 2010 to at least 2800 different experiences available worldwide today. CrashEd is an interactive learning experience that parallels many of the attractions of an escape room – it incorporates a staged, realistic ‘crime scene’ and invites participants to work together to gather forensic evidence and question a witness in order to solve a crime, all whilst competing against a ticking clock. An animation can enhance reality and engage with cognitive processes to help learning; in CrashEd, it is the last piece of the jigsaw that consolidates the students’ incremental acquisition of knowledge to tie together the pieces of evidence, identify a suspect and ultimately solve the crime. This article presents the background to CrashEd and an overview of how a timely placed animation at the end of an educational experience can enhance learning. The lessons learned, from delivering bespoke versions of the experience to different demographic groups, are discussed. The article will consider the successes and challenges raised by the collaborative project, future developments and potential wider implications of the development of CrashEd.

The Process of Simulation Authoring/Creation by Chemistry Teachers: A Service Learning Experience

Two case studies are presented to describe the process of public school teachers authoring and creating chemistry simulations. They are part of the Virtual Didactic Laboratory for Chemistry, a project developed by the School of the Future of the University of Sao Paulo. the documental analysis of the material produced by two groups of teachers reflects different selection process for both themes and problem-situations when creating simulations. The study demonstrates the potential for chemistry learning with an approach that takes students' everyday lives into account and is based on collaborative work among teachers and researches. Also, from the teachers' perspectives, the possibilities of interaction that a simulation offers for classroom activities are considered.

Interactive whiteboards in Portuguese primary schools: the teachers' view

Focusing on the use of Interactive Whiteboards (IWBs) in primary schools in Oeiras municipality, this article presents primary teachers’ views, from their experience, on the implementation of this innovation as a resource for the teaching and learning processes. IWBs have been recently launched in the framework of a major program aiming the technological modernization of Portuguese schools, in order to promote the use of ICT in teaching and learning, as well as in school management. Findings show that teachers are enthusiastic about Interactive White Boards because they really believe their pupils learn better and in a more joyful way. However, they draw attention to the need of training in order to fully exploit the potential of this resourc

Post-MAPS: An interactive acquisition platform for gastroenterology

Post-MAPS is a web platform that collects gastroenterological exam data from several european hospital centers, to be used in future clinical studies and was developed in partnership with experts from the gastroenterological area and information technology (IT) technicians. However, although functional, this platform has some issues that are crucial for its functioning, and can render user interaction unpleasant and exhaustive. Accordingly, we proposed the development of a new web platform, in which we aimed for an improvement in terms of usability, data uni cation and interoperability. Therefore, it was necessary to identify and study different ways of acquiring clinical data and review some of the existing clinical databases in order to understand how they work and what type of data they store, as well as their impact and contribution to clinical knowledge. Closely linked to the data model is the ability to share data with other systems, so, we also studied the concept of interoperability and analyzed some of the most widely used international standards, such as DICOM, HL7 and openEHR. As one of the primary objectives of this project was to achieve a better level of usability, practices related to Human Computer-Interaction, such as requirement analysis, creation of conceptual models, prototyping, and evaluation were also studied. Before we began the development, we conducted an analysis of the previous platform, from a functional point of view, which allowed us to gather not only a list of architectural and interface issues, but also a list of improvement opportunities. It was also performed a small preliminary study in order to evaluate the platform's usability, where we were able to realize that perceived usability is different between users, and that, in some aspects, varies according to their location, age and years of experience. Based on the information gathered during the platform's analysis and in the conclusions of the preliminary study, a new platform was developed, prepared for all potential users, from the inexperienced to the most comfortable with technology. It presents major improvements in terms of usability, also providing several new features that simplify the users' work, improving their interaction with the system, making their experience more enjoyable.

Public Participation geographic information systems in developing countries: lessons from Uganda on the impacts of interactive screens PPGIS and community perceptions of space

Dissertation submitted in partial fulfillment of the requirements for the Degree of Master of Science in Geospatial Technologies.

Evaluation of an online, case-based interactive approach to teaching pathophysiology

AIM: The aim of this study was to evaluate a new pedagogical approach in teaching fluid, electrolyte and acid-base pathophysiology in undergraduate students. METHODS: This approach comprises traditional lectures, the study of clinical cases on the web and a final interactive discussion of these cases in the classroom. When on the web, the students are asked to select laboratory tests that seem most appropriate to understand the pathophysiological condition underlying the clinical case. The percentage of students having chosen a given test is made available to the teacher who uses it in an interactive session to stimulate discussion with the whole class of students. The same teacher used the same case studies during 2 consecutive years during the third year of the curriculum. RESULTS: The majority of students answered the questions on the web as requested and evaluated positively their experience with this form of teaching and learning. CONCLUSIONS: Complementing traditional lectures with online case-based studies and interactive group discussions represents, therefore, a simple means to promote the learning and the understanding of complex pathophysiological mechanisms. This simple problem-based approach to teaching and learning may be implemented to cover all fields of medicine.

Experience and intermediate-term results using the Contegra heterograft for right ventricular outflow reconstruction in adults.

OBJECTIVES: The Contegra bioprosthesis (valved heterologous bovine jugular vein) is used for reconstruction of the right ventricular outflow tract (RVOT) in congenital heart malformations and pulmonary valve replacement in different settings. Compared to pulmonary homografts, the Contegra conduit is readily available 'on the shelf'. So far, its use was mainly described in children. The aim of this study is to evaluate the feasibility and the outcome of Contegra graft implantation in the adult. METHODS: Between November 1999 and December 2007, a total of 32 Contegra grafts were implanted in 31 patients (24 men and 7 women), with a mean age of 35.7+/-10.5 years (range 18-54 years). All operations have been completed through median sternotomy with cardiopulmonary bypass. Indications included: Ross procedure for aortic valve disease (n=22); re-operation of corrected Fallot-tetralogy (n=5); isolated pulmonary valve disease (n=2); re-operation of double outlet right ventricle (DORV) (n=1); pulmonary stenosis in congenital dilated cardiomyopathy (DCM) (n=1). Conduit sizes included 22 mm (n=31), 20 mm (n=1). RESULTS: There was no hospital mortality and no valved conduit related early morbidity. In the median follow-up of 38 months (range 1-99 months) of 28 patients there was one late death, not conduit related (total mortality 3.6%). Re-operation for symptomatic graft stenosis was realised in two patients, 7 and 16 months after primo-implantation, corresponding to graft related late morbidity of 7.1%. CONCLUSIONS: In this small review of 32 operations using the Contegra graft for RVOT reconstruction in adult cardiac surgery for different indications, we observed good postoperative mid-term results concerning conduit function. Mean transpulmonary pressure gradients remain low (13.3+/-6.6 mmHg postoperative, 14.5+/-7.9 mmHg at follow-up). The use of the Contegra graft seems to be a good alternative to the homograft with low operative mortality and morbidity. Long-term outcome data are not available and further investigations must be performed to evaluate results.

Systematic and exclusive use of intravascular ultrasound for endovascular aneurysm repair - the Lausanne experience.

Five years of experience with endovascular infrarenal aneurysm repair at our institution is reviewed. Implantation of endoprostheses in 88 patients has been performed by surgeons using exclusively intravascular ultrasound (IVUS) and fluoroscopy. IVUS identified the target site of deployment in all cases. In-hospital morbidity was 22% (19/88). Two percent mortality (2/88) and 5% early conversion (4/88) as a consequence of type I endoleaks were noted only in the first 53 patients with early devices (NS). Early endoleaks were present in 36% (32/88) including twenty-two type I, five type II and five type III endoleaks. Proximal endoleaks were associated with early devices (P<0.001), and technical difficulties with deployment. Tube grafts used in the beginning, performed poorly with 54% (7/13) type I endoleaks. Endoleaks diminished to 10% (9/88) by spontaneous closure and secondary endovascular procedures that were necessary in 24% (21/88) and consisted of coil embolization/cuff extension (9), late conversion (6), and limb recanalization or femoral cross-over bypass (6). Endovascular aneurysm repair using IVUS is a valid alternative technique. Improved devices and systematic use of bifurcated endoprostheses for infrarenal aneurysms reduce the occurrence of type I endoleaks.

Inviting the Audience – Interactive, Participatory, and Social Television in Finland

The television and the ways it has invited the audience to take part have been changing during the last decade. Today’s interaction, or rather participation, comes from multiplatform formats, such as TV spectacles that combine TV and web platforms in order to create a wider TV experience. Multiplatform phenomena have spread television consumption and traditional coffee table discussions to several different devices and environments. Television has become a part of the bigger puzzle of interconnected devices that operates on several platforms instead of just one. This thesis examines the Finnish television (2004–2014) through the notion of audience participation and introduces the technical, thematic, and social linkages as three different phases, interactive, participatory, social, and their most characteristic features in terms of audience participation. The aim of the study is also to focus on the idea of a possible change by addressing the possible and subtler variations that have taken place through the concept of digital television. Firstly, Finnish television history has gone through numerous trials, exploring the interactive potential of television formats. Finnish SMS-based iTV had its golden era around 2005, when nearly 50% of the television formats were to some extent interactive. Nowadays, interactive television formats have vanished due to their negative reputation and this important part of recent history is mainly been neglected in the academic scope. The dissertation focuses also on the present situation and the ways television content invites the audience to take part. “TV meets the Internet” is a global expression that characterises digital TV, and the use of the Web combined with television content is also examined. Also the linkages between television and social media are identified. Since television can nowadays be described multifaceted, the research approaches are also versatile. The research is based on qualitative content analysis, media observation, and Internet inquiry. The research material also varies. It consists of primary data: taped iTV formats, website material, and social media traces both from Twitter and Facebook and secondary data: discussion forums, observations from the media and Internet inquiry data. To sum up the results, the iTV phase represented, through its content, a new possibility for audiences to take part in a TV show (through gameful and textual features) in real-time. In participatory phase, the most characteristic features from TV-related content view, is the fact that online platform(s) were used to immerse the audience with additional material and, due to this, to extend the TV watching enjoyment beyond the actual broadcast. During the Social (media) phase, both of these features, real-timeness, and extended enjoyment through additional material, are combined and Facebook & Twitter, for example, are used to immerse people in live events (in real-time) via broadcast-related tweets and extra-material offered on a Facebook page. This thesis fills in the gap in Finnish television research by examining the rapid changes taken place on the field within the last ten years. The main results is that the development of Finnish digital television has been much more diverse and subtle than has been anticipated by following only the news, media, and contemporary discourses on the subject of television. The results will benefit both practitioners and academics by identifying the recent history of Finnish television.

Influencing Perceived Agency: A Study into User Experiences in Digital Interactive Storytelling

User experience is a crucial element in interactive storytelling, and as such it is important to recognize the different aspects of a positive user experience in an interactive story. Towards that goal, in the first half of this thesis, we will go through the different elements that make up the user experience, with a strong focus on agency. Agency can be understood as the user’s ability to affect the story or the world in which the story is told with interesting and satisfying choices. The freedoms granted by agency are not completely compatible with traditional storytelling, and as such we will also go through some of the issues of agency-centric design philosophies and explore alternate schools of thought. The core purpose of this thesis is to determine the most important aspects of agency with regards to a positive user experience and attempt to find ways for authors to improve the overall quality of user experience in interactive stories. The latter half of this thesis deals with the research conducted on this matter. This research was carried out by analyzing data from an online survey coupled with data gathered by the interactive storytelling system specifically made for this research (Regicide). The most important aspects of this research deal with influencing perceived agency and facilitating an illusion of agency in different ways, and comparing user experiences in these different test environments. The most important findings based on this research include the importance of context-controlled and focused agency and settings in which the agency takes place and the importance of ensuring user-competency within an interactive storytelling system. Another essential conclusion to this research boils down to communication between the user and the system; the goal of influencing perceived agency should primarily be to ensure that the user is aware of all the theoretical agency they possess.

The interpretation of music videos : an interactive relationship between medium and viewer

There is a great deal of evidence to support the examination of an interactive relationship between the medium and the viewer in the interpretation of mainstream media. The exact nature of this relationship, however, is not well understood. The current study was carried out to assess the variables that may help explain why certain people interpret media, such as music videos, differently than others. Jensen's concept of reception analysis describes the relationship between the medium and the audience, and thus remains a strong focus within this study. Differences in the interpretation of music videos were investigated as a function of Absorption, gender role, screen size, age and viewing experience. Multiple regression analyses uncovered independent predictions of sexuality and violence scores by absorption and experience, as well as an interaction between absorption and screen size in the sexuality rating of the music videos.

Réseau de recherche E-Inclusion, thème 3 : Audiovision interactive et adaptable, projet 3.1, rapport final

Le Réseau de recherche E-Inclusion a pour but de permettre à tous les Canadiens d’accéder au contenu informationnel de documents audiovisuels. Le thème 3 du projet, Audiovision interactive et adaptable, avait pour but d'offrir des lignes directrices à l'intention de producteurs de films et d'émissions de télévision concernant le contenu de textes d'audiovision, et de mesurer l'utilité potentielle, pour la production de textes d'audiovision à partir de mots-clés générés dans d'autres contextes.

The autotelic experience : a design approach to user experience

Si les principes d’utilisabilité guident la conception de solutions de design interactif pour s’assurer que celles-ci soient « utilisables », quels principes guident la conception d’objets interactifs pour s’assurer que l’expérience subjective de l’usager (UX) soit adéquate et mémorable? Que manque-t-il au cadre de l‘UX pour expliquer, comprendre, et anticiper en tant que designer une expérience mémorable (‘an experience’; Dewey, 1934)? La question centrale est issue d’une double problématique : (1) le cadre théorique de l’UX est incomplet, et (2) les processus et capacités des designers ne sont pas considérés et utilisés à leur pleine capacité en conception UX. Pour répondre à cette question, nous proposons de compléter les modèles de l’UX avec la notion d’expérience autotélique qui appartient principalement à deux cadres théoriques ayant bien cerné l’expérience subjective, soit l’expérience optimale (ou Flow) de Csikszentmihalyi (1988) et l’expérience esthétique selon Schaeffer (2001). L’autotélie est une dimension interne du Flow alors qu’elle couvre toute l’expérience esthétique. L’autotélie est une expérience d’éveil au moment même de l’interaction. Cette prise de conscience est accompagnée d’une imperceptible tension de vouloir faire durer ce moment pour faire durer le plaisir qu’il génère. Trois études exploratoires ont été faites, s’appuyant sur une analyse faite à partir d’un cadre théorique en trois parties : le Flow, les signes d’activité non verbale (les gestes physiques) et verbale (le discours) ont été évalués pour voir comment ceux-ci s’associent. Nos résultats tendent à prouver que les processus spatiaux jouent un rôle de premier plan dans l’expérience autotélique et par conséquent dans une UX optimale. De plus, ils suggèrent que les expériences pragmatique et autotélique sont ancrées dans un seul et même contenu, et que leur différence tient au type d’attention que le participant porte sur l’interaction, l’attention ordinaire ou de type autotélique. Ces résultats nous ont menés à proposer un modèle pour la conception UX. L’élément nouveau, resté jusqu’alors inaperçu, consiste à s’assurer que l’interface (au sens large) appelle une attitude réceptive à l’inattendu, pour qu’une information puisse déclencher les processus spatiaux, offrant une opportunité de passer de l’attention ordinaire à l’attention autotélique. Le nouveau modèle ouvre la porte à une meilleure valorisation des habiletés et processus du designer au sein de l’équipe multidisciplinaire en conception UX.

Towards a Skills Audit: identifying your experience

A workshop session which looks at skills from an employers perspective. Slides plus link to Graduate Recruiters Association. Used in first small group class of info1010 - covers ground rules, career destinations, typical earnings,types of jobs and skills evaluation. Slides are reference for interactive discussions