Learning with tangible interfaces

Trabalho apresentado no âmbito do Mestrado em Engenharia Informática, como requisito parcial para obtenção do grau de Mestre em Engenharia Informática

ARTHUR: A Collaborative Augmented Environment for Architectural Design and Urban Planning

Projects in the area of architectural design and urban planning typically engage several architects as well as experts from other professions. While the design and review meetings thus often involve a large number of cooperating participants, the actual design is still done by the individuals in the time in between those meetings using desktop PCs and CAD applications. A real collaborative approach to architectural design and urban planning is often limited to early paper-based sketches.In order to overcome these limitations, we designed and realized the ARTHUR system, an Augmented Reality (AR) enhanced round table to support complex design and planning decisions for architects. WhileAR has been applied to this area earlier, our approach does not try to replace the use of CAD systems but rather integrates them seamlessly into the collaborative AR environment. The approach is enhanced by intuitiveinteraction mechanisms that can be easily con-figured for different application scenarios.

tCAD: a 3D modeling application on a depth enhanced tabletop computer

Tabletop computers featuring multi-touch input and object tracking are a common platform for research on Tangible User Interfaces (also known as Tangible Interaction). However, such systems are confined to sensing activity on the tabletop surface, disregarding the rich and relatively unexplored interaction canvas above the tabletop. This dissertation contributes with tCAD, a 3D modeling tool combining fiducial marker tracking, finger tracking and depth sensing in a single system. This dissertation presents the technical details of how these features were integrated, attesting to its viability through the design, development and early evaluation of the tCAD application. A key aspect of this work is a description of the interaction techniques enabled by merging tracked objects with direct user input on and above a table surface.

Numerical methods and tangible interfaces for pollutant dispersion simulation

Dissertação apresentada para obtenção do Grau de Doutor em Engenharia do Ambiente, pela Universidade Nova de Lisboa, Faculdade de Ciências e Tecnologia

Brain-Computer Interfaces for augmented communication: Asynchronous and adaptive algorithms and evaluation with end users

This thesis aimed at addressing some of the issues that, at the state of the art, avoid the P300-based brain computer interface (BCI) systems to move from research laboratories to end users’ home. An innovative asynchronous classifier has been defined and validated. It relies on the introduction of a set of thresholds in the classifier, and such thresholds have been assessed considering the distributions of score values relating to target, non-target stimuli and epochs of voluntary no-control. With the asynchronous classifier, a P300-based BCI system can adapt its speed to the current state of the user and can automatically suspend the control when the user diverts his attention from the stimulation interface. Since EEG signals are non-stationary and show inherent variability, in order to make long-term use of BCI possible, it is important to track changes in ongoing EEG activity and to adapt BCI model parameters accordingly. To this aim, the asynchronous classifier has been subsequently improved by introducing a self-calibration algorithm for the continuous and unsupervised recalibration of the subjective control parameters. Finally an index for the online monitoring of the EEG quality has been defined and validated in order to detect potential problems and system failures. This thesis ends with the description of a translational work involving end users (people with amyotrophic lateral sclerosis-ALS). Focusing on the concepts of the user centered design approach, the phases relating to the design, the development and the validation of an innovative assistive device have been described. The proposed assistive technology (AT) has been specifically designed to meet the needs of people with ALS during the different phases of the disease (i.e. the degree of motor abilities impairment). Indeed, the AT can be accessed with several input devices either conventional (mouse, touchscreen) or alterative (switches, headtracker) up to a P300-based BCI.

Na,K-ATPase activity and epithelial interfaces in gills of the freshwater shrimp Macrobrachium amazonicum (Decapoda, Palaemonidae)

Diadromous freshwater shrimps are exposed to brackish water both as an obligatory part of their larval life cycle and during adult reproductive migration; their well-developed osmoregulatory ability is crucial to survival in such habitats. This study examines gill microsomal Na,K-ATPase (K-phosphatase activity) kinetics and protein profiles in the freshwater shrimp Macrobrachium amazonicum when in fresh water and after 10-days of acclimation to brackish water (21 parts per thousand salinity), as well as potential routes of Na(+) uptake across the gill epithelium in fresh water. On acclimation, K-phosphatase activity decreases 2.5-fold, Na,K-ATPase alpha-subunit expression declines, total protein expression pattern is markedly altered, and enzyme activity becomes redistributed into different density membrane fractions, possibly reflecting altered vesicle trafficking between the plasma membrane and intracellular compartments. Ultrastructural analysis reveals an intimately coupled pillar cell-septal cell architecture and shows that the cell membrane interfaces between the external medium and the hemolymph are greatly augmented by apical pillar cell evaginations and septal cell inviginations, respectively. These findings ire discussed regarding the putative movement of Na(+) across the pillar cell interfaces and into the hemolymph via the septal cells, powered by the Na,K-ATPase located in their invaginations. (C) 2008 Elsevier Inc. All rights reserved.

Changing environmental behaviors through smartphone-based augmented experiences

Dissertação para obtenção do Grau de Mestrado em Engenharia de Informática

ISEGI-NOVA AR Project - Augmented Reality Aplied to the Universidade Nova de Lisboa

Project work presented as a partial requirement to obtain a Master Degree in Information Management

Disseny, implementació i avaluació d'un joc tangible basat en puzles per aprendre concepte de les enginyeries TIC

L'interès per les carreres relacionades amb les enginyeries del camp de les Tecnologies de la Informació i la Comunicació (TIC) va caient any rere any i això es tradueix en menys matriculacions per cada any que passa. Una de les causes principals és la falta de motivació i interès envers aquestes carreres. Aquest problema s’atribueix a que les metodologies d’aprenentatge tradicionals no s’adeqüen a les necessitats i requeriments dels estudiants d’avui dia, que han crescut envoltats de tecnologia, i se’ls coneix amb el nom en anglès de digitalnatives.L’aprenentatge basat en jocs sorgeix com a una possible solució per afrontar aquesta falta d’interès per les àrees del coneixement relacionades amb les enginyeries TIC. Aquest mètode d'aprenentatge consisteix en que els estudiants aprenguin conceptes de les TIC mentre estan jugant a un joc. Per tant, en el context d’aquest PFC, ens centrarem en el disseny i implementació d’un joc per aprendre conceptes bàsics de les enginyeries TIC. En concret, el disseny d’aquest joc segueix les característiques definides per un model conceptual que descriuquins són els elements necessaris per crear jocs basats en puzles: quins són els elements principals que componen aquests tipus de joc i quines pistes es poden afegir per guiar a l’estudiant en el procés d’aprenentatge amb el joc. Per altra banda, pel que fa a laimplementació del joc, s’utilitzarà tecnologia basada en interfícies tangibles.Per tal d’analitzar el joc basat en puzles que s’ha dissenyat i implementat per aprendre conceptes basics de les Enginyeries TIC, s’ha portat a terme una avaluació amb estudiants d’un centre educatiu. Aspectes com el disseny de pistes, l’experiència dels estudiants amb el joc il’aprenentatge amb el joc seran analitzats per extreure les conclusions oportunes.

Quantifying epistemic actions in human-computer interaction

As digital systems move away from traditional desktop setups, new interaction paradigms are emerging that better integrate with users’ realworld surroundings, and better support users’ individual needs. While promising, these modern interaction paradigms also present new challenges, such as a lack of paradigm-specific tools to systematically evaluate and fully understand their use. This dissertation tackles this issue by framing empirical studies of three novel digital systems in embodied cognition – an exciting new perspective in cognitive science where the body and its interactions with the physical world take a central role in human cognition. This is achieved by first, focusing the design of all these systems on a contemporary interaction paradigm that emphasizes physical interaction on tangible interaction, a contemporary interaction paradigm; and second, by comprehensively studying user performance in these systems through a set of novel performance metrics grounded on epistemic actions, a relatively well established and studied construct in the literature on embodied cognition. The first system presented in this dissertation is an augmented Four-in-a-row board game. Three different versions of the game were developed, based on three different interaction paradigms (tangible, touch and mouse), and a repeated measures study involving 36 participants measured the occurrence of three simple epistemic actions across these three interfaces. The results highlight the relevance of epistemic actions in such a task and suggest that the different interaction paradigms afford instantiation of these actions in different ways. Additionally, the tangible version of the system supports the most rapid execution of these actions, providing novel quantitative insights into the real benefits of tangible systems. The second system presented in this dissertation is a tangible tabletop scheduling application. Two studies with single and paired users provide several insights into the impact of epistemic actions on the user experience when these are performed outside of a system’s sensing boundaries. These insights are clustered by the form, size and location of ideal interface areas for such offline epistemic actions to occur, as well as how can physical tokens be designed to better support them. Finally, and based on the results obtained to this point, the last study presented in this dissertation directly addresses the lack of empirical tools to formally evaluate tangible interaction. It presents a video-coding framework grounded on a systematic literature review of 78 papers, and evaluates its value as metric through a 60 participant study performed across three different research laboratories. The results highlight the usefulness and power of epistemic actions as a performance metric for tangible systems. In sum, through the use of such novel metrics in each of the three studies presented, this dissertation provides a better understanding of the real impact and benefits of designing and developing systems that feature tangible interaction.

ARISupport - Interaction support for augmented reality systems

The communication between user and software is a basic stage in any Interaction System project. In interactive systems, this communication is established by the means of a graphical interface, whose objective is to supply a visual representation of the main entities and functions present in the Virtual Environment. New ways of interacting in computational systems have been minimizing the gap in the relationship between man and computer, and therefore enhancing its usability. The objective of this paper, therefore, is to present a proposal for a non-conventional user interface library called ARISupport, which supplies ARToolKit applications developers with an opportunity to create simple GUI interfaces, and provides some of the functionality used in Augmented Reality systems. © Springer-Verlag Berlin Heidelberg 2005.

Inventania: interfaces tecnológicas em invenções poéticas

Pós-graduação em Artes - IA

Interação com objetos digitais 3D em estúdios virtuais

Pós-graduação em Televisão Digital: Informação e Conhecimento - FAAC