Belfast Soundwalks: Experiences in Sound and Place through Locative Media

This article outlines the ongoing development of a locative smartphone app for iPhone and Android phones entitled The Belfast Soundwalks Project. Drawing upon a method known as soundwalking, the aim of this app is to engage the public in sonic art through the creation of up to ten soundwalks within the city of Belfast. This paper discusses the use of GPS enabled mobile devices in the creation of soundwalks in other cities. The authors identify various strategies for articulating an experience of listening in place as mediated by mobile technologies. The project aims to provide a platform for multiple artists to develop site-specific sound works which highlight the relationship between sound, place and community. The development of the app and the app interface are discussed, as are the methods employed to test and evaluate the project.

Laughter Type Recognition from Whole Body Motion

Despite the importance of laughter in social interactions it remains little studied in affective computing. Respiratory, auditory, and facial laughter signals have been investigated but laughter-related body movements have received almost no attention. The aim of this study is twofold: first an investigation into observers' perception of laughter states (hilarious, social, awkward, fake, and non-laughter) based on body movements alone, through their categorization of avatars animated with natural and acted motion capture data. Significant differences in torso and limb movements were found between animations perceived as containing laughter and those perceived as nonlaughter. Hilarious laughter also differed from social laughter in the amount of bending of the spine, the amount of shoulder rotation and the amount of hand movement. The body movement features indicative of laughter differed between sitting and standing avatar postures. Based on the positive findings in this perceptual study, the second aim is to investigate the possibility of automatically predicting the distributions of observer's ratings for the laughter states. The findings show that the automated laughter recognition rates approach human rating levels, with the Random Forest method yielding the best performance.

An Event Driven Fusion Approach for Enjoyment Recognition in Real-time

Social signals and interpretation of carried information is of high importance in Human Computer Interaction. Often used for affect recognition, the cues within these signals are displayed in various modalities. Fusion of multi-modal signals is a natural and interesting way to improve automatic classification of emotions transported in social signals. Throughout most present studies, uni-modal affect recognition as well as multi-modal fusion, decisions are forced for fixed annotation segments across all modalities. In this paper, we investigate the less prevalent approach of event driven fusion, which indirectly accumulates asynchronous events in all modalities for final predictions. We present a fusion approach, handling short-timed events in a vector space, which is of special interest for real-time applications. We compare results of segmentation based uni-modal classification and fusion schemes to the event driven fusion approach. The evaluation is carried out via detection of enjoyment-episodes within the audiovisual Belfast Story-Telling Corpus.

Design guidelines for developing customised serious games for parkinson's disease rehabilitation using bespoke game sensors

The research presented in this paper proposes a set of design guidelines in the context of a Parkinson's Disease (PD) rehabilitation design framework for the development of serious games for the physical therapy of people with PD. The game design guidelines provided in the paper are informed by the study of the literature review and lessons learned from the pilot testing of serious games designed to suit the requirements of rehabilitation of patients with Parkinson's Disease. The proposed PD rehabilitation design framework employed for the games pilot testing utilises a low-cost, customized and off-the-shelf motion capture system (employing commercial game controllers) developed to cater for the unique requirement of the physical therapy of people with PD. Although design guidelines have been proposed before for the design of serious games in health, this is the first research paper to present guidelines for the design of serious games specifically for PD motor rehabilitation.

Robust bimodal person identification using face and speech with limited training data and corruption of both modalities

This paper presents a novel method of audio-visual fusion for person identification where both the speech and facial modalities may be corrupted, and there is a lack of prior knowledge about the corruption. Furthermore, we assume there is a limited amount of training data for each modality (e.g., a short training speech segment and a single training facial image for each person). A new representation and a modified cosine similarity are introduced for combining and comparing bimodal features with limited training data as well as vastly differing data rates and feature sizes. Optimal feature selection and multicondition training are used to reduce the mismatch between training and testing, thereby making the system robust to unknown bimodal corruption. Experiments have been carried out on a bimodal data set created from the SPIDRE and AR databases with variable noise corruption of speech and occlusion in the face images. The new method has demonstrated improved recognition accuracy.

Virtual Thrower Versus Real Goalkeeper: The Influence of Different Visual Conditions on Performance

In order to use virtual reality as a sport analysis tool, we need to be sure that an immersed athlete reacts realistically in a virtual environment. This has been validated for a real handball goalkeeper facing a virtual thrower. However, we currently ignore which visual variables induce a realistic motor behavior of the immersed handball goalkeeper. In this study, we used virtual reality to dissociate the visual information related to the movements of the player from the visual information related to the trajectory of the ball. Thus, the aim is to evaluate the relative influence of these different visual information sources on the goalkeeper's motor behavior. We tested 10 handball goalkeepers who had to predict the final position of the virtual ball in the goal when facing the following: only the throwing action of the attacking player (TA condition), only the resulting ball trajectory (BA condition), and both the throwing action of the attacking player and the resulting ball trajectory (TB condition). Here we show that performance was better in the BA and TB conditions, but contrary to expectations, performance was substantially worse in the TA condition. A significant effect of ball landing zone does, however, suggest that the relative importance between visual information from the player and the ball depends on the targeted zone in the goal. In some cases, body-based cues embedded in the throwing actions may have a minor influence on the ball trajectory and vice versa. Kinematics analysis was then combined with these results to determine why such differences occur depending on the ball landing zone and consequently how it can clarify the role of different sources of visual information on the motor behavior of an athlete immersed in a virtual environment.

Laughter and Humour as Conversational Mind-Reading Displays

Laughter and humor are pervasive phenomena in conversa- tional interactions. This paper argues that they function as displays of mind-reading abilities in social interactions–as suggested by the Analogi- cal Peacock Hypothesis (APH). In this view, they are both social bonding signals and can elevate one’s social status. The relational combination of concepts in humor is addressed. However, it is in the inclusion of context and receiver knowledge, required by the APH view, that it contributes the most to existing theories. Taboo and offensive humor are addressed in terms of costly signaling, and implications for human computer inter- action and some possible routes to solutions are suggested.

Beyond the artefact and techno-centricity: towards process-centric understanding of architecture - alternative facilitation strategies and proposals

The artefact and techno-centricity of the research into the architecture process needs to be counterbalanced by other approaches. An increasing amount of information is collected and used in the process, resulting in challenges related to information and knowledge management, as this research evidences through interviews with practicing architects. However, emerging technologies are expected to resolve many of the traditional challenges, opening up new avenues for research. This research suggests that among them novel techniques addressing how architects interact with project information, especially that indirectly related to the artefacts, and tools which better address the social nature of work, notably communication between participants, become a higher priority. In the fields associated with the Human Computer Interaction generic solutions still frequently prevail, whereas it appears that specific alternative approaches would be particularly in demand for the dynamic and context dependent design process. This research identifies an opportunity for a process-centric and integrative approach for architectural practice and proposes an information management and communication software application, developed for the needs discovered in close collaboration with architects. Departing from the architects’ challenges, an information management software application, Mneme, was designed and developed until a working prototype. It proposes the use of visualizations as an interface to provide an overview of the process, facilitate project information retrieval and access, and visualize relationships between the pieces of information. Challenges with communication about visual content, such as images and 3D files, led to a development of a communication feature allowing discussions attached to any file format and searchable from a database. Based on the architects testing the prototype and literature recognizing the subjective side of usability, this thesis argues that visualizations, even 3D visualizations, present potential as an interface for information management in the architecture process. The architects confirmed that Mneme allowed them to have a better project overview, to easier locate heterogeneous content, and provided context for the project information. Communication feature in Mneme was seen to offer a lot of potential in design projects where diverse file formats are typically used. Through empirical understanding of the challenges in the architecture process, and through testing the resulting software proposal, this thesis suggests promising directions for future research into the architecture and design process.

Time in Perspective: a visual approach to models of time

Geographical representations of topographical space come in many shapes and are a regular topic of discussion. The depiction of the invisible and maybe even illusory concept of time on the other hand, remains largely unchanged and undisputed. A uniform and arithmetic model of time fits well with the rigid structure of digital data, which might be why it has been widely adopted within HCI. In our proposal, we will present historic and contemporary approaches that offer alternative perspectives on the visual representation of time. Keywords: timeline, chronographics

Scholarly chronographics: can a timeline be useful in historiography?

Our paper is concerned with the visualisation of historical events and artefacts in the context of time. It arises from a project bringing together expertise in visualisation, historiography and software engineering. The work is the result of an extended enquiry over several years which has included investigation of the prior history of such chronographics and their grounding in the temporal ontology of the Enlightenment. Timelines - visual, spatial presentations of chronology - are generally regarded as being too simple, perhaps too childish, to be worthy of academic attention, yet such chronographics should be capable of supporting sophisticated thinking about history and historiography, especially if they take full advantage of the capabilities of digital technologies. They should enable even professional academic historians to 'make sense' of history in new ways, allowing them insights they would not otherwise have achieved. In our paper we highlight key findings from the history of such representations, principally from the eighteenth and nineteenth centuries, and show how, in a project to develop new digital chronographics for collections of cultural objects and events, we have explored new implementations of the important ideas we have extracted about timewise presentation and interaction. This includes the representation of uncertainty, of relations between events, and the epistemology of time as a 'space' for history. We present developed examples, in particular a chronographic presentation of a large database of works by a single author, a composer, and discuss the extent to which our ambitions for chronographics have been realised in practice. Keywords: timeline, chronographics

Avaliação da Usabilidade de um Projeto de eHealth, enquadrado na visão europeia de Health Technology Assessment (HTA)

Trabalho de projeto apresentado à Escola Superior de Comunicação Social como parte dos requisitos para obtenção de grau de mestre em Audiovisual e Multimédia.

Proposta de normalização da gestão de sinistros, na relação entre hospitais e fornecedores de seguros de saúde

Trabalho de projeto apresentado à Escola Superior de Comunicação Social como parte dos requisitos para obtenção de grau de mestre em Audiovisual e Multimédia.