Real-time audio interaction in serious games for music learning

In this LBD, we present several Apps for playing while learning music or for learning music while playing. The core of all the games is based on the good performance of the real-time audio interaction algorithms developed by the ATIC group at Universidad de Ma ́laga (SPAIN).

Serendipitous road trips: Enhancing tourists’ experiences through social interaction

Driving can be a lonely activity. While there has been a lot of research and technical inventions concerning car-to-car communication and passenger entertainment, there is still little work concerning connecting drivers. Whereas tourism is very much a social activity, drive tourists have few options to communicate with fellow travellers. The proposed project is placed at the intersection of tourism and driving and aims to enhance the trip experience during driving through social interaction. This thesis explores how a mobile application that allows instant messaging between travellers sharing similar context can add to road trip experiences. To inform the design of such an application, the project adopted the principle of the user-centred design process. User needs were assessed by running an ideation workshop and a field trip. Findings of both studies have shown that tourists have different preferences and diverse attitudes towards contacting new people. Yet all participants stressed the value of social recommendations. Based on those results and a later expert review, three prototype versions of the system were created. A prototyping session with potential end users highlighted the most important features including the possibility to view user profiles, choose between text and audio input and receive up-to-date information. An implemented version of the prototype was evaluated in an exploratory study to identify usability related problems in an actual use case scenario as well as to find implementation bugs. The outcomes of this research are relevant for the design of future mobile tourist guides that leverage from benefits of social recommendations.

Emotional experience in psychotherapeutic interaction : Conversation analytical study on cognitive psychotherapy

The dissertation examines how emotional experiences are oriented to in the details of psychotherapeutic interaction. The data (57 audio recorded sessions) come from one therapist-patient dyad in cognitive psychotherapy. Conversation analysis is used as method. The dissertation consists of 4 original articles and a summary. The analyses explicate the therapist s practices of responding to the patient s affective expressions. Different types of affiliating responses are identified. It is shown that the affiliating responses are combined with, or build grounds for, more interpretive and challenging actions. The study also includes a case study of a session with strong misalignment between the therapist s and patient s orientations, showing how this misalignment is managed by the therapist. Moreover, through a longitudinal analysis of the transformation of a sequence type, the study suggests that therapeutic change processes can be located to sequential relations of actions. The practices found in this study are compared to earlier research on everyday talk and on medical encounters. It is suggested that in psychotherapeutic interaction, the generic norms of interaction considering affiliation and epistemic access, are modified for the purposes of therapeutic work. The study also shows that the practices of responding to emotional experience in psychotherapy can deviate from the everyday practices of affiliation. The results of the study are also discussed in terms of concepts arising from clinical theory. These include empathy, validation of emotion, therapeutic alliance, interpretation, challenging beliefs, and therapeutic change. The therapist s approach described in this study involves practical integration of different clinical theories. In general terms, the study suggests that in the details of interaction, psychotherapy recurrently performs a dual task of empathy and challenging in relation to the patient s ways of describing their experiences. Methodologically, the study discusses the problem of identifying actions in conversation analysis of psychotherapy and emotional interaction, and the possibility to apply conversation analysis in the study of therapeutic change.

Multimodal Biometric Human Recognition for Perceptual Human-Computer Interaction

In this paper, a novel video-based multimodal biometric verification scheme using the subspace-based low-level feature fusion of face and speech is developed for specific speaker recognition for perceptual human--computer interaction (HCI). In the proposed scheme, human face is tracked and face pose is estimated to weight the detected facelike regions in successive frames, where ill-posed faces and false-positive detections are assigned with lower credit to enhance the accuracy. In the audio modality, mel-frequency cepstral coefficients are extracted for voice-based biometric verification. In the fusion step, features from both modalities are projected into nonlinear Laplacian Eigenmap subspace for multimodal speaker recognition and combined at low level. The proposed approach is tested on the video database of ten human subjects, and the results show that the proposed scheme can attain better accuracy in comparison with the conventional multimodal fusion using latent semantic analysis as well as the single-modality verifications. The experiment on MATLAB shows the potential of the proposed scheme to attain the real-time performance for perceptual HCI applications.

Understanding Online Audio-Visual Content: A European Initiative, Media Literacy and the User

Recent debates about media literacy and the internet have begun to acknowledge the importance of active user-engagement and interaction. It is not enough simply to access material online, but also to comment upon it and re-use. Yet how do these new user expectations fit within digital initiatives which increase access to audio-visual-content but which prioritise access and preservation of archives and online research rather than active user-engagement? This article will address these issues of media literacy in relation to audio-visual content. It will consider how these issues are currently being addressed, focusing particularly on the high-profile European initiative EUscreen. EUscreen brings together 20 European television archives into a single searchable database of over 40,000 digital items. Yet creative re-use restrictions and copyright issues prevent users from re-working the material they find on the site. Instead of re-use, EUscreen instead offers access and detailed contextualisation of its collection of material. But if the emphasis for resources within an online environment rests no longer upon access but on user-engagement, what does EUscreen and similar sites offer to different users?

From activity to active learning: drawing and dialogue interaction in virtual learning environments for computer-supported collaborative work in design.

Virtual learning environments (VLEs) would appear to be particular effective in computer-supported collaborative work (CSCW) for active learning. Most research studies looking at computer-supported collaborative design have focused on either synchronous or asynchronous modes of communication, but near-synchronous working has received relatively little attention. Yet it could be argued that near-synchronous communication encourages creative, rhetorical and critical exchanges of ideas, building on each other’s contributions. Furthermore, although many researchers have carried out studies on collaborative design protocol, argumentation and constructive interaction, little is known about the interaction between drawing and dialogue in near-synchronous collaborative design. The paper reports the first stage of an investigation into the requirements for the design and development of interactive systems to support the learning of collaborative design activities. The aim of the study is to understand the collaborative design processes while sketching in a shared white board and audio conferencing media. Empirical data on design processes have been obtained from observation of seven sessions with groups of design students solving an interior space-planning problem of a lounge-diner in a virtual learning environment, Lyceum, an in-house software developed by the Open University to support its students in collaborative learning.

The distributed work of local action: interaction amongst virtually collocated research teams

Existing research on synchronous remote working in CSCW has highlighted the troubles that can arise because actions at one site are (partially) unavailable to remote colleagues. Such ‘local action’ is routinely characterised as a nuisance, a distraction, subordinate and the like. This paper explores interconnections between ‘local action’ and ‘distributed work’ in the case of a research team virtually collocated through ‘MiMeG’. MiMeG is an e-Social Science tool that facilitates ‘distributed data sessions’ in which social scientists are able to remotely collaborate on the real-time analysis of video data. The data are visible and controllable in a shared workspace and participants are additionally connected via audio conferencing. The findings reveal that whilst the (partial) unavailability of local action is at times problematic, it is also used as a resource for coordinating work. The paper considers how local action is interactionally managed in distributed data sessions and concludes by outlining implications of the analysis for the design and study of technologies to support group-to-group collaboration.

Sacks, Arlyne, interviewed by Margo Derecktor on January 9th, 2010: Audio

Some of the themes discussed are: • Colby—student life (page 2) • Colby—Greek life (3, 8) • Colby—student interaction with Waterville Jews (5, 12) • Holidays (6, 9, 12) • Marriage (6) • Colby—Jewish students from away (8) • Levine’s Store (9) • Food (10) • Occupation—woolen mills (11) • Occupation— real estate development (11) • Jewish education (12, 15) • Yiddish (13)

Rosenthal, Bob, interviewed by Becky Muller on January 17, 2009: Audio

Some of the themes discussed are: • Civic engagement (2) • The Levine family (2) • High school—private (3) • Colby (4) • Colby—student interaction with Waterville Jews (5) • Dating (6, 7, 18-20) • Life in Waterville (8, 10) • Life in Waterville—movies (12-13) • Colby—Greek life (9) • Colby—administration (9-10) • Occupation—real estate development (10-12, 13, 17) • Camp—Arcadia (13-14) • Military service (16) • Civic engagement (22) • Jewish education (23) • Holidays (23-24)

Rosenthal, Bob, interviewed by Becky Muller on January 17, 2009: Audio Part Two

Some of the themes discussed are: • Civic engagement (2) • The Levine family (2) • High school—private (3) • Colby (4) • Colby—student interaction with Waterville Jews (5) • Dating (6, 7, 18-20) • Life in Waterville (8, 10) • Life in Waterville—movies (12-13) • Colby—Greek life (9) • Colby—administration (9-10) • Occupation—real estate development (10-12, 13, 17) • Camp—Arcadia (13-14) • Military service (16) • Civic engagement (22) • Jewish education (23) • Holidays (23-24)

Hopengarten, Doris, interviewed by Desiree Shayer on January 11, 2009: Audio Recording

Some themes discussed are: • Colby—enrollment (1) • Colby—dating (2, 5) • Colby—Greek Life (2) • Colby—campus life (2-3, 5,8) • Holidays—Christmas (4) • Colby—student interaction with Waterville Jews (4) • Occupation—economics, psychology (6) • Colby—Winter Carnival (8-9)

Hopengarten, Doris, interviewed by Desiree Shayer on January 11, 2009: Audio Part Two

Some themes discussed are: • Colby—enrollment (1) • Colby—dating (2, 5) • Colby—Greek Life (2) • Colby—campus life (2-3, 5,8) • Holidays—Christmas (4) • Colby—student interaction with Waterville Jews (4) • Occupation—economics, psychology (6) • Colby—Winter Carnival (8-9)

Produção e utilização de material didático sobre fisiologia da audição e neurofisiologia

The teaching of hearing physiology requires an knowledge integration of Human Anatomy, Biophysics, more precisely Bioacoustics and Bioelectrogenesis, as well as Neurophysiology. Students present difficulty to build knowledge about functional mechanisms of sound conduction and sensory transduction, especially if the elements are not visible forms, as the middle and inner ear structures. To make the teaching about hearing physiology and sensory perception easier, was produced a set of didactical materials about the subject. At first, a resin model that faithfully describes the anatomical relationship of the ossicles with the tympanic membrane was developed. Subsequently, a second model that, besides illustrates the mechanism of acoustic impedance overcoming, also reveals how acoustic sensorial transduction occurs in inner ear, was designed and produced. In the third didactical model, are visualized, through students interaction, areas of the cerebral cortex that interpret the different sensory modalities. In addition, were created three educational videos about hearing problems and a site on Human Hearing Physiology, available on Institute of Biosciences website. The results of this course conclusion monograph are presented in the form of articles that were submitted to Journal Physics in the School and the Journal of the Nucleus of Teaching