Real-time audio interaction in serious games for music learning

In this LBD, we present several Apps for playing while learning music or for learning music while playing. The core of all the games is based on the good performance of the real-time audio interaction algorithms developed by the ATIC group at Universidad de Ma ́laga (SPAIN).

Peer interaction and learning opportunities in cohesive and less cohesive L2 classrooms

The present study investigates peer to peer oral interaction in two task based language teaching classrooms, one of which was a self-declared cohesive group, and the other a self- declared less cohesive group, both at B1 level. It studies how learners talk cohesion into being and considers how this talk leads to learning opportunities in these groups. The study was classroom-based and was carried out over the period of an academic year. Research was conducted in the classrooms and the tasks were part of regular class work. The research was framed within a sociocognitive perspective of second language learning and data came from a number of sources, namely questionnaires, interviews and audio recorded talk of dyads, triads and groups of four students completing a total of eight oral tasks. These audio recordings were transcribed and analysed qualitatively for interactions which encouraged a positive social dimension and behaviours which led to learning opportunities, using conversation analysis. In addition, recordings were analysed quantitatively for learning opportunities and quantity and quality of language produced. Results show that learners in both classes exhibited multiple behaviours in interaction which could promote a positive social dimension, although behaviours which could discourage positive affect amongst group members were also found. Analysis of interactions also revealed the many ways in which learners in both the cohesive and less cohesive class created learning opportunities. Further qualitative analysis of these interactions showed that a number of factors including how learners approach a task, the decisions they make at zones of interactional transition and the affective relationship between participants influence the amount of learning opportunities created, as well as the quality and quantity of language produced. The main conclusion of the study is that it is not the cohesive nature of the group as a whole but the nature of the relationship between the individual members of the small group completing the task which influences the effectiveness of oral interaction for learning.This study contributes to our understanding of the way in which learners individualise the learning space and highlights the situated nature of language learning. It shows how individuals interact with each other and the task, and how talk in interaction changes moment-by-moment as learners react to the ‘here and now’ of the classroom environment.

Problemáticas de la interacción discursiva en la enseñanza y el aprendizaje de las Ciencias Naturales. Aportes didácticos. Interaction discoursive issues in teaching and learning Natural Sciences. Didactic contributions

Las didácticas específicas de las ciencias naturales revelan diferentes problemáticas en su enseñanza y aprendizaje en los diferentes niveles del sistema educativo. En particular, en las clases de ciencias la interacción discursiva docente alumnos adquiere relevancia, ya que el proceso de comunicación del conocimiento es uno de los pilares didácticos, junto a la trasposición del mismo. Especificamente, en este proyecto nos abocamos a aquellas intervenciones de docentes y alumnos que se relacionan con la construcción del conocimiento biológico y químico. El proyecto se enmarca en una actual linea de trabajo que indaga sobre las dificultades en los abordajes del conocimiento científico en las aulas, las características del discurso entre docentes y alumnos, las habilidades y dificultades en la comprensión de los enunciados de problemas y las características de los textos que se utilizan en las clases. Se focaliza este estudio en casos que intentan dar respuesta a tres temáticas, agrupadas en un conjunto de situaciones de investigación relacionadas con la interacción discursiva docente-alumno, retomando el rol del docente al hablar, guiar o diseñar las situaciones de referencia para el aprendizaje de los alumnos. Los casos son: 1- En cuanto a las concepciones sobre diversidad biológica en estudiantes de escuela secundaria y en textos académicos, atendemos a cómo la escuela presenta los contenidos ecológicos como un conjunto de dogmas y conceptos estáticos. Además suelen simplificarse conceptualmente y presentarse poco actualizados. Es por ello que se planea estudiar las concepciones y actitudes de los alumnos de secundaria sobre la biodiversidad, cómo estas dificultan su comprensión y los textos usados en relación a la promoción de la transposición didáctica. 2- En relación a cómo se elabora el patrón temático del tema célula en clases de Biología, se analizarán las diferentes estrategias de significados y de desarrollo temático, que se emplean en la comunicación aulica. Se intentará establecer si hay cambios en el desarrollo temático a medida que se avanza en la escolaridad. Esto es porque se puede apreciar que muchos de los problemas de aprendizaje del alumnado se deben a un desconocimiento tanto del patrón temático como del patrón estructural de la ciencia, siendo preciso evocar los patrones temáticos que se quieren utilizar, para construir un conocimiento compartido. 3-Finalmente, en los enunciados de problemas de Química, se analizarán las dificultades de comprensión lectora de alumnos de Ingeniería. Los docentes frecuentemente atribuyen los problemas a deficiencias en la instrucción recibida, sin considerarse los conocimientos previos del alumno, los obstáculos conceptuales originados en el tema, las deficiencias en la habilidad lectora, el tipo textual predominante en la consigna, el formato en el que se escribió la consigna y los factores personales, etc., siendo que la comprensión del enunciado de una consigna de trabajo condiciona fuertemente la posibilidad de su resolución. Los tres casos utilizarán metodologías cualitaritas que incluyan análisis de contenido en discursos orales y escritos. Los datos se registrarán desde observación no participante, registro etnográfico y con grabaciones de audio. Se espera contribuir al conocimiento, realizando aportes a la formación docente en tanto las estrategias discursivas que se emplean en el aula, en forma oral y en la escrita, conocer concepciones que dificultan o favoren la construcción del conocimiento científico, entre otras. Los productos de estos estudios estarán integrados por nuevos desarrollos para la formación docente, publicaciones científicas de impacto nacional e internacional, presentaciones a congresos, materiales didácticos y divulgativos, dictado de seminarios y/o cursos, redacción de informes a las escuelas intervinientes.. The specific Natural Sciences didactics show different problems in teaching and learning along the school system. In particular, the discourse used to communicate knowledge in Science lessons becomes important. With this project we will focus on the teachers and students actions regarding the construction of biological and chemical knowledge. This project attempts to answer these issues and brings together a range of research situations related to teacher-student interaction, through discourse, taking up the role of the teacher to speak, to plan and to guide student learning. We will study the ideas and attitudes of high school students about biodiversity that make difficult its understanding and the textbooks used in relation to promotion of the didactic transposition. In addition, regarding how the thematic pattern in biology classes is costructed, it will be analyzed the different meaning and thematic development strategies that are used in communication. We will attempt to establish whether there are any changes in the thematic development throughout high school education. Finally, we will analyze the reading comprehension problems in engineering students. Teachers frequently attribute these issues to deficiencies in prior education, without considering the students background, the conceptual obstacles arising in the field, the format in which the prompt is written, personal factors, etc., keeping in mind that the outcome of an activity is strictly dependant con the prompt understanding. We expect to make contributions to the teacher education in both the discourse strategies used in the classroom, orally and in writing, to learn about the conceptions that hinder or favor the knowledge construction, among others. The products of this study will be national and international impact scientific publications, conference presentations, popular science publications, seminars courses and reports to the schools involeved.

Social network extraction and analysis based on multimodal dyadic interaction

Social interactions are a very important component in people"s lives. Social network analysis has become a common technique used to model and quantify the properties of social interactions. In this paper, we propose an integrated framework to explore the characteristics of a social network extracted from multimodal dyadic interactions. For our study, we used a set of videos belonging to New York Times" Blogging Heads opinion blog. The Social Network is represented as an oriented graph, whose directed links are determined by the Influence Model. The links" weights are a measure of the"influence" a person has over the other. The states of the Influence Model encode automatically extracted audio/visual features from our videos using state-of-the art algorithms. Our results are reported in terms of accuracy of audio/visual data fusion for speaker segmentation and centrality measures used to characterize the extracted social network.

From activity to active learning: drawing and dialogue interaction in virtual learning environments for computer-supported collaborative work in design.

Virtual learning environments (VLEs) would appear to be particular effective in computer-supported collaborative work (CSCW) for active learning. Most research studies looking at computer-supported collaborative design have focused on either synchronous or asynchronous modes of communication, but near-synchronous working has received relatively little attention. Yet it could be argued that near-synchronous communication encourages creative, rhetorical and critical exchanges of ideas, building on each other’s contributions. Furthermore, although many researchers have carried out studies on collaborative design protocol, argumentation and constructive interaction, little is known about the interaction between drawing and dialogue in near-synchronous collaborative design. The paper reports the first stage of an investigation into the requirements for the design and development of interactive systems to support the learning of collaborative design activities. The aim of the study is to understand the collaborative design processes while sketching in a shared white board and audio conferencing media. Empirical data on design processes have been obtained from observation of seven sessions with groups of design students solving an interior space-planning problem of a lounge-diner in a virtual learning environment, Lyceum, an in-house software developed by the Open University to support its students in collaborative learning.

The distributed work of local action: interaction amongst virtually collocated research teams

Existing research on synchronous remote working in CSCW has highlighted the troubles that can arise because actions at one site are (partially) unavailable to remote colleagues. Such ‘local action’ is routinely characterised as a nuisance, a distraction, subordinate and the like. This paper explores interconnections between ‘local action’ and ‘distributed work’ in the case of a research team virtually collocated through ‘MiMeG’. MiMeG is an e-Social Science tool that facilitates ‘distributed data sessions’ in which social scientists are able to remotely collaborate on the real-time analysis of video data. The data are visible and controllable in a shared workspace and participants are additionally connected via audio conferencing. The findings reveal that whilst the (partial) unavailability of local action is at times problematic, it is also used as a resource for coordinating work. The paper considers how local action is interactionally managed in distributed data sessions and concludes by outlining implications of the analysis for the design and study of technologies to support group-to-group collaboration.

Sacks, Arlyne, interviewed by Margo Derecktor on January 9th, 2010: Audio

Some of the themes discussed are: • Colby—student life (page 2) • Colby—Greek life (3, 8) • Colby—student interaction with Waterville Jews (5, 12) • Holidays (6, 9, 12) • Marriage (6) • Colby—Jewish students from away (8) • Levine’s Store (9) • Food (10) • Occupation—woolen mills (11) • Occupation— real estate development (11) • Jewish education (12, 15) • Yiddish (13)

Rosenthal, Bob, interviewed by Becky Muller on January 17, 2009: Audio

Some of the themes discussed are: • Civic engagement (2) • The Levine family (2) • High school—private (3) • Colby (4) • Colby—student interaction with Waterville Jews (5) • Dating (6, 7, 18-20) • Life in Waterville (8, 10) • Life in Waterville—movies (12-13) • Colby—Greek life (9) • Colby—administration (9-10) • Occupation—real estate development (10-12, 13, 17) • Camp—Arcadia (13-14) • Military service (16) • Civic engagement (22) • Jewish education (23) • Holidays (23-24)

Rosenthal, Bob, interviewed by Becky Muller on January 17, 2009: Audio Part Two

Some of the themes discussed are: • Civic engagement (2) • The Levine family (2) • High school—private (3) • Colby (4) • Colby—student interaction with Waterville Jews (5) • Dating (6, 7, 18-20) • Life in Waterville (8, 10) • Life in Waterville—movies (12-13) • Colby—Greek life (9) • Colby—administration (9-10) • Occupation—real estate development (10-12, 13, 17) • Camp—Arcadia (13-14) • Military service (16) • Civic engagement (22) • Jewish education (23) • Holidays (23-24)

Hopengarten, Doris, interviewed by Desiree Shayer on January 11, 2009: Audio Recording

Some themes discussed are: • Colby—enrollment (1) • Colby—dating (2, 5) • Colby—Greek Life (2) • Colby—campus life (2-3, 5,8) • Holidays—Christmas (4) • Colby—student interaction with Waterville Jews (4) • Occupation—economics, psychology (6) • Colby—Winter Carnival (8-9)

Hopengarten, Doris, interviewed by Desiree Shayer on January 11, 2009: Audio Part Two

Some themes discussed are: • Colby—enrollment (1) • Colby—dating (2, 5) • Colby—Greek Life (2) • Colby—campus life (2-3, 5,8) • Holidays—Christmas (4) • Colby—student interaction with Waterville Jews (4) • Occupation—economics, psychology (6) • Colby—Winter Carnival (8-9)

Produção e utilização de material didático sobre fisiologia da audição e neurofisiologia

The teaching of hearing physiology requires an knowledge integration of Human Anatomy, Biophysics, more precisely Bioacoustics and Bioelectrogenesis, as well as Neurophysiology. Students present difficulty to build knowledge about functional mechanisms of sound conduction and sensory transduction, especially if the elements are not visible forms, as the middle and inner ear structures. To make the teaching about hearing physiology and sensory perception easier, was produced a set of didactical materials about the subject. At first, a resin model that faithfully describes the anatomical relationship of the ossicles with the tympanic membrane was developed. Subsequently, a second model that, besides illustrates the mechanism of acoustic impedance overcoming, also reveals how acoustic sensorial transduction occurs in inner ear, was designed and produced. In the third didactical model, are visualized, through students interaction, areas of the cerebral cortex that interpret the different sensory modalities. In addition, were created three educational videos about hearing problems and a site on Human Hearing Physiology, available on Institute of Biosciences website. The results of this course conclusion monograph are presented in the form of articles that were submitted to Journal Physics in the School and the Journal of the Nucleus of Teaching

TIMPANO: Technology for complex Human-Machine conversational interaction with dynamic learning

El proyecto TIMPANO tiene por objetivo profundizar en el desarrollo de sistemas de comunicación oral hombre-máquina atendiendo principalmente a la capacidad de dar respuesta a múltiples requerimientos de los usuarios, como pueden ser el acceso a información, la extracción de información, o el análisis de grandes repositorios de información en audio. En el proyecto se hace especial énfasis en la adaptación dinámica de los modelos a diversos contextos, tanto de tipo acústico, como semántico o de idioma.

Multimodal 'Eyes-Free' interaction techniques for mobile devices

Mobile and wearable computers present input/output prob-lems due to limited screen space and interaction techniques. When mobile, users typically focus their visual attention on navigating their environment - making visually demanding interface designs hard to operate. This paper presents two multimodal interaction techniques designed to overcome these problems and allow truly mobile, 'eyes-free' device use. The first is a 3D audio radial pie menu that uses head gestures for selecting items. An evaluation of a range of different audio designs showed that egocentric sounds re-duced task completion time, perceived annoyance, and al-lowed users to walk closer to their preferred walking speed. The second is a sonically enhanced 2D gesture recognition system for use on a belt-mounted PDA. An evaluation of the system with and without audio feedback showed users' ges-tures were more accurate when dynamically guided by au-dio-feedback. These novel interaction techniques demon-strate effective alternatives to visual-centric interface de-signs on mobile devices.

Guidelines for audio-enhancement of graphical user Interface widgets

Audio feedback remains little used in most graphical user interfaces despite its potential to greatly enhance interaction. Not only does sonic enhancement of interfaces permit more natural human-computer communication but it also allows users to employ an appropriate sense to solve a problem rather than having to rely solely on vision. Research shows that designers do not typically know how to use sound effectively; subsequently, their ad hoc use of sound often leads to audio feedback being considered an annoying distraction. Unlike the design of purely graphical user interfaces for which guidelines are common, the audio-enhancement of graphical user interfaces has (until now) been plagued by a lack of suitable guidance. This paper presents a series of empirically substantiated guidelines for the design and use of audio-enhanced graphical user interface widgets.