Measuring end-to-end delay in real-time auralisation systems

One of the major challenges in the development of an immersive system is handling the delay between the tracking of the user’s head position and the updated projection of a 3D image or auralised sound, also called end-to-end delay. Excessive end-to-end delay can result in the general decrement of the “feeling of presence”, the occurrence of motion sickness and poor performance in perception-action tasks. These latencies must be known in order to provide insights on the technological (hardware/software optimization) or psychophysical (recalibration sessions) strategies to deal with them. Our goal was to develop a new measurement method of end-to-end delay that is both precise and easily replicated. We used a Head and Torso simulator (HATS) as an auditory signal sensor, a fast response photo-sensor to detect a visual stimulus response from a Motion Capture System, and a voltage input trigger as real-time event. The HATS was mounted in a turntable which allowed us to precisely change the 3D sound relative to the head position. When the virtual sound source was at 90º azimuth, the correspondent HRTF would set all the intensity values to zero, at the same time a trigger would register the real-time event of turning the HATS 90º azimuth. Furthermore, with the HATS turned 90º to the left, the motion capture marker visualization would fell exactly in the photo-sensor receptor. This method allowed us to precisely measure the delay from tracking to displaying. Moreover, our results show that the method of tracking, its tracking frequency, and the rendering of the sound reflections are the main predictors of end-to-end delay.

Interacting software-agents to support a kind of expert supervision systems

Expert supervision systems are software applications specially designed to automate process monitoring. The goal is to reduce the dependency on human operators to assure the correct operation of a process including faulty situations. Construction of this kind of application involves an important task of design and development in order to represent and to manipulate process data and behaviour at different degrees of abstraction for interfacing with data acquisition systems connected to the process. This is an open problem that becomes more complex with the number of variables, parameters and relations to account for the complexity of the process. Multiple specialised modules tuned to solve simpler tasks that operate under a co-ordination provide a solution. A modular architecture based on concepts of software agents, taking advantage of the integration of diverse knowledge-based techniques, is proposed for this purpose. The components (software agents, communication mechanisms and perception/action mechanisms) are based on ICa (Intelligent Control architecture), software middleware supporting the build-up of applications with software agent features

Création sonore et cinéma contemporain : la pensée et la pratique du mixage

Notre thèse décrit et analyse les conditions esthétiques, matérielles et idéelles qui rendent possibles les agencements sonores du cinéma contemporain. Au cours des 30 dernières années, le raffinement des outils de manipulation du son, l’importance grandissante du concepteur sonore et le nouvel espace de cohabitation des sons (favorisé par le Dolby et la diffusion multicanal) sont des facteurs qui ont transformé la création et l’écoute du son au cinéma. Ces transformations révèlent un nouveau paradigme : le mixage s’est graduellement imposé comme le geste perceptif et créateur qui rend compte de la sensibilité contemporaine. Notre thèse explore les effets de la pensée du mixage (qui procède par résonance, simultanéité, dosage et modulation) sur notre écoute et notre compréhension de l'expérience cinématographique. À l'aide de paroles de concepteurs sonores (Murch, Beaugrand, Thom, Allard…), de textes théoriques sur le son filmique (Cardinal, Chion, Campan), de documentaires sur des musiciens improvisateurs (Lussier, Glennie, Frith), de films de fiction à la dimension sonore affirmée (Denis, Van Sant), de textes philosophiques sur la perception (Leibniz, James, Straus, Szendy…), d'analyses du dispositif sonore cinématographique, notre thèse rend audibles des tensions, des récurrences, de nouveaux agencements, des problèmes actuels et inactuels qui forgent et orientent l'écoute du théoricien, du créateur et de l'auditeur. En interrogeant la dimension sonore de la perception, de l’action, de l’espace et de la pensée, cette thèse a pour objectif de modifier la façon dont on écoute, crée et pense le son au cinéma.

Interacting software-agents to support a kind of expert supervision systems

Expert supervision systems are software applications specially designed to automate process monitoring. The goal is to reduce the dependency on human operators to assure the correct operation of a process including faulty situations. Construction of this kind of application involves an important task of design and development in order to represent and to manipulate process data and behaviour at different degrees of abstraction for interfacing with data acquisition systems connected to the process. This is an open problem that becomes more complex with the number of variables, parameters and relations to account for the complexity of the process. Multiple specialised modules tuned to solve simpler tasks that operate under a co-ordination provide a solution. A modular architecture based on concepts of software agents, taking advantage of the integration of diverse knowledge-based techniques, is proposed for this purpose. The components (software agents, communication mechanisms and perception/action mechanisms) are based on ICa (Intelligent Control architecture), software middleware supporting the build-up of applications with software agent features

Hierarchical Prediction Machines and Big Data Analytics

An emerging consensus in cognitive science views the biological brain as a hierarchically-organized predictive processing system. This is a system in which higher-order regions are continuously attempting to predict the activity of lower-order regions at a variety of (increasingly abstract) spatial and temporal scales. The brain is thus revealed as a hierarchical prediction machine that is constantly engaged in the effort to predict the flow of information originating from the sensory surfaces. Such a view seems to afford a great deal of explanatory leverage when it comes to a broad swathe of seemingly disparate psychological phenomena (e.g., learning, memory, perception, action, emotion, planning, reason, imagination, and conscious experience). In the most positive case, the predictive processing story seems to provide our first glimpse at what a unified (computationally-tractable and neurobiological plausible) account of human psychology might look like. This obviously marks out one reason why such models should be the focus of current empirical and theoretical attention. Another reason, however, is rooted in the potential of such models to advance the current state-of-the-art in machine intelligence and machine learning. Interestingly, the vision of the brain as a hierarchical prediction machine is one that establishes contact with work that goes under the heading of 'deep learning'. Deep learning systems thus often attempt to make use of predictive processing schemes and (increasingly abstract) generative models as a means of supporting the analysis of large data sets. But are such computational systems sufficient (by themselves) to provide a route to general human-level analytic capabilities? I will argue that they are not and that closer attention to a broader range of forces and factors (many of which are not confined to the neural realm) may be required to understand what it is that gives human cognition its distinctive (and largely unique) flavour. The vision that emerges is one of 'homomimetic deep learning systems', systems that situate a hierarchically-organized predictive processing core within a larger nexus of developmental, behavioural, symbolic, technological and social influences. Relative to that vision, I suggest that we should see the Web as a form of 'cognitive ecology', one that is as much involved with the transformation of machine intelligence as it is with the progressive reshaping of our own cognitive capabilities.

The informational turn in Philosophy: any novelty in the study of Mind?

The concept of information is analyzed starting from Adams' hypothesis in The Informational Turn in Philosophy, according to which there has been a far-reaching turn in Philosophy following the publication of Turing's article "Computing Machinery and Intelligence". Adams maintains that new guidelines are being indicated in philosophical research, having the concept of "information" as the basis for treatment of classical problems, such as the relationships between mind-body, perception-action, and the nature of knowledge, amongst others. Partially agreeing with Adams, we believe, however, that his hypothesis faces difficulties, the most fundamental of which concerns the different meanings given to the concept of information. We argue that even though the concept of information underlying the mechanicist proposal of Turing, according to which "to think is to compute", is indeed being employed in Philosophy, this is not because of its mechanistic nature, but mainly due to the representationist presupposition dominant in this area. From this point of view, the informational turn in philosophy would not provide any great novelty, given that since the earliest days philosophical approaches to the nature of mind have always been mainly representationist. The novelty would not lie specifically in the Turing thesis, but in reflections on the nature of information, especially ecological information, and its relation to action.

Percepção e ações educativas em ambientes escolares: enfoques aos documentos legais determinantes em área de proteção ambiental

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior

Influence of Imposed Optic Flow Characteristics and Intention on Postural Responses

This study examined the influence of both optic flow characteristics and intention on postural control responses. Two groups of 10 adults each were exposed to the room's movement either at 0.6 cm/s (low velocity group) or 1.0 cm/s (high velocity group). All the participants stood in the upright stance inside of a moving room and were informed about the room movement only after the fourth trial as they were asked to resist to its influence. Results revealed that participants from both groups were influenced by the imposed visual stimulus in the first trials, but the coupling strength was weaker for the high velocity group. The request to resist the visual influences decreased visual influences oil body sway, but only for the low velocity group. These results indicate that intention might play a role in stimulus influences on body sway but it is stimulus dependent.

Percepção e ação: direções teóricas e experimentais atuais

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Visual information and body sway coupling in infants during sitting acquisition

The purpose of this study was to examine if there is any developmental change in the coupling between visual information and trunk sway in infants as they acquire the sitting position. Twenty-four infants distributed in four groups (6-, 7-, 8-, and 9-month-old) were sat inside a moving room that oscillated back and forward at frequencies of 0.2 and 0.5 Hz. The results revealed that trunk sway matched to the moving room at both frequencies but did not differ among the four age groups. Coherence and gain revealed that the coupling was weaker at 0.2 than at 0.5 Hz. Relative phase showed that at 0.2 Hz, infants were swaying with no lag but at 0.5 Hz they were lagging the room. These results showed that the coupling between visual information and trunk sway in infants varies with the visual stimulus but does not change as infants acquire the sitting position. © 2001 Elsevier B.V.

Affordances: a relação entre agente e ambiente

Pós-graduação em Filosofia - FFC

Uma reflexão filosófica sobre o conceito de informação ecológica

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Conhecimento sensorial: uma abordagem ecológica via realismo informacional

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)