Measuring end-to-end delay in real-time auralisation systems

One of the major challenges in the development of an immersive system is handling the delay between the tracking of the user’s head position and the updated projection of a 3D image or auralised sound, also called end-to-end delay. Excessive end-to-end delay can result in the general decrement of the “feeling of presence”, the occurrence of motion sickness and poor performance in perception-action tasks. These latencies must be known in order to provide insights on the technological (hardware/software optimization) or psychophysical (recalibration sessions) strategies to deal with them. Our goal was to develop a new measurement method of end-to-end delay that is both precise and easily replicated. We used a Head and Torso simulator (HATS) as an auditory signal sensor, a fast response photo-sensor to detect a visual stimulus response from a Motion Capture System, and a voltage input trigger as real-time event. The HATS was mounted in a turntable which allowed us to precisely change the 3D sound relative to the head position. When the virtual sound source was at 90º azimuth, the correspondent HRTF would set all the intensity values to zero, at the same time a trigger would register the real-time event of turning the HATS 90º azimuth. Furthermore, with the HATS turned 90º to the left, the motion capture marker visualization would fell exactly in the photo-sensor receptor. This method allowed us to precisely measure the delay from tracking to displaying. Moreover, our results show that the method of tracking, its tracking frequency, and the rendering of the sound reflections are the main predictors of end-to-end delay.

Sensorimotor synchronization when walking side by side with a point light walker

[Excerpt] Synchronization of periodic movements like side-by-side walking [7] is frequently modeled by coupled oscillators [5] and the coupling strength is defined quantitatively [3]. In contrast, in most studies on sensorimotor synchronization (SMS), simple movements like finger taps are synchronized with simple stimuli like metronomes [4]. While the latter paradigm simplifies matters and allows for the assessment of the relative weights of sensory modalities through systematic variation of the stimuli [1], it might lack ecological validity. Conversely, using more complex movements and stimuli might complicate the specification of mechanisms underlying coupling. We merged the positive aspects of both approaches to study the contribution of auditory and visual information on synchronization during side-by-side walking. As stimuli, we used Point Light Walkers (PLWs) and auralized steps sound; both were constructed from previously captured walking individuals [2][6]. PLWs were retro-projected on a screen and matched according to gender, hip height, and velocity. The participant walked for 7.20m side by side with 1) a PLW, 2) steps sound, or 3) both displayed in temporal congruence. Instruction to participants was to synchronize with the available stimuli. [...]

Abnormalities in the processing of emotional prosody from single words in schizophrenia

Background: Abnormalities in emotional prosody processing have been consistently reported in schizophrenia and are related to poor social outcomes. However, the role of stimulus complexity in abnormal emotional prosody processing is still unclear. Method: We recorded event-related potentials in 16 patients with chronic schizophrenia and 16 healthy controls to investigate: 1) the temporal course of emotional prosody processing; and 2) the relative contribution of prosodic and semantic cues in emotional prosody processing. Stimuli were prosodic single words presented in two conditions: with intelligible (semantic content condition—SCC) and unintelligible semantic content (pure prosody condition—PPC). Results: Relative to healthy controls, schizophrenia patients showed reduced P50 for happy PPC words, and reduced N100 for both neutral and emotional SCC words and for neutral PPC stimuli. Also, increased P200 was observed in schizophrenia for happy prosody in SCC only. Behavioral results revealed higher error rates in schizophrenia for angry prosody in SCC and for happy prosody in PPC. Conclusions: Together, these data further demonstrate the interactions between abnormal sensory processes and higher-order processes in bringing about emotional prosody processing dysfunction in schizophrenia. They further suggest that impaired emotional prosody processing is dependent on stimulus complexity.

The music of language: an ERP investigation of the effects of musical training on emotional prosody processing

Recent studies have demonstrated the positive effects of musical training on the perception of vocally expressed emotion. This study investigated the effects of musical training on event-related potential (ERP) correlates of emotional prosody processing. Fourteen musicians and fourteen control subjects listened to 228 sentences with neutral semantic content, differing in prosody (one third with neutral, one third with happy and one third with angry intonation), with intelligible semantic content (semantic content condition--SCC) and unintelligible semantic content (pure prosody condition--PPC). Reduced P50 amplitude was found in musicians. A difference between SCC and PPC conditions was found in P50 and N100 amplitude in non-musicians only, and in P200 amplitude in musicians only. Furthermore, musicians were more accurate in recognizing angry prosody in PPC sentences. These findings suggest that auditory expertise characterizing extensive musical training may impact different stages of vocal emotional processing.

Exploração de dados para soluções de retalho em business intelligence

Dissertação de mestrado integrado em Engenharia de Gestão e Sistemas de Informação

Neurocognitive profile and cognitive intervention in Alzheimer's disease

Tese de Doutoramento em Psicologia (Especialidade de Psicologia Clínica)

Avaliação do risco para peões em ambiente urbano

Dissertação de mestrado integrado em Engenharia Civil

A "audiação" no desenvolvimento da criatividade na aprendizagem do saxofone

Relatório de estágio de mestrado em Ensino de Música

A inclusão de alunos com NEE: um estudo quantitativo sobre recursos pessoais e institucionais e atitude de professores de educação física

Dissertação de mestrado em Educação Especial (área de especialização em Dificuldades de Aprendizagem Específicas)

Mother’s depression at childbirth does not contribute to the effects of antenatal depression on neonate’s behavioral development

Background: Maternal depression is a worldwide phenomenon that has been linked to adverse developmental outcomes in neonates. Aims: To study the effect of antenatal depression (during the third trimester of pregnancy) on neonate behavior, preference, and habituation to both the mother and a stranger’s face/voice. To analyze mother’s depression at childbirth as a potential mediator or moderator of the relationship between antenatal depression and neonate behavioral development. Method: A sample of 110 pregnant women was divided in 2 groups according to their scores on the Edinburgh Postnatal Depression Scale during pregnancy (EPDS; ≥10, depressed; <10, non-depressed). In the first 5 days after birth, neonatal performance on the Neonatal Behavioral Assessment Scale (NBAS) and in the ‘Preference and habituation to the mother’s face/voice versus stranger’ paradigm was assessed; each mother filled out an EPDS. Results: Neonates of depressed pregnant women, achieved lower scores on the NBASs (regulation of state, range of state, and habituation); did not show a visual/auditory preference for the mother’s face/voice; required more trials to become habituated to the mother’s face/voice; and showed a higher visual/auditory preference for the stranger’s face/voice after habituation compared to neonates of non-depressed pregnant women. Depression at childbirth does not contribute to the effect of antenatal depression on neonatal behavioral development. Conclusion: Depression even before childbirth compromises the neonatal behavioral development. Depression is a relevant issue and should be addressed as a routine part of prenatal health care.

Application of multivariate statistical process control to fuel cell manufacturing

Univariate statistical control charts, such as the Shewhart chart, do not satisfy the requirements for process monitoring on a high volume automated fuel cell manufacturing line. This is because of the number of variables that require monitoring. The risk of elevated false alarms, due to the nature of the process being high volume, can present problems if univariate methods are used. Multivariate statistical methods are discussed as an alternative for process monitoring and control. The research presented is conducted on a manufacturing line which evaluates the performance of a fuel cell. It has three stages of production assembly that contribute to the final end product performance. The product performance is assessed by power and energy measurements, taken at various time points throughout the discharge testing of the fuel cell. The literature review performed on these multivariate techniques are evaluated using individual and batch observations. Modern techniques using multivariate control charts on Hotellings T2 are compared to other multivariate methods, such as Principal Components Analysis (PCA). The latter, PCA, was identified as the most suitable method. Control charts such as, scores, T2 and DModX charts, are constructed from the PCA model. Diagnostic procedures, using Contribution plots, for out of control points that are detected using these control charts, are also discussed. These plots enable the investigator to perform root cause analysis. Multivariate batch techniques are compared to individual observations typically seen on continuous processes. Recommendations, for the introduction of multivariate techniques that would be appropriate for most high volume processes, are also covered.

Idosos hipertensos apresentam menor desempenho cognitivo do que idosos normotensos

FUNDAMENTO: A hipertensão arterial tem sido associada à redução do desempenho cognitivo, contudo a literatura é conflitante. OBJETIVO: Comparar o desempenho cognitivo entre idosos normotensos ("N"; n = 17; idade 68 ± 1; pressão arterial = 133 ± 3/74 ± 2 mmHg) e hipertensos ("H"; n = 28; idade 69 ± 1, pressão arterial = 148 ± 4/80 ± 1 mmHg) com pelo menos cinco anos de escolaridade. MÉTODOS: A avaliação neuropsicológica ampla constou do "Cambridge Cognition-Revised" (CAMCOG-R), dos "Trail Making Test A and B" (TMT A e B) e do "Rey Auditory Verbal Learning Test" (RAVLT). RESULTADOS: Os idosos hipertensos apresentaram menor escore do CAMCOG-R (N = 87,6 ± 1,8; H = 78,6 ± 1,4; p = 0,002). Os idosos hipertensos necessitaram de maior tempo para realizar o TMT A e B (TMT A: N = 39 ± 3s; H = 57 ± 3,4s; p = 0,001; TMT B: N = 93 ± 7s; H = 124 ± 7s; p = 0,006), o que também é demonstrado pelos percentis significativamente menores obtidos nestes testes. O somatório do RAVLT foi significativamente menor nos idosos hipertensos (N = 51,8 ± 1,7; H = 40,7 ± 1,5; p < 0,0001). Mesmo ajustado para idade, sexo, escolaridade e sintomas de depressão, a hipertensão arterial foi um fator preditor independente do desempenho cognitivo medido pelo CAMCOG-R, TMT A e o somatório do RAVLT. CONCLUSÃO: O desempenho cognitivo em idosos hipertensos é menor do que em idosos normotensos.

Akustisches Diskriminierungslernen bei der Mongolischen Wüstenrennmaus : Proteinsyntheseabhängigkeit und Veränderungen der Genexpression im Hörkortex

Gerbil auditory cortex, long-term memory, protein synthesis inhibitor gene expression

Nichtlineare Wechselwirkung im auditorischen Kortex nach Stimulation mit Sequenzen mehrerer Sinustöne

Monkey, neuron, auditory cortex, temporal processing, nonlinear interaction, sequence, temporal coding

Objektivierung eines musikunterstützten Trainings motorischer Funktionen nach Schlaganfall

Neurorehabilitation, Stroke, Plasticity, Music-supported Training, Auditory sensorimotor integration