Pitch perception: A dynamical-systems perspective

Two and a half millennia ago Pythagoras initiated the scientific study of the pitch of sounds; yet our understanding of the mechanisms of pitch perception remains incomplete. Physical models of pitch perception try to explain from elementary principles why certain physical characteristics of the stimulus lead to particular pitch sensations. There are two broad categories of pitch-perception models: place or spectral models consider that pitch is mainly related to the Fourier spectrum of the stimulus, whereas for periodicity or temporal models its characteristics in the time domain are more important. Current models from either class are usually computationally intensive, implementing a series of steps more or less supported by auditory physiology. However, the brain has to analyze and react in real time to an enormous amount of information from the ear and other senses. How is all this information efficiently represented and processed in the nervous system? A proposal of nonlinear and complex systems research is that dynamical attractors may form the basis of neural information processing. Because the auditory system is a complex and highly nonlinear dynamical system, it is natural to suppose that dynamical attractors may carry perceptual and functional meaning. Here we show that this idea, scarcely developed in current pitch models, can be successfully applied to pitch perception.

Research in speech communication.

Advances in digital speech processing are now supporting application and deployment of a variety of speech technologies for human/machine communication. In fact, new businesses are rapidly forming about these technologies. But these capabilities are of little use unless society can afford them. Happily, explosive advances in microelectronics over the past two decades have assured affordable access to this sophistication as well as to the underlying computing technology. The research challenges in speech processing remain in the traditionally identified areas of recognition, synthesis, and coding. These three areas have typically been addressed individually, often with significant isolation among the efforts. But they are all facets of the same fundamental issue--how to represent and quantify the information in the speech signal. This implies deeper understanding of the physics of speech production, the constraints that the conventions of language impose, and the mechanism for information processing in the auditory system. In ongoing research, therefore, we seek more accurate models of speech generation, better computational formulations of language, and realistic perceptual guides for speech processing--along with ways to coalesce the fundamental issues of recognition, synthesis, and coding. Successful solution will yield the long-sought dictation machine, high-quality synthesis from text, and the ultimate in low bit-rate transmission of speech. It will also open the door to language-translating telephony, where the synthetic foreign translation can be in the voice of the originating talker.

Efeitos da diabetes mellitus e hipertensão arterial sobre a audição de idosos

Introdução: Estudos têm demonstrado que doenças crônicas e alterações metabólicas podem atuar como fator de aceleração na degeneração do sistema auditivo decorrente da idade. Todavia, os estudos sobre a associação entre a perda auditiva com o diabetes mellitus (DM) e com a hipertensão arterial (HA) em idosos mostraram conclusões controversas. Sendo assim, novos estudos sobre este assunto são necessários, a fim de esclarecer o efeito destas doenças crônicas sobre o sistema auditivo. Objetivos: Comparar uma audiometria inicial (A1) com uma audiometria sequencial (A2) realizada com um intervalo de 3 a 4 anos em uma população de idosos portadores de DM e/ou HA; realizar um estudo comparativo entre quatro grupos de idosos: grupo controle (GC), formado por idosos sem alterações crônicas, grupo de idosos portadores de DM; grupo de idosos portadores de HA, grupo de idosos portadores de DM e HA. Métodos: Foi realizado um levantamento em 901 prontuários do Estudo Longitudinal de Saúde Auditiva do Adulto (ELSAA), de indivíduos atendidos no Hospital Universitário (HU) da Universidade de São Paulo, no período de 2009 a 2015. De acordo com os critérios de inclusão, foram selecionados 100 indivíduos para participarem da presente pesquisa. A avaliação inicial (A1), constando de anamnese, audiometria tonal e imitânciometria foram utilizadas e foi feita uma nova avaliação audiológica (A2) após o período de 3 a 4 anos. Os participantes foram distribuídos em quatro grupos: 20 indivíduos portadores de DM (grupo DM), 20 indivíduos portadores de HA (grupo HA), 20 indivíduos portadores de DM e HA (grupo DMHA) e 40 indivíduos não portadores de DM nem de HA (GC). Para cada grupo estudo (HA, DM e DMHA), foram selecionados indivíduos (entre os 40 do GC) de forma a parear as características referentes a idade e sexo. Foram utilizados os testes estatísticos ANOVA, teste exato de Fisher e Kruskal-Wallis, com nível de significância de 0,05. Foi também calculada a odds ratio, com intervalo de confiança de 95%. Resultados: Não houve diferença estatisticamente significante entre as orelhas para nenhum dos grupos; sendo assim, as orelhas direita e esquerda foram agrupadas para as outras comparações. Na comparação da média de aumento anual dos limiares auditivos da primeira avaliação A1 com a segunda avaliação A2 entre os grupos, pode-se observar que para o grupo DM, não houve diferença estatisticamente significante para nenhuma das frequências avaliadas, quando comparado ao seu respectivo controle; para o grupo HA foram observadas diferenças significantes a partir de 4kHz, bem como tendência à diferença estatisticamente significante em 3 kHz, quando comparado a seu respectivo controle. Já para o grupo DMHA, quando comparado a seu grupo controle, foram observadas diferenças significantes nas frequências de 500, 2k, 3k e 8kHz, além de tendência à diferença estatisticamente significante em 4k e 6kHz. Considerando-se os casos novos de perda auditiva, pode-se observar que houve diferença estatisticamente significante apenas para o grupo HA, para as frequências altas. Verificou-se também que, para as frequências altas (3k a 8kHz), os números de casos novos de perda auditiva foram sempre maiores nos grupos estudo quando comparados aos seus respectivos controles. Na comparação das médias dos limiares auditivos, tanto na avaliação A1 quanto na avaliação A2, observou-se que os grupos estudo (DM, HA e DMHA) apresentaram limiares auditivos mais prejudicados, quando comparados a seus respectivos grupos controle. Na comparação entre os grupos apenas para a avaliação A2, pode-se observar que para as frequências altas, houve associação estatisticamente significante entre apresentar as condições clínicas (DM, HA e DMHA) e a presença de perda auditiva. A OR para DM foi de 5,57 (2,9-14,65), para HA foi de 4,2 (1,35-13,06) e para DMHA foi de 5,72 (1,85-17,64). Conclusão: Verificou-se que os idosos portadores de DM, HA ou ambos apresentaram limiares auditivos mais rebaixados quando comparados a seus respectivos grupos controle, principalmente nas altas frequências, o que sugere que estas patologias podem ter um efeito deletério sobre a audição. Além disso, nota-se que o grupo HA apresentou limiares auditivos piores para a maioria das frequências e foi o que apresentou maior queda dos limiares auditivos no segmento de 3 a 4 anos, quando comparado aos outros dois grupos estudo (DMHA e DM), sugerindo que dentre as três condições estudadas, a hipertensão parece ser a que teve maior influência sobre a audição

O efeito da estimulação top-down e bottom-up no potencial evocado auditivo de tronco encefálico com estímulo complexo

Introdução: Crianças com transtorno fonológico (TF) apresentam dificuldade na percepção de fala, em processar estímulos acústicos quando apresentados de forma rápida e em sequência. A percepção dos sons complexos da fala, dependem da integridade no processo de codificação analisado pelo Sistema Nervoso Auditivo. Por meio do Potencial Evocado Auditivo de Tronco Encefálico com estímulo complexo (PEATEc) é possível investigar a representação neural dos sons em níveis corticais e obter informações diretas sobre como a estrutura do som da sílaba falada é codificada no sistema auditivo. Porém, acredita-se que esse potencial sofre interferências tanto de processos bottom-up quanto top-down, o que não se sabe é quanto e como cada um desses processos modifica as respostas do PEATEc. Uma das formas de investigar a real influência dos aspectos top-down e bottom-up nos resultados do PEATEc é estimulando separadamente esses dois processos por meio do treinamento auditivo e da terapia fonoaudiológica. Objetivo: Verificar o impacto da estimulação sensorial (processamento bottom-up) e cognitiva (processamento top-down), separadamente, nos diferentes domínios da resposta eletrofisiológica do PEATEc. Método: Participaram deste estudo 11 crianças diagnosticadas com TF, com idades entre 7 e 10:11, submetidas a avaliação comportamental e eletrofisiológica e então dividas nos grupos Bottom-up (B-U) (N=6) e Top-down T-D (N=5). A estimulação bottom-up foi voltada ao treinamento das habilidades sensoriais, através de softwares de computador. A estimulação top-down foi realizada por meio de tarefas para estimular as habilidades cognitiva por meio do Programa de Estimulação Fonoaudiológica (PEF). Ambas as estimulações foram aplicadas uma vez por semana, num período de aproximadamente 45 minutos por 12 semanas. Resultados: O grupo B-U apresentou melhoras em relação aos domínios onset e harmônicos e no valor da pontuação do escore após ser submetido à estimulação bottom-up. Por sua vez, após serem submetidos à estimulação top-down, o grupo T-D apresentou melhoras em relação aos domínios onset, espectro-temporal, fronteiras do envelope e harmônicos e para os valores da pontuação do escore. Conclusão: Diante dos resultados obtidos neste estudo, foi possível observar que a estimulação sensorial (processamento bottom-up) e a estimulação cognitiva (processamento top-down) mostraram impactar de forma diferente a resposta eletrofisiológica do PEATEc

Asynchrony and the grouping of vowel components:captor tones revisited

Asynchrony is an important grouping cue for separating sound mixtures. A harmonic incremented in level makes a reduced contribution to vowel timbre when it begins before the other components. This contribution can be partly restored by adding a captor tone in synchrony with, and one octave above, the leading portion of the incremented harmonic [Darwin and Sutherland, Q. J. Exp. Psychol. A 36, 193-208 (1984)]. The captor is too remote to evoke adaptation in peripheral channels tuned to the incremented harmonic, and so the restoration effect is usually attributed to the grouping of the leading portion with the captor. However, results are presented that contradict this interpretation. Captor efficacy does not depend on a common onset, or harmonic relations, with the leading component. Rather, captor efficacy is influenced by frequency separation, and extends to about 1.5 oct above the leading component. Below this cutoff, the captor effect is equivalent to attenuating the leading portion of the incremented harmonic by about 6 dB. These results indicate that high-level grouping does not govern the captor effect. Instead, it is proposed that the partial restoration of the contribution of an asynchronous component to vowel timbre depends on broadband inhibition within the central auditory system. © 2006 Acoustical Society of America.

Neural population coding is optimized by discrete tuning curves

The sigmoidal tuning curve that maximizes the mutual information for a Poisson neuron, or population of Poisson neurons, is obtained. The optimal tuning curve is found to have a discrete structure that results in a quantization of the input signal. The number of quantization levels undergoes a hierarchy of phase transitions as the length of the coding window is varied. We postulate, using the mammalian auditory system as an example, that the presence of a subpopulation structure within a neural population is consistent with an optimal neural code.

A hierarchy of phase transitions in optimal neuronal coding:from binary to M-ary discrete optimal codes

We have investigated how optimal coding for neural systems changes with the time available for decoding. Optimization was in terms of maximizing information transmission. We have estimated the parameters for Poisson neurons that optimize Shannon transinformation with the assumption of rate coding. We observed a hierarchy of phase transitions from binary coding, for small decoding times, toward discrete (M-ary) coding with two, three and more quantization levels for larger decoding times. We postulate that the presence of subpopulations with specific neural characteristics could be a signiture of an optimal population coding scheme and we use the mammalian auditory system as an example.

Coding Strategies and Implementations of Compressive Sensing

This dissertation studies the coding strategies of computational imaging to overcome the limitation of conventional sensing techniques. The information capacity of conventional sensing is limited by the physical properties of optics, such as aperture size, detector pixels, quantum efficiency, and sampling rate. These parameters determine the spatial, depth, spectral, temporal, and polarization sensitivity of each imager. To increase sensitivity in any dimension can significantly compromise the others.

This research implements various coding strategies subject to optical multidimensional imaging and acoustic sensing in order to extend their sensing abilities. The proposed coding strategies combine hardware modification and signal processing to exploiting bandwidth and sensitivity from conventional sensors. We discuss the hardware architecture, compression strategies, sensing process modeling, and reconstruction algorithm of each sensing system.

Optical multidimensional imaging measures three or more dimensional information of the optical signal. Traditional multidimensional imagers acquire extra dimensional information at the cost of degrading temporal or spatial resolution. Compressive multidimensional imaging multiplexes the transverse spatial, spectral, temporal, and polarization information on a two-dimensional (2D) detector. The corresponding spectral, temporal and polarization coding strategies adapt optics, electronic devices, and designed modulation techniques for multiplex measurement. This computational imaging technique provides multispectral, temporal super-resolution, and polarization imaging abilities with minimal loss in spatial resolution and noise level while maintaining or gaining higher temporal resolution. The experimental results prove that the appropriate coding strategies may improve hundreds times more sensing capacity.

Human auditory system has the astonishing ability in localizing, tracking, and filtering the selected sound sources or information from a noisy environment. Using engineering efforts to accomplish the same task usually requires multiple detectors, advanced computational algorithms, or artificial intelligence systems. Compressive acoustic sensing incorporates acoustic metamaterials in compressive sensing theory to emulate the abilities of sound localization and selective attention. This research investigates and optimizes the sensing capacity and the spatial sensitivity of the acoustic sensor. The well-modeled acoustic sensor allows localizing multiple speakers in both stationary and dynamic auditory scene; and distinguishing mixed conversations from independent sources with high audio recognition rate.

Étude des mécanismes de localisation auditive et de leur plasticité dans le cortex auditif humain.

Pouvoir déterminer la provenance des sons est fondamental pour bien interagir avec notre environnement. La localisation auditive est une faculté importante et complexe du système auditif humain. Le cerveau doit décoder le signal acoustique pour en extraire les indices qui lui permettent de localiser une source sonore. Ces indices de localisation auditive dépendent en partie de propriétés morphologiques et environnementales qui ne peuvent être anticipées par l'encodage génétique. Le traitement de ces indices doit donc être ajusté par l'expérience durant la période de développement. À l’âge adulte, la plasticité en localisation auditive existe encore. Cette plasticité a été étudiée au niveau comportemental, mais on ne connaît que très peu ses corrélats et mécanismes neuronaux. La présente recherche avait pour objectif d'examiner cette plasticité, ainsi que les mécanismes d'encodage des indices de localisation auditive, tant sur le plan comportemental, qu'à travers les corrélats neuronaux du comportement observé. Dans les deux premières études, nous avons imposé un décalage perceptif de l’espace auditif horizontal à l’aide de bouchons d’oreille numériques. Nous avons montré que de jeunes adultes peuvent rapidement s’adapter à un décalage perceptif important. Au moyen de l’IRM fonctionnelle haute résolution, nous avons observé des changements de l’activité corticale auditive accompagnant cette adaptation, en termes de latéralisation hémisphérique. Nous avons également pu confirmer l’hypothèse de codage par hémichamp comme représentation de l'espace auditif horizontal. Dans une troisième étude, nous avons modifié l’indice auditif le plus important pour la perception de l’espace vertical à l’aide de moulages en silicone. Nous avons montré que l’adaptation à cette modification n’était suivie d’aucun effet consécutif au retrait des moulages, même lors de la toute première présentation d’un stimulus sonore. Ce résultat concorde avec l’hypothèse d’un mécanisme dit de many-to-one mapping, à travers lequel plusieurs profils spectraux peuvent être associés à une même position spatiale. Dans une quatrième étude, au moyen de l’IRM fonctionnelle et en tirant profit de l’adaptation aux moulages de silicone, nous avons révélé l’encodage de l’élévation sonore dans le cortex auditif humain.

Étude des mécanismes de localisation auditive et de leur plasticité dans le cortex auditif humain

Pouvoir déterminer la provenance des sons est fondamental pour bien interagir avec notre environnement. La localisation auditive est une faculté importante et complexe du système auditif humain. Le cerveau doit décoder le signal acoustique pour en extraire les indices qui lui permettent de localiser une source sonore. Ces indices de localisation auditive dépendent en partie de propriétés morphologiques et environnementales qui ne peuvent être anticipées par l'encodage génétique. Le traitement de ces indices doit donc être ajusté par l'expérience durant la période de développement. À l’âge adulte, la plasticité en localisation auditive existe encore. Cette plasticité a été étudiée au niveau comportemental, mais on ne connaît que très peu ses corrélats et mécanismes neuronaux. La présente recherche avait pour objectif d'examiner cette plasticité, ainsi que les mécanismes d'encodage des indices de localisation auditive, tant sur le plan comportemental, qu'à travers les corrélats neuronaux du comportement observé. Dans les deux premières études, nous avons imposé un décalage perceptif de l’espace auditif horizontal à l’aide de bouchons d’oreille numériques. Nous avons montré que de jeunes adultes peuvent rapidement s’adapter à un décalage perceptif important. Au moyen de l’IRM fonctionnelle haute résolution, nous avons observé des changements de l’activité corticale auditive accompagnant cette adaptation, en termes de latéralisation hémisphérique. Nous avons également pu confirmer l’hypothèse de codage par hémichamp comme représentation de l'espace auditif horizontal. Dans une troisième étude, nous avons modifié l’indice auditif le plus important pour la perception de l’espace vertical à l’aide de moulages en silicone. Nous avons montré que l’adaptation à cette modification n’était suivie d’aucun effet consécutif au retrait des moulages, même lors de la toute première présentation d’un stimulus sonore. Ce résultat concorde avec l’hypothèse d’un mécanisme dit de many-to-one mapping, à travers lequel plusieurs profils spectraux peuvent être associés à une même position spatiale. Dans une quatrième étude, au moyen de l’IRM fonctionnelle et en tirant profit de l’adaptation aux moulages de silicone, nous avons révélé l’encodage de l’élévation sonore dans le cortex auditif humain.

EFFECTS OF AGING ON MIDBRAIN AND CORTICAL SPEECH-IN-NOISE PROCESSING

Older adults frequently report that they can hear what they have been told but cannot understand the meaning. This is particularly true in noisy conditions, where the additional challenge of suppressing irrelevant noise (i.e. a competing talker) adds another layer of difficulty to their speech understanding. Hearing aids improve speech perception in quiet, but their success in noisy environments has been modest, suggesting that peripheral hearing loss may not be the only factor in the older adult’s perceptual difficulties. Recent animal studies have shown that auditory synapses and cells undergo significant age-related changes that could impact the integrity of temporal processing in the central auditory system. Psychoacoustic studies carried out in humans have also shown that hearing loss can explain the decline in older adults’ performance in quiet compared to younger adults, but these psychoacoustic measurements are not accurate in describing auditory deficits in noisy conditions. These results would suggest that temporal auditory processing deficits could play an important role in explaining the reduced ability of older adults to process speech in noisy environments. The goals of this dissertation were to understand how age affects neural auditory mechanisms and at which level in the auditory system these changes are particularly relevant for explaining speech-in-noise problems. Specifically, we used non-invasive neuroimaging techniques to tap into the midbrain and the cortex in order to analyze how auditory stimuli are processed in younger (our standard) and older adults. We will also attempt to investigate a possible interaction between processing carried out in the midbrain and cortex.

Incidencia de hipoacusia y su relación con factores de riesgo, en pacientes del servicio de neonatología, Hospital Latinoamericano, Cuenca-Ecuador. 2015

ANTECEDENTES: Conocer el funcionamiento del sistema auditivo es de interés para los profesionales, por esto la detección temprana de hipoacusia es importante. OBJETIVO GENERAL: Determinar la incidencia de hipoacusia y su relación con factores de riesgo, en pacientes del Servicio de Neonatología, Hospital Latinoamericano, Cuenca - Ecuador, 2015. METODOLOGÍA: Es un estudio prospectivo analítico, la muestra de 50 pacientes cumplieron los criterios de inclusión y exclusión, los factores de riesgo se recolectaron en un formulario elaborado por los autores. Para la formulación y análisis de tablas estadísticas se utilizó Microsoft Office Excel 2007 y SPSS. Medidas Estadísticas: Riesgo Relativo, Índice de Confianza, y valor de P. RESULTADOS: La incidencia de hipoacusia detectada por OEA fue de 20 (40%) de 50 pacientes. El grupo etario con mayor incidencia de hipoacusia fueron pacientes entre 1 y 5 días de nacidos. Los factores de riesgo más frecuentes fueron PREMATURIDAD y APGAR al minuto deprimido, ambos con 28 casos (56%). El sexo MASCULINO con un 60% del total de hipoacusias detectadas fue el de mayor incidencia. Los factores de riesgo estadísticamente significativos, fueron MANIFESTACIONES NEUROLÓGICAS, con un RR=3.31 (IC95%: 2.10 – 5.21) y valor p = 0.001 y MALFORMACIONES CONGENITAS con un RR=2.88 (IC95%: 1.94 – 4.27) y valor p=0.021. CONCLUSIONES: Determinar la incidencia de hipoacusia mediante OEA es importante para llegar a un diagnóstico definitivo mediante la prueba de Potenciales Evocados y lograr un tratamiento temprano y adecuado, además de un control epidemiológico propio para detectar factores de riesgo asociados

Neurophysiological aspects of musical auditory stimulation on cardiovascular system

Introduction: The literature has shown that musical stimulation can influence the cardiovascular system, however, the neurophysiological aspects of this influence are not yet fully elucidated. Objective: This study describes the influence of music on the neurophysiological mechanisms in the human body, specifically the variable blood pressure, as well as the neural mechanisms of music processing. Methods: Searches were conducted in Medline, PEDro, Lilacs and SciELO using the intersection of the keyword “music” with the keyword descriptors “blood pressure” and “neurophysiology”. Results: There were selected 11 articles, which indicated that music interferes in some aspects of physiological variables. Conclusion: Studies have indicated that music interferes on the control of blood pressure, heart and respiratory rate, through possible involvement of limbic brain areas which modulate hypothalamic-pituitary functions. Further studies are needed in order to identify the mechanisms by which this influence occurs.

Prenatal augmented auditory stimulation and visual system development: Effects of timing on intersensory organization

This study investigated the effects of augmented prenatal auditory stimulation on postnatal visual responsivity and neural organization in bobwhite quail (Colinus virginianus). I delivered conspecific embryonic vocalizations before, during, or after the development of a multisensory, midbrain audiovisual area, the optic tectum. Postnatal simultaneous choice tests revealed that hatchlings receiving augmented auditory stimulation during optic tectum development as embryos failed to show species-typical visual preferences for a conspecific maternal hen 72 hours after hatching. Auditory simultaneous choice tests showed no hatchlings had deficits in auditory function in any of the groups, indicating deficits were specific to visual function. ZENK protein expression confirmed differences in the amount of neural plasticity in multiple neuroanatomical regions of birds receiving stimulation during optic tecturn development, compared to unmanipulated birds. The results of these experiments support the notion that the timing of augmented prenatal auditory stimulation relative to optic tectum development can impact postnatal perceptual organization in an enduring way.^

Influence of Cochlear Function on Auditory Temporal Resolution in Tinnitus Patients

Our aim was to analyze the influence of subtle cochlear damage on temporal auditory resolution in tinnitus patients. Forty-eight subjects (hearing threshold <= 25 dB HL) were assigned to one of two experimental groups: 28 without auditory complaints (mean age, 28.8 years) and 20 with tinnitus (mean age, 33.5 years). We analyzed distortion product otoacoustic emission growth functions (by threshold, slope, and estimated amplitude), extended high-frequency thresholds, and the Gaps-in-Noise test. There were differences between the groups, principally in the extended high-frequency thresholds and the Gaps-in-Noise test results. Our findings suggest that subtle peripheral hearing impairment affects temporal resolution in tinnitus, even when pure-tone thresholds as conventionally measured appear normal. Copyright (C) 2010 S. Karger AG, Basel