AIRSTREAM: A Neural Network Model of Auditory Scene Analysis and Source Segregation

Multiple sound sources often contain harmonics that overlap and may be degraded by environmental noise. The auditory system is capable of teasing apart these sources into distinct mental objects, or streams. Such an "auditory scene analysis" enables the brain to solve the cocktail party problem. A neural network model of auditory scene analysis, called the AIRSTREAM model, is presented to propose how the brain accomplishes this feat. The model clarifies how the frequency components that correspond to a give acoustic source may be coherently grouped together into distinct streams based on pitch and spatial cues. The model also clarifies how multiple streams may be distinguishes and seperated by the brain. Streams are formed as spectral-pitch resonances that emerge through feedback interactions between frequency-specific spectral representaion of a sound source and its pitch. First, the model transforms a sound into a spatial pattern of frequency-specific activation across a spectral stream layer. The sound has multiple parallel representations at this layer. A sound's spectral representation activates a bottom-up filter that is sensitive to harmonics of the sound's pitch. The filter activates a pitch category which, in turn, activate a top-down expectation that allows one voice or instrument to be tracked through a noisy multiple source environment. Spectral components are suppressed if they do not match harmonics of the top-down expectation that is read-out by the selected pitch, thereby allowing another stream to capture these components, as in the "old-plus-new-heuristic" of Bregman. Multiple simultaneously occuring spectral-pitch resonances can hereby emerge. These resonance and matching mechanisms are specialized versions of Adaptive Resonance Theory, or ART, which clarifies how pitch representations can self-organize durin learning of harmonic bottom-up filters and top-down expectations. The model also clarifies how spatial location cues can help to disambiguate two sources with similar spectral cures. Data are simulated from psychophysical grouping experiments, such as how a tone sweeping upwards in frequency creates a bounce percept by grouping with a downward sweeping tone due to proximity in frequency, even if noise replaces the tones at their interection point. Illusory auditory percepts are also simulated, such as the auditory continuity illusion of a tone continuing through a noise burst even if the tone is not present during the noise, and the scale illusion of Deutsch whereby downward and upward scales presented alternately to the two ears are regrouped based on frequency proximity, leading to a bounce percept. Since related sorts of resonances have been used to quantitatively simulate psychophysical data about speech perception, the model strengthens the hypothesis the ART-like mechanisms are used at multiple levels of the auditory system. Proposals for developing the model to explain more complex streaming data are also provided.

A Neural Network for Synthesizing the Pitch of an Acoustic Source

This article describes a neural network model capable of generating a spatial representation of the pitch of an acoustic source. Pitch is one of several auditory percepts used by humans to separate multiple sound sources in the environment from each other. The model provides a neural instantiation of a type of "harmonic sieve". It is capable of quantitatively simulating a large body of psychoacoustical data, including new data on octave shift perception.

A Spectral Network Model of Pitch Perception

A model of pitch perception, called the Spatial Pitch Network or SPINET model, is developed and analyzed. The model neurally instantiates ideas front the spectral pitch modeling literature and joins them to basic neural network signal processing designs to simulate a broader range of perceptual pitch data than previous spectral models. The components of the model arc interpreted as peripheral mechanical and neural processing stages, which arc capable of being incorporated into a larger network architecture for separating multiple sound sources in the environment. The core of the new model transforms a spectral representation of an acoustic source into a spatial distribution of pitch strengths. The SPINET model uses a weighted "harmonic sieve" whereby the strength of activation of a given pitch depends upon a weighted sum of narrow regions around the harmonics of the nominal pitch value, and higher harmonics contribute less to a pitch than lower ones. Suitably chosen harmonic weighting functions enable computer simulations of pitch perception data involving mistuned components, shifted harmonics, and various types of continuous spectra including rippled noise. It is shown how the weighting functions produce the dominance region, how they lead to octave shifts of pitch in response to ambiguous stimuli, and how they lead to a pitch region in response to the octave-spaced Shepard tone complexes and Deutsch tritones without the use of attentional mechanisms to limit pitch choices. An on-center off-surround network in the model helps to produce noise suppression, partial masking and edge pitch. Finally, it is shown how peripheral filtering and short term energy measurements produce a model pitch estimate that is sensitive to certain component phase relationships.

Numerical investigation of a source extraction technique based on an acoustic correction method

An aerodynamic sound source extraction from a general flow field is applied to a number of model problems and to a problem of engineering interest. The extraction technique is based on a variable decomposition, which results to an acoustic correction method, of each of the flow variables into a dominant flow component and a perturbation component. The dominant flow component is obtained with a general-purpose Computational Fluid Dynamics (CFD) code which uses a cell-centred finite volume method to solve the Reynolds-averaged Navier–Stokes equations. The perturbations are calculated from a set of acoustic perturbation equations with source terms extracted from unsteady CFD solutions at each time step via the use of a staggered dispersion-relation-preserving (DRP) finite-difference scheme. Numerical experiments include (1) propagation of a 1-D acoustic pulse without mean flow, (2) propagation of a 2-D acoustic pulse with/without mean flow, (3) reflection of an acoustic pulse from a flat plate with mean flow, and (4) flow-induced noise generated by the an unsteady laminar flow past a 2-D cavity. The computational results demonstrate the accuracy for model problems and illustrate the feasibility for more complex aeroacoustic problems of the source extraction technique.

Scale-dependent foraging ecology of a marine top predator modelled using passive acoustic data

1.Understanding which environmental factors drive foraging preferences is critical for the development of effective management measures, but resource use patterns may emerge from processes that occur at different spatial and temporal scales. Direct observations of foraging are also especially challenging in marine predators, but passive acoustic techniques provide opportunities to study the behaviour of echolocating species over a range of scales. 2.We used an extensive passive acoustic data set to investigate the distribution and temporal dynamics of foraging in bottlenose dolphins using the Moray Firth (Scotland, UK). Echolocation buzzes were identified with a mixture model of detected echolocation inter-click intervals and used as a proxy of foraging activity. A robust modelling approach accounting for autocorrelation in the data was then used to evaluate which environmental factors were associated with the observed dynamics at two different spatial and temporal scales. 3.At a broad scale, foraging varied seasonally and was also affected by seabed slope and shelf-sea fronts. At a finer scale, we identified variation in seasonal use and local interactions with tidal processes. Foraging was best predicted at a daily scale, accounting for site specificity in the shape of the estimated relationships. 4.This study demonstrates how passive acoustic data can be used to understand foraging ecology in echolocating species and provides a robust analytical procedure for describing spatio-temporal patterns. Associations between foraging and environmental characteristics varied according to spatial and temporal scale, highlighting the need for a multi-scale approach. Our results indicate that dolphins respond to coarser scale temporal dynamics, but have a detailed understanding of finer-scale spatial distribution of resources.

Speech Recognition with unknown partial feature corruption - a review of the union model

This paper provides a summary of our studies on robust speech recognition based on a new statistical approach – the probabilistic union model. We consider speech recognition given that part of the acoustic features may be corrupted by noise. The union model is a method for basing the recognition on the clean part of the features, thereby reducing the effect of the noise on recognition. To this end, the union model is similar to the missing feature method. However, the two methods achieve this end through different routes. The missing feature method usually requires the identity of the noisy data for noise removal, while the union model combines the local features based on the union of random events, to reduce the dependence of the model on information about the noise. We previously investigated the applications of the union model to speech recognition involving unknown partial corruption in frequency band, in time duration, and in feature streams. Additionally, a combination of the union model with conventional noise-reduction techniques was studied, as a means of dealing with a mixture of known or trainable noise and unknown unexpected noise. In this paper, a unified review, in the context of dealing with unknown partial feature corruption, is provided into each of these applications, giving the appropriate theory and implementation algorithms, along with an experimental evaluation.

An observational study of a magneto-acoustic wave in the solar corona

The Solar Eclipse Corona Imaging System (SECIS) observed a strong 6-s oscillation in an active region coronal loop, during the 1999 August 11 total solar eclipse. In the present paper we show that this oscillation is associated with a fast-mode magneto-acoustic wave that travels through the loop apex with a velocity of 2100 km s-1. We use near-simultaneous SOHO observations to calculate the parameters of the loop and its surroundings such as density, temperature and their spatial variation. We find that the temporal evolution of the intensity is in agreement with the model of an impulsively generated, fast-mode wave.

Ion-acoustic waves in a plasma consisting of adiabatic warm ions, non-isothermal electrons and a weakly relativistic electron beam: linear and higher-order nonlinear effects

The nonlinear propagation of finite amplitude ion acoustic solitary waves in a plasma consisting of adiabatic warm ions, nonisothermal electrons, and a weakly relativistic electron beam is studied via a two-fluid model. A multiple scales technique is employed to investigate the nonlinear regime. The existence of the electron beam gives rise to four linear ion acoustic modes, which propagate at different phase speeds. The numerical analysis shows that the propagation speed of two of these modes may become complex-valued (i.e., waves cannot occur) under conditions which depend on values of the beam-to-background-electron density ratio , the ion-to-free-electron temperature ratio , and the electron beam velocity v0; the remaining two modes remain real in all cases. The basic set of fluid equations are reduced to a Schamel-type equation and a linear inhomogeneous equation for the first and second-order potential perturbations, respectively. Stationary solutions of the coupled equations are derived using a renormalization method. Higher-order nonlinearity is thus shown to modify the solitary wave amplitude and may also deform its shape, even possibly transforming a simple pulse into a W-type curve for one of the modes. The dependence of the excitation amplitude and of the higher-order nonlinearity potential correction on the parameters , , and v0 is numerically investigated.

Acoustic, volumetric, compressibility and refractivity properties and reduction parameters for the ERAS and Flory models of some homologous series of amines from 298.15 to 328.15 K

The speeds of sound u, densities ? and refractive indices nD of homologous series of mono-, di-, and tri-alkylamines were measured in the temperature range from 298.15 to 328.15 K. Isentropic and isothermal compressibilities ?S and ?T, molar refraction Rm, Eykman’s constant Cm, Rao’s molar sound function R, thermal expansion coefficient a, thermal pressure coefficient ?, and reduction parameters P*, V*, and T* in frameworks of the ERAS model for associated amines and Flory model for tertiary amines have been calculated from the measured experimental data. Applicability of the Rao theory and the ERAS and Flory models have been examined and discussed for the alkyl amines.

Lagrangian description of nonlinear dust-ion acoustic waves in dusty plasmas

An analytical model is presented for the description of nonlinear dust-ion-acoustic waves propagating in an unmagnetized, collisionless, three component plasma composed of electrons, ions and inertial dust grains. The formulation relies on a Lagrangian approach of the plasma fluid model. The modulational stability of the wave amplitude is investigated. Different types of localized envelope electrostatic excitations are shown to exist.

Acoustic solitary waves in dusty and/or multi-ion plasmas with cold, adiabatic, and hot constituents

Large nonlinear acoustic waves are discussed in a four-component plasma, made up of two superhot isothermal species, and two species with lower thermal velocities, being, respectively, adiabatic and cold. First a model is considered in which the isothermal species are electrons and ions, while the cooler species are positive and/or negative dust. Using a Sagdeev pseudopotential formalism, large dust-acoustic structures have been studied in a systematic way, to delimit the compositional parameter space in which they can be found, without restrictions on the charges and masses of the dust species and their charge signs. Solitary waves can only occur for nonlinear structure velocities smaller than the adiabatic dust thermal velocity, leading to a novel dust-acoustic-like mode based on the interplay between the two dust species. If the cold and adiabatic dust are oppositely charged, only solitary waves exist, having the polarity of the cold dust, their parameter range being limited by infinite compression of the cold dust. However, when the charges of the cold and adiabatic species have the same sign, solitary structures are limited for increasing Mach numbers successively by infinite cold dust compression, by encountering the adiabatic dust sonic point, and by the occurrence of double layers. The latter have, for smaller Mach numbers, the same polarity as the charged dust, but switch at the high Mach number end to the opposite polarity. Typical Sagdeev pseudopotentials and solitary wave profiles have been presented. Finally, the analysis has nowhere used the assumption that the dust would be much more massive than the ions and hence, one or both dust species can easily be replaced by positive and/or negative ions and the conclusions will apply to that plasma model equally well. This would cover a number of different scenarios, such as, for example, very hot electrons and ions, together with a mix of adiabatic ions and dust (of either polarity) or a very hot electron-positron mix, together with a two-ion mix or together with adiabatic ions and cold dust (both of either charge sign), to name but some of the possible plasma compositions.

Large acoustic solitons and double layers in plasmas with two positive ion species

Large nonlinear acoustic waves are discussed in a plasma made up of cold supersonic and adiabatic subsonic positive ions, in the presence of hot isothermal electrons, with the help of Sagdeev pseudopotential theory. In this model, no solitons are found at the acoustic speed, and no compositional parameter ranges exist where solutions of opposite polarities can coexist. All nonlinear modes are thus super-acoustic, but polarity changes are possible. The upper limits on admissible structure velocities come from different physical arguments, in a strict order when the fractional cool ion density is increased: infinite cold ion compression, warm ion sonic point, positive double layers, negative double layers, and finally, positive double layers again. However, not all ranges exist for all mass and temperature ratios. Whereas the cold and warm ion sonic point limitations are always present over a wide range of mass and temperature ratios, and thus positive polarity solutions can easily be obtained, double layers have a more restricted existence range, specially if polarity changes are sought. (C) 2011 American Institute of Physics. [doi:10.1063/1.3579397]

Fully kinetic simulation of ion acoustic and dust-ion acoustic waves

A series of numerical simulations is presented, based on a recurrence-free Vlasov kinetic model using kinetic phase point trajectories. All plasma components are modeled kinetically via a Vlasov evolution equation, then coupled through Poisson’s equation. The dynamics of ion acoustic waves in an electron-ion and in a dusty (electron-ion-dust) plasma configuration are investigated, focusing on wave decay due to Landau damping and, in particular, on the parametric dependence of the damping rate on the dust concentration and on the electron-to-ion temperature ratio. In the absence of dust, the occurrence of damping was observed, as expected, and its dependence to the relative magnitude of the electron vs ion temperature(s) was investigated. When present, the dust component influences the charge balance, enabling dust-ion acoustic waves to survive Landau damping even in the extreme regime where Te???Ti. The Landau damping rate is shown to be minimized for a strong dust concentration or/and for a high value of the electron-to-ion temperature ratio. Our results confirm earlier theoretical considerations and contribute to the interpretation of experimental observations of dust-ion acoustic wave characteristics.

Nonlinear dust-acoustic solitary waves in strongly coupled dusty plasmas

Dust-acoustic waves are investigated in a three-component plasma consisting of strongly coupled dust particles and Maxwellian electrons and ions. A fluid model approach is used, with the effects of strong coupling being accounted for by an effective electrostatic "pressure" which is a function of the dust number density and the electrostatic potential. Both linear and weakly nonlinear cases are considered by derivation and analysis of the linear dispersion relation and the Korteweg-de Vries equation, respectively. In contrast to previous studies using this model, this paper presents the results arising from an expansion of the dynamical form of the electrostatic pressure, accounting for the variations in its value in the vicinity of the wave. DOI: 10.1103/PhysRevE.86.066404

Strong electrostatic interaction effect on modulational stability of dust acoustic waves

The modulational instability of dust-acoustic waves is investigated, relying on a recently proposed model for strong electrostatic interactions between the highly charged dust particles. The resulting effect on the occurrence (threshold, growth rate) of modulational instability is investigated. Our results can in principle be tested experimentally.