Perception of concurrent sentences with harmonic or frequency-shifted voiced excitation:performance of human listeners and of computational models based on autocorrelation

Keyword identification in one of two simultaneous sentences is improved when the sentences differ in F0, particularly when they are almost continuously voiced. Sentences of this kind were recorded, monotonised using PSOLA, and re-synthesised to give a range of harmonic ?F0s (0, 1, 3, and 10 semitones). They were additionally re-synthesised by LPC with the LPC residual frequency shifted by 25% of F0, to give excitation with inharmonic but regularly spaced components. Perceptual identification of frequency-shifted sentences showed a similar large improvement with nominal ?F0 as seen for harmonic sentences, although overall performance was about 10% poorer. We compared performance with that of two autocorrelation-based computational models comprising four stages: (i) peripheral frequency selectivity and half-wave rectification; (ii) within-channel periodicity extraction; (iii) identification of the two major peaks in the summary autocorrelation function (SACF); (iv) a template-based approach to speech recognition using dynamic time warping. One model sampled the correlogram at the target-F0 period and performed spectral matching; the other deselected channels dominated by the interferer and performed matching on the short-lag portion of the residual SACF. Both models reproduced the monotonic increase observed in human performance with increasing ?F0 for the harmonic stimuli, but not for the frequency-shifted stimuli. A revised version of the spectral-matching model, which groups patterns of periodicity that lie on a curve in the frequency-delay plane, showed a closer match to the perceptual data for frequency-shifted sentences. The results extend the range of phenomena originally attributed to harmonic processing to grouping by common spectral pattern.

Analytical model for active metamaterials with quantum ingredients

We present an analytical model for describing complex dynamics of a hybrid system consisting of resonantly coupled classical resonator and quantum structures. Classical resonators in our model correspond to plasmonic metamaterials of various geometries, as well as other types of nano- and microstructure, the optical responses of which can be described classically. Quantum resonators are represented by atoms or molecules, or their aggregates (for example, quantum dots, carbon nanotubes, dye molecules, polymer or bio-molecules etc), which can be accurately modelled only with the use of the quantum mechanical approach. Our model is based on the set of equations that combines well established density matrix formalism appropriate for quantum systems, coupled with harmonic-oscillator equations ideal for modelling sub-wavelength plasmonic and optical resonators. As a particular example of application of our model, we show that the saturation nonlinearity of carbon nanotubes increases multifold in the resonantly enhanced near field of a metamaterial. In the framework of our model, we discuss the effect of inhomogeneity of the carbon-nanotube layer (bandgap value distribution) on the nonlinearity enhancement. © 2012 IOP Publishing Ltd.