Speaker verification based on the fusion of speech acoustics and inverted articulatory signals

We propose apractical, feature-level and score-level fusion approach by combining acoustic and estimated articulatory information for both text independent and text dependent speaker verification. From a practical point of view, we study how to improve speaker verification performance by combining dynamic articulatory information with the conventional acoustic features. On text independent speaker verification, we find that concatenating articulatory features obtained from measured speech production data with conventional Mel-frequency cepstral coefficients (MFCCs) improves the performance dramatically. However, since directly measuring articulatory data is not feasible in many real world applications, we also experiment with estimated articulatory features obtained through acoustic-to-articulatory inversion. We explore both feature level and score level fusion methods and find that the overall system performance is significantly enhanced even with estimated articulatory features. Such a performance boost could be due to the inter-speaker variation information embedded in the estimated articulatory features. Since the dynamics of articulation contain important information, we included inverted articulatory trajectories in text dependent speaker verification. We demonstrate that the articulatory constraints introduced by inverted articulatory features help to reject wrong password trials and improve the performance after score level fusion. We evaluate the proposed methods on the X-ray Microbeam database and the RSR 2015 database, respectively, for the aforementioned two tasks. Experimental results show that we achieve more than 15% relative equal error rate reduction for both speaker verification tasks. (C) 2015 Elsevier Ltd. All rights reserved.

MULTI-INSTRUMENT DETECTION IN POLYPHONIC MUSIC USING GAUSSIAN MIXTURE BASED FACTORIAL HMM

We formulate the problem of detecting the constituent instruments in a polyphonic music piece as a joint decoding problem. From monophonic data, parametric Gaussian Mixture Hidden Markov Models (GM-HMM) are obtained for each instrument. We propose a method to use the above models in a factorial framework, termed as Factorial GM-HMM (F-GM-HMM). The states are jointly inferred to explain the evolution of each instrument in the mixture observation sequence. The dependencies are decoupled using variational inference technique. We show that the joint time evolution of all instruments' states can be captured using F-GM-HMM. We compare performance of proposed method with that of Student's-t mixture model (tMM) and GM-HMM in an existing latent variable framework. Experiments on two to five polyphony with 8 instrument models trained on the RWC dataset, tested on RWC and TRIOS datasets show that F-GM-HMM gives an advantage over the other considered models in segments containing co-occurring instruments.

The Comovement between Monetary and Fiscal Policy Instruments during the Post-War Period in the U.S.

This paper empirically studies the dynamic relationship between monetary and fiscal policies by analyzing the comovements between the Fed funds rate and the primary deficit/output ratio. Simple economic thinking establishes that a negative correlation between Fed rate and deficit arises whenever the two policy authorities share a common stabilization objective. However, when budget balancing concerns lead to a drastic deficit reduction the Fed may reduce the Fed rate in order to smooth the impact of fiscal policy, which results in a positive correlation between these two policy instruments. The empirical results show (i) a significant negative comovement between Fed rate and deficit and (ii) that deficit and output gap Granger-cause the Fed funds rate during the post-Volcker era, but the opposite is not true.

Hydroacoustic surveys: a non-destructive approach to monitoring fish distributions at National Marine Sanctuaries

The science of fisheries acoustics and its applicability to resource management have evolved over the past several decades. This document provides a basic description of fisheries acoustics and recommendations on using this technology for research and monitoring of fish distributions and habitats within sanctuaries. It also describes recent efforts aimed at applying fisheries acoustics to Gray’s Reef National Marine Sanctuary (GRNMS) (Figure 1). Historically, methods to assess the underwater environment have included net trawls, diver censuses, hook and line, video, sonar and other techniques deployed in a variety of ways. Fisheries acoustics, using active sonar, relies on the physics of sound traveling through water to quantify the distribution of biota in the water column. By sending a signal of a given frequency through the water column and recording the time of travel and the strength of the reflected signal, it is possible to determine the size and location of fish and estimate biomass from the acoustic backscatter. As a fisheries assessment tool, active hydroacoustics technology is an efficient, non-intrusive method of mapping the water column at a very fine spatial and temporal resolution. It provides a practical alternative to bottom and mid-water trawls, which are not allowed at GRNMS. Passive acoustics, which uses underwater hydrophones to record man-made and natural sounds such as fish spawning calls and sounds produced by marine mammals for communication and echolocation, can provide a useful, complementary survey tool. This report primarily deals with active acoustics, although the integration of active and passive acoustics is addressed as well. (PDF contains 32 pages)

Effects of underwater explosions on oysters, crabs and fish: a preliminary report.

Investigation on the effects of explosive shock on marine life. Necessary that the "commercial" effects, the actual damage to commercially important stocks of fish and shellfish, be evaluated. Equally important are the "biological" effects, the immediate physical effects of shock waves on animals and the indirect effects on future stocks. Indirect effects might include the diversion of migratory stocks from an area, or actual damage to the habitat, rendering it unfit for sedentary or non-migratory native species. Interruption of the food chains in an area by destruction of forge forms or vegetation. (PDF contains 43 pages)

Cost effectiveness of a combination of instruments for global warming: a quantitative approach for Spain

Climate change is an important environmental problem and one whose economic implications are many and varied. This paper starts with the presumption that mitigation of greenhouse gases is a necessary policy that has to be designed in a cost effective way. It is well known that market instruments are the best option for cost effectiveness. But the discussion regarding which of the various market instruments should be used, how they may interact and what combinations of policies should be implemented is still open and very lively. In this paper we propose a combination of instruments: the marketable emission permits already in place in Europe for major economic sectors and a CO(2) tax for economic sectors not included in the emissions permit scheme. The study uses an applied general equilibrium model for the Spanish economy to compute the results obtained with the new mix of instruments proposed. As the combination of the market for emission permits and the CO(2) tax admits different possibilities that depend on how the mitigation is distributed among the economic sectors, we concentrate on four possibilities: cost-effective, equalitarian, proportional to emissions, and proportional to output distributions. Other alternatives to the CO(2) tax are also analysed (tax on energy, on oil and on electricity). Our findings suggest that careful, well designed policies are needed as any deviation imposes significant additional costs that increase more than proportionally to the level of emissions reduction targeted by the EU.

FORTH for NOAA/MLML Instruments

This report describes FORTH software written for several instruments used in the NASA-sponsored project to design and build Marine Optical Buoy System (MOBS) and in the NOAA-sponsored project "EOS MODIS Execution: Oceanographic Profiling, Data Acquisition and Management for the Marine Optical Buoy System·'. In the NOAA project MLML and NOAA personnel will participate in quarterly cruises at the MOBS Hawaiian site to validate performance of SeaWiFS and will participate in several extended "process" cruises to provide wide geographic surface truthing investigations similar to those lead by Dennis Clark (NOAA) following the "launch of CZCS in 1979. In the NASA project we are designing and building MOBS, a high resolution spectroradiometer that will operate autonomously in a buoy moored west of Lanai in the Hawaiian Islands. That instrument, the "Marine Optical System" (MOS), will transmit by cellular phone in near real time observations of upwelled radiance and downwelled irradiance from three depths. [PDF contains 90 pages]