Discriminative language model adaptation for Mandarin broadcast speech transcription and translation

This paper investigates unsupervised test-time adaptation of language models (LM) using discriminative methods for a Mandarin broadcast speech transcription and translation task. A standard approach to adapt interpolated language models to is to optimize the component weights by minimizing the perplexity on supervision data. This is a widely made approximation for language modeling in automatic speech recognition (ASR) systems. For speech translation tasks, it is unclear whether a strong correlation still exists between perplexity and various forms of error cost functions in recognition and translation stages. The proposed minimum Bayes risk (MBR) based approach provides a flexible framework for unsupervised LM adaptation. It generalizes to a variety of forms of recognition and translation error metrics. LM adaptation is performed at the audio document level using either the character error rate (CER), or translation edit rate (TER) as the cost function. An efficient parameter estimation scheme using the extended Baum-Welch (EBW) algorithm is proposed. Experimental results on a state-of-the-art speech recognition and translation system are presented. The MBR adapted language models gave the best recognition and translation performance and reduced the TER score by up to 0.54% absolute. © 2007 IEEE.

Language model combination and adaptation using weighted finite state transducers

In speech recognition systems language model (LMs) are often constructed by training and combining multiple n-gram models. They can be either used to represent different genres or tasks found in diverse text sources, or capture stochastic properties of different linguistic symbol sequences, for example, syllables and words. Unsupervised LM adaptation may also be used to further improve robustness to varying styles or tasks. When using these techniques, extensive software changes are often required. In this paper an alternative and more general approach based on weighted finite state transducers (WFSTs) is investigated for LM combination and adaptation. As it is entirely based on well-defined WFST operations, minimum change to decoding tools is needed. A wide range of LM combination configurations can be flexibly supported. An efficient on-the-fly WFST decoding algorithm is also proposed. Significant error rate gains of 7.3% relative were obtained on a state-of-the-art broadcast audio recognition task using a history dependently adapted multi-level LM modelling both syllable and word sequences. ©2010 IEEE.

Transient Ventilation Dynamics Following a Change in Strength of a Point Source of Heat

We investigate the transient ventilation flow within a confined ventilated space, with high- and low-level openings, when the strength of a low-level point source of heat is changed instantaneously. The steady-flow regime in the space involves a turbulent buoyant plume, which rises from the point source to a well-mixed warm upper layer. The steady-state height of the interface between this layer and the lower layer of exterior fluid is independent of the heat flux, but the upper layer becomes progressively warmer with heat flux. New analogue laboratory experiments of the transient adjustment between steady states identify that if the heat flux is increased, the continuing plume propagates to the top of the room forming a new, warmer layer. This layer gradually deepens, and as the turbulent plume entrains fluid from the original warm layer, the original layer is gradually depleted and disappears, and a new steady state is established. In contrast, if the source buoyancy flux is decreased, the continuing plume is cooler than the original plume, so that on reaching the interface it is of intermediate density between the original warm layer and the external fluid. The plume supplies a new intermediate layer, which gradually deepens with the continuing flow. In turn, the original upper layer becomes depleted, both as a result of being vented through the upper opening of the space, but also due to some penetrative entrainment of this layer by the plume, as the plume overshoots the interface before falling back to supply the new intermediate layer. We develop quantitative models which are in good accord with our experimental data, by combining classical plume theory with models of the penetrative entrainment for the case of a decrease in heating. Typically, we find that the effect of penetrative entrainment on the density of the intruding layer is relatively weak, provided the change in source strength is sufficiently large. However, penetrative entrainment measurably increases the rate at which the depth of the draining layer decreases. We conclude with a discussion of the importance of these results for the control of naturally ventilated spaces.

Transient Natural Ventilation of a Room with a Distributed Heat Source

We report on an experimental and theoretical study of the transient flows which develop as a naturally ventilated room adjusts from one temperature to another. We focus on a room heated from below by a uniform heat source, with both high- and low-level ventilation openings. Depending on the initial temperature of the room relative to (i) the final equilibrium temperature and (ii) the exterior temperature, three different modes of ventilation may develop. First, if the room temperature lies between the exterior and the equilibrium temperature, the interior remains well-mixed and gradually heats up to the equilibrium temperature. Secondly, if the room is initially warmer than the equilibrium temperature, then a thermal stratification develops in which the upper layer of originally hot air is displaced upwards by a lower layer of relatively cool inflowing air. At the interface, some mixing occurs owing to the effects of penetrative convection. Thirdly, if the room is initially cooler than the exterior, then on opening the vents, the original air is displaced downwards and a layer of ambient air deepens from above. As this lower layer drains, it is eventually heated to the ambient temperature, and is then able to mix into the overlying layer of external air, and the room becomes well-mixed. For each case, we present new laboratory experiments and compare these with some new quantitative models of the transient flows. We conclude by considering the implications of our work for natural ventilation of large auditoria.

On the transition from displacement to mixing ventilation with a localized heat source

We investigate the steady state natural ventilation of a room heated at the base and consisting of two vents at different levels. We explore how the air flow rate and internal temperature relative to the exterior vary as a function of the vent areas, position of the vents and heat load in order to establish appropriate ventilation strategies for a room. When the room is heated by a distributed source, the room becomes well mixed and the steady state ventilation rate depends on the heating rate, the area of the vents and the distance between the lower and upper level vents. However, when the room is heated by a localised source the room becomes stratified. If the effective ventilation area is sufficiently large, then the interface separating the two layers lies above the inlet vent and the lower layer is comprised of ambient fluid. In this case the upper layer is warmer than in the well mixed case and the ventilation rate is smaller. However, if the effective area for ventilation is sufficiently small, then the interface separating the two layers lies below the inlet vent and the lower layer is comprised of warm fluid which originates as the cold incoming fluid mixes during descent from the vent through the upper layer. In this case both the ventilation rate and the upper layer temperature are the same as in the case of a distributed heat load. As the vertical separation between lower and upper level vents decreases, then the temperature difference between the layers falls to zero and the room becomes approximately well mixed. These findings suggest how the appropriate ventilation strategy for a room can be varied depending on the exterior temperature, with mixing ventilation more suitable for winter conditions and displacement ventilation for warmer external temperatures.

Heat release rate measurement in turbulent flames

The dominant industrial approach for the reduction of NO x emissions in industrial gas turbines is the lean pre-mixed prevaporized concept. The main advantage of this concept is the lean operation of the combustion process; this decreases the heat release rate from the flame and results in a reduction in operating temperature. The direct measurement of heat release rates via simultaneous laser induced fluorescence of OH and CH 2O radicals using planar laser induced fluorescence. The product of the two images correlated with the forward production rate of the HCO radical, which in turn has correlated well with heat release rates from premixed hydrocarbon flames. The experimental methodology of the measurement of heat release rate and applications in different turbulent premixed flames were presented. This is an abstract of a paper presented at the 7th World Congress of Chemical Engineering (Glasgow, Scotland 7/10-14/2005).

Convective heat dissipation with lattice-frame materials

This paper presents experimental results on heat transfer and pressure drop for a compact heat sink made of fully triangulated, lightweight (porosity∼0.938), aluminum lattice-frame materials (LFMs). Due to the inherent structural anisotropy of the LFMs, two mutually perpendicular orientations were selected for the measurements. Constant heat flux was applied to the heat sink under steady state conditions, and dissipated by forced air convection. The experimental data were compared with those predicted from an analytical model based on fin analogy. The experimental results revealed that pressure drop is strongly dependent upon the orientation of the structure, due mainly to the flow blockage effect. For heat transfer measurements, typical local temperature distributions on the substrate under constant heat flux conditions were captured with infrared camera. The thermal behavior of LFMs was found to follow closely that of cylinder banks, with early transition Reynolds number (based on strut diameter) equal to about 300. The Nusselt number prediction from the fin-analogy correlates well with experimental measurements, except at low Reynolds numbers where a slightly underestimation is observed. Comparisons with empty channels and commonly used heat exchanger media show that the present LFM heat sink can remove heat approximately seven times more efficient than an empty channel and as efficient as a bank of cylinders at the same porosity level. The aluminum LFMs are extremely stiff and strong, making them ideal candidates for multifunctional structures requiring both heat dissipation and mechanical load carrying capabilities. © 2003 Elsevier Ltd. All rights reserved.

Language model cross adaptation for LVCSR system combination

State-of-the-art large vocabulary continuous speech recognition (LVCSR) systems often combine outputs from multiple subsystems developed at different sites. Cross system adaptation can be used as an alternative to direct hypothesis level combination schemes such as ROVER. In normal cross adaptation it is assumed that useful diversity among systems exists only at acoustic level. However, complimentary features among complex LVCSR systems also manifest themselves in other layers of modelling hierarchy, e.g., subword and word level. It is thus interesting to also cross adapt language models (LM) to capture them. In this paper cross adaptation of multi-level LMs modelling both syllable and word sequences was investigated to improve LVCSR system combination. Significant error rate gains up to 6.7% rel. were obtained over ROVER and acoustic model only cross adaptation when combining 13 Chinese LVCSR subsystems used in the 2010 DARPA GALE evaluation. © 2010 ISCA.