Discriminative language model adaptation for Mandarin broadcast speech transcription and translation

This paper investigates unsupervised test-time adaptation of language models (LM) using discriminative methods for a Mandarin broadcast speech transcription and translation task. A standard approach to adapt interpolated language models to is to optimize the component weights by minimizing the perplexity on supervision data. This is a widely made approximation for language modeling in automatic speech recognition (ASR) systems. For speech translation tasks, it is unclear whether a strong correlation still exists between perplexity and various forms of error cost functions in recognition and translation stages. The proposed minimum Bayes risk (MBR) based approach provides a flexible framework for unsupervised LM adaptation. It generalizes to a variety of forms of recognition and translation error metrics. LM adaptation is performed at the audio document level using either the character error rate (CER), or translation edit rate (TER) as the cost function. An efficient parameter estimation scheme using the extended Baum-Welch (EBW) algorithm is proposed. Experimental results on a state-of-the-art speech recognition and translation system are presented. The MBR adapted language models gave the best recognition and translation performance and reduced the TER score by up to 0.54% absolute. © 2007 IEEE.

A bone remodelling model coupling micro-damage growth and repair by 3D BMU-activity.

Bone as most of living tissues is able, during its entire lifetime, to adapt its internal microstructure and subsequently its associated mechanical properties to its specific mechanical and physiological environment in a process commonly known as bone remodelling. Bone is therefore continuously renewed and micro-damage, accumulated by fatigue or creep, is removed minimizing the risk of fracture. Nevertheless, bone is not always able to repair itself completely. Actually, if bone repairing function is slower than micro-damage accumulation, a type of bone fracture, usually known as "stress fracture", can finally evolve. In this paper, we propose a bone remodelling continuous model able to simulate micro-damage growth and repair in a coupled way and able therefore to predict the occurrence of "stress fractures". The biological bone remodelling process is modelled in terms of equations that describe the activity of basic multicellular units. The predicted results show a good correspondence with experimental and clinical data. For example, in disuse, bone porosity increases until an equilibrium situation is achieved. In overloading, bone porosity decreases unless the damage rate is so high that causes resorption or "stress fracture".

Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty.

Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models.

Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty

Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models. © 2010 Nagengast et al.

Use of contexts in language model interpolation and adaptation

Language models (LMs) are often constructed by building multiple individual component models that are combined using context independent interpolation weights. By tuning these weights, using either perplexity or discriminative approaches, it is possible to adapt LMs to a particular task. This paper investigates the use of context dependent weighting in both interpolation and test-time adaptation of language models. Depending on the previous word contexts, a discrete history weighting function is used to adjust the contribution from each component model. As this dramatically increases the number of parameters to estimate, robust weight estimation schemes are required. Several approaches are described in this paper. The first approach is based on MAP estimation where interpolation weights of lower order contexts are used as smoothing priors. The second approach uses training data to ensure robust estimation of LM interpolation weights. This can also serve as a smoothing prior for MAP adaptation. A normalized perplexity metric is proposed to handle the bias of the standard perplexity criterion to corpus size. A range of schemes to combine weight information obtained from training data and test data hypotheses are also proposed to improve robustness during context dependent LM adaptation. In addition, a minimum Bayes' risk (MBR) based discriminative training scheme is also proposed. An efficient weighted finite state transducer (WFST) decoding algorithm for context dependent interpolation is also presented. The proposed technique was evaluated using a state-of-the-art Mandarin Chinese broadcast speech transcription task. Character error rate (CER) reductions up to 7.3 relative were obtained as well as consistent perplexity improvements. © 2012 Elsevier Ltd. All rights reserved.

Risk based lifetime costs assessment of a ground source heat pump (GSHP) system design: Methodology and case study

Space heating accounts for a large portion of the world's carbon dioxide emissions. Ground Source Heat Pumps (GSHPs) are a technology which can reduce carbon emissions from heating and cooling. GSHP system performance is however highly sensitive to deviation from design values of the actual annual energy extraction/rejection rates from/to the ground. In order to prevent failure and/or performance deterioration of GSHP systems it is possible to incorporate a safety factor in the design of the GSHP by over-sizing the ground heat exchanger (GHE). A methodology to evaluate the financial risk involved in over-sizing the GHE is proposed is this paper. A probability based approach is used to evaluate the economic feasibility of a hypothetical full-size GSHP system as compared to four alternative Heating Ventilation and Air Conditioning (HVAC) system configurations. The model of the GSHP system is developed in the TRNSYS energy simulation platform and calibrated with data from an actual hybrid GSHP system installed in the Department of Earth Science, University of Oxford, UK. Results of the analysis show that potential savings from a full-size GSHP system largely depend on projected HVAC system efficiencies and gas and electricity prices. Results of the risk analysis also suggest that a full-size GSHP with auxiliary back up is potentially the most economical system configuration. © 2012 Elsevier Ltd.