Use of contexts in language model interpolation and adaptation

Language models (LMs) are often constructed by building multiple individual component models that are combined using context independent interpolation weights. By tuning these weights, using either perplexity or discriminative approaches, it is possible to adapt LMs to a particular task. This paper investigates the use of context dependent weighting in both interpolation and test-time adaptation of language models. Depending on the previous word contexts, a discrete history weighting function is used to adjust the contribution from each component model. As this dramatically increases the number of parameters to estimate, robust weight estimation schemes are required. Several approaches are described in this paper. The first approach is based on MAP estimation where interpolation weights of lower order contexts are used as smoothing priors. The second approach uses training data to ensure robust estimation of LM interpolation weights. This can also serve as a smoothing prior for MAP adaptation. A normalized perplexity metric is proposed to handle the bias of the standard perplexity criterion to corpus size. A range of schemes to combine weight information obtained from training data and test data hypotheses are also proposed to improve robustness during context dependent LM adaptation. In addition, a minimum Bayes' risk (MBR) based discriminative training scheme is also proposed. An efficient weighted finite state transducer (WFST) decoding algorithm for context dependent interpolation is also presented. The proposed technique was evaluated using a state-of-the-art Mandarin Chinese broadcast speech transcription task. Character error rate (CER) reductions up to 7.3 relative were obtained as well as consistent perplexity improvements. © 2012 Elsevier Ltd. All rights reserved.

A global assessment of manufacturing: Economic development, energy use, carbon emissions, and the potential for energy efficiency and materials recycling

We present in two parts an assessment of global manufacturing. In the first part, we review economic development, pollution, and carbon emissions from a country perspective, tracking the rise of China and other developing countries. The results show not only a rise in the economic fortunes of the newly industrializing nations, but also a significant rise in global pollution, particularly air pollution and CO2 emissions largely from coal use, which alter and even reverse previous global trends. In the second part, we change perspective and quantitatively evaluate two important technical strategies to reduce pollution and carbon emissions: energy efficiency and materials recycling. We subdivide the manufacturing sector on the basis of the five major subsectors that dominate energy use and carbon emissions: (a) iron and steel, (b) cement, (c) plastics, (d) paper, and (e) aluminum. The analysis identifies technical constraints on these strategies, but by combined and aggressive action, industry should be able to balance increases in demand with these technical improvements. The result would be high but relatively flat energy use and carbon emissions. The review closes by demonstrating the consequences of extrapolating trends in production and carbon emissions and suggesting two options for further environmental improvements, materials efficiency, and demand reduction. © 2013 by Annual Reviews. All rights reserved.

Exploring the use of sensors to measure behavioral interactions: an experimental evaluation of using hand trajectories.

Humans appear to be sensitive to relative small changes in their surroundings. These changes are often initially perceived as irrelevant, but they can cause significant changes in behavior. However, how exactly people's behavior changes is often hard to quantify. A reliable and valid tool is needed in order to address such a question, ideally measuring an important point of interaction, such as the hand. Wearable-body-sensor systems can be used to obtain valuable, behavioral information. These systems are particularly useful for assessing functional interactions that occur between the endpoints of the upper limbs and our surroundings. A new method is explored that consists of computing hand position using a wearable sensor system and validating it against a gold standard reference measurement (optical tracking device). Initial outcomes related well to the gold standard measurements (r = 0.81) showing an acceptable average root mean square error of 0.09 meters. Subsequently, the use of this approach was further investigated by measuring differences in motor behavior, in response to a changing environment. Three subjects were asked to perform a water pouring task with three slightly different containers. Wavelet analysis was introduced to assess how motor consistency was affected by these small environmental changes. Results showed that the behavioral motor adjustments to a variable environment could be assessed by applying wavelet coherence techniques. Applying these procedures in everyday life, combined with correct research methodologies, can assist in quantifying how environmental changes can cause alterations in our motor behavior.