Use of contexts in language model interpolation and adaptation

Language models (LMs) are often constructed by building multiple individual component models that are combined using context independent interpolation weights. By tuning these weights, using either perplexity or discriminative approaches, it is possible to adapt LMs to a particular task. This paper investigates the use of context dependent weighting in both interpolation and test-time adaptation of language models. Depending on the previous word contexts, a discrete history weighting function is used to adjust the contribution from each component model. As this dramatically increases the number of parameters to estimate, robust weight estimation schemes are required. Several approaches are described in this paper. The first approach is based on MAP estimation where interpolation weights of lower order contexts are used as smoothing priors. The second approach uses training data to ensure robust estimation of LM interpolation weights. This can also serve as a smoothing prior for MAP adaptation. A normalized perplexity metric is proposed to handle the bias of the standard perplexity criterion to corpus size. A range of schemes to combine weight information obtained from training data and test data hypotheses are also proposed to improve robustness during context dependent LM adaptation. In addition, a minimum Bayes' risk (MBR) based discriminative training scheme is also proposed. An efficient weighted finite state transducer (WFST) decoding algorithm for context dependent interpolation is also presented. The proposed technique was evaluated using a state-of-the-art Mandarin Chinese broadcast speech transcription task. Character error rate (CER) reductions up to 7.3 relative were obtained as well as consistent perplexity improvements. © 2012 Elsevier Ltd. All rights reserved.

Policy as a struggle for meaning: disentangling knowledge translation across international health contexts

Over the last decade, research in medical science has focused on knowledge translation and diffusion of best practices to enable improved health outcomes. However, there has been less attention given to the role of policy in influencing the translation of best practice across different national contexts. This paper argues that the underlying set of public discourses of healthcare policy significantly influences its development with implications for the dissemination of best practices. Our research uses Critical Discourse Analysis to examine the policy discourses surrounding the treatment of stroke across Canada and the U.K. It focuses in specific on how concepts of knowledge translation, user empowerment, and service innovation construct different accounts of the health service in the two countries. These findings provide an important yet overlooked starting point for understanding the role of policy development in knowledge transfer and the translation of science into health practice. © 2011 Operational Research Society. All rights reserved.