The design and implementation of dialogue control in voice operated database inquiry systems

This paper describes work performed as part of the U.K. Alvey sponsored Voice Operated Database Inquiry System (VODIS) project in the area of intelligent dialogue control. The principal aims of the work were to develop a habitable interface for the untrained user; to investigate the degree to which dialogue control can be used to compensate for deficiencies in recognition performance; and to examine the requirements on dialogue control for generating natural speech output. A data-driven methodology is described based on the use of frames in which dialogue topics are organized hierarchically. The concept of a dynamically adjustable scope is introduced to permit adaptation to recognizer performance and the use of historical and hierarchical contexts are described to facilitate the construction of contextually relevant output messages. © 1989.

Natural actor and belief critic: Reinforcement algorithm for learning parameters of dialogue systems modelled as POMDPs

This article presents a novel algorithm for learning parameters in statistical dialogue systems which are modeled as Partially Observable Markov Decision Processes (POMDPs). The three main components of a POMDP dialogue manager are a dialogue model representing dialogue state information; a policy that selects the system's responses based on the inferred state; and a reward function that specifies the desired behavior of the system. Ideally both the model parameters and the policy would be designed to maximize the cumulative reward. However, while there are many techniques available for learning the optimal policy, no good ways of learning the optimal model parameters that scale to real-world dialogue systems have been found yet. The presented algorithm, called the Natural Actor and Belief Critic (NABC), is a policy gradient method that offers a solution to this problem. Based on observed rewards, the algorithm estimates the natural gradient of the expected cumulative reward. The resulting gradient is then used to adapt both the prior distribution of the dialogue model parameters and the policy parameters. In addition, the article presents a variant of the NABC algorithm, called the Natural Belief Critic (NBC), which assumes that the policy is fixed and only the model parameters need to be estimated. The algorithms are evaluated on a spoken dialogue system in the tourist information domain. The experiments show that model parameters estimated to maximize the expected cumulative reward result in significantly improved performance compared to the baseline hand-crafted model parameters. The algorithms are also compared to optimization techniques using plain gradients and state-of-the-art random search algorithms. In all cases, the algorithms based on the natural gradient work significantly better. © 2011 ACM.

Energy scattering in weakly non-linear systems.

The Chinese Tam-Tam exhibits non-linear behavior in its vibro-acoustic response. The frequency content of the response during free, unforced vibration smoothly changes, with energy being progressively smeared out over a greater bandwidth with time. This is used as a motivating case for the general study of the phenomenon of energy cascading through weak nonlinearity. Numerical models based upon the Fermi-Pasta-Ulam system of non-linearly coupled oscillators, modified with the addition of damping, have been developed. These were used to study the response of ensembles of systems with randomized natural frequencies. Results from simulations will be presented here. For un-damped systems, individual ensemble members exhibit cyclical energy exchange between linear modes, but the ensemble average displays a steady state. For the ensemble response of damped systems, lightly damped modes can exhibit an effective damping which is higher than predicated by linear theory. The presence of a non-linearity provides a path for energy flow to other modes, increasing the apparent damping spectrum at some frequencies and reducing it at others. The target of this work is a model revealing the governing parameters of a generic system of this type and leading to predictions of the ensemble response.

Real-time experimental demonstration of low-cost VCSEL intensity-modulated 11.25 Gb/s optical OFDM signal transmission over 25 km PON systems.

The feasibility of utilising low-cost, un-cooled vertical cavity surface-emitting lasers (VCSELs) as intensity modulators in real-time optical OFDM (OOFDM) transceivers is experimentally explored, for the first time, in terms of achievable signal bit rates, physical mechanisms limiting the transceiver performance and performance robustness. End-to-end real-time transmission of 11.25 Gb/s 64-QAM-encoded OOFDM signals over simple intensity modulation and direct detection, 25 km SSMF PON systems is experimentally demonstrated with a power penalty of 0.5 dB. The low extinction ratio of the VCSEL intensity-modulated OOFDM signal is identified to be the dominant factor determining the maximum obtainable transmission performance. Experimental investigations indicate that, in addition to the enhanced transceiver performance, adaptive power loading can also significantly improve the system performance robustness to variations in VCSEL operating conditions. As a direct result, the aforementioned capacity versus reach performance is still retained over a wide VCSEL bias (driving) current (voltage) range of 4.5 mA to 9 mA (275 mVpp to 320 mVpp). This work is of great value as it demonstrates the possibility of future mass production of cost-effective OOFDM transceivers for PON applications.

On-line policy optimisation of spoken dialogue systems via live interaction with human subjects

Statistical dialogue models have required a large number of dialogues to optimise the dialogue policy, relying on the use of a simulated user. This results in a mismatch between training and live conditions, and significant development costs for the simulator thereby mitigating many of the claimed benefits of such models. Recent work on Gaussian process reinforcement learning, has shown that learning can be substantially accelerated. This paper reports on an experiment to learn a policy for a real-world task directly from human interaction using rewards provided by users. It shows that a usable policy can be learnt in just a few hundred dialogues without needing a user simulator and, using a learning strategy that reduces the risk of taking bad actions. The paper also investigates adaptation behaviour when the system continues learning for several thousand dialogues and highlights the need for robustness to noisy rewards. © 2011 IEEE.

The application of STEM and in situ controlled dehydration to bacterial systems using ESEM.

Transmission imaging with an environmental scanning electron microscope (ESEM) (Wet STEM) is a recent development in the field of electron microscopy, combining the simple preparation inherent to ESEM work with an alternate form of contrast available through a STEM detector. Because the technique is relatively new, there is little information available on how best to apply this technique and which samples it is best suited for. This work is a description of the sample preparation and microscopy employed by the authors for imaging bacteria with Wet STEM (scanning transmission electron microscopy). Three different bacterial samples will be presented in this study: first, used as a model system, is Escherichia coli for which the contrast mechanisms of STEM are demonstrated along with the visual effects of a dehydration-induced collapse. This collapse, although clearly in some sense artifactual, is thought to lead to structurally meaningful morphological information. Second, Wet STEM is applied to two distinct bacterial systems to demonstrate the novel types of information accessible by this approach: the plastic-producing Cupriavidus necator along with wild-type and ΔmreC knockout mutants of Salmonella enterica serovar Typhimurium. Cupriavidus necator is shown to exhibit clear internal differences between bacteria with and without plastic granules, while the ΔmreC mutant of S. Typhimurium has an internal morphology distinct from that of the wild type.

The analysis of impact forces in randomly vibrating elastic systems

This work is concerned with the characteristics of the impact force produced when two randomly vibrating elastic bodies collide with each other, or when a single randomly vibrating elastic body collides with a stop. The impact condition includes a non-linear spring, which may represent, for example, a Hertzian contact, and in the case of a single body, closed form approximate expressions are derived for the duration and magnitude of the impact force and for the maximum deceleration at the impact point. For the case of two impacting bodies, a set of algebraic equations are derived which can be solved numerically to yield the quantities of interest. The approach is applied to a beam impacting a stop, a plate impacting a stop, and to two impacting beams, and in each case a comparison is made with detailed numerical simulations. Aspects of the statistics of impact velocity are also considered, including the probability that the impact velocity will exceed a specified value within a certain time. © 2012 Elsevier Ltd. All rights reserved.

The application of STEM and in situ controlled dehydration to bacterial systems using ESEM

Transmission imaging with an environmental scanning electron microscope (ESEM) (Wet STEM) is a recent development in the field of electron microscopy, combining the simple preparation inherent to ESEM work with an alternate form of contrast available through a STEM detector. Because the technique is relatively new, there is little information available on how best to apply this technique and which samples it is best suited for. This work is a description of the sample preparation and microscopy employed by the authors for imaging bacteria with Wet STEM (scanning transmission electron microscopy). Three different bacterial samples will be presented in this study: first, used as a model system, is Escherichia coli for which the contrast mechanisms of STEM are demonstrated along with the visual effects of a dehydration-induced collapse. This collapse, although clearly in some sense artifactual, is thought to lead to structurally meaningful morphological information. Second, Wet STEM is applied to two distinct bacterial systems to demonstrate the novel types of information accessible by this approach: the plastic-producing Cupriavidus necator along with wild-type and δmreC knockout mutants of Salmonella enterica serovar Typhimurium. Cupriavidus necator is shown to exhibit clear internal differences between bacteria with and without plastic granules, while the δmreC mutant of S. Typhimurium has an internal morphology distinct from that of the wild type. © 2012 Wiley Periodicals, Inc.

Robust multiplexed MPC for distributed multi-agent systems

This paper extends the authors' earlier work which adapted robust multiplexed MPC for application to distributed control of multi-agent systems with non-interacting dynamics and coupled constraint sets in the presence of persistent unknown, but bounded disturbances. Specifically, we propose exploiting the single agent update nature of the multiplexed approach, and fix the update sequence to enable input move-blocking and increased discretisation rates. This permits a higher rate of individual policy update to be achieved, whilst incurring no additional computational cost in the corresponding optimal control problems to be solved. A disturbance feedback policy is included between updates to facilitate finding feasible solutions. The new formulation inherits the property of rapid response to disturbances from multiplexing the control and numerical results show that fixing the update sequence does not incur any loss in performance. © 2011 IFAC.

Biofluid behaviour in 3D microchannel systems: Numerical analysis and design development of 3D microchannel biochip separators

This paper describes the design and development cycle of a 3D biochip separator and the modelling analysis of flow behaviour in the biochip microchannel features. The focus is on identifying the difference between 2D and 3D implementations as well as developing basic forms of 3D microfluidic separators. Five variants, based around the device are proposed and analysed. These include three variations of the branch channels (circular, rectangular, disc) and two variations of the main channel (solid and concentric). Ignoring the initial transient behaviour and assuming steady state flow has been established, the efficiencies of the flow between the main and side channels for the different designs are analysed and compared with regard to relevant biomicrofluidic laws or effects (bifurcation law, Fahraeus effect, cell-free phenomenon, bending channel effect and laminar flow behaviour). The modelling results identify flow features in microchannels, a constriction and bifurcations and show detailed differences in flow fields between the various designs. The manufacturing process using injection moulding for the initial base case design is also presented and discussed. The work reported here is supported as part of the UK funded 3D-MINTEGRATION project. © 2010 IEEE.

The vibro-acoustic analysis of built-up systems using a hybrid method with parametric and non-parametric uncertainties

An existing hybrid finite element (FE)/statistical energy analysis (SEA) approach to the analysis of the mid- and high frequency vibrations of a complex built-up system is extended here to a wider class of uncertainty modeling. In the original approach, the constituent parts of the system are considered to be either deterministic, and modeled using FE, or highly random, and modeled using SEA. A non-parametric model of randomness is employed in the SEA components, based on diffuse wave theory and the Gaussian Orthogonal Ensemble (GOE), and this enables the mean and variance of second order quantities such as vibrational energy and response cross-spectra to be predicted. In the present work the assumption that the FE components are deterministic is relaxed by the introduction of a parametric model of uncertainty in these components. The parametric uncertainty may be modeled either probabilistically, or by using a non-probabilistic approach such as interval analysis, and it is shown how these descriptions can be combined with the non-parametric uncertainty in the SEA subsystems to yield an overall assessment of the performance of the system. The method is illustrated by application to an example built-up plate system which has random properties, and benchmark comparisons are made with full Monte Carlo simulations. © 2012 Elsevier Ltd. All rights reserved.