Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system

The optimization of dialogue policies using reinforcement learning (RL) is now an accepted part of the state of the art in spoken dialogue systems (SDS). Yet, it is still the case that the commonly used training algorithms for SDS require a large number of dialogues and hence most systems still rely on artificial data generated by a user simulator. Optimization is therefore performed off-line before releasing the system to real users. Gaussian Processes (GP) for RL have recently been applied to dialogue systems. One advantage of GP is that they compute an explicit measure of uncertainty in the value function estimates computed during learning. In this paper, a class of novel learning strategies is described which use uncertainty to control exploration on-line. Comparisons between several exploration schemes show that significant improvements to learning speed can be obtained and that rapid and safe online optimisation is possible, even on a complex task. Copyright © 2011 ISCA.

Large scale heterogeneous networks, the Davis-Wielandt shell, and graph separation

We consider a large scale network of interconnected heterogeneous dynamical components. Scalable stability conditions are derived that involve the input/output properties of individual subsystems and the interconnection matrix. The analysis is based on the Davis-Wielandt shell, a higher dimensional version of the numerical range with important convexity properties. This can be used to allow heterogeneity in the agent dynamics while relaxing normality and symmetry assumptions on the interconnection matrix. The results include small gain and passivity approaches as special cases, with the three dimensional shell shown to be inherently connected with corresponding graph separation arguments. © 2012 Society for Industrial and Applied Mathematics.

Friction-induced vibration: Model development and comparison with large-scale experimental tests

This paper presents a comparison between theoretical predictions and experimental results from a pin-on-disc test rig exploring friction-induced vibration. The model is based on a linear stability analysis of two systems coupled by sliding contact at a single point. Predictions are compared with a large volume of measured squeal initiations that have been post-processed to extract growth rates and frequencies at the onset of squeal. Initial tests reveal the importance of including both finite contact stiffness and a velocity-dependent dynamic model for friction, giving predictions that accounted for nearly all major clusters of squeal initiations from 0 to 5 kHz. However, a large number of initiations occurred at disc mode frequencies that were not predicted with the same parameters. These frequencies proved remarkably difficult to destabilise, requiring an implausibly high coefficient of friction. An attempt has been made to estimate the dynamic friction behaviour directly from the squeal initiation data, revealing complex-valued frequency-dependent parameters for a new model of linearised dynamic friction. These new parameters readily destabilised the disc modes and provided a consistent model that could account for virtually all initiations from 0 to 15 kHz. The results suggest that instability thresholds for a wide range of squeal-type behaviour can be predicted, but they highlight the central importance of a correct understanding and accurate description of dynamic friction at the sliding interface. © 2013 Elsevier Ltd. All rights reserved.

Investigation of magnetic wedge effects in large-scale BDFMs

This paper studies the effects of magnetic wedges on the equivalent circuit parameters of the Brushless Doubly-Fed Machine (BDFM). Magnetic wedges are used in slot openings of large electrical machines to reduce magnetizing currents, but the study of their effects on the BDFM performance is not straightforward due to the complex magnetic fields in the BDFM. Equivalent circuit and FE models have been developed for a 250 kW BDFM taking into account the effects of wedges and verified experimentally.

Novel ZnO nanorod films by chemical solution deposition for planar device applications.

Smooth and continuous ZnO films consisting of densely packed ZnO nanorods (NRs), which can be used for electronic device fabrication, were synthesized using a hydro-thermo-chemical solution deposition method. Such devices would have the novelty of high performance, benefiting from the inherited unique properties of the nanomaterials, and can be fabricated on these smooth films using a conventional, low cost planar process. Photoluminescence measurements showed that the NR films have much stronger shallow donor to valence band emissions than those from discrete ZnO NRs, and hence have the potential for the development of ZnO light emission diodes and lasers, etc. The NR films have been used to fabricate large area surface acoustic wave devices by conventional photolithography. These demonstrated two well-defined resonant peaks and their potential for large area device applications. The chemical solution deposition method is simple, reproducible, scalable and economic. These NR films are suitable for large scale production on cost-effective substrates and are promising for various fields such as sensing systems, renewable energy and optoelectronic applications.