On-line policy optimisation of spoken dialogue systems via live interaction with human subjects

Statistical dialogue models have required a large number of dialogues to optimise the dialogue policy, relying on the use of a simulated user. This results in a mismatch between training and live conditions, and significant development costs for the simulator thereby mitigating many of the claimed benefits of such models. Recent work on Gaussian process reinforcement learning, has shown that learning can be substantially accelerated. This paper reports on an experiment to learn a policy for a real-world task directly from human interaction using rewards provided by users. It shows that a usable policy can be learnt in just a few hundred dialogues without needing a user simulator and, using a learning strategy that reduces the risk of taking bad actions. The paper also investigates adaptation behaviour when the system continues learning for several thousand dialogues and highlights the need for robustness to noisy rewards. © 2011 IEEE.

A Study of Fan-Distortion Interaction Within the NASA Rotor 67 Transonic Stage

The performance of a transonic fan operating within nonuniform inlet flow remains a key concern for the design and operability of a turbofan engine. This paper applies computational methods to improve the understanding of the interaction between a transonic fan and an inlet total pressure distortion. The test case studied is the NASA rotor 67 stage operating with a total pressure distortion covering a 120-deg sector of the inlet flow field. Full-annulus, unsteady, three-dimensional CFD has been used to simulate the test rig installation and the full fan assembly operating with inlet distortion. Novel post-processing methods have been applied to extract the fan performance and features of the interaction between the fan and the nonuniform inflow. The results of the unsteady computations agree well with the measurement data. The local operating condition of the fan at different positions around the annulus has been tracked and analyzed, and this is shown to be highly dependent on the swirl and mass flow redistribution that the rotor induces ahead of it due to the incoming distortion. The upstream flow effects lead to a variation in work input that determines the distortion pattern seen downstream of the fan stage. In addition, the unsteady computations also reveal more complex flow features downstream of the fan stage, which arise due to the three dimensionality of the flow and unsteadiness. © 2012 American Society of Mechanical Engineers.

Investigation of low nanosecond light-matter interaction mechanisms

Laser ablation of solid Silicon targets using pulsed Yb fiber lasers of pulse duration 1.5-400 ns Yb fiber lasers is studied in this work. Material responses of a range of pulse envelopes are examined including front peak (FP) and double peak (DP) pulses. Theoretical models for the interactions are examined and qualitative explanations of material response experiments are presented.