On-line policy optimisation of Bayesian spoken dialogue systems via human interaction

A partially observable Markov decision process has been proposed as a dialogue model that enables robustness to speech recognition errors and automatic policy optimisation using reinforcement learning (RL). However, conventional RL algorithms require a very large number of dialogues, necessitating a user simulator. Recently, Gaussian processes have been shown to substantially speed up the optimisation, making it possible to learn directly from interaction with human users. However, early studies have been limited to very low dimensional spaces and the learning has exhibited convergence problems. Here we investigate learning from human interaction using the Bayesian Update of Dialogue State system. This dynamic Bayesian network based system has an optimisation space covering more than one hundred features, allowing a wide range of behaviours to be learned. Using an improved policy model and a more robust reward function, we show that stable learning can be achieved that significantly outperforms a simulator trained policy. © 2013 IEEE.

Sorptive interaction between goethite and strongly reducing organic substances from anaerobic decomposition of green manures

Strongly reducing organic substances (SROS) and iron oxides exist widely in soils and sediments and have been implicated in many soil and sediment processes. In the present work, the sorptive interaction between goethite and SROS derived from anaerobic decomposition of green manures was investigated by differential pulse voltammetry (DPV). Both green manures, Astragaltus sinicus (Astragalus) and Vicia varia (Vicia) were chosen to be anaerobically decomposed by the mixed microorganisms isolated from paddy soils for 30 d to prepare different SROS. Goethite used in experiments was synthesized in laboratory. The anaerobic incubation solutions from green manures at different incubation time were arranged to react with goethite, in which SROS concentration and Fe(II) species were analyzed. The anaerobic decomposition of Astragalus generally produced SROS more in amount but weaker in reducibility than that of Vicia in the same incubation time. The available SROS from Astragalus that could interact with goethite was 0.69 +/- 0.04, 0.84 +/- 0.04 and 1.09 +/- 0.03 cmol kg(-1) as incubated for 10, 15 and 30 d, respectively, for Vicia, it was 0.12 +/- 0.03, 0.46 +/- 0.02 and 0.70 +/- 0.02 cmol kg(-1). One of the fates of SROS as they interacted with goethite was oxidation. The amounts of oxidizable SROS from Astragalus decreased over increasing incubation time from 0.51 +/- 0.05 cmol kg(-1) at day 10 to 0.39 +/- 0.04 cmol kg(-1) at day 30, but for Vicia, it increased with the highest reaching to 0.58 +/- 0.04 cmol kg(-1) at day 30. Another fate of these substances was sorption by goethite. The SROS from Astragalus were sorbed more readily than those from Vicia, and closely depended upon the incubation time, whereas for those from Vicia, the corresponding values were remarkably less and apparently unchangeable with incubation time. The extent of goethite dissolution induced by the anaerobic solution from Vicia was greater than that from Astragalus, showing its higher reactivity. (c) 2008 Published by Elsevier Ltd.

A fixed-grid b-spline finite element technique for fluid-structure interaction

We present a fixed-grid finite element technique for fluid-structure interaction problems involving incompressible viscous flows and thin structures. The flow equations are discretised with isoparametric b-spline basis functions defined on a logically Cartesian grid. In addition, the previously proposed subdivision-stabilisation technique is used to ensure inf-sup stability. The beam equations are discretised with b-splines and the shell equations with subdivision basis functions, both leading to a rotation-free formulation. The interface conditions between the fluid and the structure are enforced with the Nitsche technique. The resulting coupled system of equations is solved with a Dirichlet-Robin partitioning scheme, and the fluid equations are solved with a pressure-correction method. Auxiliary techniques employed for improving numerical robustness include the level-set based implicit representation of the structure interface on the fluid grid, a cut-cell integration algorithm based on marching tetrahedra and the conservative data transfer between the fluid and structure discretisations. A number of verification and validation examples, primarily motivated by animal locomotion in air or water, demonstrate the robustness and efficiency of our approach. © 2013 John Wiley & Sons, Ltd.

Interaction of a premixed flame with a liquid fuel film on a wall

© 2004 The Combustion Institute. Published by Elsevier Inc. All rights reserved. In piston engines and in gas turbines, the injection of liquid fuel often leads to the formation of a liquid film on the combustor wall. If a flame reaches this zone, undesired phenomena such as coking may occur and diminish the lifetime of the engine. Moreover, the effect of such an interaction on maximum wall heat fluxes, flame quenching, and pollutant formation is largely unknown. This paper presents a numerical study of the interaction of a premixed flame with a cold wall covered with a film of liquid fuel. Simulations show that the presence of the film leads to a very rich zone at the wall in which the flame cannot propagate. As a result, the flame wall distance remains larger with liquid fuel than it is for a dry wall, and maximum heat fluxes are smaller. The nature of the interaction of flame wall interaction with a liquid fuel is also different from the classical flame/dry wall interaction: it is controlled mainly by chemical mechanisms and not by the thermal quenching effect observed for flames interacting with dry walls: the existence of a very rich zone created above the liquid film is the main mechanism controlling quenching.

Effects of electron-electron interactions on the electronic Raman scattering of graphite in high magnetic fields

We report the observation of strongly temperature (T)-dependent spectral lines in electronic Raman-scattering spectra of graphite in a high magnetic field up to 45 T applied along the c axis. The magnetic field quantizes the in-plane motion, while the out-of-plane motion remains free, effectively reducing the system dimension from 3 to 1. Optically created electron-hole pairs interact with, or shake up, the one-dimensional Fermi sea in the lowest Landau subbands. Based on the Tomonaga-Luttinger liquid theory, we show that interaction effects modify the spectral line shape from (ω-Δ)-1/2 to (ω-Δ)2α-1/2 at T = 0. At finite T, we predict a thermal broadening factor that increases linearly with T. Our model reproduces the observed T-dependent line shape, determining the electron-electron interaction parameter α to be ∼0.05 at 40 T. © 2014 American Physical Society.

Active control of normal shock wave/turbulent boundary layer interaction using "Smart" piezoelectric flap actuators

This paper looks at active control of the normal shock wave/turbulent boundary layer interaction (SBLI) using smart flap actuators. The actuators are manufactured by bonding piezoelectric material to an inert substrate to control the bleed/suction rate through a plenum chamber. The cavity provides communication of signals across the shock, allowing rapid thickening of the boundary layer approaching the shock, which splits into a series of weaker shocks forming a lambda shock foot, reducing wave drag. Active control allows optimum control of the interaction, as it would be capable of positioning the control region around the original shock position and control the rate of mass transfer. © 2004 by the American Institute of Aeronautics and Astronautics, Inc. All rights reserved.

Control of normal shock wave / turbulent boundary-layer interaction using streamwise slots

The effect of streamwise slots on the interaction of a normal shock wave / turbulent boundary layer has been investigated experimentally at a Mach number of 1.3. The surface pressure distribution for the controlled interaction was found to be significantly smeared, featuring a distinct plateau. This was due to a change in shock structure from a typical unseparated normal shock wave boundary layer interaction to a large bifurcated Lambda type shock pattern. Boundary layer velocity measurements downstream of the slots revealed a strong spanwise variation of boundary layer properties whereas the modified shock structure was relatively twodimensional. Oil flow visualisation indicated that in the presence of slots the boundary layer surface flow was highly three dimensional and confirmed that the effect of slots was mainly due to suction and blowing similar to that for passive control with uniform surface ventilation. Three hole probe measurements confirmed that the boundary layer was three dimensional and that the slots introduced vortical motion into the flowfield. Results indicate that when applied to an aerofoil, the control device has the potential to reduce wave drag while incurring only small viscous penalties. The introduction of streamwise vorticity may also be beneficial to delay trailing edge separation and the device is thought to be capable of postponing buffet onset. © 2001 by A N Smith.