On-line policy optimisation of spoken dialogue systems via live interaction with human subjects

Statistical dialogue models have required a large number of dialogues to optimise the dialogue policy, relying on the use of a simulated user. This results in a mismatch between training and live conditions, and significant development costs for the simulator thereby mitigating many of the claimed benefits of such models. Recent work on Gaussian process reinforcement learning, has shown that learning can be substantially accelerated. This paper reports on an experiment to learn a policy for a real-world task directly from human interaction using rewards provided by users. It shows that a usable policy can be learnt in just a few hundred dialogues without needing a user simulator and, using a learning strategy that reduces the risk of taking bad actions. The paper also investigates adaptation behaviour when the system continues learning for several thousand dialogues and highlights the need for robustness to noisy rewards. © 2011 IEEE.

Effects of initial soil fabric and mode of shearing on quasi-steady state line for monotonic undrained behavior

The effects of initial soil fabric and mode of shearing on quasi-steady state line in void ratiostress space are studied by employing the Distinct Element Method numerical analysis. The results show that the initial soil fabric and the mode of shearing have a profound effect on the location of the quasi-steady state line. The evolution of the soil fabric during the course of undrained shearing shows that the specimens with different initial soil fabrics reach quasi-steady state at various soil fabric conditions. At quasi-steady state, the soil fabric has a significant adjustment to change its behavior from contractive to dilative. As the stress state approaches the steady state, the soil fabrics of different initial conditions become similar. The numerical analysis results are compared qualitatively with the published experimental data and the effects of specimen reconstitution methods and mode of shearing found in the experimental studies canbe systematically explained by the numerical analysis. © 2009 Taylor & Francis Group.

Vehicle trajectory linearisation to enable efficient optimisation of the constant speed racing line

A driver model is presented capable of optimising the trajectory of a simple dynamic nonlinear vehicle, at constant forward speed, so that progression along a predefined track is maximised as a function of time. In doing so, the model is able to continually operate a vehicle at its lateral-handling limit, maximising vehicle performance. The technique used forms a part of the solution to the motor racing objective of minimising lap time. A new approach of formulating the minimum lap time problem is motivated by the need for a more computationally efficient and robust tool-set for understanding on-the-limit driving behaviour. This has been achieved through set point-dependent linearisation of the vehicle model and coupling the vehicle-track system using an intrinsic coordinate description. Through this, the geometric vehicle trajectory had been linearised relative to the track reference, leading to new path optimisation algorithm which can be formed as a computationally efficient convex quadratic programming problem. © 2012 Copyright Taylor and Francis Group, LLC.

Recovering 3D Structure of Poorly Textured Infrastructure Scenes Using Point and Line Features

Most of the existing automated machine vision-based techniques for as-built documentation of civil infrastructure utilize only point features to recover the 3D structure of a scene. However it is often the case in man-made structures that not enough point features can be reliably detected (e.g. buildings and roofs); this can potentially lead to the failure of these techniques. To address the problem, this paper utilizes the prominence of straight lines in infrastructure scenes. It presents a hybrid approach that benefits from both point and line features. A calibrated stereo set of video cameras is used to collect data. Point and line features are then detected and matched across video frames. Finally, the 3D structure of the scene is recovered by finding 3D coordinates of the matched features. The proposed approach has been tested on realistic outdoor environments and preliminary results indicate its capability to deal with a variety of scenes.

Blade loading and its application in the mean-line design of low pressure turbines

In order to minimize the number of iterations to a turbine design, reasonable choices of the key parameters must be made at the earliest possible opportunity. The choice of blade loading is of particular concern in the low pressure (LP) turbine of civil aero engines, where the use of high-lift blades is widespread. This paper presents an analytical mean-line design study for a repeating-stage, axial-flow Low Pressure (LP) turbine. The problem of how to measure blade loading is first addressed. The analysis demonstrates that the Zweifel coefficient [1] is not a reasonable gauge of blade loading because it inherently depends on the flow angles. A more appropriate coefficient based on blade circulation is proposed. Without a large set of turbine test data it is not possible to directly evaluate the accuracy of a particular loss correlation. The analysis therefore focuses on the efficiency trends with respect to flow coefficient, stage loading, lift coefficient and Reynolds number. Of the various loss correlations examined, those based on Ainley and Mathieson ([2], [3], [4]) do not produce realistic trends. The profile loss model of Coull and Hodson [5] and the secondary loss models of Craig and Cox [6] and Traupel [7] gave the most reasonable results. The analysis suggests that designs with the highest flow turning are the least sensitive to increases in blade loading. The increase in Reynolds number lapse with loading is also captured, achieving reasonable agreement with experiments. Copyright © 2011 by ASME.

Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system

The optimization of dialogue policies using reinforcement learning (RL) is now an accepted part of the state of the art in spoken dialogue systems (SDS). Yet, it is still the case that the commonly used training algorithms for SDS require a large number of dialogues and hence most systems still rely on artificial data generated by a user simulator. Optimization is therefore performed off-line before releasing the system to real users. Gaussian Processes (GP) for RL have recently been applied to dialogue systems. One advantage of GP is that they compute an explicit measure of uncertainty in the value function estimates computed during learning. In this paper, a class of novel learning strategies is described which use uncertainty to control exploration on-line. Comparisons between several exploration schemes show that significant improvements to learning speed can be obtained and that rapid and safe online optimisation is possible, even on a complex task. Copyright © 2011 ISCA.

Half-bridge SIC inverter for hybrid electric vehicles: Design, development and testing at higher operating temperature

In recent years, Silicon Carbide (SiC) semiconductor devices have shown promise for high density power electronic applications, due to their electrical and thermal properties. In this paper, the performance of SiC JFETs for hybrid electric vehicle (HEV) applications is investigated at heatsink temperatures of 100 °C. The thermal runaway characteristics, maximum current density and packaging temperature limitations of the devices are considered and the efficiency implications discussed. To quantify the power density capabilities of power transistors, a novel 'expression of rating' (EoR) is proposed. A prototype single phase, half-bridge voltage source inverter using SiC JFETs is also tested and its performance at 25 °C and 100 °C investigated.

A framework for clarifying the meaning of Triple Bottom-Line, Integrated, and Sustainability Assessment

Terms such as Integrated Assessment and Sustainability Assessment are used to label 'new' approaches to impact assessment that are designed to direct planning and decision-making towards sustainable development (SD). Established assessment techniques, such as EIA and SEA, are also widely promoted as SD 'tools'. This paper presents the findings of a literature review undertaken to identify the features that are typically promoted for improving the SD-directedness of assessments. A framework is developed which reconciles the broad range of emerging approaches and tackles the inconsistent use of terminology. The framework comprises a three-dimensional space defined by the following axes: the comprehensiveness of the SD coverage; the degree of 'integration' of the techniques and themes; and the extent to which a strategic perspective is adopted. By applying the framework, assessment approaches can be positioned relative to one another, enabling comparison on the basis of substance rather than semantics. © 2007 Elsevier Inc. All rights reserved.

Blade Loading and Its Application in the Mean-Line Design of Low Pressure Turbines

In order to minimize the number of iterations to a turbine design, reasonable choices of the key parameters must be made at the preliminary design stage. The choice of blade loading is of particular concern in the low pressure (LP) turbine of civil aero engines, where the use of high-lift blades is widespread. This paper considers how blade loading should be measured, compares the performance of various loss correlations, and explores the impact of blade lift on performance and lapse rates. To these ends, an analytical design study is presented for a repeating-stage, axial-flow LP turbine. It is demonstrated that the long-established Zweifel lift coefficient (Zweifel, 1945, "The Spacing of Turbomachine Blading, Especially with Large Angular Deflection" Brown Boveri Rev., 32(1), pp. 436-444) is flawed because it does not account for the blade camber. As a result the Zweifel coefficient is only meaningful for a fixed set of flow angles and cannot be used as an absolute measure of blade loading. A lift coefficient based on circulation is instead proposed that accounts for the blade curvature and is independent of the flow angles. Various existing profile and secondary loss correlations are examined for their suitability to preliminary design. A largely qualitative comparison demonstrates that the loss correlations based on Ainley and Mathieson (Ainley and Mathieson, 1957, "A Method of Performance Estimation for Axial-Flow Turbines," ARC Reports and Memoranda No. 2974; Dunham and Came, 1970, "Improvements to the Ainley-Mathieson Method of Turbine Performance Prediction," Trans. ASME: J. Eng. Gas Turbines Power, July, pp. 252-256; Kacker and Okapuu, 1982, "A Mean Line Performance Method for Axial Flow Turbine Efficiency," J. Eng. Power, 104, pp. 111-119). are not realistic, while the profile loss model of Coull and Hodson (Coull and Hodson, 2011, "Predicting the Profile Loss of High-Lift Low Pressure Turbines," J. Turbomach., 134(2), pp. 021002) and the secondary loss model of (Traupel, W, 1977, Thermische Turbomaschinen, Springer-Verlag, Berlin) are arguably the most reasonable. A quantitative comparison with multistage rig data indicates that, together, these methods over-predict lapse rates by around 30%, highlighting the need for improved loss models and a better understanding of the multistage environment. By examining the influence of blade lift across the Smith efficiency chart, the analysis demonstrates that designs with higher flow turning will tend to be less sensitive to increases in blade loading. © 2013 American Society of Mechanical Engineers.

Elastic properties of crystalline-amorphous core-shell silicon nanowires

The pressure behavior of Raman frequencies and line widths of crystalline core-amorphous shell silicon nanowires (SiNWs) with two different core-to-shell ratio thicknesses was studied at pressures up to 8 GPa. The obtained isothermal compressibility (bulk modulus) of SiNWs with a core-to-shell ratio of about 1.8 is ∼20% higher (lower) than reported values for bulk Si. For SiNWs with smaller core-to-shell ratios, a plastic deformation of the shell was observed together with a strain relaxation. A significant increase in the full width at half-maximum of the Raman LTO-peak due to phonon decay was used to determine the critical pressure at which LTO-phonons decay into LO + TA phonons. Our results reveal that this critical pressure in strained core-shell SiNWs (∼4 GPa) is different from the reported value for bulk Si (∼7 GPa), whereas no change is observed for relaxed core-shell SiNWs. © 2013 American Chemical Society.

A power optimised narrowband power-line communication system

Narrowband Power-line Communication (NPLC) technology uses a narrow bandwidth to transmit information. Its major applications include control, smart home systems and security. This paper proposes a power optimised NPLC system to minimise its systemic power consumption without compromising its communication ability. By using the proposed Smart Energy Conservation Layer which reads the signal strength from the PLC channel, a power optimised system is achieved to provide the essential transmitting power to secure the communications. Compared to commercial systems, the potential power saving could be up to 99% in a household environment, as demonstrated by the experimental results. © 2013 IEEE.