Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system

The optimization of dialogue policies using reinforcement learning (RL) is now an accepted part of the state of the art in spoken dialogue systems (SDS). Yet, it is still the case that the commonly used training algorithms for SDS require a large number of dialogues and hence most systems still rely on artificial data generated by a user simulator. Optimization is therefore performed off-line before releasing the system to real users. Gaussian Processes (GP) for RL have recently been applied to dialogue systems. One advantage of GP is that they compute an explicit measure of uncertainty in the value function estimates computed during learning. In this paper, a class of novel learning strategies is described which use uncertainty to control exploration on-line. Comparisons between several exploration schemes show that significant improvements to learning speed can be obtained and that rapid and safe online optimisation is possible, even on a complex task. Copyright © 2011 ISCA.

Detection of large-scale concrete columns for automated bridge inspection

There are over 600,000 bridges in the US, and not all of them can be inspected and maintained within the specified time frame. This is because manually inspecting bridges is a time-consuming and costly task, and some state Departments of Transportation (DOT) cannot afford the essential costs and manpower. In this paper, a novel method that can detect large-scale bridge concrete columns is proposed for the purpose of eventually creating an automated bridge condition assessment system. The method employs image stitching techniques (feature detection and matching, image affine transformation and blending) to combine images containing different segments of one column into a single image. Following that, bridge columns are detected by locating their boundaries and classifying the material within each boundary in the stitched image. Preliminary test results of 114 concrete bridge columns stitched from 373 close-up, partial images of the columns indicate that the method can correctly detect 89.7% of these elements, and thus, the viability of the application of this research.

Large Scale Column Detection for Bridge Inspection

Manually inspecting bridges is a time-consuming and costly task. There are over 600,000 bridges in the US, and not all of them can be inspected and maintained within the specified time frame as some state DOTs cannot afford the essential costs and manpower. This paper presents a novel method that can detect bridge concrete columns from visual data for the purpose of eventually creating an automated bridge condition assessment system. The method employs SIFT feature detection and matching to find overlapping areas among images. Affine transformation matrices are then calculated to combine images containing different segments of one column into a single image. Following that, the bridge columns are detected by identifying the boundaries in the stitched image and classifying the material within each boundary. Preliminary test results using real bridge images indicate that most columns in stitched images can be correctly detected and thus, the viability of the application of this research.

Friction-induced vibration: Model development and comparison with large-scale experimental tests

This paper presents a comparison between theoretical predictions and experimental results from a pin-on-disc test rig exploring friction-induced vibration. The model is based on a linear stability analysis of two systems coupled by sliding contact at a single point. Predictions are compared with a large volume of measured squeal initiations that have been post-processed to extract growth rates and frequencies at the onset of squeal. Initial tests reveal the importance of including both finite contact stiffness and a velocity-dependent dynamic model for friction, giving predictions that accounted for nearly all major clusters of squeal initiations from 0 to 5 kHz. However, a large number of initiations occurred at disc mode frequencies that were not predicted with the same parameters. These frequencies proved remarkably difficult to destabilise, requiring an implausibly high coefficient of friction. An attempt has been made to estimate the dynamic friction behaviour directly from the squeal initiation data, revealing complex-valued frequency-dependent parameters for a new model of linearised dynamic friction. These new parameters readily destabilised the disc modes and provided a consistent model that could account for virtually all initiations from 0 to 15 kHz. The results suggest that instability thresholds for a wide range of squeal-type behaviour can be predicted, but they highlight the central importance of a correct understanding and accurate description of dynamic friction at the sliding interface. © 2013 Elsevier Ltd. All rights reserved.