Partially Observable Markov Decision Processes with continuous observations for dialogue management

This work shows how a dialogue model can be represented as a Partially Observable Markov Decision Process (POMDP) with observations composed of a discrete and continuous component. The continuous component enables the model to directly incorporate a confidence score for automated planning. Using a testbed simulated dialogue management problem, we show how recent optimization techniques are able to find a policy for this continuous POMDP which outperforms a traditional MDP approach. Further, we present a method for automatically improving handcrafted dialogue managers by incorporating POMDP belief state monitoring, including confidence score information. Experiments on the testbed system show significant improvements for several example handcrafted dialogue managers across a range of operating conditions.

Comparison of Image-Based and Time-of-Flight-Based Technologies for 3D Reconstruction of Infrastructure

Image-based (i.e., photo/videogrammetry) and time-of-flight-based (i.e., laser scanning) technologies are typically used to collect spatial data of infrastructure. In order to help architecture, engineering, and construction (AEC) industries make cost-effective decisions in selecting between these two technologies with respect to their settings, this paper makes an attempt to measure the accuracy, quality, time efficiency, and cost of applying image-based and time-of-flight-based technologies to conduct as-built 3D reconstruction of infrastructure. In this paper, a novel comparison method is proposed, and preliminary experiments are conducted. The results reveal that if the accuracy and quality level desired for a particular application is not high (i.e., error < 10 cm, and completeness rate > 80%), image-based technologies constitute a good alternative for time-of-flight-based technologies and significantly reduce the time and cost needed for collecting the data on site.

Comparison of Image-Based and Time-of-Flight-Based Technologies for Three-Dimensional Reconstruction of Infrastructure

Image-based (i.e., photo/videogrammetry) and time-of-flight-based (i.e., laser scanning) technologies are typically used to collect spatial data of infrastructure. In order to help architecture, engineering, and construction (AEC) industries make cost-effective decisions in selecting between these two technologies with respect to their settings, this paper makes an attempt to measure the accuracy, quality, time efficiency, and cost of applying image-based and time-of-flight-based technologies to conduct as-built 3D reconstruction of infrastructure. In this paper, a novel comparison method is proposed, and preliminary experiments are conducted. The results reveal that if the accuracy and quality level desired for a particular application is not high (i.e., error < 10 cm, and completeness rate > 80%), image-based technologies constitute a good alternative for time-of-flight-based technologies and significantly reduce the time and cost needed for collecting the data on site.

Continuous Diffraction Patterns from Circular Arrays of Carbon Nanotubes

We report the remarkable diffraction effects produced from circular patterned arrays of multiwalled carbon nanotubes (MWCNTs). Highly ordered circular arrays of multiwalled carbon nanotubes (with inter-nanotube spacings of 633 nm) display optical dispersion effects similar to compact discs. These arrays display remarkable diffraction patterns in the far field which are spatially continuous. High quality diffraction patterns were obtained experimentally which are in excellent agreement with the theoretical calculations. The achieved continuous diffraction patterns pave the way towards the utilization of engineered carbon nanotube arrays in applications like three dimensional holograms.

On the transition from finite-volume negatively buoyant releases to continuous fountains

An experimental investigation to identify the source conditions that distinguish finite-volume negatively buoyant fluid projectile behaviour from fountain behaviour in quiescent environments of uniform density is described. Finite-volume releases are governed by their source Froude number Fr D and the aspect ratio L/D of the release, where L denotes the length of the column of fluid dispensed vertically from the nozzle of diameter D. We establish the influence of L/D on the peak rise heights of a release formed by dispensing saline solution into fresh water for 0continuous flux. The critical aspect ratio (L/D) f, for a given Fr D, which when exceeded no longer influenced release behaviour, led to the determination of Fr D, (L/D) f paired source conditions that give rise to solely Froude-number-dependent, i.e. fountain-like, behaviour. As such, we make the link between finite-volume releases and continuous fountains. The Fr D(L/D) f pairs led us directly to the classification of a Fr D, L/D space from which source conditions giving rise to either negatively buoyant projectiles or fountains may be readily identified. The variation of (L/D) f with Fr D corresponds closely to established fountain regimes of very weak, weak and forced fountains. Moreover, our results indicate that the formation or otherwise of a primary vortex, as fluid is ejected, has a profound influence on the length of the dispensed fluid column that is necessary to achieve rise heights equal to fountain rise heights. © 2012 Cambridge University Press.

On the time delay in continuous in-cylinder sampling from IC engines

When gas sample is continuously drawn from the cylinder of an internal combustion engine, the sample that appears at the end of the sampling system corresponds to the in-cylinder content sometime ago because of the finite transit time which is a function of the cylinder pressure history. This variable delay causes a dispersion of the sample signal and makes the interpretation of the signal difficult An unsteady flow analysis of a typical sampling system was carried out for selected engine loads and speeds. For typical engine operation, a window in which the delay is approximately constant may be found. This window gets smaller with increase in engine speed, with decrease in load, and with the increase in exit pressure of the sampling system.

Reinforcement learning using a continuous time actor-critic framework with spiking neurons.

Animals repeat rewarded behaviors, but the physiological basis of reward-based learning has only been partially elucidated. On one hand, experimental evidence shows that the neuromodulator dopamine carries information about rewards and affects synaptic plasticity. On the other hand, the theory of reinforcement learning provides a framework for reward-based learning. Recent models of reward-modulated spike-timing-dependent plasticity have made first steps towards bridging the gap between the two approaches, but faced two problems. First, reinforcement learning is typically formulated in a discrete framework, ill-adapted to the description of natural situations. Second, biologically plausible models of reward-modulated spike-timing-dependent plasticity require precise calculation of the reward prediction error, yet it remains to be shown how this can be computed by neurons. Here we propose a solution to these problems by extending the continuous temporal difference (TD) learning of Doya (2000) to the case of spiking neurons in an actor-critic network operating in continuous time, and with continuous state and action representations. In our model, the critic learns to predict expected future rewards in real time. Its activity, together with actual rewards, conditions the delivery of a neuromodulatory TD signal to itself and to the actor, which is responsible for action choice. In simulations, we show that such an architecture can solve a Morris water-maze-like navigation task, in a number of trials consistent with reported animal performance. We also use our model to solve the acrobot and the cartpole problems, two complex motor control tasks. Our model provides a plausible way of computing reward prediction error in the brain. Moreover, the analytically derived learning rule is consistent with experimental evidence for dopamine-modulated spike-timing-dependent plasticity.

Continuous-time subspace flows related to the symmetric eigenproblem

The classes of continuous-time flows on Rn×p that induce the same flow on the set of p- dimensional subspaces of Rn×p are described. The power flow is briefly reviewed in this framework, and a subspace generalization of the Rayleigh quotient flow [Linear Algebra Appl. 368C, 2003, pp. 343-357] is proposed and analyzed. This new flow displays a property akin to deflation in finite time. © 2008 Yokohama Publishers.

Continuous dynamical systems that realize discrete optimization on the hypercube

We study the problem of finding a local minimum of a multilinear function E over the discrete set {0,1}n. The search is achieved by a gradient-like system in [0,1]n with cost function E. Under mild restrictions on the metric, the stable attractors of the gradient-like system are shown to produce solutions of the problem, even when they are not in the vicinity of the discrete set {0,1}n. Moreover, the gradient-like system connects with interior point methods for linear programming and with the analog neural network studied by Vidyasagar (IEEE Trans. Automat. Control 40 (8) (1995) 1359), in the same context. © 2004 Elsevier B.V. All rights reserved.

Aerodynamic noise from a poroelastic trailing edge with implications for the silent flight of owls

The interaction of a turbulent eddy with a semi-infinite, poroelastic edge is examined with respect to the effects of both elasticity and porosity on the efficiency of scattered aerodynamic noise. The scattering problem is solved using the Wiener-Hopf technique for constant plate properties to identify their scaling dependence on the resulting aerodynamic noise, including the dependence on flight velocity, where special attention is paid to the limiting cases of rigid, porous and elastic, impermeable plate conditions. Results from these analyses attempt to address how trailing edge noise may be mitigated by porosity and seek to deepen the understanding of how owls hunt in acoustic stealth. © 2012 by Justin W. Jaworski and Nigel Peake. Published by the American Institute of Aeronautics and Astronautics, Inc.