Partially Observable Markov Decision Processes with continuous observations for dialogue management

This work shows how a dialogue model can be represented as a Partially Observable Markov Decision Process (POMDP) with observations composed of a discrete and continuous component. The continuous component enables the model to directly incorporate a confidence score for automated planning. Using a testbed simulated dialogue management problem, we show how recent optimization techniques are able to find a policy for this continuous POMDP which outperforms a traditional MDP approach. Further, we present a method for automatically improving handcrafted dialogue managers by incorporating POMDP belief state monitoring, including confidence score information. Experiments on the testbed system show significant improvements for several example handcrafted dialogue managers across a range of operating conditions.

A design strategy in the propulsion system attachment to a submarine hull to minimise radiated noise

Vibration modes of a submerged hull are excited by fluctuating forces generated at the propeller and transmitted to the hull via the propeller-shafting system. The low frequency hull vibrational modes result in significant sound radiation. This work investigates the reduction of the far-field radiated sound pressure by optimising the connection point of the shafting system to the hull. The submarine hull is modelled as a fluid loaded cylindrical hull with truncated conical shells at each end. The propeller-shafting system consists of the propeller, shaft, thrust bearing and foundation, and is modelled in a modular approach using a combination of spring-mass-damper elements and continuous systems (beams, plates, shells). The foundation is attached to the stern side end plate of the hull, which is modelled as a circular plate coupled to an annular plate. By tuning the connection radius of the foundation to the end plate, the maximum radiated noise in a given frequency range can be minimised.

Boundary effects on the vibration statistics of a random plate

This paper considers the estimation of statistics of displacement of a vibrating rectangular plate with random wave scatterers. The influence of uncertainty is investigated using point impedance theory. Coherent boundary effects are seen, which decrease when the number of scatterers increases. The boundary effect is investigated using images and the first side and corner reflections are found to be a minimum requirement to estimate the spatial correlation. Statistics for point driven response are investigated under the assumption that the statistics of the natural frequencies follow those of the Gaussian Orthogonal Ensemble (GOE). The estimates are compared with Monte Carlo simulation results, and they show good agreement. © 2012 Elsevier Ltd. All rights reserved.

Continuous Diffraction Patterns from Circular Arrays of Carbon Nanotubes

We report the remarkable diffraction effects produced from circular patterned arrays of multiwalled carbon nanotubes (MWCNTs). Highly ordered circular arrays of multiwalled carbon nanotubes (with inter-nanotube spacings of 633 nm) display optical dispersion effects similar to compact discs. These arrays display remarkable diffraction patterns in the far field which are spatially continuous. High quality diffraction patterns were obtained experimentally which are in excellent agreement with the theoretical calculations. The achieved continuous diffraction patterns pave the way towards the utilization of engineered carbon nanotube arrays in applications like three dimensional holograms.

On the transition from finite-volume negatively buoyant releases to continuous fountains

An experimental investigation to identify the source conditions that distinguish finite-volume negatively buoyant fluid projectile behaviour from fountain behaviour in quiescent environments of uniform density is described. Finite-volume releases are governed by their source Froude number Fr D and the aspect ratio L/D of the release, where L denotes the length of the column of fluid dispensed vertically from the nozzle of diameter D. We establish the influence of L/D on the peak rise heights of a release formed by dispensing saline solution into fresh water for 0continuous flux. The critical aspect ratio (L/D) f, for a given Fr D, which when exceeded no longer influenced release behaviour, led to the determination of Fr D, (L/D) f paired source conditions that give rise to solely Froude-number-dependent, i.e. fountain-like, behaviour. As such, we make the link between finite-volume releases and continuous fountains. The Fr D(L/D) f pairs led us directly to the classification of a Fr D, L/D space from which source conditions giving rise to either negatively buoyant projectiles or fountains may be readily identified. The variation of (L/D) f with Fr D corresponds closely to established fountain regimes of very weak, weak and forced fountains. Moreover, our results indicate that the formation or otherwise of a primary vortex, as fluid is ejected, has a profound influence on the length of the dispensed fluid column that is necessary to achieve rise heights equal to fountain rise heights. © 2012 Cambridge University Press.

On the time delay in continuous in-cylinder sampling from IC engines

When gas sample is continuously drawn from the cylinder of an internal combustion engine, the sample that appears at the end of the sampling system corresponds to the in-cylinder content sometime ago because of the finite transit time which is a function of the cylinder pressure history. This variable delay causes a dispersion of the sample signal and makes the interpretation of the signal difficult An unsteady flow analysis of a typical sampling system was carried out for selected engine loads and speeds. For typical engine operation, a window in which the delay is approximately constant may be found. This window gets smaller with increase in engine speed, with decrease in load, and with the increase in exit pressure of the sampling system.

Reinforcement learning using a continuous time actor-critic framework with spiking neurons.

Animals repeat rewarded behaviors, but the physiological basis of reward-based learning has only been partially elucidated. On one hand, experimental evidence shows that the neuromodulator dopamine carries information about rewards and affects synaptic plasticity. On the other hand, the theory of reinforcement learning provides a framework for reward-based learning. Recent models of reward-modulated spike-timing-dependent plasticity have made first steps towards bridging the gap between the two approaches, but faced two problems. First, reinforcement learning is typically formulated in a discrete framework, ill-adapted to the description of natural situations. Second, biologically plausible models of reward-modulated spike-timing-dependent plasticity require precise calculation of the reward prediction error, yet it remains to be shown how this can be computed by neurons. Here we propose a solution to these problems by extending the continuous temporal difference (TD) learning of Doya (2000) to the case of spiking neurons in an actor-critic network operating in continuous time, and with continuous state and action representations. In our model, the critic learns to predict expected future rewards in real time. Its activity, together with actual rewards, conditions the delivery of a neuromodulatory TD signal to itself and to the actor, which is responsible for action choice. In simulations, we show that such an architecture can solve a Morris water-maze-like navigation task, in a number of trials consistent with reported animal performance. We also use our model to solve the acrobot and the cartpole problems, two complex motor control tasks. Our model provides a plausible way of computing reward prediction error in the brain. Moreover, the analytically derived learning rule is consistent with experimental evidence for dopamine-modulated spike-timing-dependent plasticity.

Plastic limit solution for the response of plate anchors under combined translational and torsional undrained loading

Plate anchors are increasingly being used to moor large floating offshore structures in deep and ultradeep water. These facilities impart substantial vertical uplift loading to plate anchors. However, extreme operating conditions such as hurricane loading often result in partial system failures, with significant change in the orientation of the remaining intact mooring lines. The purpose of this study is to investigate the undrained pure translational (parallel to plate) and torsional bearing capacity of anchor plates idealized as square and rectangular shaped plates. Moreover, the interaction response of plate anchors under combined translational and torsional loading is studied using a modified plastic limit analysis (PLA) approach. The previous PLA formulation which did not account for shear-normal force interaction on the vertical end faces of the plate provides an exact solution to the idealized problem of an infinitely thin plate but only an approximate solution to the problem of a plate of finite thickness. This is also confirmed by the three-dimensional finite element (FE) results, since the PLA values exceed FE results as the thickness of the plate increases. By incorporating the shear-normal interaction relationship in the modified solution, the torsional bearing capacity factors, as well as the plate interaction responses are enhanced as they show satisfactory agreement with the FE results. The interaction relationship is then obtained for square and rectangular plates of different aspect ratios and thicknesses. The new interaction relationships could also be used as an associated plastic failure locus for combined shear and torsional loading to predict plastic displacements and rotations in translational and torsional loading modes as well. Copyright © 2011 by the International Society of Offshore and Polar Engineers (ISOPE).

Continuous-time subspace flows related to the symmetric eigenproblem

The classes of continuous-time flows on Rn×p that induce the same flow on the set of p- dimensional subspaces of Rn×p are described. The power flow is briefly reviewed in this framework, and a subspace generalization of the Rayleigh quotient flow [Linear Algebra Appl. 368C, 2003, pp. 343-357] is proposed and analyzed. This new flow displays a property akin to deflation in finite time. © 2008 Yokohama Publishers.

Continuous dynamical systems that realize discrete optimization on the hypercube

We study the problem of finding a local minimum of a multilinear function E over the discrete set {0,1}n. The search is achieved by a gradient-like system in [0,1]n with cost function E. Under mild restrictions on the metric, the stable attractors of the gradient-like system are shown to produce solutions of the problem, even when they are not in the vicinity of the discrete set {0,1}n. Moreover, the gradient-like system connects with interior point methods for linear programming and with the analog neural network studied by Vidyasagar (IEEE Trans. Automat. Control 40 (8) (1995) 1359), in the same context. © 2004 Elsevier B.V. All rights reserved.

Structural analysis of plate-type fuel assemblies and development of a non-destructive method to assess their integrity

This work is concerned with the structural behaviour and the integrity of parallel plate-type nuclear fuel assemblies. A plate-type assembly consists of several thin plates mounted in a box-like structure and is subjected to a coolant flow that can result in a considerable drag force. A finite element model of an assembly is presented to study the sensitivity of the natural frequencies to the stiffness of the plates' junctions. It is shown that the shift in the natural frequencies of the torsional modes can be used to check the global integrity of the fuel assembly while the local natural frequencies of the inner plates can be used to estimate the maximum drag force they can resist. Finally a non-destructive method is developed to assess the resistance of the inner plates to bear an applied load. Extensive computational and experimental results are presented to prove the applicability of the method presented. © 2013 Elsevier B.V. All rights reserved.