Effects of the user model on simulation-based learning of dialogue strategies

Over the past decade, a variety of user models have been proposed for user simulation-based reinforcement-learning of dialogue strategies. However, the strategies learned with these models are rarely evaluated in actual user trials and it remains unclear how the choice of user model affects the quality of the learned strategy. In particular, the degree to which strategies learned with a user model generalise to real user populations has not be investigated. This paper presents a series of experiments that qualitatively and quantitatively examine the effect of the user model on the learned strategy. Our results show that the performance and characteristics of the strategy are in fact highly dependent on the user model. Furthermore, a policy trained with a poor user model may appear to perform well when tested with the same model, but fail when tested with a more sophisticated user model. This raises significant doubts about the current practice of learning and evaluating strategies with the same user model. The paper further investigates a new technique for testing and comparing strategies directly on real human-machine dialogues, thereby avoiding any evaluation bias introduced by the user model. © 2005 IEEE.

Minimize frequency fluctuations of isolated power system with wind farm by using superconducting magnetic energy storage

Wind power generation as one of the most popular renewable energy applications is absorbing more and more attention all over the world. However, output power fluctuations of wind farm due to random variations of wind speed can cause network frequency and voltage flicker in power systems. The power quality consequently declines, particularly in an isolated power system such as the power system in a remote community or a small island. This paper proposes an application of superconducting magnetic energy storage (SMES) to minimize output fluctuations of an isolated power system with wind farm. The isolated power system is fed by a diesel generator and a wind generator consisting of a wind turbine and squirrel cage induction machine. The control strategy is detailed and the proposed system is evaluated by simulation in Matlab/Simulink.

Cross-Lingual spoken language understanding from unaligned data using discriminative classification models and machine translation

This paper investigates several approaches to bootstrapping a new spoken language understanding (SLU) component in a target language given a large dataset of semantically-annotated utterances in some other source language. The aim is to reduce the cost associated with porting a spoken dialogue system from one language to another by minimising the amount of data required in the target language. Since word-level semantic annotations are costly, Semantic Tuple Classifiers (STCs) are used in conjunction with statistical machine translation models both of which are trained from unaligned data to further reduce development time. The paper presents experiments in which a French SLU component in the tourist information domain is bootstrapped from English data. Results show that training STCs on automatically translated data produced the best performance for predicting the utterance's dialogue act type, however individual slot/value pairs are best predicted by training STCs on the source language and using them to decode translated utterances. © 2010 ISCA.

Contact and channel modelling using part and function libraries in a function-based design approach

To support the development and analysis of engineering designs at the embodiment stage, designers work iteratively with representations of those designs as they consider the function and form of their constituent parts. Detailed descriptions of "what a machine does" usually include flows of forces and active principles within the technical system, and their localization within parts and across the interfaces between them. This means that a representation should assist a designer in considering form and function at the same time and at different levels of abstraction. This paper describes a design modelling approach that enables designers to break down a system architecture into its subsystems and parts, while assigning functions and flows to parts and the interfaces between them. In turn, this may reveal further requirements to fulfil functions in order to complete the design. The approach is implemented in a software tool which provides a uniform, computable language allowing the user to describe functions and flows as they are iteratively discovered, created and embodied. A database of parts allows the user to search for existing design solutions. The approach is illustrated through an example: modelling the complex mechanisms within a humanoid robot. Copyright © 2010 by ASME.

Practical deployment of the brushless doubly-fed machine in a medium scale wind turbine

The Brushless Doubly-Fed Machine (BDFM) is a brushless electrical generator which allows variable speed operation with a power converter rated at only a fraction of the machine rating. This paper details an example implementation of the BDFM in a medium-scale wind turbine. Details of a simplified design procedure based on electrical and magnetic loadings are given along with the results of tests on the manufactured machine. These show that a BDFM of the scale works as expected but that the 4/8 BDFM chosen was slower and thus larger than the turbine's original induction machine. The implementation of the turbine system is discussed, including the vector-based control scheme that ensures the BDFM operates at a demanded speed and the Maximum Power Point Tracking (MPPT) scheme that selects the rotor speed that extracts the most power from the incident wind conditions.

Operation of brushless doubly-fed machine for drive applications

This paper presents dynamic and steady-state performance of the Brushless Doubly-Fed Machine (BDFM) operating as a variable speed drive. A simple closed-loop control system is used which only requires a speed feedback. The controller is capable of stabilising the machine when changes in speed and torque are applied. The machine starts in cascade mode and then makes a transition to the synchronous mode to reach the desired speed. This will allow a uni-directional converter to be used. The experiments included in this paper were carried out on a 180 frame size BDFM.

Stable operation of the Brushless Doubly-Fed Machine (BDFM)

A simple method of controlling the Brushless Doubly-Fed Machine (BDFM) is presented. The controller comprises two Proportional-Integral (PI) modules and requires only the rotor speed feedback. The machine model and the control system are developed in MATLAB. Both simulation and experimental results are presented. The performance of the system is presented in the motoring and generating operations. The experimental tests included in this paper were carried out on a 180 frame size BDFM with a nested-loop rotor. © 2007 IEEE.

Ready configuration of machines into an existing manufacturing system

This paper focuses on simplifying and easing the integration of a new machine into an existing conventional hierarchical manufacturing system. Based on a distributed manufacturing paradigm, it proposes the functions and interfaces that a new machine and an existing manufacturing system should possess so that ready and simple configuration of additional machines can be achieved. The configuration process is intended to include, not only mechanical and electrical interfaces, but also decision system interfaces (such as planning, scheduling, and shop-floor control). Preliminary laboratory experiments to compare the reconfigurability resulting from a conventional integration method and the proposed distributed method are presented and discussed. © 2007 ISAM.

A novel vector control approach for Single Phase Brushless Doubly Fed Machine

This paper proposed a novel control scheme for operating the Single Phase Brushless Doubly-Fed Machine (SPB) based on Stator-Flux-Oriented control algorithm. The SPB is a new type of Brushless Doubly-Fed Machine (BDFM) which shows a potential in applications which require adjustable speed such as Wind Power generation and speed adjustable Drive. The SPB can be applied to single-phase power system and the lower cost of the SPB makes the SPB suitable for low-rated power conversion applications. This paper develops the control scheme of the SPB with explicit mathematical analysis and block diagram of the controller. Experimental verification is also given. © 2011 IEEE.

Parameter estimation for agenda-based user simulation

This paper presents an agenda-based user simulator which has been extended to be trainable on real data with the aim of more closely modelling the complex rational behaviour exhibited by real users. The train-able part is formed by a set of random decision points that may be encountered during the process of receiving a system act and responding with a user act. A sample-based method is presented for using real user data to estimate the parameters that control these decisions. Evaluation results are given both in terms of statistics of generated user behaviour and the quality of policies trained with different simulators. Compared to a handcrafted simulator, the trained system provides a much better fit to corpus data and evaluations suggest that this better fit should result in improved dialogue performance. © 2010 Association for Computational Linguistics.

Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system

The optimization of dialogue policies using reinforcement learning (RL) is now an accepted part of the state of the art in spoken dialogue systems (SDS). Yet, it is still the case that the commonly used training algorithms for SDS require a large number of dialogues and hence most systems still rely on artificial data generated by a user simulator. Optimization is therefore performed off-line before releasing the system to real users. Gaussian Processes (GP) for RL have recently been applied to dialogue systems. One advantage of GP is that they compute an explicit measure of uncertainty in the value function estimates computed during learning. In this paper, a class of novel learning strategies is described which use uncertainty to control exploration on-line. Comparisons between several exploration schemes show that significant improvements to learning speed can be obtained and that rapid and safe online optimisation is possible, even on a complex task. Copyright © 2011 ISCA.

Sensorless commutation of a two-phase linear machine for marine renewable power generation

A sensorless scheme is presented for a two-phase permanent-magnet linear machine targeted for use in marine wave-power generation. This is a field where system reliability is a key concern. The scheme is able to extract the effective inductance and back-emf of the machine's phases simultaneously from measurements of the current ripple present on the power electronic converter. These measurements can then be used to estimate position. An enhancement to the scheme in the presence of spatially-varying mutual inductance between phases allows more accurate and reliable tracking from indutance-based measurements than would otherwise be expected. This scheme is able to operate at any speed including, critically, when stationary. Experimental results show promise for the scheme, although some work to reduce the level of noise would be desirable. © 2013 IEEE.