On-line policy optimisation of Bayesian spoken dialogue systems via human interaction

A partially observable Markov decision process has been proposed as a dialogue model that enables robustness to speech recognition errors and automatic policy optimisation using reinforcement learning (RL). However, conventional RL algorithms require a very large number of dialogues, necessitating a user simulator. Recently, Gaussian processes have been shown to substantially speed up the optimisation, making it possible to learn directly from interaction with human users. However, early studies have been limited to very low dimensional spaces and the learning has exhibited convergence problems. Here we investigate learning from human interaction using the Bayesian Update of Dialogue State system. This dynamic Bayesian network based system has an optimisation space covering more than one hundred features, allowing a wide range of behaviours to be learned. Using an improved policy model and a more robust reward function, we show that stable learning can be achieved that significantly outperforms a simulator trained policy. © 2013 IEEE.

City versus national energy use: implications for urban energy policy and strategies

The global trend towards urbanization means that over half of the world's population now lives in cities. Cities use energy in different proportions to national energy use averages, typically corresponding to whether a country is industrialized or developing. Cities in industrialized countries tend to use less energy per capita than the national average while cities in developing countries use more. This paper looks at existing World Bank data in respect to urban energy consumption, the emissions inventory work done by New York City, and discusses how this data highlights the need for a focus on: energy policy for buildings in industrialized cities; masterplanning and new construction standards in developing cities; and how urban energy policy can become more effective in reducing urban greenhouse gas emissions.

The temporal and spatial evaluation on China's agricultural policy output since 1978

Since reform and opening up, how much contribution has China's implementation of new agricultural policy made to agricultural output? This paper is trying to establish an agricultural policy output econometric model for doing a quantitative analysis of China's new agricultural policy. The results show that China's agricultural policies on agricultural output have an average contribution rate of about 7% since 1978, which is consistent with the OECD's basic forecast. There are obvious temporal and spatial differences. Generally speaking, we can divide the contribution of agricultural policy into three periods, which are the start-up phase from 1978 to 1991 (14 years), the stationary phase from 1992 to 2002 (11 years) and the rising phase from 2003 to 2008 (6 years). In space, the contribution of agricultural policy underwent a process from the all-low in the start-up phase, the gradual increase in the stationary phase to the all-high in the rising phase. Northern and western regions are more sensitive to policies. There are three major factors that can affect the contribution of regional agricultural policies, which are the process of national industrialization strategy, terrain and the level of local finance.

Maritime policy in Scotland.

This paper begins by defining the meaning of the term `maritime policy'. Since devolution in the UK, the opening of the new Scottish parliament in 1998 and the creation of the Scottish Executive, little effort has been made to establish a distinct maritime policy for Scotland. As was evident prior to devolution, the primary emphasis from any maritime policy perspective has continued to be a focus on lifeline island ferry services. This ignores significant developments in several other key maritime transport sectors, and this paper provides examples of areas that require some form of policy response, including intra-European short sea shipping, UK coastal shipping, urban/river transport and global container shipping. Long-standing institutional bias against maritime transport coupled with subsidy devoted almost entirely to land transport systems has resulted in a quite distorted marketplace. This suggests that a maritime policy is now imperative if maritime transport is to play a more significant role in the overall transport system. Further discussion centres on the need to consider, from a Scottish policy perspective, the role of various state-sponsored maritime service providers and how these bodies might fit better within evolving policy. The conclusion is that formulation of a maritime policy by the Scottish Executive is overdue and that a degree of restructuring of transport responsibilities within the Executive, combined with adequate resource allocation towards the maritime industry, will be necessary in order that market distortions can be overcome, so enabling Scotland to fully exploit the competitive and environmental advantages that maritime transport can provide.

An integrated firewall policy validation tool.

Security policies are increasingly being implemented by organisations. Policies are mapped to device configurations to enforce the policies. This is typically performed manually by network administrators. The development and management of these enforcement policies is a difficult and error prone task. This thesis describes the development and evaluation of an off-line firewall policy parser and validation tool. This provides the system administrator with a textual interface and the vendor specific low level languages they trust and are familiar with, but the support of an off-line compiler tool. The tool was created using the Microsoft C#.NET language, and the Microsoft Visual Studio Integrated Development Environment (IDE). This provided an object environment to create a flexible and extensible system, as well as simple Web and Windows prototyping facilities to create GUI front-end applications for testing and evaluation. A CLI was provided with the tool, for more experienced users, but it was also designed to be easily integrated into GUI based applications for non-expert users. The evaluation of the system was performed from a custom built GUI application, which can create test firewall rule sets containing synthetic rules, to supply a variety of experimental conditions, as well as record various performance metrics. The validation tool was created, based around a pragmatic outlook, with regard to the needs of the network administrator. The modularity of the design was important, due to the fast changing nature of the network device languages being processed. An object oriented approach was taken, for maximum changeability and extensibility, and a flexible tool was developed, due to the possible needs of different types users. System administrators desire, low level, CLI-based tools that they can trust, and use easily from scripting languages. Inexperienced users may prefer a more abstract, high level, GUI or Wizard that has an easier to learn process. Built around these ideas, the tool was implemented, and proved to be a usable, and complimentary addition to the many network policy-based systems currently available. The tool has a flexible design and contains comprehensive functionality. As opposed to some of the other tools which perform across multiple vendor languages, but do not implement a deep range of options for any of the languages. It compliments existing systems, such as policy compliance tools, and abstract policy analysis systems. Its validation algorithms were evaluated for both completeness, and performance. The tool was found to correctly process large firewall policies in just a few seconds. A framework for a policy-based management system, with which the tool would integrate, is also proposed. This is based around a vendor independent XML-based repository of device configurations, which could be used to bring together existing policy management and analysis systems.

MUES (Mid Wales - Users - Ethnic Services) Ethnic services provision 2007-08. Policy guidance for Libraries for Life: Delivering the entitlement agenda for library users in Wales 2007-09

Urquhart, C., Thomas, R., Crossan, S. & Hines, B. (2008). MUES (Mid Wales - Users - Ethnic Services) Ethnic services provision 2007-08. Policy guidance for Libraries for Life: Delivering the entitlement agenda for library users in Wales 2007-09. Aberystwyth: Department of Information Studies, Aberystwyth University. Relates to report of same title - http://hdl.handle.net/2160/609 Sponsorship: CyMAL

Ethics and Foreign Policy: The Antinomies of New Labour's 'Third Way' in Sub-Saharan Africa

Abrahamsen, Rita, Williams, Paul, 'Ethics and Foreign Policy: The Antinomies of New Labour's 'Third Way' in Sub-Saharan Africa', Political Studies (2002) 49(2) pp.249-264 RAE2008

France and the Problems of Security and Disarmament after the First World War

Jackson, Peter, 'France and the Problems of Security and Disarmament after the First World War', Journal of Strategic Studies (2006) 29(2) pp.247-280 Special Issue: Enforcing arms limits: Germany post 1919; Iraq post 1991 RAE2008

Irrelevant or Indispensable? ESDP, the ?War on Terror' and the Fallout from Iraq

Shepherd, Alistair, 'Irrelevant or Indispensable? ESDP, the ?War on Terror' and the Fallout from Iraq', International Politics (2006) 43(1) pp.71-92 RAE2008

Strat?gie et id?ologie: le haut commandement fran?ais et la guerre civile espagnole?

Jackson, Peter, 'Strat?gie et id?ologie: le haut commandement fran?ais et la guerre civile espagnole ', Guerres Mondiales et Conflits Contemporains - Revue Trimestrielle d'Histoire (2001) 199 pp.111-133 RAE2008