A new adaptive marine policy toolbox to support ecosystem-based approach to management

4 p.

Gaussian processes for fast policy optimisation of POMDP-based dialogue managers

Modelling dialogue as a Partially Observable Markov Decision Process (POMDP) enables a dialogue policy robust to speech understanding errors to be learnt. However, a major challenge in POMDP policy learning is to maintain tractability, so the use of approximation is inevitable. We propose applying Gaussian Processes in Reinforcement learning of optimal POMDP dialogue policies, in order (1) to make the learning process faster and (2) to obtain an estimate of the uncertainty of the approximation. We first demonstrate the idea on a simple voice mail dialogue task and then apply this method to a real-world tourist information dialogue task. © 2010 Association for Computational Linguistics.

Policy optimisation of POMDP-based dialogue systems without state space compression

The partially observable Markov decision process (POMDP) has been proposed as a dialogue model that enables automatic improvement of the dialogue policy and robustness to speech understanding errors. It requires, however, a large number of dialogues to train the dialogue policy. Gaussian processes (GP) have recently been applied to POMDP dialogue management optimisation showing an ability to substantially increase the speed of learning. Here, we investigate this further using the Bayesian Update of Dialogue State dialogue manager. We show that it is possible to apply Gaussian processes directly to the belief state, removing the need for a parametric policy representation. In addition, the resulting policy learns significantly faster while maintaining operational performance. © 2012 IEEE.

GIS-based Association Between PM10 and Allergic Diseases in Seoul: Implications for Health and Environmental Policy.

PURPOSE: The role of PM10 in the development of allergic diseases remains controversial among epidemiological studies, partly due to the inability to control for spatial variations in large-scale risk factors. This study aims to investigate spatial correspondence between the level of PM10 and allergic diseases at the sub-district level in Seoul, Korea, in order to evaluate whether the impact of PM10 is observable and spatially varies across the subdistricts. METHODS: PM10 measurements at 25 monitoring stations in the city were interpolated to 424 sub-districts where annual inpatient and outpatient count data for 3 types of allergic diseases (atopic dermatitis, asthma, and allergic rhinitis) were collected. We estimated multiple ordinary least square regression models to examine the association of the PM10 level with each of the allergic diseases, controlling for various sub-district level covariates. Geographically weighted regression (GWR) models were conducted to evaluate how the impact of PM10 varies across the sub-districts. RESULTS: PM10 was found to be a significant predictor of atopic dermatitis patient count (P<0.01), with greater association when spatially interpolated at the sub-district level. No significant effect of PM10 was observed on allergic rhinitis and asthma when socioeconomic factors were controlled for. GWR models revealed spatial variation of PM10 effects on atopic dermatitis across the sub-districts in Seoul. The relationship of PM10 levels to atopic dermatitis patient counts is found to be significant only in the Gangbuk region (P<0.01), along with other covariates including average land value, poverty rate, level of education and apartment rate (P<0.01). CONCLUSIONS: Our findings imply that PM10 effects on allergic diseases might not be consistent throughout Seoul. GIS-based spatial modeling techniques could play a role in evaluating spatial variation of air pollution impacts on allergic diseases at the sub-district level, which could provide valuable guidelines for environmental and public health policymakers.

A policy-definition language and prototype implementation library for policy-based autonomic systems

This paper presents work towards generic policy toolkit support for autonomic computing systems in which the policies themselves can be adapted dynamically and automatically. The work is motivated by three needs: the need for longer-term policy-based adaptation where the policy itself is dynamically adapted to continually maintain or improve its effectiveness despite changing environmental conditions; the need to enable non autonomics-expert practitioners to embed self-managing behaviours with low cost and risk; and the need for adaptive policy mechanisms that are easy to deploy into legacy code. A policy definition language is presented; designed to permit powerful expression of self-managing behaviours. The language is very flexible through the use of simple yet expressive syntax and semantics, and facilitates a very diverse policy behaviour space through both hierarchical and recursive uses of language elements. A prototype library implementation of the policy support mechanisms is described. The library reads and writes policies in well-formed XML script. The implementation extends the state of the art in policy-based autonomics through innovations which include support for multiple policy versions of a given policy type, multiple configuration templates, and meta-policies to dynamically select between policy instances and templates. Most significantly, the scheme supports hot-swapping between policy instances. To illustrate the feasibility and generalised applicability of these tools, two dissimilar example deployment scenarios are examined. The first is taken from an exploratory implementation of self-managing parallel processing, and is used to demonstrate the simple and efficient use of the tools. The second example demonstrates more-advanced functionality, in the context of an envisioned multi-policy stock trading scheme which is sensitive to environmental volatility

Generic support for policy-based self-adaptive systems

This paper presents a policy definition language which forms part of a generic policy toolkit for autonomic computing systems in which the policies themselves can be modified dynamically and automatically. Targeted enhancements to the current state of practice include: policy self-adaptation where the policy itself is dynamically modified to match environmental conditions; improved support for non autonomics-expert developers; and facilitating easy deployment of adaptive policies into legacy code. The policy definition language permits powerful expression of self-managing behaviours and facilitates a diverse policy behaviour space. Features include support for multiple versions of a given policy type, multiple configuration templates, and meta policies to dynamically select between policy instances. An example deployment scenario illustrates advanced functionality in the context of a multi policy stock trading system which is sensitive to environmental volatility.

Policy-based techniques for self-managing parallel applications

This paper presents an empirical investigation of policy-based self-management techniques for parallel applications executing in loosely-coupled environments. The dynamic and heterogeneous nature of these environments is discussed and the special considerations for parallel applications are identified. An adaptive strategy for the run-time deployment of tasks of parallel applications is presented. The strategy is based on embedding numerous policies which are informed by contextual and environmental inputs. The policies govern various aspects of behaviour, enhancing flexibility so that the goals of efficiency and performance are achieved despite high levels of environmental variability. A prototype self-managing parallel application is used as a vehicle to explore the feasibility and benefits of the strategy. In particular, several aspects of stability are investigated. The implementation and behaviour of three policies are discussed and sample results examined.

Towards policy-based self-configuration of embedded systems

This paper describes work towards the deployment of flexible self-management into real-time embedded systems. A challenging project which focuses specifically on the development of a dynamic, adaptive automotive middleware is described, and the specific self-management requirements of this project are discussed. These requirements have been identified through the refinement of a wide-ranging set of use cases requiring context-sensitive behaviours. A sample of these use-cases is presented to illustrate the extent of the demands for self-management. The strategy that has been adopted to achieve self-management, based on the use of policies is presented. The embedded and real-time nature of the target system brings the constraints that dynamic adaptation capabilities must not require changes to the run-time code (except during hot update of complete binary modules), adaptation decisions must have low latency, and because the target platforms are resource-constrained the self-management mechanism have low resource requirements (especially in terms of processing and memory). Policy-based computing is thus and ideal candidate for achieving the self-management because the policy itself is loaded at run-time and can be replaced or changed in the future in the same way that a data file is loaded. Policies represent a relatively low complexity and low risk means of achieving self-management, with low run-time costs. Policies can be stored internally in ROM (such as default policies) as well as externally to the system. The architecture of a designed-for-purpose powerful yet lightweight policy library is described. A suitable evaluation platform, supporting the whole life-cycle of feasibility analysis, concept evaluation, development, rigorous testing and behavioural validation has been devised and is described.

Scenarios for integrated river catchment and coastal zone management

The European Water Framework Directive requires EU Member States to introduce water quality objectives for all water bodies, including coastal waters. Measures will have to be introduced if these objectives are not met, given predictions based on current trends. In this context, the estimation of future fluxes of nutrients and contaminants in the catchment, and the evaluation of policies to improve water quality in coastal zones are an essential part of river basin management plans. This paper investigates the use of scenarios for integrated catchment/coastal zone management in the Humber Estuary in the U.K. The context of this ongoing research is a European research project which aims to assist the implementation of integrated catchment and coastal zone management by analysing the response of the coastal sea to changes in fluxes of nutrients and contaminants from the catchments. The example of the Humber illustrates how scenarios focusing on water quality improvement can provide a useful tool to investigate future fluxes and evaluate policy options for a more integrated coastal/catchment management strategy.

The role of economics in ecosystem based management: The case of the EU Marine Strategy Framework Directive, First lessons learnt and way forward

The EU Marine Strategy Framework Directive (MSFD) sets out a plan of action relating to marine environmental policy and in particular to achieving ‘good environmental status’ (GES) in European marine waters by 2020. Article 8.1 (c) of the Directive calls for ‘an economic and social analysis of the use of those waters and of the cost of degradation of the marine environment’. The MSFD is ‘informed’ by the Ecosystem Approach to management, with GES interpreted in terms of ecosystem functioning and services provision. Implementation of the Ecosystem Approach is expected to be by adaptive management policy and practice. The initial socio-economic assessment was made by maritime EU Member States between 2011 and 2012, with future updates to be made on a regular basis. For the majority of Member States, this assessment has led to an exercise combining an analysis of maritime activities both at national and coastal zone scales, and an analysis of the non-market value of marine waters. In this paper we examine the approaches taken in more detail, outline the main challenges facing the Member States in assessing the economic value of achieving GES as outlined in the Directive and make recommendations for the theoretically sound and practically useful completion of the required follow-up economic assessments specified in the MSFD.

The role of economics in ecosystem based management: The case of the EU Marine Strategy Framework Directive, First lessons learnt and way forward

The EU Marine Strategy Framework Directive (MSFD) sets out a plan of action relating to marine environmental policy and in particular to achieving ‘good environmental status’ (GES) in European marine waters by 2020. Article 8.1 (c) of the Directive calls for ‘an economic and social analysis of the use of those waters and of the cost of degradation of the marine environment’. The MSFD is ‘informed’ by the Ecosystem Approach to management, with GES interpreted in terms of ecosystem functioning and services provision. Implementation of the Ecosystem Approach is expected to be by adaptive management policy and practice. The initial socio-economic assessment was made by maritime EU Member States between 2011 and 2012, with future updates to be made on a regular basis. For the majority of Member States, this assessment has led to an exercise combining an analysis of maritime activities both at national and coastal zone scales, and an analysis of the non-market value of marine waters. In this paper we examine the approaches taken in more detail, outline the main challenges facing the Member States in assessing the economic value of achieving GES as outlined in the Directive and make recommendations for the theoretically sound and practically useful completion of the required follow-up economic assessments specified in the MSFD.

Approved Social Work Training in Northern Ireland: Using Research to Examine Competence-Based Learning and Influence Policy Change

This article reports on how research activity helped describe and analyse ASW (Approved Social Worker) learning experience as well as acting as a catalyst for change and development in policy and practice in Northern Ireland. The paper contextualizes the study by outlining the legislation, the main features of the ASW role and the approach to ASW training in Northern Ireland, and by reviewing the literature on the efficacy and value of competence-based learning. While the findings do not provide conclusive evidence that a competence-based approach is inherently more effective than previous courses, they do indicate that candidates who were trained in this way were moderately more satisfied than those who had participated in non-competence based programmes. The research also highlights the importance of the interrelationship between training, practice experience and support in developing and sustaining competence. The paper concludes with a review of the recommendations arising from the study and an analysis of the developments in training and regulations relating to practice experience and re-approval of ASWs since publication of the research. The study is of contemporary interest given the proposed changes to the role of ASWs/Mental Health Officers in the context of the reviews of UK mental health law.