Dialog Systems based on Markov decision processes over two real tasks

In this work the state of the art of the automatic dialogue strategy management using Markov decision processes (MDP) with reinforcement learning (RL) is described. Partially observable Markov decision processes (POMDP) are also described. To test the validity of these methods, two spoken dialogue systems have been developed. The first one is a spoken dialogue system for weather forecast providing, and the second one is a more complex system for train information. With the first system, comparisons between a rule-based system and an automatically trained system have been done, using a real corpus to train the automatic strategy. In the second system, the scalability of these methods when used in larger systems has been tested.

A Novel Scheduling Index Rule Proposal for QoE Maximization in Wireless Networks

This paper deals with the resource allocation problem aimed at maximizing users' perception of quality in wireless channels with time-varying capacity. First of all, we model the subjective quality-aware scheduling problem in the framework of Markovian decision processes. Then, given that the obtaining of the optimal solution of this model is unachievable, we propose a simple scheduling index rule with closed-form expression by using a methodology based on Whittle approach. Finally, we analyze the performance of the achieved scheduling proposal in several relevant scenarios, concluding that it outperforms the most popular existing resource allocation strategies.

Markov Switching Risk Premium and the term structure of interest rates. Empirical evidence from US post-war interest rates

This paper considers the basic present value model of interest rates under rational expectations with two additional features. First, following McCallum (1994), the model assumes a policy reaction function where changes in the short-term interest rate are determined by the long-short spread. Second, the short-term interest rate and the risk premium processes are characterized by a Markov regime-switching model. Using US post-war interest rate data, this paper finds evidence that a two-regime switching model fits the data better than the basic model. The estimation results also show the presence of two alternative states displaying quite different features.

Evaluating governance and participatory processes in Natura 2000: lessons learned and guidance for future prospects

In recent years, participatory approaches have been incorporated in decision-making processes as a way to strengthen the bonds between diverse areas of knowledge and social actors in natural resources management and environmental governance. Despite the favourable context, this paradigm shift is still in an early stage within the development of the Natura 2000 in the European Union, the largest network of protected areas in the world. To enhance the full scope of participatory approaches in this context, this article: (i) briefly reviews the role of participatory approaches in environmental governance, (ii) develops a common framework to evaluate such participatory processes in protected area management, (iii) applies this framework to a real case study, and (iv) based on the lessons learned, provides guidance to improve the future governance of Natura 2000 sites.

Evaluating Governance and Participatory Processes in Natura 2000: Lessons Learned and Guidance for Future Prospects

23 p.