The misbehavior of value and the discipline of the will.

Most reinforcement learning models of animal conditioning operate under the convenient, though fictive, assumption that Pavlovian conditioning concerns prediction learning whereas instrumental conditioning concerns action learning. However, it is only through Pavlovian responses that Pavlovian prediction learning is evident, and these responses can act against the instrumental interests of the subjects. This can be seen in both experimental and natural circumstances. In this paper we study the consequences of importing this competition into a reinforcement learning context, and demonstrate the resulting effects in an omission schedule and a maze navigation task. The misbehavior created by Pavlovian values can be quite debilitating; we discuss how it may be disciplined.

Visualization Summit 2007: Ten research goals for 2010

At the first international Visualization Summit, more than 100 international researchers and practitioners defined and assessed nine original and important research goals in the context of Visualization Science, and proposed methods for achieving these goals by 2010. The synthesis of the whole event is presented in the 10th research goal. This article contributes a building block for systemizing visualization research by proposing mutually elaborated research goals with defined milestones. Such a consensus on where to go together is only one step toward establishing visualization science in the long-term perspective as a discipline with comparable relevance to chemistry, mathematics, language, or history. First, this article introduces the conference setting. Second, it describes the research goals and findings from the nine workshops. Third, a survey among 62 participants about the originality and importance of each research goal is presented and discussed. Finally, the article presents a synthesis of the nine research goals in the form of a 10th research goal, namely Visualizing Future Cities. The article is relevant for visualization researchers, trend scouts, research programme directors who define the topics that get funds. © 2007 Palgr aveMacmillan Ltd. All rights reserved.