Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans.

Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.

Tomorrow's cities: a framework to assess urban resilience

Urbanisation is one of the great driving forces of the twenty-first century. Cities generate both productivity and creativity, and the benefits offered by high-density living and working contribute to sustainability. Cities comprise multiple components, forming both static and dynamic systems that are interconnected directly and indirectly on a number of levels. Bringing together large numbers of people within a complex system can lead to vulnerability from a wide range of hazards, threats and trends. The key to reducing this vulnerability is the identification of critical systems and determination of the implications of their failure and their interconnectivities with other systems. One emerging approach to these challenges focuses on building resilience – defined here as the degree to which a system can continue to function effectively in a changing environment. This paper puts forward a framework designed to help engineers, planners and designers to support cities in understanding the hazards, threats and trends that can make them vulnerable, and identify focus areas for building resilience into the systems, which allow it to function and prosper. Four case studies of cities whose resilience was tested by recent extreme weather events are presented, seeking to demonstrate the application of the proposed framework.