Gradient estimation in dendritic reinforcement learning

We study synaptic plasticity in a complex neuronal cell model where NMDA-spikes can arise in certain dendritic zones. In the context of reinforcement learning, two kinds of plasticity rules are derived, zone reinforcement (ZR) and cell reinforcement (CR), which both optimize the expected reward by stochastic gradient ascent. For ZR, the synaptic plasticity response to the external reward signal is modulated exclusively by quantities which are local to the NMDA-spike initiation zone in which the synapse is situated. CR, in addition, uses nonlocal feedback from the soma of the cell, provided by mechanisms such as the backpropagating action potential. Simulation results show that, compared to ZR, the use of nonlocal feedback in CR can drastically enhance learning performance. We suggest that the availability of nonlocal feedback for learning is a key advantage of complex neurons over networks of simple point neurons, which have previously been found to be largely equivalent with regard to computational capability.

The role of learning-related dopamine signals in addiction vulnerability

Dopaminergic signals play a mathematically precise role in reward-related learning, and variations in dopaminergic signaling have been implicated in vulnerability to addiction. Here, we provide a detailed overview of the relationship between theoretical, mathematical, and experimental accounts of phasic dopamine signaling, with implications for the role of learning-related dopamine signaling in addiction and related disorders. We describe the theoretical and behavioral characteristics of model-free learning based on errors in the prediction of reward, including step-by-step explanations of the underlying equations. We then use recent insights from an animal model that highlights individual variation in learning during a Pavlovian conditioning paradigm to describe overlapping aspects of incentive salience attribution and model-free learning. We argue that this provides a computationally coherent account of some features of addiction.

Beyond questionnaires – Exploring adult education teachers' mathematical beliefs with pictures and interviews

Because of the impact that mathematical beliefs have on an individual’s behaviour, they are generally well researched. However, little mathematical belief research has taken place in the field of adult education. This paper presents preliminary results from a study conducted in this field in Switzerland. It is based on Ernest’s (1989) description of mathematics as an instrumental, Platonist or problem solving construct. The analysis uses pictures drawn by the participants and interviews conducted with them as data. Using a categorising scheme developed by Rolka and Halverscheid (2011), the author argues that adults’ mathematical beliefs are complex and especially personal aspects are difficult to capture with said scheme. Particularly the analysis of visual data requires a more refined method of analysis.