Code-specific learning rules improve action selection by populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral decisions. We previously introduced reinforcement learning for population-based decision making by spiking neurons. Here we generalize population reinforcement learning to spike-based plasticity rules that take account of the postsynaptic neural code. We consider spike/no-spike, spike count and spike latency codes. The multi-valued and continuous-valued features in the postsynaptic code allow for a generalization of binary decision making to multi-valued decision making and continuous-valued action selection. We show that code-specific learning rules speed up learning both for the discrete classification and the continuous regression tasks. The suggested learning rules also speed up with increasing population size as opposed to standard reinforcement learning rules. Continuous action selection is further shown to explain realistic learning speeds in the Morris water maze. Finally, we introduce the concept of action perturbation as opposed to the classical weight- or node-perturbation as an exploration mechanism underlying reinforcement learning. Exploration in the action space greatly increases the speed of learning as compared to exploration in the neuron or weight space.

The role of controlled attention and selective encoding for kindergarteners' learning

Selectivity in encoding, aspects of attentional control and their contribution to learning performance were explored in a sample of preschoolers. While the children are performing a learning task, their encoding of relevant and attention towards irrelevant information was recorded through an eye-tracking device. Recognition of target items was used as measure of learning outcome, and individual differences in resistance to interference and inhibition of attention to task-irrelevant stimuli (i.e. distractibility) were used as measures of executive control of attention. Results indicated well-developed selectivity during encoding in young children. Recognition performance was related to selective encoding and aspects of attentional control, explaining individual differences in learning. Copyright © 2011 John Wiley & Sons, Ltd.