Spatio-temporal credit assignment in population learning

We present a model for plasticity induction in reinforcement learning which is based on a cascade of synaptic memory traces. In the cascade of these so called eligibility traces presynaptic input is first corre lated with postsynaptic events, next with the behavioral decisions and finally with the external reinforcement. A population of leaky integrate and fire neurons endowed with this plasticity scheme is studied by simulation on different tasks. For operant co nditioning with delayed reinforcement, learning succeeds even when the delay is so large that the delivered reward reflects the appropriateness, not of the immediately preceeding response, but of a decision made earlier on in the stimulus - decision sequence . So the proposed model does not rely on the temporal contiguity between decision and pertinent reward and thus provides a viable means of addressing the temporal credit assignment problem. In the same task, learning speeds up with increasing population si ze, showing that the plasticity cascade simultaneously addresses the spatial problem of assigning credit to the different population neurons. Simulations on other task such as sequential decision making serve to highlight the robustness of the proposed sch eme and, further, contrast its performance to that of temporal difference based approaches to reinforcement learning.

Spatio-Temporal Credit Assignment in Neuronal Population Learning

n learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain.

The implicit achievement motive predicts match performance and the explicit motive choices for goal distances in team sports

Motivational research over the past decade has provided ample evidence for the existence of two distinct motivational systems. Implicit motives are affect-based needs and have been found to predict spontaneous behavioral trends over time. Explicit motives in contrast represent cognitively based self-attributes and are preferably linked to choices. The present research examines the differentiating and predictive value of the implicit vs. explicit achievement motives for team sports performances. German students (N = 42) completed a measure of the implicit (Operant Motive Test) and the explicit achievement motive (Achievement Motive Scale-Sport). Choosing a goal distance is significantly predicted by the explicit achievement motive measure. By contrast, repeated performances in a team tournament are significantly predicted by the indirect measure. Results are in line with findings showing that implicit and explicit motive measures are associated with different classes of behavior.

The implicit affiliation motive moderates cortisol responses to acute psychosocial stress in high school students

It has been previously shown that the implicit affiliation motive – the need to establish and maintain friendly relationships with others – leads to chronic health benefits. The underlying assumption for the present research was that the implicit affiliation motive also moderates the salivary cortisol response to acute psychological stress when some aspects of social evaluation and uncontrollability are involved. By contrast we did not expect similar effects in response to exercise as a physical stressor. Fifty-nine high school students aged M = 14.8 years were randomly assigned to a psychosocial stress (publishing the results of an intelligence test performed), a physical stress (exercise intensity of 65–75% of HRmax), and a control condition (normal school lesson) each lasting 15 min. Participants’ affiliation motives were assessed using the Operant Motive Test and salivary cortisol samples were taken pre and post stressor. We found that the strength of the affiliation motive negatively predicted cortisol reactions to acute psychosocial but not to physical stress when compared to a control group. The results suggest that the affiliation motive buffers the effect of acute psychosocial stress on the HPA axis.

Explicit vs implicit affiliation motives predict different social behavior in sports competition

Objectives The present study investigated the predictive value of the explicit and implicit affiliation motive for social behavior in sport competitions. From an information processing perspective, an explicit motive is linked to verbal cues and respondent behavior. The implicit motive in turn is linked to nonverbal stimuli and operant behavior (McClelland, Koestner, & Weinberger, 1989; Schultheiss, 2008). Both respondent affiliative behavior (e.g., verbal interactions with teammates) and operant nonverbal social behavior (e.g., pleasant to opponents) can be observed in racquet sports team competitions. Design & Methods Fifty-two male racquet sportsmen completed the Personality Research Form (explicit affiliation motive) and the Operant Motive Test (implicit affiliation motive). Motive measures were used to predict social behavior during competitions using multiple regression analyses. To this aim real competitive matches were videotaped and analyzed. Results Results show that the explicit affiliation motive is associated with time spent in verbal team contact. The implicit affiliation motive, by contrast, is linked to pleasant nonverbal behavior shown toward opponents. Conclusions Findings suggest that implicit and explicit affiliation motives predict different kinds of social behavior in sports competition respectively. Indirect motive measures may be of additional predictive value for different behavior in real sports settings.