Spatio-Temporal Credit Assignment in Neuronal Population Learning

n learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain.

Delays in childhood immunization in a conflict area: a study from Sierra Leone during civil war

ABSTRACT: BACKGROUND: Sierra Leone has undergone a decade of civil war from 1991 to 2001. From this period few data on immunization coverage are available, and conflict-related delays in immunization according to the Expanded Programme on Immunization (EPI) schedule have not been investigated. We aimed to study delays in childhood immunization in the context of civil war in a Sierra Leonean community. METHODS: We conducted an immunization survey in Kissy Mess-Mess in the Greater Freetown area in 1998/99 using a two-stage sampling method. Based on immunization cards and verbal history we collected data on immunization for tuberculosis, diphtheria, tetanus, pertussis, polio, and measles by age group (0-8/9-11/12-23/24-35 months). We studied differences between age groups and explored temporal associations with war-related hostilities taking place in the community. RESULTS: We included 286 children who received 1690 vaccine doses; card retention was 87%. In 243 children (85%, 95% confidence interval (CI): 80-89%) immunization was up-to-date. In 161 of these children (56%, 95%CI: 50-62%) full age-appropriate immunization was achieved; in 82 (29%, 95%CI: 24-34%) immunization was not appropriate for age. In the remaining 43 children immunization was partial in 37 (13%, 95%CI: 9-17) and absent in 6 (2%, 95%CI: 1-5). Immunization status varied across age groups. In children aged 9-11 months the proportion with age-inappropriate (delayed) immunization was higher than in other age groups suggesting an association with war-related hostilities in the community. CONCLUSION: Only about half of children under three years received full age-appropriate immunization. In children born during a period of increased hostilities, immunization was mostly inappropriate for age, but recommended immunizations were not completely abandoned. Missing or delayed immunization represents an additional threat to the health of children living in conflict areas.