Spatio-temporal credit assignment in population learning

We present a model for plasticity induction in reinforcement learning which is based on a cascade of synaptic memory traces. In the cascade of these so called eligibility traces presynaptic input is first corre lated with postsynaptic events, next with the behavioral decisions and finally with the external reinforcement. A population of leaky integrate and fire neurons endowed with this plasticity scheme is studied by simulation on different tasks. For operant co nditioning with delayed reinforcement, learning succeeds even when the delay is so large that the delivered reward reflects the appropriateness, not of the immediately preceeding response, but of a decision made earlier on in the stimulus - decision sequence . So the proposed model does not rely on the temporal contiguity between decision and pertinent reward and thus provides a viable means of addressing the temporal credit assignment problem. In the same task, learning speeds up with increasing population si ze, showing that the plasticity cascade simultaneously addresses the spatial problem of assigning credit to the different population neurons. Simulations on other task such as sequential decision making serve to highlight the robustness of the proposed sch eme and, further, contrast its performance to that of temporal difference based approaches to reinforcement learning.

Spatio-Temporal Credit Assignment in Neuronal Population Learning

n learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain.

Minimum ten year results of total hip arthroplasty with the acetabular reinforcement ring in avascular osteonecrosis

Total hip arthroplasty (THA) still carries a higher failure rate in patients with avascular necrosis of the femoral head (AVN) than in a similar patient population with THA for other reasons. This is particularly true for the acetabular component. One of the major factors accounting for this is the compromised acetabular bone quality with structural defects subsequent to collapsing of the femoral head in high-grade AVN. In this study we implanted an acetabular reinforcement ring with hook (ARRH), which had been used successfully for other indications with acetabular bone stock deficiency, in 32 consecutive THA's in 29 patients with AVN. Five patients died during the observation period of causes unrelated to the surgery, one patient was lost to follow-up and one patient could not be followed up due to chronic illness, leaving 25 hips (23 patients) with a minimum follow-up of ten years (mean: 11.8; range: 10-15). The mean Merle d'Aubigne score increased significantly from 7.7 preoperatively to 16.6 postoperatively (p < 0.001). One revision was performed for aseptic stem loosening. Of the unrevised hips, one acetabular component was classified as definitively loose. The cumulative 12-year survivorship for THA with ARRH in AVN was 95.2% (confidence interval: 86.1-100%) for both components, 100% for the cup and 95.2% for the stem (86.1-100%).

Cell population, viability, and some key immunomodulatory molecules in different milk somatic cell samples in dairy cows

Immune cells in the milk are most important in combating pathogens that invade the mammary gland. This study investigated the immune competence and viability of somatic milk cells that are already resident in milk and udders free of infection. Cells were studied in freshly removed milk to simulate conditions in the udder. Effects of incubation, cell preparation, and immunological stimulation with 0.5 mug/ml lipopolysaccharide (LPS) from Escherichia coli were analysed. Viability and differential counts of milk cells between high and low somatic cell count (SCC) quarters, and cisternal and alveolar milk with and without LPS stimulation were compared. Incubation and preparation of cells caused a cell loss which further increased with time independently of SCC and milk fraction. The viability of these cells was stable until 3 h post incubation and decreased until 6 h. Cell populations differed between both investigations, but did not change during the course of the experiment. mRNA expression of immune and apoptosis factors of the cells, measured by qPCR, did not change substantially: mRNA expression of caspase 3, Toll like receptor 4, and GM-CSF did not change, whereas the expression of the death receptor Fas/APO-1 (CD95), lactoferrin and lysozyme was decreased at 6 h. Cyclooxygenase-2 and TNF-alpha mRNA expression were decreased after 6 h of LPS treatment. In comparison with other studies in vivo or in vitro (in cell culture), in this study where cells are studied ex vivo (removed from the udder but kept in their natural environment, the milk) resident milk cells seem to be more vulnerable, less viable, less able to respond to stimulation, and thus less immune competent compared with cells that have freshly migrated from blood into milk after pathogen stimulation. The cell viability and differential cell count differed between high- and low-SCC milk and between cisternal and alveolar milk depending on the individual cow. In conclusion, the results support the view that for a most effective defence against invading pathogens the mammary gland is reliant on the recruitment of fresh immune cells from the blood.

Les experiences de retour des sans-papiers rentrés en Equateur: Ressources et defies, mesures proposes pour un retour viable

Notre compréhension de la migration du retour est encore très limitée. Ce sujet n’a que peu retenu l’attention des spécialistes de la migration et il existe peu d’études qui donnent une vision différenciée sur les divers types de « retourné-e-s », leurs motivations à retourner dans leurs pays, les défis qu’ils/elles affrontent et les ressources dont ils/elles disposent pour parvenir à se réinsérer dans les pays d’origine. Il existe en particulier un manque important d’études qui examinent en détail la situation spécifique du retour des migrant-e-s sans-papiers et l’impact de l’aide de programmes gouvernementaux pour leur réinsertion socio-économique. Cette lacune est particulièrement marquée dans le cas de la Suisse. Confronté à la situation d’absence d’évaluations des programmes d’appui au retour des sans-papiers, et dans le but d’y apporter des améliorations possibles à son propre programme, le Service de la Population du canton de Vaud a chargé Yvonne Riaño de mener une recherche sur la situation de retour des sans-papiers retournés en Équateur entre 2008-2010 avec l’appui du programme. La recherche présentée ici se base sur un travail de terrain réalisé en Équateur en 2010. Nous avons rencontré 25 familles (70% du total des familles rentrées avec l’aide du Canton de Vaud) habitant dans diverses régions du pays et avons recueilli leurs expériences de retour. La méthodologie choisie pour la récolte des données est qualitative et combine entretiens narratifs et semi-directifs. La recherche examine les raisons d'émigration et du retour des personnes interviewées ainsi que la situation actuelle de leurs projets de réinsertion, leurs ressources disponibles et le défis auxquels elles font face pour la réalisation de leurs projets. Six principes clés sont proposés pour repenser l’aide au retour de façon à pouvoir garantir un retour viable.