Learning Spike-Based Population Codes by Reward and Population Feedback

We investigate a recently proposed model for decision learning in a population of spiking neurons where synaptic plasticity is modulated by a population signal in addition to reward feedback. For the basic model, binary population decision making based on spike/no-spike coding, a detailed computational analysis is given about how learning performance depends on population size and task complexity. Next, we extend the basic model to n-ary decision making and show that it can also be used in conjunction with other population codes such as rate or even latency coding.

Age-modulated association between prefrontal NAA and the BDNF gene

Brain-derived neurotrophic factor (BDNF) has been implicated in the pathophysiology of psychiatric and neurological disorders and in the mechanisms of antidepressant pharmacotherapy. Psychiatric and neurological conditions have also been associated with reduced brain levels of N-acetyl-aspartate (NAA), which has been used as a putative marker of neural integrity. However, few studies have explored the relationship between BDNF polymorphisms and NAA levels directly. Here, we present data from a single-voxel proton magnetic resonance spectroscopy study of 64 individuals and explore the relationship between BDNF polymorphisms and prefrontal NAA level. Our results indicate an association between a single nucleotide polymorphism (SNP) within BDNF, known as rs1519480, and reduced NAA level (p = 0.023). NAA levels were further predicted by age and Asian ancestry. There was a significant rs1519480 × age interaction on NAA level (p = 0.031). Specifically, the effect of rs1519480 on NAA level became significant at age ⩾34.17 yr. NAA level decreased with advancing age for genotype TT (p = 0.001) but not for genotype CT (p = 0.82) or CC (p = 0.34). Additional in silico analysis of 142 post-mortem brain samples revealed an association between the same SNP and reduced BDNF mRNA expression in the prefrontal cortex. The rs1519480 SNP influences BDNF mRNA expression and has an impact on prefrontal NAA level over time. This genetic mechanism may contribute to inter-individual variation in cognitive performance seen during normal ageing, as well as contributing to the risk for developing psychiatric and neurological conditions.

Glycoprotein Ib cross-linking/ligation on echicetin-coated surfaces or echicetin-IgMkappa in stirred suspension activates platelets by cytoskeleton modulated calcium release

Cross-linking platelet GPIb with the snake C-type lectin echicetin provides a specific technique for activation via this receptor. This allows GPIb-dependent mechanisms to be studied without the necessity for shear stress-induced binding of von Willebrand factor or primary alpha(IIb)beta(3) involvement. We already showed that platelets are activated, including tyrosine phosphorylation, by echicetin-IgMkappa-induced GPIb cross-linking. We now investigate the mechanism further and demonstrate that platelets, without modulator reagents, spread directly on an echicetin-coated surface, by a GPIb-specific mechanism, causing exocytosis of alpha-granule markers (P-selectin) and activation of alpha(IIb)beta(3). This spreading requires actin polymerization and release of internal calcium stores but is not dependent on external calcium nor on src family tyrosine kinases. Cross-linking of GPIb complex molecules on platelets, either in suspension or via specific surface attachment, is sufficient to induce platelet activation.

PLACENTAL URIC ACID TRANSPORTER GLUT9 IS MODULATED BY FREE IODINE

PLACENTAL URIC ACID TRANSPORTER GLUT9 IS MODULATED BY FREE IODINE Objectives: Materno-fetal transplacental transport is crucial for the fetal well-being. The altered expression of placental transport proteins under specific pathophysiological conditions may affect the intrauterine environment. Pre-eclampsia is often associated with high maternal uric acid serum levels. The regulation of the placental uric transport system and its transporter glucose transporter (GLUT)-9 are not fully understood yet. The aim of this study was to investigate the placental urate transport and to characterize its transporter GLUT9. Methods: In this study we used a transepithelial transport (Transwell®) model to assess uric acid transport activity. Electrophysiological techniques and radioactive ligand up-take assays were used to measure transport activity of GLUT9 expressed in Xenopus oocytes. Results: In the Transwell/model uric acid is transported across the BeWo choriocarcinoma cell monolayer with 530 pmol/min at the linear stage. We could successfully over-express GLUT9 using the Xenopus laevis oocytes expression system. Chloride modulates the urate transport system: interestingly replacing chloride with iodine resulted in a complete loss of urate transport activity.We determined the IC50 of iodine at 30uM concentration. In radioactive up-take experiments iodinehad noeffect on uric acid transport. Conclusions: In vitro the “materno-fetal” transport of uric acid is slow. This indicates that in vivo the child is protected from short-term fluctuations of maternal uric acid serum concentrations. The different results regarding iodine-mediated regulation of GLUT9 transport activity between electrophysiological and radioactive ligand uptake experiments may suggest that iodine does not directly inhibit uric acid transport, but changes the mode of up-take from an electrogenic to an electroneutral transport. GLUT9 is not an uric acid uniporter, there are more ions involved in the transport. This may allow regulating uric acid transport by the change from an active to a passive transport.

Valence and agency influence striatal response to feedback in patients with major depressive disorder

BACKGROUND: Reduced sensitivity to positive feedback is common in patients with major depressive disorder (MDD). However, findings regarding negative feedback are ambiguous, with both exaggerated and blunted responses being reported. The ventral striatum (VS) plays a major role in processing valenced feedback, and previous imaging studies have shown that the locus of controls (self agency v. external agency) over the outcome influences VS response to feedback. We investigated whether attributing the outcome to one's own action or to an external agent influences feedback processing in patients with MDD. We hypothesized that depressed participants would be less sensitive to the feedback attribution reflected by an altered VS response to self-attributed gains and losses. METHODS: Using functional MRI and a motion prediction task, we investigated the neural responses to self-attributed (SA) and externally attributed (EA) monetary gains and losses in unmedicated patients with MDD and healthy controls. RESULTS: We included 21 patients and 25 controls in our study. Consistent with our prediction, healthy controls showed a VS response influenced by feedback valence and attribution, whereas in depressed patients striatal activity was modulated by valence but was insensitive to attribution. This attribution insensitivity led to an altered ventral putamen response for SA - EA losses in patients with MDD compared with healthy controls. LIMITATIONS: Depressed patients with comorbid anxiety disorder were included. CONCLUSION: These results suggest an altered assignment of motivational salience to SA losses in patients with MDD. Altered striatal response to SA negative events may reinforce the belief of not being in control of negative outcomes contributing to a cycle of learned helplessness.

Intensity-modulated radiotherapy for a rendu-osler-weber disease patient with recurrent severe epistaxis: a case report

We present a case of a Rendu-Osler-Weber disease patient with recurrent life threatening epistaxis demanding multiple blood transfusions despite of repetitive endoscopic laser and electrocoagulations, endovascular embolisation, septodermoplasty, and long-term intranasal dressings. As alternative treatment modalities repeatedly failed and the patient became almost permanently dependent on nasal dressing, we performed a highly conformal intensity-modulated radiotherapy of the nasal cavity; a total dose of 50 Gy in 2 Gy single fractions was applied. The therapy was very well tolerated, no acute toxicities occurred. Two weeks after the last radiation dose had been applied, the nasal dressing could be removed without problems. Endoscopical control revealed an almost avascular white mucosa without any trace of bleeding spots; previously existing hemangiomas and crusts had disappeared. After a 1-year-follow up, the patient had no significant recurrent epistaxis.

High-dose (80 Gy) intensity-modulated radiation therapy with daily image-guidance as primary treatment for localized prostate cancer

to report acute and late toxicity in prostate cancer patients treated by high-dose intensity-modulated radiation therapy (IMRT) with daily image-guidance.

Urethral toxicity vs. cancer control-Lessons to be learned from high-dose rate brachytherapy combined with intensity-modulated radiation therapy in intermediate- and high-risk prostate cancer

To describe biochemical relapse-free survival (BRFS) and late toxicity after combined high-dose rate brachytherapy (HDR-B) and intensity-modulated radiation therapy (IMRT) in intermediate- and high-risk prostate cancer patients.

Intensity modulated radiation therapy or stereotactic fractionated radiotherapy for infratentorial ependymoma in children: a multicentric study

This study was to evaluate the treatment dosimetry, efficacy and toxicity of intensity modulated radiation therapy (IMRT) and fractionated stereotactic radiotherapy (FSRT) in the management of infratentorial ependymoma. Between 1999 and 2007, seven children (median age, 3.1 years) with infratentorial ependymoma were planned with either IMRT (3 patients) or SFRT (4 patients), the latter after conventional posterior fossa irradiation. Two children underwent gross total resection. Median prescribed dose was 59.4 Gy (range, 55.8-60). The median follow-up for surviving patients was 4.8 years (range, 1.3-8). IMRT (median dose, 59.4 Gy) and FSRT (median dose, 55.8 Gy) achieved similar optimal target coverage. Percentages of maximum doses delivered to the cochleae (59.5 vs 85.0% Gy; P = 0.05) were significantly inferior with IMRT, when compared to FSRT planning. Percentages of maximum doses administered to the pituitary gland (38.2 vs 20.1%; P = 0.05) and optic chiasm (38.1 vs 14.1%; P = 0.001) were, however, significantly higher with IMRT, when compared to FSRT planning. No recurrences were observed at the last follow-up. The estimated 3-year progression-free survival and overall survival were 87.5 and 100%, respectively. No grade >1 acute toxicity was observed. Two patients presented late adverse events (grade 2 hypoacousia) during follow-up, without cognitive impairment. IMRT or FSRT for infratentorial ependymomas is effective and associated with a tolerable toxicity level. Both treatment techniques were able to capitalize their intrinsic conformal ability to deliver high-dose radiation. Larger series of patients treated with these two modalities will be necessary to more fully evaluate these delivery techniques.

Spatio-temporal credit assignment in population learning

Learning by reinforcement is important in shaping animal behavior, and in particular in behavioral decision making. Such decision making is likely to involve the integration of many synaptic events in space and time. However, using a single reinforcement signal to modulate synaptic plasticity, as suggested in classical reinforcement learning algorithms, a twofold problem arises. Different synapses will have contributed differently to the behavioral decision, and even for one and the same synapse, releases at different times may have had different effects. Here we present a plasticity rule which solves this spatio-temporal credit assignment problem in a population of spiking neurons. The learning rule is spike-time dependent and maximizes the expected reward by following its stochastic gradient. Synaptic plasticity is modulated not only by the reward, but also by a population feedback signal. While this additional signal solves the spatial component of the problem, the temporal one is solved by means of synaptic eligibility traces. In contrast to temporal difference (TD) based approaches to reinforcement learning, our rule is explicit with regard to the assumed biophysical mechanisms. Neurotransmitter concentrations determine plasticity and learning occurs fully online. Further, it works even if the task to be learned is non-Markovian, i.e. when reinforcement is not determined by the current state of the system but may also depend on past events. The performance of the model is assessed by studying three non-Markovian tasks. In the first task, the reward is delayed beyond the last action with non-related stimuli and actions appearing in between. The second task involves an action sequence which is itself extended in time and reward is only delivered at the last action, as it is the case in any type of board-game. The third task is the inspection game that has been studied in neuroeconomics, where an inspector tries to prevent a worker from shirking. Applying our algorithm to this game yields a learning behavior which is consistent with behavioral data from humans and monkeys, revealing themselves properties of a mixed Nash equilibrium. The examples show that our neuronal implementation of reward based learning copes with delayed and stochastic reward delivery, and also with the learning of mixed strategies in two-opponent games.

Spatio-temporal credit assignment in population learning

Learning by reinforcement is important in shaping animal behavior. But behavioral decision making is likely to involve the integration of many synaptic events in space and time. So in using a single reinforcement signal to modulate synaptic plasticity a twofold problem arises. Different synapses will have contributed differently to the behavioral decision and, even for one and the same synapse, releases at different times may have had different effects. Here we present a plasticity rule which solves this spatio-temporal credit assignment problem in a population of spiking neurons. The learning rule is spike time dependent and maximizes the expected reward by following its stochastic gradient. Synaptic plasticity is modulated not only by the reward but by a population feedback signal as well. While this additional signal solves the spatial component of the problem, the temporal one is solved by means of synaptic eligibility traces. In contrast to temporal difference based approaches to reinforcement learning, our rule is explicit with regard to the assumed biophysical mechanisms. Neurotransmitter concentrations determine plasticity and learning occurs fully online. Further, it works even if the task to be learned is non-Markovian, i.e. when reinforcement is not determined by the current state of the system but may also depend on past events. The performance of the model is assessed by studying three non-Markovian tasks. In the first task the reward is delayed beyond the last action with non-related stimuli and actions appearing in between. The second one involves an action sequence which is itself extended in time and reward is only delivered at the last action, as is the case in any type of board-game. The third is the inspection game that has been studied in neuroeconomics. It only has a mixed Nash equilibrium and exemplifies that the model also copes with stochastic reward delivery and the learning of mixed strategies.

Expression of the nociceptin precursor and nociceptin receptor is modulated in cancer and septic patients

A role of nociceptin and its receptor (NOP) in pain and immune function has been suggested. The hypothesis was that mRNA expression of NOP and the nociceptin precursor pre-pronociceptin (pN/OFQ) in peripheral blood cells differs in end-stage cancer patients suffering from chronic pain and septic intensive care unit (ICU) patients compared with healthy controls.

Effects and limitations of an AED with audiovisual feedback for cardiopulmonary resuscitation: a randomized manikin study

Correctly performed basic life support (BLS) and early defibrillation are the most effective measures to treat sudden cardiac arrest. Audiovisual feedback improves BLS. Automated external defibrillators (AED) with feedback technology may play an important role in improving CPR quality. The aim of this simulation study was to investigate if an AED with audiovisual feedback improves CPR parameters during standard BLS performed by trained laypersons.