Code-specific learning rules improve action selection by populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral decisions. We previously introduced reinforcement learning for population-based decision making by spiking neurons. Here we generalize population reinforcement learning to spike-based plasticity rules that take account of the postsynaptic neural code. We consider spike/no-spike, spike count and spike latency codes. The multi-valued and continuous-valued features in the postsynaptic code allow for a generalization of binary decision making to multi-valued decision making and continuous-valued action selection. We show that code-specific learning rules speed up learning both for the discrete classification and the continuous regression tasks. The suggested learning rules also speed up with increasing population size as opposed to standard reinforcement learning rules. Continuous action selection is further shown to explain realistic learning speeds in the Morris water maze. Finally, we introduce the concept of action perturbation as opposed to the classical weight- or node-perturbation as an exploration mechanism underlying reinforcement learning. Exploration in the action space greatly increases the speed of learning as compared to exploration in the neuron or weight space.

Astroblastoma with rhabdoid features and favorable long-term outcome: report of a case with a 12-year follow-up

Astroblastoma is a historically traded microscopic diagnosis to denote a rare neuroepithelial tumor of uncertain nosology, involving a distinctive pattern of pseudorosette arrangement of neoplastic cells. While displaying some glial properties, the latter shall not - by definition - be either reducible to or part of any conventional glioma type. We report on clinicopathologic correlations in a case of astroblastoma involving an extensive rhabdoid phenotype of tumor cells. The male patient was operated on at the age of 53 and 59 years for a left parietal tumor measuring 5.8 cm in diameter at the first presentation. On magnetic resonance imaging and angiography, both the primary and its recurrence were discrete, highly vascularized, and contrast-enhancing. The second surgery was complemented with radiotherapy of 66 Gy, followed by chemotherapy with Temozolomide. Twelve years into clinical history, the patient has stable minimal residual disease at the age of 65. A review of pathology samples from both surgeries showed well-differentiated astroblastoma according to current standards, with an MIB-1 labeling index of 1% and 4%, respectively. Neither of the specimens involved cellular anaplasia, overt mitotic activity, microvascular proliferation, or palisading necrosis. Most tumor cells harbored paranuclear filamentous rhabdoid inclusions that were immunostained for vimentin and, in part, also for GFAP. No polyantigenic reactivity was observed. This example contributes another facet to the spectrum of the so-called composite rhabdoid tumors. Involving a low-grade parent neoplasm, it also further substantiates the incipient perception that the rhabdoid phenotype neither is a peculiar but nonspecific convergence point of anaplastic evolution, nor are such lesions indiscriminately bound for a relentless course.