Code-specific policy gradient rules for spiking neurons

Although it is widely believed that reinforcement learning is a suitable tool for describing behavioral learning, the mechanisms by which it can be implemented in networks of spiking neurons are not fully understood. Here, we show that different learning rules emerge from a policy gradient approach depending on which features of the spike trains are assumed to influence the reward signals, i.e., depending on which neural code is in effect. We use the framework of Williams (1992) to derive learning rules for arbitrary neural codes. For illustration, we present policy-gradient rules for three different example codes - a spike count code, a spike timing code and the most general "full spike train" code - and test them on simple model problems. In addition to classical synaptic learning, we derive learning rules for intrinsic parameters that control the excitability of the neuron. The spike count learning rule has structural similarities with established Bienenstock-Cooper-Munro rules. If the distribution of the relevant spike train features belongs to the natural exponential family, the learning rules have a characteristic shape that raises interesting prediction problems.

Bayesian updating of a unified soil compression model

Some amount of differential settlement occurs even in the most uniform soil deposit, but it is extremely difficult to estimate because of the natural heterogeneity of the soil. The compression response of the soil and its variability must be characterised in order to estimate the probability of the differential settlement exceeding a certain threshold value. The work presented in this paper introduces a probabilistic framework to address this issue in a rigorous manner, while preserving the format of a typical geotechnical settlement analysis. In order to avoid dealing with different approaches for each category of soil, a simplified unified compression model is used to characterise the nonlinear compression behavior of soils of varying gradation through a single constitutive law. The Bayesian updating rule is used to incorporate information from three different laboratory datasets in the computation of the statistics (estimates of the means and covariance matrix) of the compression model parameters, as well as of the uncertainty inherent in the model.

Genetic variation of fish parasite populations in historically connected habitats: undetected habitat fragmentation effect on populations of the nematode Procamallanus fulvidraconis in the catfish Pelteobagrus fulvidraco

Habitat fragmentation may have some significant effects on population genetic structure because geographic distance and physical barriers may impede gene flow between populations. In this study, we investigated whether recent habitat fragmentation affected genetic structure and diversity of populations of the nematode Procamallanus fulvidraconis in the yellowhead catfish, Pelteobagrus fin't4draco. The nematode was collected from 12 localities in 7 floodplain lakes of the Yangtze River. Using I I intersirnple sequence repeat markers, analysis of molecular variance showed that genetic diversity occurred mainly within populations (70.26%). Expected heterozygosity (He) of P. fulvidraconis was barely different between connected (0.2105) and unconnected lakes (0.2083). Population subdivision (Fst) between connected lakes (0.2177) was higher than in unconnected lakes (0. 1676). However, the connected and unconnected lakes did not Cluster into 2 clades. A Mantel test revealed significant positive correlation between genetic and geographic distances (R = 0.5335, P < 0.01). These results suggest that habitat fragmentation did not cause genetic differentiation among populations or a reduction of diversity in isolated populations of P. fulvidraconis. At least 2 factors may increase the dispersal range of the nematode, i.e., flash flooding in summer and other species of fish that may serve as the definitive hosts. Moreover, lake fragmentation is probably a recent process; population size of the nematode in these lakes is large enough to maintain Population structure.

NK-lysin of channel catfish: Gene triplication, sequence variation, and expression analysis

Antimicrobial peptides (AMPs) are important components of the host innate immune response against microbial invasion. In addition to the previously known four classes of antimicrobial peptides, a fifth class of antimicrobial peptides has been recently identified to include NK-lysins that have a globular three-dimensional structure and are larger with 74-78 amino acid residues. NK-lysin has been shown to harbor antimicrobial activities against a wide spectrum of microorganisms including bacteria, fungi, protozoa, and parasites. To date, NK-lysin genes have been reported from only a limited number of organisms. We previously identified a NK-lysin cDNA in channel catfish. Here we report the identification of two noveltypes of NK-lysin transcripts in channel catfish. Altogether, three distinct NK-lysin transcripts exist in channel catfish. In this work, their encoding genes were identified, sequenced, and characterized. We provide strong evidence that the catfish NK-lysin gene is tripled in the same genomic neighborhood. All three catfish NK-lysin genes are present in the same genomic region and are tightly linked on the same chromosome, as the same BAC clones harbor all three copies of the NK-lysin genes. All three NK-lysin genes are expressed, but exhibit distinct expression profiles in various tissues. In spite of the existence of a single copy of NK-lysin gene in the human genome, and only a single hit from the pufferfish,genome, there are two tripled clusters of NK-lysin genes on chromosome 17 of zebrafish in addition to one more copy on its chromosome 5. The similarity in the genomic arrangement of the tripled NK-lysin genes in channel catfish and zebrafish suggest similar evolution of NK-lysin genes. (c) 2005 Elsevier Ltd. All rights reserved.

Neuro-Stimulus Chip with Photodiodes Array for Sub-retinal Implants

A prototype neuro-stimulus chip for sub-retinal implants in blind patients affected by Age-related Macular Degeneration (AMD) or Retinitis Pigmentosa (RP) is presented in this paper. This retinal prosthetic chip was designed to replace the degenerated photoreceptor cells, and in order to stimulate directly the remaining healthy layers of retinal neurons. The current stimulus circuits are monolithic integrated with photodiodes (PD) array, which can convert the illumination on the eyes into bi-phasic electrical pulses. In addition, a novel charge cancellation circuit is used to discharge the electrodes for medical safty. The prototype chip is designed and fabricated in HJTC 0.18 mu m N-well CMOS 1P6M Mix-signal process, with a +/- 2.5 V dual voltage power supply.

快速热退火对高应变InGaAs／GaAs量子阱的影响

用固态分子束外延技术生长了高应变．In0．45Ga0.55As／GaAs量子阱材料．研究了快速热退火对高应变InGaAs／GaAs量子阱材料光学性质的影响．本文采用假设InGaAs／GaAs量子阱中的In—Ga原子扩散为误差函数扩散并解任意形状量子阱的薛定谔方程的方法，对不同退火温度下InGaAs／GaAs量子阱室温光致发光峰值波长拟合，得到了In原子在高应变InGaAs／GaAs量子阱中的扩散系数以及扩散激活能（O．88ev）．