Spatio-Temporal Credit Assignment in Neuronal Population Learning

n learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain.

Correcting mortality for loss to follow-up: a nomogram applied to antiretroviral treatment programmes in sub-Saharan Africa

Background The World Health Organization estimates that in sub-Saharan Africa about 4 million HIV-infected patients had started antiretroviral therapy (ART) by the end of 2008. Loss of patients to follow-up and care is an important problem for treatment programmes in this region. As mortality is high in these patients compared to patients remaining in care, ART programmes with high rates of loss to follow-up may substantially underestimate mortality of all patients starting ART. Methods and Findings We developed a nomogram to correct mortality estimates for loss to follow-up, based on the fact that mortality of all patients starting ART in a treatment programme is a weighted average of mortality among patients lost to follow-up and patients remaining in care. The nomogram gives a correction factor based on the percentage of patients lost to follow-up at a given point in time, and the estimated ratio of mortality between patients lost and not lost to follow-up. The mortality observed among patients retained in care is then multiplied by the correction factor to obtain an estimate of programme-level mortality that takes all deaths into account. A web calculator directly calculates the corrected, programme-level mortality with 95% confidence intervals (CIs). We applied the method to 11 ART programmes in sub-Saharan Africa. Patients retained in care had a mortality at 1 year of 1.4% to 12.0%; loss to follow-up ranged from 2.8% to 28.7%; and the correction factor from 1.2 to 8.0. The absolute difference between uncorrected and corrected mortality at 1 year ranged from 1.6% to 9.8%, and was above 5% in four programmes. The largest difference in mortality was in a programme with 28.7% of patients lost to follow-up at 1 year. Conclusions The amount of bias in mortality estimates can be large in ART programmes with substantial loss to follow-up. Programmes should routinely report mortality among patients retained in care and the proportion of patients lost. A simple nomogram can then be used to estimate mortality among all patients who started ART, for a range of plausible mortality rates among patients lost to follow-up.

Intravaginal practices, bacterial vaginosis, and HIV infection in women: individual participant data meta-analysis

Background Identifying modifiable factors that increase women's vulnerability to HIV is a critical step in developing effective female-initiated prevention interventions. The primary objective of this study was to pool individual participant data from prospective longitudinal studies to investigate the association between intravaginal practices and acquisition of HIV infection among women in sub-Saharan Africa. Secondary objectives were to investigate associations between intravaginal practices and disrupted vaginal flora; and between disrupted vaginal flora and HIV acquisition. Methods and Findings We conducted a meta-analysis of individual participant data from 13 prospective cohort studies involving 14,874 women, of whom 791 acquired HIV infection during 21,218 woman years of follow-up. Data were pooled using random-effects meta-analysis. The level of between-study heterogeneity was low in all analyses (I2 values 0.0%–16.1%). Intravaginal use of cloth or paper (pooled adjusted hazard ratio [aHR] 1.47, 95% confidence interval [CI] 1.18–1.83), insertion of products to dry or tighten the vagina (aHR 1.31, 95% CI 1.00–1.71), and intravaginal cleaning with soap (aHR 1.24, 95% CI 1.01–1.53) remained associated with HIV acquisition after controlling for age, marital status, and number of sex partners in the past 3 months. Intravaginal cleaning with soap was also associated with the development of intermediate vaginal flora and bacterial vaginosis in women with normal vaginal flora at baseline (pooled adjusted odds ratio [OR] 1.24, 95% CI 1.04–1.47). Use of cloth or paper was not associated with the development of disrupted vaginal flora. Intermediate vaginal flora and bacterial vaginosis were each associated with HIV acquisition in multivariable models when measured at baseline (aHR 1.54 and 1.69, p<0.001) or at the visit before the estimated date of HIV infection (aHR 1.41 and 1.53, p<0.001), respectively. Conclusions This study provides evidence to suggest that some intravaginal practices increase the risk of HIV acquisition but a direct causal pathway linking intravaginal cleaning with soap, disruption of vaginal flora, and HIV acquisition has not yet been demonstrated. More consistency in the definition and measurement of specific intravaginal practices is warranted so that the effects of specific intravaginal practices and products can be further elucidated.

Mechanisms of osteoclastogenesis inhibition by a novel class of biphenyl-type cannabinoid CB(2) receptor inverse agonists

The cannabinoid CB(2) receptor is known to modulate osteoclast function by poorly understood mechanisms. Here, we report that the natural biphenyl neolignan 4'-O-methylhonokiol (MH) is a CB(2) receptor-selective antiosteoclastogenic lead structure (K(i) < 50 nM). Intriguingly, MH triggers a simultaneous G(i) inverse agonist response and a strong CB(2) receptor-dependent increase in intracellular calcium. The most active inverse agonists from a library of MH derivatives inhibited osteoclastogenesis in RANK ligand-stimulated RAW264.7 cells and primary human macrophages. Moreover, these ligands potently inhibited the osteoclastogenic action of endocannabinoids. Our data show that CB(2) receptor-mediated cAMP formation, but not intracellular calcium, is crucially involved in the regulation of osteoclastogenesis, primarily by inhibiting macrophage chemotaxis and TNF-α expression. MH is an easily accessible CB(2) receptor-selective scaffold that exhibits a novel type of functional heterogeneity.

Proteins encoded in genomic regions associated with immune-mediated disease physically interact and suggest underlying biology

Genome-wide association studies (GWAS) have defined over 150 genomic regions unequivocally containing variation predisposing to immune-mediated disease. Inferring disease biology from these observations, however, hinges on our ability to discover the molecular processes being perturbed by these risk variants. It has previously been observed that different genes harboring causal mutations for the same Mendelian disease often physically interact. We sought to evaluate the degree to which this is true of genes within strongly associated loci in complex disease. Using sets of loci defined in rheumatoid arthritis (RA) and Crohn's disease (CD) GWAS, we build protein-protein interaction (PPI) networks for genes within associated loci and find abundant physical interactions between protein products of associated genes. We apply multiple permutation approaches to show that these networks are more densely connected than chance expectation. To confirm biological relevance, we show that the components of the networks tend to be expressed in similar tissues relevant to the phenotypes in question, suggesting the network indicates common underlying processes perturbed by risk loci. Furthermore, we show that the RA and CD networks have predictive power by demonstrating that proteins in these networks, not encoded in the confirmed list of disease associated loci, are significantly enriched for association to the phenotypes in question in extended GWAS analysis. Finally, we test our method in 3 non-immune traits to assess its applicability to complex traits in general. We find that genes in loci associated to height and lipid levels assemble into significantly connected networks but did not detect excess connectivity among Type 2 Diabetes (T2D) loci beyond chance. Taken together, our results constitute evidence that, for many of the complex diseases studied here, common genetic associations implicate regions encoding proteins that physically interact in a preferential manner, in line with observations in Mendelian disease.

A research agenda for malaria eradication: basic science and enabling technologies

Today's malaria control efforts are limited by our incomplete understanding of the biology of Plasmodium and of the complex relationships between human populations and the multiple species of mosquito and parasite. Research priorities include the development of in vitro culture systems for the complete life cycle of P. falciparum and P. vivax and the development of an appropriate liver culture system to study hepatic stages. In addition, genetic technologies for the manipulation of Plasmodium need to be improved, the entire parasite metabolome needs to be characterized to identify new druggable targets, and improved information systems for monitoring the changes in epidemiology, pathology, and host-parasite-vector interactions as a result of intensified control need to be established to bridge the gap between bench, preclinical, clinical, and population-based sciences.

Hostile takeover by Plasmodium: reorganization of parasite and host cell membranes during liver stage egress

The protozoan parasite Plasmodium is transmitted by female Anopheles mosquitoes and undergoes obligatory development within a parasitophorous vacuole in hepatocytes before it is released into the bloodstream. The transition to the blood stage was previously shown to involve the packaging of exoerythrocytic merozoites into membrane-surrounded vesicles, called merosomes, which are delivered directly into liver sinusoids. However, it was unclear whether the membrane of these merosomes was derived from the parasite membrane, the parasitophorous vacuole membrane or the host cell membrane. This knowledge is required to determine how phagocytes will be directed against merosomes. Here, we fluorescently label the candidate membranes and use live cell imaging to show that the merosome membrane derives from the host cell membrane. We also demonstrate that proteins in the host cell membrane are lost during merozoite liberation from the parasitophorous vacuole. Immediately after the breakdown of the parasitophorous vacuole membrane, the host cell mitochondria begin to degenerate and protein biosynthesis arrests. The intact host cell plasma membrane surrounding merosomes allows Plasmodium to mask itself from the host immune system and bypass the numerous Kupffer cells on its way into the bloodstream. This represents an effective strategy for evading host defenses before establishing a blood stage infection.

Collapse of telomere homeostasis in hematopoietic cells caused by heterozygous mutations in telomerase genes

Telomerase activity is readily detectable in extracts from human hematopoietic stem and progenitor cells, but appears unable to maintain telomere length with proliferation in vitro and with age in vivo. We performed a detailed study of the telomere length by flow FISH analysis in leukocytes from 835 healthy individuals and 60 individuals with reduced telomerase activity. Healthy individuals showed a broad range in average telomere length in granulocytes and lymphocytes at any given age. The average telomere length declined with age at a rate that differed between age-specific breakpoints and between cell types. Gender differences between leukocyte telomere lengths were observed for all cell subsets studied; interestingly, this trend could already be detected at birth. Heterozygous carriers for mutations in either the telomerase reverse transcriptase (hTERT) or the telomerase RNA template (hTERC) gene displayed striking and comparable telomere length deficits. Further, non-carrier relatives of such heterozygous individuals had somewhat shorter leukocyte telomere lengths than expected; this difference was most profound for granulocytes. Failure to maintain telomere homeostasis as a result of partial telomerase deficiency is thought to trigger cell senescence or cell death, eventually causing tissue failure syndromes. Our data are consistent with these statements and suggest that the likelihood of similar processes occurring in normal individuals increases with age. Our work highlights the essential role of telomerase in the hematopoietic system and supports the notion that telomerase levels in hematopoietic cells, while limiting and unable to prevent overall telomere shortening, are nevertheless crucial to maintain telomere homeostasis with age.

LGI2 truncation causes a remitting focal epilepsy in dogs

One quadrillion synapses are laid in the first two years of postnatal construction of the human brain, which are then pruned until age 10 to 500 trillion synapses composing the final network. Genetic epilepsies are the most common neurological diseases with onset during pruning, affecting 0.5% of 2-10-year-old children, and these epilepsies are often characterized by spontaneous remission. We previously described a remitting epilepsy in the Lagotto romagnolo canine breed. Here, we identify the gene defect and affected neurochemical pathway. We reconstructed a large Lagotto pedigree of around 34 affected animals. Using genome-wide association in 11 discordant sib-pairs from this pedigree, we mapped the disease locus to a 1.7 Mb region of homozygosity in chromosome 3 where we identified a protein-truncating mutation in the Lgi2 gene, a homologue of the human epilepsy gene LGI1. We show that LGI2, like LGI1, is neuronally secreted and acts on metalloproteinase-lacking members of the ADAM family of neuronal receptors, which function in synapse remodeling, and that LGI2 truncation, like LGI1 truncations, prevents secretion and ADAM interaction. The resulting epilepsy onsets at around seven weeks (equivalent to human two years), and remits by four months (human eight years), versus onset after age eight in the majority of human patients with LGI1 mutations. Finally, we show that Lgi2 is expressed highly in the immediate post-natal period until halfway through pruning, unlike Lgi1, which is expressed in the latter part of pruning and beyond. LGI2 acts at least in part through the same ADAM receptors as LGI1, but earlier, ensuring electrical stability (absence of epilepsy) during pruning years, preceding this same function performed by LGI1 in later years. LGI2 should be considered a candidate gene for common remitting childhood epilepsies, and LGI2-to-LGI1 transition for mechanisms of childhood epilepsy remission.