Spatio-Temporal Credit Assignment in Neuronal Population Learning

n learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain.

Intravaginal practices, bacterial vaginosis, and HIV infection in women: individual participant data meta-analysis

Background Identifying modifiable factors that increase women's vulnerability to HIV is a critical step in developing effective female-initiated prevention interventions. The primary objective of this study was to pool individual participant data from prospective longitudinal studies to investigate the association between intravaginal practices and acquisition of HIV infection among women in sub-Saharan Africa. Secondary objectives were to investigate associations between intravaginal practices and disrupted vaginal flora; and between disrupted vaginal flora and HIV acquisition. Methods and Findings We conducted a meta-analysis of individual participant data from 13 prospective cohort studies involving 14,874 women, of whom 791 acquired HIV infection during 21,218 woman years of follow-up. Data were pooled using random-effects meta-analysis. The level of between-study heterogeneity was low in all analyses (I2 values 0.0%–16.1%). Intravaginal use of cloth or paper (pooled adjusted hazard ratio [aHR] 1.47, 95% confidence interval [CI] 1.18–1.83), insertion of products to dry or tighten the vagina (aHR 1.31, 95% CI 1.00–1.71), and intravaginal cleaning with soap (aHR 1.24, 95% CI 1.01–1.53) remained associated with HIV acquisition after controlling for age, marital status, and number of sex partners in the past 3 months. Intravaginal cleaning with soap was also associated with the development of intermediate vaginal flora and bacterial vaginosis in women with normal vaginal flora at baseline (pooled adjusted odds ratio [OR] 1.24, 95% CI 1.04–1.47). Use of cloth or paper was not associated with the development of disrupted vaginal flora. Intermediate vaginal flora and bacterial vaginosis were each associated with HIV acquisition in multivariable models when measured at baseline (aHR 1.54 and 1.69, p<0.001) or at the visit before the estimated date of HIV infection (aHR 1.41 and 1.53, p<0.001), respectively. Conclusions This study provides evidence to suggest that some intravaginal practices increase the risk of HIV acquisition but a direct causal pathway linking intravaginal cleaning with soap, disruption of vaginal flora, and HIV acquisition has not yet been demonstrated. More consistency in the definition and measurement of specific intravaginal practices is warranted so that the effects of specific intravaginal practices and products can be further elucidated.

Proteins encoded in genomic regions associated with immune-mediated disease physically interact and suggest underlying biology

Genome-wide association studies (GWAS) have defined over 150 genomic regions unequivocally containing variation predisposing to immune-mediated disease. Inferring disease biology from these observations, however, hinges on our ability to discover the molecular processes being perturbed by these risk variants. It has previously been observed that different genes harboring causal mutations for the same Mendelian disease often physically interact. We sought to evaluate the degree to which this is true of genes within strongly associated loci in complex disease. Using sets of loci defined in rheumatoid arthritis (RA) and Crohn's disease (CD) GWAS, we build protein-protein interaction (PPI) networks for genes within associated loci and find abundant physical interactions between protein products of associated genes. We apply multiple permutation approaches to show that these networks are more densely connected than chance expectation. To confirm biological relevance, we show that the components of the networks tend to be expressed in similar tissues relevant to the phenotypes in question, suggesting the network indicates common underlying processes perturbed by risk loci. Furthermore, we show that the RA and CD networks have predictive power by demonstrating that proteins in these networks, not encoded in the confirmed list of disease associated loci, are significantly enriched for association to the phenotypes in question in extended GWAS analysis. Finally, we test our method in 3 non-immune traits to assess its applicability to complex traits in general. We find that genes in loci associated to height and lipid levels assemble into significantly connected networks but did not detect excess connectivity among Type 2 Diabetes (T2D) loci beyond chance. Taken together, our results constitute evidence that, for many of the complex diseases studied here, common genetic associations implicate regions encoding proteins that physically interact in a preferential manner, in line with observations in Mendelian disease.

A research agenda for malaria eradication: basic science and enabling technologies

Today's malaria control efforts are limited by our incomplete understanding of the biology of Plasmodium and of the complex relationships between human populations and the multiple species of mosquito and parasite. Research priorities include the development of in vitro culture systems for the complete life cycle of P. falciparum and P. vivax and the development of an appropriate liver culture system to study hepatic stages. In addition, genetic technologies for the manipulation of Plasmodium need to be improved, the entire parasite metabolome needs to be characterized to identify new druggable targets, and improved information systems for monitoring the changes in epidemiology, pathology, and host-parasite-vector interactions as a result of intensified control need to be established to bridge the gap between bench, preclinical, clinical, and population-based sciences.

Hostile takeover by Plasmodium: reorganization of parasite and host cell membranes during liver stage egress

The protozoan parasite Plasmodium is transmitted by female Anopheles mosquitoes and undergoes obligatory development within a parasitophorous vacuole in hepatocytes before it is released into the bloodstream. The transition to the blood stage was previously shown to involve the packaging of exoerythrocytic merozoites into membrane-surrounded vesicles, called merosomes, which are delivered directly into liver sinusoids. However, it was unclear whether the membrane of these merosomes was derived from the parasite membrane, the parasitophorous vacuole membrane or the host cell membrane. This knowledge is required to determine how phagocytes will be directed against merosomes. Here, we fluorescently label the candidate membranes and use live cell imaging to show that the merosome membrane derives from the host cell membrane. We also demonstrate that proteins in the host cell membrane are lost during merozoite liberation from the parasitophorous vacuole. Immediately after the breakdown of the parasitophorous vacuole membrane, the host cell mitochondria begin to degenerate and protein biosynthesis arrests. The intact host cell plasma membrane surrounding merosomes allows Plasmodium to mask itself from the host immune system and bypass the numerous Kupffer cells on its way into the bloodstream. This represents an effective strategy for evading host defenses before establishing a blood stage infection.

TGF-b2 induction regulates invasiveness of Theileria-transformed leukocytes and disease susceptibility

Theileria parasites invade and transform bovine leukocytes causing either East Coast fever (T. parva), or tropical theileriosis (T. annulata). Susceptible animals usually die within weeks of infection, but indigenous infected cattle show markedly reduced pathology, suggesting that host genetic factors may cause disease susceptibility. Attenuated live vaccines are widely used to control tropical theileriosis and attenuation is associated with reduced invasiveness of infected macrophages in vitro. Disease pathogenesis is therefore linked to aggressive invasiveness, rather than uncontrolled proliferation of Theileria-infected leukocytes. We show that the invasive potential of Theileria-transformed leukocytes involves TGF-b signalling. Attenuated live vaccine lines express reduced TGF-b2 and their invasiveness can be rescued with exogenous TGF-b. Importantly, infected macrophages from disease susceptible Holstein-Friesian (HF) cows express more TGF-b2 and traverse Matrigel with great efficiency compared to those from disease-resistant Sahiwal cattle. Thus, TGF-b2 levels correlate with disease susceptibility. Using fluorescence and time-lapse video microscopy we show that Theileria-infected, disease-susceptible HF macrophages exhibit increased actin dynamics in their lamellipodia and podosomal adhesion structures and develop more membrane blebs. TGF-b2-associated invasiveness in HF macrophages has a transcription-independent element that relies on cytoskeleton remodelling via activation of Rho kinase (ROCK). We propose that a TGF-b autocrine loop confers an amoeboid-like motility on Theileria-infected leukocytes, which combines with MMP-dependent motility to drive invasiveness and virulence.

Uncovering the dynamics of cardiac systems using stochastic pacing and frequency domain analyses

Alternans of cardiac action potential duration (APD) is a well-known arrhythmogenic mechanism which results from dynamical instabilities. The propensity to alternans is classically investigated by examining APD restitution and by deriving APD restitution slopes as predictive markers. However, experiments have shown that such markers are not always accurate for the prediction of alternans. Using a mathematical ventricular cell model known to exhibit unstable dynamics of both membrane potential and Ca2+ cycling, we demonstrate that an accurate marker can be obtained by pacing at cycle lengths (CLs) varying randomly around a basic CL (BCL) and by evaluating the transfer function between the time series of CLs and APDs using an autoregressive-moving-average (ARMA) model. The first pole of this transfer function corresponds to the eigenvalue (λalt) of the dominant eigenmode of the cardiac system, which predicts that alternans occurs when λalt≤−1. For different BCLs, control values of λalt were obtained using eigenmode analysis and compared to the first pole of the transfer function estimated using ARMA model fitting in simulations of random pacing protocols. In all versions of the cell model, this pole provided an accurate estimation of λalt. Furthermore, during slow ramp decreases of BCL or simulated drug application, this approach predicted the onset of alternans by extrapolating the time course of the estimated λalt. In conclusion, stochastic pacing and ARMA model identification represents a novel approach to predict alternans without making any assumptions about its ionic mechanisms. It should therefore be applicable experimentally for any type of myocardial cell.

CD4 cell count and the risk of AIDS or death in HIV-Infected adults on combination antiretroviral therapy with a suppressed viral load: a longitudinal cohort study from COHERE

Background Most adults infected with HIV achieve viral suppression within a year of starting combination antiretroviral therapy (cART). It is important to understand the risk of AIDS events or death for patients with a suppressed viral load. Methods and Findings Using data from the Collaboration of Observational HIV Epidemiological Research Europe (2010 merger), we assessed the risk of a new AIDS-defining event or death in successfully treated patients. We accumulated episodes of viral suppression for each patient while on cART, each episode beginning with the second of two consecutive plasma viral load measurements <50 copies/µl and ending with either a measurement >500 copies/µl, the first of two consecutive measurements between 50–500 copies/µl, cART interruption or administrative censoring. We used stratified multivariate Cox models to estimate the association between time updated CD4 cell count and a new AIDS event or death or death alone. 75,336 patients contributed 104,265 suppression episodes and were suppressed while on cART for a median 2.7 years. The mortality rate was 4.8 per 1,000 years of viral suppression. A higher CD4 cell count was always associated with a reduced risk of a new AIDS event or death; with a hazard ratio per 100 cells/µl (95% CI) of: 0.35 (0.30–0.40) for counts <200 cells/µl, 0.81 (0.71–0.92) for counts 200 to <350 cells/µl, 0.74 (0.66–0.83) for counts 350 to <500 cells/µl, and 0.96 (0.92–0.99) for counts ≥500 cells/µl. A higher CD4 cell count became even more beneficial over time for patients with CD4 cell counts <200 cells/µl. Conclusions Despite the low mortality rate, the risk of a new AIDS event or death follows a CD4 cell count gradient in patients with viral suppression. A higher CD4 cell count was associated with the greatest benefit for patients with a CD4 cell count <200 cells/µl but still some slight benefit for those with a CD4 cell count ≥500 cells/µl.

Design, synthesis, and biological evaluation of somatostatin-based radiopeptides

The prototypes for tumor targeting with radiolabeled peptides are derivatives of somatostatin. Usually, they primarily have high affinity for somatostatin receptor subtype 2 (sst2), and they have moderate affinity for sst5. We aimed at developing analogs that recognize different somatostatin receptor subtypes for internal radiotherapy in order to extend the present range of accessible tumors. We synthesized DOTA-octapeptides based on octreotide by replacing Phe3 mainly with unnatural amino acids. The affinity profile was determined by using cell lines transfected with sst1-5. Internalization was determined by using AR42J, HEK-sst3, and HEK-sst5 cell lines, and biodistribution was studied in rat tumor models. Two of the derivatives thus obtained showed an improved binding affinity profile, enhanced internalization into cells expressing sst2 and sst3, respectively, and better tumor:kidney ratios in animals.

Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration

Much medical research is observational. The reporting of observational studies is often of insufficient quality. Poor reporting hampers the assessment of the strengths and weaknesses of a study and the generalisability of its results. Taking into account empirical evidence and theoretical considerations, a group of methodologists, researchers, and editors developed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) recommendations to improve the quality of reporting of observational studies. The STROBE Statement consists of a checklist of 22 items, which relate to the title, abstract, introduction, methods, results and discussion sections of articles. Eighteen items are common to cohort studies, case-control studies and cross-sectional studies and four are specific to each of the three study designs. The STROBE Statement provides guidance to authors about how to improve the reporting of observational studies and facilitates critical appraisal and interpretation of studies by reviewers, journal editors and readers. This explanatory and elaboration document is intended to enhance the use, understanding, and dissemination of the STROBE Statement. The meaning and rationale for each checklist item are presented. For each item, one or several published examples and, where possible, references to relevant empirical studies and methodological literature are provided. Examples of useful flow diagrams are also included. The STROBE Statement, this document, and the associated Web site (http://www.strobe-statement.org/) should be helpful resources to improve reporting of observational research.

Genetic Variation and Population Structure in Native Americans

We examined genetic diversity and population structure in the American landmass using 678 autosomal microsatellite markers genotyped in 422 individuals representing 24 Native American populations sampled from North, Central, and South America. These data were analyzed jointly with similar data available in 54 other indigenous populations worldwide, including an additional five Native American groups. The Native American populations have lower genetic diversity and greater differentiation than populations from other continental regions. We observe gradients both of decreasing genetic diversity as a function of geographic distance from the Bering Strait and of decreasing genetic similarity to Siberians-signals of the southward dispersal of human populations from the northwestern tip of the Americas. We also observe evidence of: (1) a higher level of diversity and lower level of population structure in western South America compared to eastern South America, (2) a relative lack of differentiation between Mesoamerican and Andean populations, (3) a scenario in which coastal routes were easier for migrating peoples to traverse in comparison with inland routes, and (4) a partial agreement on a local scale between genetic similarity and the linguistic classification of populations. These findings offer new insights into the process of population dispersal and differentiation during the peopling of the Americas.

Insulin resistance, obesity and the metabolic syndrome. Is there a therapeutic role for endothelin-1 antagonists?

There is increasing evidence to suggest that chronic activation of the endothelin-1 system can lead to heterologous desensitization of the glucose-regulatory and mitogenic actions of insulin with subsequent development of glucose intolerance, hyperinsulinemia, impaired endothelial function and exacerbation of cardiovascular disease. Effects are mediated through a variety of mechanisms that include attenuation of key insulin signalling pathways and decreased tyrosine phosphorylation of insulin receptor substrates IRS-1, SHC and G alpha q/11. Other actions involve hemodynamic changes leading to reduced delivery of insulin and glucose to peripheral tissues as well as enhanced hepatic glycogenolysis, decreased glucose-transporter translocation and modulation of various adipokines that regulate insulin action. Overall the data suggest that ET-1 antagonists may provide an effective means of improving cardiac dysfunction and favourably influencing glucose tolerance in obese humans and patients with early insulin sensitivity where there is clear evidence for activation of the ET-1 system. Although most effects of ET-1 that modulate mechanisms leading to glucose intolerance appear to involve the ETA receptor subtype recent data indicates that combined ETA/ETB receptor antagonists may function as effectively as selective ETA blockers. Prospective trials are needed to assess whether ET-1 antagonists, either alone or in combination, are superior to other more conventional therapies such as insulin sensitizers and to evaluate effects of combined treatments on the development of insulin resistance and the progression of diabetes. Early screening of patients at risk for evidence of ET-1 activation would help to identify subjects who may benefit most from such treatment.

Public-health and individual approaches to antiretroviral therapy: township South Africa and Switzerland compared

BACKGROUND: The provision of highly active antiretroviral therapy (HAART) in resource-limited settings follows a public health approach, which is characterised by a limited number of regimens and the standardisation of clinical and laboratory monitoring. In industrialized countries doctors prescribe from the full range of available antiretroviral drugs, supported by resistance testing and frequent laboratory monitoring. We compared virologic response, changes to first-line regimens, and mortality in HIV-infected patients starting HAART in South Africa and Switzerland. METHODS AND FINDINGS: We analysed data from the Swiss HIV Cohort Study and two HAART programmes in townships of Cape Town, South Africa. We included treatment-naïve patients aged 16 y or older who had started treatment with at least three drugs since 2001, and excluded intravenous drug users. Data from a total of 2,348 patients from South Africa and 1,016 patients from the Swiss HIV Cohort Study were analysed. Median baseline CD4+ T cell counts were 80 cells/mul in South Africa and 204 cells/mul in Switzerland. In South Africa, patients started with one of four first-line regimens, which was subsequently changed in 514 patients (22%). In Switzerland, 36 first-line regimens were used initially, and these were changed in 539 patients (53%). In most patients HIV-1 RNA was suppressed to 500 copies/ml or less within one year: 96% (95% confidence interval [CI] 95%-97%) in South Africa and 96% (94%-97%) in Switzerland, and 26% (22%-29%) and 27% (24%-31%), respectively, developed viral rebound within two years. Mortality was higher in South Africa than in Switzerland during the first months of HAART: adjusted hazard ratios were 5.90 (95% CI 1.81-19.2) during months 1-3 and 1.77 (0.90-3.50) during months 4-24. CONCLUSIONS: Compared to the highly individualised approach in Switzerland, programmatic HAART in South Africa resulted in similar virologic outcomes, with relatively few changes to initial regimens. Further innovation and resources are required in South Africa to both achieve more timely access to HAART and improve the prognosis of patients who start HAART with advanced disease.