Spatio-Temporal Credit Assignment in Neuronal Population Learning

n learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain.

Interactions between short-term and long-term plasticity: shooting for a moving target

Far from being static transmission units, synapses are highly dynamical elements that change over multiple time scales depending on the history of the neural activity of both the pre- and postsynaptic neuron. Moreover, synaptic changes on different time scales interact: long-term plasticity (LTP) can modify the properties of short-term plasticity (STP) in the same synapse. Most existing theories of synaptic plasticity focus on only one of these time scales (either STP or LTP or late-LTP) and the theoretical principles underlying their interactions are thus largely unknown. Here we develop a normative model of synaptic plasticity that combines both STP and LTP and predicts specific patterns for their interactions. Recently, it has been proposed that STP arranges for the local postsynaptic membrane potential at a synapse to behave as an optimal estimator of the presynaptic membrane potential based on the incoming spikes. Here we generalize this approach by considering an optimal estimator of a non-linear function of the membrane potential and the long-term synaptic efficacy—which itself may be subject to change on a slower time scale. We find that an increase in the long-term synaptic efficacy necessitates changes in the dynamics of STP. More precisely, for a realistic non-linear function to be estimated, our model predicts that after the induction of LTP, causing long-term synaptic efficacy to increase, a depressing synapse should become even more depressing. That is, in a protocol using trains of presynaptic stimuli, as the initial EPSP becomes stronger due to LTP, subsequent EPSPs should become weakened and this weakening should be more pronounced with LTP. This form of redistribution of synaptic efficacies agrees well with electrophysiological data on synapses connecting layer 5 pyramidal neurons.

Alba-domain proteins of Trypanosoma brucei are cytoplasmic RNA-binding proteins that interact with the translation machinery

Trypanosoma brucei and related pathogens transcribe most genes as polycistronic arrays that are subsequently processed into monocistronic mRNAs. Expression is frequently regulated post-transcriptionally by cis-acting elements in the untranslated regions (UTRs). GPEET and EP procyclins are the major surface proteins of procyclic (insect midgut) forms of T. brucei. Three regulatory elements common to the 3' UTRs of both mRNAs regulate mRNA turnover and translation. The glycerol-responsive element (GRE) is unique to the GPEET 3' UTR and regulates its expression independently from EP. A synthetic RNA encompassing the GRE showed robust sequence-specific interactions with cytoplasmic proteins in electromobility shift assays. This, combined with column chromatography, led to the identification of 3 Alba-domain proteins. RNAi against Alba3 caused a growth phenotype and reduced the levels of Alba1 and Alba2 proteins, indicative of interactions between family members. Tandem-affinity purification and co-immunoprecipitation verified these interactions and also identified Alba4 in sub-stoichiometric amounts. Alba proteins are cytoplasmic and are recruited to starvation granules together with poly(A) RNA. Concomitant depletion of all four Alba proteins by RNAi specifically reduced translation of a reporter transcript flanked by the GPEET 3' UTR. Pulldown of tagged Alba proteins confirmed interactions with poly(A) binding proteins, ribosomal protein P0 and, in the case of Alba3, the cap-binding protein eIF4E4. In addition, Alba2 and Alba3 partially cosediment with polyribosomes in sucrose gradients. Alba-domain proteins seem to have exhibited great functional plasticity in the course of evolution. First identified as DNA-binding proteins in Archaea, then in association with nuclear RNase MRP/P in yeast and mammalian cells, they were recently described as components of a translationally silent complex containing stage-regulated mRNAs in Plasmodium. Our results are also consistent with stage-specific regulation of translation in trypanosomes, but most likely in the context of initiation.

Landfill Closure and Housing Values

The United States disposes roughly 60% of the municipal solid waste it generates each year in solid waste disposal facilities, commonly known as landfills. Hedonic pricing studies have estimated the external costs of landfills on neighboring housing markets, but the literature is silent on what happens to property values after the landfill closes. Original housing price data collected both before and after a landfill closure are used to estimate how a landfill closure affects neighboring property values. Results of both a hedonic pricing model and repeat-sales estimator are used in the analysis.

The Operatics of Cabiria (1914): Intermediality in Early Italian Cinema

This article presents an intermedial analysis of the Italian silent film Cabiria by Giovanni Pastrone within the cultural context of its time. Employing theories developed by Werner Wolf and Irina Rajewsky, the article lays out the intermedial and transmedial relationships of Cabiria with other media, in particular opera, literature, and painting, and illustrates that operatic references are incorporated recognizably during key moments of the film. By contrasting these references with specific cinematic techniques, Pastrone demonstrates that film is able to elicit an operatic sensation and that film is a distinct and valuable form of art.

Responses to Central Oxotremorine and Scopolamine Support the Cholinergic Control of Male Mating Behavior in Hamsters

The responses of hamsters to intracranial injections of the cholinergic agonist oxotremorine (OXO) implicate cholinergic mechanisms in the medial preoptic area (MPOA) in the control of male mating behavior. To extend these observations, we ran three studies of responses to cholinergic drugs delivered singly or in combination to the vicinity of the MPOA. The first tested responses to OXO, confirming its ability to reduce the postejaculatory interval. The second complemented the first by examining responses to MPOA microinjections of the cholinergic antagonist scopolamine (SCO). These caused several changes revolving around intromission. These included increases in intromission frequency and ejaculation latency. They also included a change in the patterning of intromissions, marked by continuous strings without the usual separation by dismounts. The final study resembled the others in examining the effects of MPOA injections of OXO and SCO but focused on the ability of each drug to antagonize responses to the other. Most of the responses to OXO and SCO individually replicated earlier findings, though the measures examined here also permitted the description of effects on some noncopulatory sexual behaviors, specifically the male's inspection of the female. However, the most interesting results may be those suggesting asymmetry in the responses to the addition of the second drug: Whereas responses to OXO tended to be antagonized by SCO, OXO was less effective at counteracting responses to SCO. Though the explanation of this asymmetry is not completely clear, it is consistent with previous suggestions of differences in the affinities of these drugs for subtypes of muscarinic receptors. Therefore, it suggests that the cholinergic synapses and circuits controlling distinct elements of male behavior could differ in their dependence on these receptors. Copyright 2013 Elsevier Inc. All rights reserved.

Constrained pattern of viral evolution in acute and early HCV infection limits viral plasticity

Cellular immune responses during acute Hepatitis C virus (HCV) and HIV infection are a known correlate of infection outcome. Viral adaptation to these responses via mutation(s) within CD8+ T-cell epitopes allows these viruses to subvert host immune control. This study examined HCV evolution in 21 HCV genotype 1-infected subjects to characterise the level of viral adaptation during acute and early HCV infection. Of the total mutations observed 25% were within described CD8+ T-cell epitopes or at viral adaptation sites. Most mutations were maintained into the chronic phase of HCV infection (75%). The lack of reversion of adaptations and high proportion of silent substitutions suggests that HCV has structural and functional limitations that constrain evolution. These results were compared to the pattern of viral evolution observed in 98 subjects during a similar phase in HIV infection from a previous study. In contrast to HCV, evolution during acute HIV infection is marked by high levels of amino acid change relative to silent substitutions, including a higher proportion of adaptations, likely reflecting strong and continued CD8+ T-cell pressure combined with greater plasticity of the virus. Understanding viral escape dynamics for these two viruses is important for effective T cell vaccine design.

Organelle segregation into Plasmodium liver stage merozoites

The liver stage of the Plasmodium parasite remains one of the most promising targets for intervention against malaria as it is clinically silent, precedes the symptomatic blood stage and represents a bottleneck in the parasite life cycle. However, many aspects of the development of the parasite during this stage are far from understood. During the liver stage, the parasite undergoes extensive replication, forming tens of thousands of infectious merozoites from each invading sporozoite. This implies a very efficient and accurate process of cytokinesis and thus also of organelle development and segregation. We have generated for the first time Plasmodium berghei double-fluorescent parasite lines, allowing visualization of the apicoplast, mitochondria and nuclei in live liver stage parasites. Using these we have seen that in parallel with nuclear division, the apicoplast and mitochondrion become two extensively branched and intertwining structures. The organelles then undergo impressive morphological and positional changes prior to cell division. To form merozoites, the parasite undergoes cytokinesis and the complex process of organelle development and segregation into the forming daughter merozoites could be analysed in detail using the newly generated transgenic parasites.

An unusual splice defect in the mitofusin 2 gene (MFN2) is associated with degenerative axonopathy in Tyrolean Grey cattle

Tyrolean Grey cattle represent a local breed with a population size of approximately 5000 registered cows. In 2003, a previously unknown neurological disorder was recognized in Tyrolean Grey cattle. The clinical signs of the disorder are similar to those of bovine progressive degenerative myeloencephalopathy (weaver syndrome) in Brown Swiss cattle but occur much earlier in life. The neuropathological investigation of an affected calf showed axonal degeneration in the central nervous system (CNS) and femoral nerve. The pedigrees of the affected calves suggested a monogenic autosomal recessive inheritance. We localized the responsible mutation to a 1.9 Mb interval on chromosome 16 by genome-wide association and haplotype mapping. The MFN2 gene located in this interval encodes mitofusin 2, a mitochondrial membrane protein. A heritable human axonal neuropathy, Charcot-Marie-Tooth disease-2A2 (CMT2A2), is caused by MFN2 mutations. Therefore, we considered MFN2 a positional and functional candidate gene and performed mutation analysis in affected and control Tyrolean Grey cattle. We did not find any non-synonymous variants. However, we identified a perfectly associated silent SNP in the coding region of exon 20 of the MFN2 gene. This SNP is located within a putative exonic splice enhancer (ESE) and the variant allele leads to partial retention of the entire intron 19 and a premature stop codon in the aberrant MFN2 transcript. Thus we have identified a highly unusual splicing defect, where an exonic single base exchange leads to the retention of the preceding intron. This splicing defect represents a potential explanation for the observed degenerative axonopathy. Marker assisted selection can now be used to eliminate degenerative axonopathy from Tyrolean Grey cattle.

LGI2 truncation causes a remitting focal epilepsy in dogs

One quadrillion synapses are laid in the first two years of postnatal construction of the human brain, which are then pruned until age 10 to 500 trillion synapses composing the final network. Genetic epilepsies are the most common neurological diseases with onset during pruning, affecting 0.5% of 2-10-year-old children, and these epilepsies are often characterized by spontaneous remission. We previously described a remitting epilepsy in the Lagotto romagnolo canine breed. Here, we identify the gene defect and affected neurochemical pathway. We reconstructed a large Lagotto pedigree of around 34 affected animals. Using genome-wide association in 11 discordant sib-pairs from this pedigree, we mapped the disease locus to a 1.7 Mb region of homozygosity in chromosome 3 where we identified a protein-truncating mutation in the Lgi2 gene, a homologue of the human epilepsy gene LGI1. We show that LGI2, like LGI1, is neuronally secreted and acts on metalloproteinase-lacking members of the ADAM family of neuronal receptors, which function in synapse remodeling, and that LGI2 truncation, like LGI1 truncations, prevents secretion and ADAM interaction. The resulting epilepsy onsets at around seven weeks (equivalent to human two years), and remits by four months (human eight years), versus onset after age eight in the majority of human patients with LGI1 mutations. Finally, we show that Lgi2 is expressed highly in the immediate post-natal period until halfway through pruning, unlike Lgi1, which is expressed in the latter part of pruning and beyond. LGI2 acts at least in part through the same ADAM receptors as LGI1, but earlier, ensuring electrical stability (absence of epilepsy) during pruning years, preceding this same function performed by LGI1 in later years. LGI2 should be considered a candidate gene for common remitting childhood epilepsies, and LGI2-to-LGI1 transition for mechanisms of childhood epilepsy remission.

"In vivo" imaging of atherosclerosis

Atherosclerosis is a systemic and multifocal disease, which starts early in life, and that usually takes decades before overt disease eventually appears as a consequence of progressive obstruction or abrupt thrombotic occlusion. This silent course makes necessary to develop predictors of disease long before symptomatic lesions develop. Besides several classical risk factors and new emerging humoral risk predictors, imaging may constitute a formidable diagnostic and prognostic tool in order to identify presence, extension, progression (or regression) of disease as well as vulnerability of atherosclerotic lesions. This review summarizes the rapidly growing clinical and research field in imaging atherosclerosis from different perspectives opening important opportunities for timely detection and treatment of atherosclerosis.

Seeing Spaces: An Eye-Tracking Study Of Speech Segmentation

Speech is often a multimodal process, presented audiovisually through a talking face. One area of speech perception influenced by visual speech is speech segmentation, or the process of breaking a stream of speech into individual words. Mitchel and Weiss (2013) demonstrated that a talking face contains specific cues to word boundaries and that subjects can correctly segment a speech stream when given a silent video of a speaker. The current study expanded upon these results, using an eye tracker to identify highly attended facial features of the audiovisual display used in Mitchel and Weiss (2013). In Experiment 1, subjects were found to spend the most time watching the eyes and mouth, with a trend suggesting that the mouth was viewed more than the eyes. Although subjects displayed significant learning of word boundaries, performance was not correlated with gaze duration on any individual feature, nor was performance correlated with a behavioral measure of autistic-like traits. However, trends suggested that as autistic-like traits increased, gaze duration of the mouth increased and gaze duration of the eyes decreased, similar to significant trends seen in autistic populations (Boratston & Blakemore, 2007). In Experiment 2, the same video was modified so that a black bar covered the eyes or mouth. Both videos elicited learning of word boundaries that was equivalent to that seen in the first experiment. Again, no correlations were found between segmentation performance and SRS scores in either condition. These results, taken with those in Experiment, suggest that neither the eyes nor mouth are critical to speech segmentation and that perhaps more global head movements indicate word boundaries (see Graf, Cosatto, Strom, & Huang, 2002). Future work will elucidate the contribution of individual features relative to global head movements, as well as extend these results to additional types of speech tasks.

Role of Acetylcholine in Control of Sexual Behavior of Male and Female Mammals

The results of studies using systemic or central applications of cholinergic drugs suggest that acetylcholine makes important contributions to the neurochemical control of male- and female-typical reproductive behaviors. In males, cholinergic control seems largely specific to some elements or aspects of copulatory behavior that can vary significantly across species. Synapses in or near the medial preoptic area represent part of this mechanism, but the entire system appears to extend more widely, perhaps especially to one or more structures flanking some part of the lateral ventricle. In females, the lordosis response that essentially defines sexual receptivity is clearly responsive to cholinergic drugs. The same seems likely to be true of other elements of female sexual behavior, but additional studies will be needed to confirm this. Changes in cholinergic activity may help to mediate estrogenic effects on female sexual behavior. However, estrogen exposure can increase or decrease cholinergic effects, suggesting a relationship that is complex and requires further analysis. Also presently unclear is the localization of the cholinergic effects on female sexual responses. Though periventricular sites again have been implicated, their identity is presently unknown. This review discusses these and other aspects of the central cholinergic systems affecting male and female sexual behaviors. Copyright 2014 Elsevier Inc. All rights reserved.

The Representation of Motherhood in Polish Cinema

The project aimed to analyse representations of motherhood in Polish cinema as a special case of a more general system within the representation of women. It concentrated on the image of the Polish Mother created during the 19th century in Polish culture under the influence of specific political, social and religious factors. Ms. Ostrowska's initial hypothesis was that this symbolic image became one of the most stable elements in Polish cinema and as her research revealed, it was valuable for the preservation of national identity but nevertheless a fiercely constraining model for Polish femininity. In order to fully understand the nature of this persistent image it was initially necessary to related it to broader contexts and issues in representation. These included the image of the Polish Mother within general mythological structures (using the notion of myth in the Barthesian sense). Following her initial research Ms. Ostrowska felt that it was most appropriate to view the myth of the Polish Mother as a dominant ideological structure in the discourse of motherhood within Polish culture. An analysis of the myth of the Polish Mother can provide an insight into how Polish society sees itself at different periods in time and how a national identity was constructed in relation to particular ideological demands stemming from concrete historical and political situations. The analysis of the film version of this myth also revealed some aspects of the national character of Polish cinema. There the image of woman has become enshrined as the "eternal feminine", with virtues which are inevitably derived directly from Catholicism, particularly in relation to the networks of meanings around the central figure of Mary, Mother of God. In 19th century Poland these were linked with patriotic values and images of woman became part of the defence of the very idea of Poland and Polishness. After World War Two, this religious-political image system was adapted to the demands of the new communist ideology. The possibility of manipulating the ideological dimensions of the myth of the Polish Mother is due to the very nature of the image, which as a symbol of civil religion had been able to function independently of any particular state or church institution. Although in communist ideology the stress was on the patriotic aspect of the myth, its pronounced religious aspect was also transmitted, consciously or not, in the denotation process, this being of great significance in the viewer's response to the female character. This appropriation of elements derived from the national patriotic tradition into the discourse of communist ideology was a very efficient strategy to establish the illusion of continuity in national existence, which was supposed to convince society of the rightness of the new political situation. The analysis of films made in the post-war period showed the persistence of this discourse on motherhood in a range of cinematic texts regardless of the changing political situation. Ms. Ostrowska claims that the stability of this discursive formation is to a certain extent the result of the mythological aspect of the mother figure. This mythological structure also belongs to the ideology of Romanticism which in general continues to prevail in Polish cultural discourse as a meta-language of national community. The analysis of the films confirmed the hypothesis of the Polish Mother as a myth-sign whose signifier is stable whereas the signified depends on the specific historical conditions in which it is set. Therefore in the famous propaganda documentary Kobiety naszych dni (Women of Our Days, 1951) by Jan Zelnik, and in other films made after the October 1956 "thaw" it functions as an "empty sign. She concludes that it would be difficult to deny that the myth of the Polish Mother has offered Polish women a special role in national life, granting them a high moral position in the social, hierarchy. However the processes of idealisation involved have resulted in a deprivation of her subjectivity and the right to decide about her own life. This idealisation also served to strengthen traditional patriarchal structures through this set of female obligations to the mother land. In Polish ideology it is not a man who demands sacrifice from a woman but the motherland, which, deprived of the institutions of male power for nearly 150 years, had functioned as a feminine structure. That is why oppressive aspects of the myth have been obscured for so long. While Polish women were doubtless able to accept the constrictions because of their sense of national duty and any misgivings were overridden by the argument of the cause, it is important to recognise that the strength of these constructions, compounded by the ways in which they spoke of and continue to speak of a certain perfection, make them persist into contemporary Poland. Poland is however no longer embattled and the signs that made these meanings are potentially empty. This space for meaning will be and is already being contested and increasingly colonised by current western models of femininity. Ms. Ostrowska's final question is whether this will help to prevent a possible resentful victimisation of the silent and noble Polish Mother.

The bovine aristaless-like homeobox 4 (ALX4) as a candidate gene for syndactyly

The ALX4 (aristaless-like homeobox 4) gene encodes a paired-type homeodomain transcriptional activator and plays a major role in anterior-posterior pattern formation during limb development. Here, the cloning, genomic structure and expression of the bovine ortholog of the ALX4 gene are reported. The bovine ALX4 gene consists of four exons and is located on BTA15q28-->q29 in a region syntenic to HSA11p11.2. The transcribed ALX4 mRNA encodes a 397-amino-acid protein showing a paired-type homeodomain and a C-terminal stretch of amino acids known as the OAR- or aristaless domain. The predicted protein shares 92.5% identity to human and mouse ALX4 proteins and all three species share almost complete identity in the conserved domains. ALX4 expression was detected by reverse transcriptase polymerase chain reaction in bovine fetal limb bones. The ALX4 gene was evaluated as a candidate gene for bovine syndactyly which has been mapped on the telomeric region of cattle chromosome 15. Sequencing of the four exons with flanking sequences of the bovine ALX4 gene from a panel of 14 affected animals belonging to German Holstein, German Fleckvieh and crossbreds, and 27 unaffected individuals from German Holstein revealed five silent SNPs within the coding region out of eleven SNPs in total. Four SNPs were polymorphic in the affected animals, but in comparison to the genotyped unaffected individuals the genotype distribution showed no evidence for an association to the phenotype. Therefore our data indicate that the ALX4 gene can probably be excluded as candidate gene for bovine syndactyly in the examined animals.