Adaptation of Dopamine Neurons' Mismatch Sensitivity Is not Compatible With Reinforcement Learning Theory

Recent electrophysical data inspired the claim that dopaminergic neurons adapt their mismatch sensitivities to reflect variances of expected rewards. This contradicts reward prediction error theory and most basal ganglia models. Application of learning principles points to a testable alternative interpretation-of the same data-that is compatible with existing theory.

A Local Circuit Model of Learned Straitial and Dopamine Cell Responses under Probabilistic Schedules of Reward

Before choosing, it helps to know both the expected value signaled by a predictive cue and the associated uncertainty that the reward will be forthcoming. Recently, Fiorillo et al. (2003) found the dopamine (DA) neurons of the SNc exhibit sustained responses related to the uncertainty that a cure will be followed by reward, in addition to phasic responses related to reward prediction errors (RPEs). This suggests that cue-dependent anticipations of the timing, magnitude, and uncertainty of rewards are learned and reflected in components of the DA signals broadcast by SNc neurons. What is the minimal local circuit model that can explain such multifaceted reward-related learning? A new computational model shows how learned uncertainty responses emerge robustly on single trial along with phasic RPE responses, such that both types of DA responses exhibit the empirically observed dependence on conditional probability, expected value of reward, and time since onset of the reward-predicting cue. The model includes three major pathways for computing: immediate expected values of cures, timed predictions of reward magnitudes (and RPEs), and the uncertainty associated with these predictions. The first two model pathways refine those previously modeled by Brown et al. (1999). A third, newly modeled, pathway is formed by medium spiny projection neurons (MSPNs) of the matrix compartment of the striatum, whose axons co-release GABA and a neuropeptide, substance P, both at synapses with GABAergic neurons in the SNr and with the dendrites (in SNr) of DA neurons whose somas are in ventral SNc. Co-release enables efficient computation of sustained DA uncertainty responses that are a non-monotonic function of the conditonal probability that a reward will follow the cue. The new model's incorporation of a striatal microcircuit allowed it to reveals that variability in striatal cholinergic transmission can explain observed difference, between monkeys, in the amplitutude of the non-monotonic uncertainty function. Involvement of matriceal MSPNs and striatal cholinergic transmission implpies a relation between uncertainty in the cue-reward contigency and action-selection functions of the basal ganglia. The model synthesizes anatomical, electrophysiological and behavioral data regarding the midbrain DA system in a novel way, by relating the ability to compute uncertainty, in parallel with other aspects of reward contingencies, to the unique distribution of SP inputs in ventral SN.

Simulating Effects of Learning and Lesions with a Model of Intrinsic and Synaptically Gated Responses of Striatal Cholinergic Interneurons

The giant cholinergic interneurons of the striatum are tonically active neurons (TANs) that respond with characteristic pauses to novel events and to appetitive and aversive conditioned stimuli. Fluctuations in acetylcholine release by TANs modulate performance- and learning-related dynamics in the striatum. Whereas tonic activity emerges from intrinsic properties of these neurons, glutamatergic inputs from thalamic centromedian-parafascicular nuclei, and dopaminergic inputs from midbrain, are required for the generation of pause responses. No prior computational models encompass both intrinsic and synaptically-gated dynamics. We present a mathematical model that robustly accounts for behavior-related electrophysiological properties of TANs in terms of their intrinsic physiological properties and known afferents. In the model, balanced intrinsic hyperpolarizing and depolarizing currents engender tonic firing, and glutamatergic inputs from thalamus (and cortex) both directly excite and indirectly inhibit TANs. If the latter inhibition, presumably mediated by GABAergic interneurons, exceeds a threshold, its effect is amplified by a KIR current to generate a prolonged pause. In the model, the intrinsic mechanisms and external inputs are both modulated by learning-dependent dopamine (DA) signals and our simulations revealed that many learning-dependent behaviors of TANs are explicable without recourse to learning-dependent changes in synapses onto TANs. The "teaching signal" that modulates reinforcement learning at cortico-striatal synapses may be a sequence composed of an adaptively scaled DA burst, a brief ACh burst, and a scaled ACh pause. Such an interpretation is consistent with recent data on cholinergic control of LTD of cortical synapses onto striatal spiny projection neurons.

The Aesthetics of Motion in Musics for the Mevlana Celal ed-Din Rumi

This dissertation investigates the concept of motion as a fundamental aesthetic element in the devotional music, dance, and rituals performed in honor of the celebrated thirteenth-century Persian mystic poet and saint, the Mevlana Celal ed-Din Muhammad Rumi. The main focus of the study is threefold. First, it investigates the prevalence of the notion of movement in Islamic music and culture, specifically within the Sufi communities of Turkey, in order to arrive at a broader understanding of the relationship between music, aesthetics, and worldview. Secondly, it explores how musical performance functions as a form of devotion or religious worship by focusing on the musical repertories performed in honor of a single holy figure, the Mevlana Rumi. Finally, it provides an ethnographic account of contemporary developments in Sufi musical culture in Turkey and across the world by describing the recent activities of the Mevlana's devotees, which includes members of the Mevlevi Order of Islamic mystics as well as adherents of other Sufi brotherhoods and followers of so-called New Religions or New Age. The primary research for this study involved two short one-month field trips to Turkey and India in 2002 and 2003, respectively, and a longer one year expedition to Turkey in 2004 and 2005, which also included shorter stays in Cyprus, Syria, and Egypt. Additionally, the dissertation draws directly from critical theories advanced in the fields of ethnomusicology, cultural anthropology, and ethnochoreology and focuses on the kinesthetic parameters of music, dance, trance, and ritual as well as on broader forms of socio-cultural movement including pilgrimage, cultural tourism, and globalization. These forms of movement are analyzed in four broad categories of music used in worship, including classical Mevlevi music, music of the zikr ceremony, popular musics, and non-Turkish musics.

Prevalence of MRSA and Antimicrobial Resistance of Staphylococcus aureus in Maryland Ground Meat Products

Gemstone Team Antibiotic Resistance

Comparative genomic data of the Avian Phylogenomics Project.

BACKGROUND: The evolutionary relationships of modern birds are among the most challenging to understand in systematic biology and have been debated for centuries. To address this challenge, we assembled or collected the genomes of 48 avian species spanning most orders of birds, including all Neognathae and two of the five Palaeognathae orders, and used the genomes to construct a genome-scale avian phylogenetic tree and perform comparative genomics analyses (Jarvis et al. in press; Zhang et al. in press). Here we release assemblies and datasets associated with the comparative genome analyses, which include 38 newly sequenced avian genomes plus previously released or simultaneously released genomes of Chicken, Zebra finch, Turkey, Pigeon, Peregrine falcon, Duck, Budgerigar, Adelie penguin, Emperor penguin and the Medium Ground Finch. We hope that this resource will serve future efforts in phylogenomics and comparative genomics. FINDINGS: The 38 bird genomes were sequenced using the Illumina HiSeq 2000 platform and assembled using a whole genome shotgun strategy. The 48 genomes were categorized into two groups according to the N50 scaffold size of the assemblies: a high depth group comprising 23 species sequenced at high coverage (>50X) with multiple insert size libraries resulting in N50 scaffold sizes greater than 1 Mb (except the White-throated Tinamou and Bald Eagle); and a low depth group comprising 25 species sequenced at a low coverage (~30X) with two insert size libraries resulting in an average N50 scaffold size of about 50 kb. Repetitive elements comprised 4%-22% of the bird genomes. The assembled scaffolds allowed the homology-based annotation of 13,000 ~ 17000 protein coding genes in each avian genome relative to chicken, zebra finch and human, as well as comparative and sequence conservation analyses. CONCLUSIONS: Here we release full genome assemblies of 38 newly sequenced avian species, link genome assembly downloads for the 7 of the remaining 10 species, and provide a guideline of genomic data that has been generated and used in our Avian Phylogenomics Project. To the best of our knowledge, the Avian Phylogenomics Project is the biggest vertebrate comparative genomics project to date. The genomic data presented here is expected to accelerate further analyses in many fields, including phylogenetics, comparative genomics, evolution, neurobiology, development biology, and other related areas.

Using Behavioral Insights For a Better Understanding of Economic Decisions (Regarding Savings, Inequality and Dishonesty)

This dissertation consists of three essays on behavioral economics, with a general aim of enriching our understanding of economic decisions using behavioral insights and experimental methodology. Each essay takes on one particular topic with this general aim.

The first chapter studies savings behavior of the poor. In this project, partnering with a savings product provider in Kenya, we tested the extent to which behavioral interventions and financial incentives can increase the saving rate of individuals with low and irregular income. Our experiment lasted for six months and included a total of twelve conditions. The control condition received weekly reminders and balance reporting via text messages. The treatment conditions received in addition one of the following interventions: (1) reminder text messages framed as if they came from the participant’s kid (2) a golden colored coin with numbers for each week of the trial, on which participants were asked to keep track of their weekly deposits (3) a match of weekly savings: The match was either 10% or 20% up to a certain amount per week. The match was either deposited at the end of each week or the highest possible match was deposited at the start of each week and was adjusted at the end. Among these interventions, by far the most effective was the coin: Those in the coin condition saved on average the highest amount and more than twice as those in the control condition. We hypothesize that being a tangible track-keeping object; the coin made subjects remember to save more often. Our results support the line of literature suggesting that saving decisions involve psychological aspects and that policy makers and product designers should take these influences into account.

The second chapter is related to views towards inequality. In this project, we investigate how the perceived fairness of income distributions depends on the beliefs about the process that generated the inequality. Specifically, we examine how two crucial features of this process affect fairness views: (1) Procedural justice - equal treatment of all, (2) Agency - one's ability to determine his/her income. We do this in a lab experiment by varying the equality of opportunity (procedural justice), and one's ability to make choices, which consequently influence subjects’ ability to influence their income (agency). We then elicit ex-post redistribution decisions of the earnings as a function of these two elements. Our results suggest both agency and procedural justice matter for fairness. Our main findings can be summarized as follows: (1) Highlighting the importance of agency, we find that inequality resulting from risk is considered to be fair only when risk is chosen freely; (2) Highlighting the importance of procedural justice, we find that introducing inequality of opportunity significantly increases redistribution, however the share of subjects redistributing none remain close to the share of subjects redistributing fully revealing an underlying heterogeneity in the population about how fairness views should account for inequality of opportunity.

The third chapter is on morality. In this project, we study whether religious rituals act as an internal reminder for basic moral principles and thus affect moral judgments. To this end, we conducted two survey experiments in Turkey and Israel to specifically test the effect of Ramadan and Yom Kippur. The results from the Turkish sample how that Ramadan has a significant effect on moral judgments to some extent for those who report to believe in God. Those who believe in God judged the moral acceptability of ten out of sixty one actions significantly differently in Ramadan, whereas those who reported not to believe in God significantly changed their judgments only for one action in Ramadan. Our results extends the hypothesis established by lab experiments that religious reminders have a significant effect on morality, by testing it in the field in the natural environment of religious rituals.

This thesis is part of a broader collaborative research agenda with both colleagues and advisors. The programming, analyses, and writing, as well as any errors in this work, are my own.

Plastid microsatellites for the study of genetic variability in the widespread Cephalanthera longifolia, C. damasonium and C. rubra (Neottieae, Orchidaceae), and cross-amplification in other Cephalanthera species

Plastid microsatellite loci developed for Cephalanthera longifolia were used to examine the level of genetic variation within and between populations of the three widespread Cephalanthera species (C. damasonium, C. longifolia and C. rubra). The most detailed sampling was in C. longifolia (42 localities from Ireland to China; 147 individuals). Eight haplotypes were detected. One was detected in the vast majority of individuals and occurred from Ireland to Iran. Three others were only found in Europe (Ireland to Italy, England to Italy and Austria to Croatia). Two were only found in the Middle East and two only in Asia. In C. damasonium, 21 individuals from 10 populations (England to Turkey) were sampled. Only one haplotype was detected. In C. rubra, 34 individuals from eight populations (England to Turkey) were sampled. Although it was not possible to amplify all loci for all samples of this species, nine haplotypes were detected. Short alleles for the trnS-trnG region found in two populations of C. rubra were characterized by sequencing and were caused by deletions of 26 and 30 base pairs. At this level of sampling, it appears that C. rubra shows the greatest genetic variability. Cephalanthera longifolia, C. rubra and C. damasonium have previously been characterized as outbreeding, outbreeding with facultative vegetative reproduction and inbreeding, respectively. Patterns of genetic variation here are discussed in the light of these reproductive system differences. The primers used in these three species of Cephalanthera were also demonstrated to amplify these loci in another five species (C. austiniae, C. calcarata, C. epipactoides, C. falcata and C. yunnanensis). Although it is sometimes treated as a synonym of C. damasonium, the single sample of C. yunnanensis from China had a markedly different haplotype from that found in C. damasonium. All three loci were successfully amplified in two achlorophyllous, myco-heterotrophic species, C. austinae and C. calcarata. © 2010 The Linnean Society of London.

Cross-sectional study of 168 patients with hepatorenal tyrosinaemia and implications for clinical practice

Background: Hepatorenal tyrosinaemia (Tyr 1) is a rare inborn error of tyrosine metabolism. Without treatment, patients are at high risk of developing acute liver failure, renal dysfunction and in the long run hepatocellular carcinoma. The aim of our study was to collect cross-sectional data. Methods. Via questionnaires we collected retrospective data of 168 patients with Tyr 1 from 21 centres (Europe, Turkey and Israel) about diagnosis, treatment, monitoring and outcome. In a subsequent consensus workshop, we discussed data and clinical implications. Results: Early treatment by NTBC accompanied by diet is essential to prevent serious complications such as liver failure, hepatocellular carcinoma and renal disease. As patients may remain initially asymptomatic or develop uncharacteristic clinical symptoms in the first months of life newborn mass screening using succinylacetone (SA) as a screening parameter in dried blood is mandatory for early diagnosis. NTBC-treatment has to be combined with natural protein restriction supplemented with essential amino acids. NTBC dosage should be reduced to the minimal dose allowing metabolic control, once daily dosing may be an option in older children and adults in order to increase compliance. Metabolic control is judged by SA (below detection limit) in dried blood or urine, plasma tyrosine (<400 μM) and NTBC-levels in the therapeutic range (20-40 μM). Side effects of NTBC are mild and often transient. Indications for liver transplantation are hepatocellular carcinoma or failure to respond to NTBC. Follow-up procedures should include liver and kidney function tests, tumor markers and imaging, ophthalmological examination, blood count, psychomotor and intelligence testing as well as therapeutic monitoring (SA, tyrosine, NTBC in blood). Conclusion: Based on the data from 21 centres treating 168 patients we were able to characterize current practice and clinical experience in Tyr 1. This information could form the basis for clinical practice recommendations, however further prospective data are required to underpin some of the recommendations.

Condition assessment of a 63-year old reinforced concrete structure exposed to the North Sea

This paper describes the condition of a reinforced concrete balustrade consisting of some 1000 individual beam elements all exposed similarly to the hostile marine environment of the North Sea at Arbroath, Scotland since 1943. A comparison is made of the condition of the original construction with the condition of repairs carried out in 1968 and in 1993. It is shown that the 1943 construction shows very little corrosion-induced cracking and little rust staining even though it does not appear to be of high construction quality. Only a very low percentage of the balustrade beams have been replaced. In contrast the beam installed in 1968 and later in 1993 show very considerable and large concrete cracks directly attributable to the corrosion of the longitudinal reinforcement, even though the concrete is of a higher quality and density. A detailed condition survey and statistics of crack sizes are presented in the paper. It is found that the higher corrosion resistance of the 1943 concrete is generally consistent with the concrete electrical resistivity measurements but the degree of corrosion of the reinforcing bars is inconsistent with chloride penetration measurements. The results are compared with the very few observations available in the literature for ageing concrete structures in marine environments. The results cast doubt on the conventional wisdom that chloride content at the reinforcement correlates well with reinforcement corrosion.

A comparison of the degree of implementation of marine biodiversity indicators by European countries in relation to the Marine Strategy Framework Directive (MSFD)

The degree of development and operability of the indicators for the Marine Strategy Framework Directive (MSFD) using Descriptor 1 (D1) Biological Diversity was assessed. To this end, an overview of the relevance and degree of operability of the underlying parameters across 20 European countries was compiled by analysing national directives, legislation, regulations, and publicly available reports. Marked differences were found between countries in the degree of ecological relevance as well as in the degree of implementation and operability of the parameters chosen to indicate biological diversity. The best scoring EU countries were France, Germany, Greece and Spain, while the worst scoring countries were Italy and Slovenia. No country achieved maximum scores for the implementation of MSFD D1. The non-EU countries Norway and Turkey score as highly as the top-scoring EU countries. On the positive side, the chosen parameters for D1 indicators were generally identified as being an ecologically relevant reflection of Biological Diversity. On the negative side however, less than half of the chosen parameters are currently operational. It appears that at a pan-European level, no consistent and harmonized approach currently exists for the description and assessment of marine biological diversity. The implementation of the MSFD Descriptor 1 for Europe as a whole can therefore at best be marked as moderately successful.