Spatio-temporal credit assignment in population learning

We present a model for plasticity induction in reinforcement learning which is based on a cascade of synaptic memory traces. In the cascade of these so called eligibility traces presynaptic input is first corre lated with postsynaptic events, next with the behavioral decisions and finally with the external reinforcement. A population of leaky integrate and fire neurons endowed with this plasticity scheme is studied by simulation on different tasks. For operant co nditioning with delayed reinforcement, learning succeeds even when the delay is so large that the delivered reward reflects the appropriateness, not of the immediately preceeding response, but of a decision made earlier on in the stimulus - decision sequence . So the proposed model does not rely on the temporal contiguity between decision and pertinent reward and thus provides a viable means of addressing the temporal credit assignment problem. In the same task, learning speeds up with increasing population si ze, showing that the plasticity cascade simultaneously addresses the spatial problem of assigning credit to the different population neurons. Simulations on other task such as sequential decision making serve to highlight the robustness of the proposed sch eme and, further, contrast its performance to that of temporal difference based approaches to reinforcement learning.

The inter-rater reliability of the Pulmonary Embolism Severity Index

The Pulmonary Embolism Severity Index (PESI) is a validated clinical prognostic model for patients with acute pulmonary embolism (PE). Our goal was to assess the PESI's inter-rater reliability in patients diagnosed with PE. We prospectively identified consecutive patients diagnosed with PE in the emergency department of a Swiss teaching hospital. For all patients, resident and attending physician raters independently collected the 11 PESI variables. The raters then calculated the PESI total point score and classified patients into one of five PESI risk classes (I-V) and as low (risk classes I/II) versus higher-risk (risk classes III-V). We examined the inter-rater reliability for each of the 11 PESI variables, the PESI total point score, assignment to each of the five PESI risk classes, and classification of patients as low versus higher-risk using kappa ( ) and intra-class correlation coefficients (ICC). Among 48 consecutive patients with an objective diagnosis of PE, reliability coefficients between resident and attending physician raters were > 0.60 for 10 of the 11 variables comprising the PESI. The inter-rater reliability for the PESI total point score (ICC: 0.89, 95% CI: 0.81-0.94), PESI risk class assignment ( : 0.81, 95% CI: 0.66-0.94), and the classification of patients as low versus higher-risk ( : 0.92, 95% CI: 0.72-0.98) was near perfect. Our results demonstrate the high reproducibility of the PESI, supporting the use of the PESI for risk stratification of patients with PE.

Sympatric colour polymorphisms associated with nonrandom gene flow in cichlid fish of Lake Victoria

Colour polymorphisms have fascinated evolutionary ecologists for a long time. Yet, knowledge on the mechanisms that allow their persistence is restricted to a handful of well-studied cases. We studied two species of Lake Victoria cichlid fish, Neochromis omnicaeruleus and Neochromis greenwoodi, exhibiting very similar sex-linked colour polymorphisms. The ecology and behaviour of one of these species is well studied, with colour-based mating and aggression preferences. Here, we ask whether the selection potentially resulting from female and male mating preferences and aggression biases reduces gene flow between the colour morphs and permits differentiation in traits other than colour. Over the past 14 years, the frequencies of colour morphs have somewhat oscillated, but there is no evidence for directional change, suggesting the colour polymorphism is persistent on an ecological timescale. We find limited evidence of ecomorphological differentiation between sympatric ancestral (plain) and derived (blotched) colour morphs. We also find significantly nonrandom genotypic assignment and an excess of linkage disequilibrium in the plain morph, which together with previous information on mating preferences suggests nonrandom mating between colour morphs. This, together with negative frequency-dependent sexual selection, found in previous studies, may facilitate maintenance of these polymorphisms in sympatry

Spatio-Temporal Credit Assignment in Neuronal Population Learning

n learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain.

Development of a biocrystallisation assay for examining effects of homeopathic preparations ursing cress seedlings

A major challenge in basic research into homeopathic potentisation is to develop bioassays that yield consistent results. We evaluated the potential of a seedling-biocrystallisation method. Cress seeds (Lepidium sativum L.) germinated and grew for 4 days in vitro in Stannum metallicum 30x or water 30x in blinded and randomized assignment. 15 experiments were performed at two laboratories. CuCl2-biocrystallisation of seedlings extracted in the homeopathic preparations was performed on circular glass plates. Resulting biocrystallograms were analysed by computerized textural image analysis. All texture analysis variables analysed yielded significant results for the homeopathic treatment; thus the texture of the biocrystallograms of homeopathically treated cress exhibited specific characteristics. Two texture analysis variables yielded differences between the internal replicates, most probably due to a processing order effect. There were only minor differences between the results of the two laboratories. The biocrystallisation method seems to be a promising complementary outcome measure for plant bioassays investigating effects of homeopathic preparations.

3D documentation of footwear impressions and tyre tracks in snow with high resolution optical surface scanning

The three-dimensional documentation of footwear and tyre impressions in snow offers an opportunity to capture additional fine detail for the identification as present photographs. For this approach, up to now, different casting methods have been used. Casting of footwear impressions in snow has always been a difficult assignment. This work demonstrates that for the three-dimensional documentation of impressions in snow the non-destructive method of 3D optical surface scanning is suitable. The new method delivers more detailed results of higher accuracy than the conventional casting techniques. The results of this easy to use and mobile 3D optical surface scanner were very satisfactory in different meteorological and snow conditions. The method is also suitable for impressions in soil, sand or other materials. In addition to the side by side comparison, the automatic comparison of the 3D models and the computation of deviations and accuracy of the data simplify the examination and delivers objective and secure results. The results can be visualized efficiently. Data exchange between investigating authorities at a national or an international level can be achieved easily with electronic data carriers.

Parallel evolution of facial stripe patterns in the Neolamprologus brichardilpulcher species complex endemic to Lake Tanganyika

Colour pattern diversity can be due to random processes or to natural or sexual selection. Consequently, similarities in colour patterns are not always correlated with common ancestry, but may result from convergent evolution under shared selection pressures or drift. Neolamprologus brichardi and Neolamprologus pulcher have been described as two distinct species based on differences in the arrangement of two dark bars on the operculum. Our study uses DNA sequences of the mitochondrial control region to show that relatedness of haplotypes disagrees with species assignment based on head colour pattern. This suggests repeated parallel evolution of particular stripe patterns. The complete lack of shared haplotypes between populations of the same or different phenotypes reflects strong philopatric behaviour, possibly induced by the cooperative breeding mode in which offspring remain in their natal territory and serve as helpers until they disperse to nearby territories or take over a breeding position. Concordant phylogeographic patterns between N. brichardi/N. pulcher populations and other rock-dwelling cichlids suggest that the same colonization routes have been taken by sympatric species and that these routes were affected by lake level fluctuations in the past. (C) 2007 Elsevier Inc. All rights reserved.

Defining Goals and Learning Objectives for a Longitudinal Clerkship in the Complex Context of Health Care

In autumn 2007 the Swiss Medical School of Berne (Switzerland) implemented mandatory short-term clerkships in primary health care for all undergraduate medical students. Students studying for a Bachelor degree complete 8 half-days per year in the office of a general practitioner, while students studying for a Masters complete a three-week clerkship. Every student completes his clerkships in the same GP office during his four years of study. The purpose of this paper is to show how the goals and learning objectives were developed and evaluated. Method:A working group of general practitioners and faculty had the task of defining goals and learning objectives for a specific training program within the complex context of primary health care. The group based its work on various national and international publications. An evaluation of the program, a list of minimum requirements for the clerkships, an oral exam in the first year and an OSCE assignment in the third year assessed achievement of the learning objectives. Results: The findings present the goals and principal learning objectives for these clerkships, the results of the evaluation and the achievement of minimum requirements. Most of the defined learning objectives were taught and duly learned by students. Some learning objectives proved to be incompatible in the context of ambulatory primary care and had to be adjusted accordingly. Discussion: The learning objectives were evaluated and adapted to address students’ and teachers’ needs and the requirements of the medical school. The achievement of minimum requirements (and hence of the learning objectives) for clerkships has been mandatory since 2008. Further evaluations will show whether additional learning objectives need to be adopte

A Calculus of Evolving Objects

The demands of developing modern, highly dynamic applications have led to an increasing interest in dynamic programming languages and mechanisms. Not only applications must evolve over time, but the object models themselves may need to be adapted to the requirements of different run-time contexts. Class-based models and prototype-based models, for example, may need to co-exist to meet the demands of dynamically evolving applications. Multi-dimensional dispatch, fine-grained and dynamic software composition, and run-time evolution of behaviour are further examples of diverse mechanisms which may need to co-exist in a dynamically evolving run-time environment How can we model the semantics of these highly dynamic features, yet still offer some reasonable safety guarantees? To this end we present an original calculus in which objects can adapt their behaviour at run-time to changing contexts. Both objects and environments are represented by first-class mappings between variables and values. Message sends are dynamically resolved to method calls. Variables may be dynamically bound, making it possible to model a variety of dynamic mechanisms within the same calculus. Despite the highly dynamic nature of the calculus, safety properties are assured by a type assignment system.

A Calculus of Evolving Objects

The demands of developing modern, highly dynamic applications have led to an increasing interest in dynamic programming languages and mechanisms. Not only must applications evolve over time, but the object models themselves may need to be adapted to the requirements of different run-time contexts. Class-based models and prototype-based models, for example, may need to co-exist to meet the demands of dynamically evolving applications. Multi-dimensional dispatch, fine-grained and dynamic software composition, and run-time evolution of behaviour are further examples of diverse mechanisms which may need to co-exist in a dynamically evolving run-time environment. How can we model the semantics of these highly dynamic features, yet still offer some reasonable safety guarantees? To this end we present an original calculus in which objects can adapt their behaviour at run-time. Both objects and environments are represented by first-class mappings between variables and values. Message sends are dynamically resolved to method calls. Variables may be dynamically bound, making it possible to model a variety of dynamic mechanisms within the same calculus. Despite the highly dynamic nature of the calculus, safety properties are assured by a type assignment system.

Effects of adjunct electroacupuncture on severity of postoperative pain in dogs undergoing hemilaminectomy because of acute thoracolumbar intervertebral disk disease

OBJECTIVE: To compare severity of postoperative pain in dogs undergoing hemilaminectomy because of acute thoracolumbar intervertebral disk disease treated with a combination of conventional analgesics and electroacupuncture (EAP) or with conventional analgesics alone. DESIGN: Controlled clinical trial. ANIMALS: 15 dogs undergoing surgery because of acute thoracolumbar disk disease. PROCEDURES: Dogs were alternately assigned to treatment (conventional analgesics and adjunct EAP) and control (conventional analgesics alone) groups. Analgesic treatment was adjusted as necessary by the attending clinician, who was not aware of group assignment. Pain scores were assigned 1, 3, and 12 hours after surgery and every 12 hours thereafter for 72 hours by the same individual who performed acupuncture treatments. RESULTS: Total dose of fentanyl administered during the first 12 hours after surgery was significantly lower in the treatment group than in the control group, but dosages of analgesics administered from 12 through 72 hours after surgery did not differ between groups. Pain score was significantly lower in the treatment group than in the control group 36 hours after surgery, but did not differ significantly between groups at any other time. CONCLUSIONS AND CLINICAL RELEVANCE: Results provided equivocal evidence that adjunct EAP might provide some mild benefit in regard to severity of postoperative pain in dogs undergoing hemilaminectomy because of acute thoracolumbar intervertebral disk disease.

Ecotypes and genetic structure of Rhinanthus alectorolophus (Orobanchaceae) in southwestern Germany

European annual species of the genus Rhinanthus often exhibit seasonal ecotypic variation, a phenomenon also known from related genera of hemiparasitic Orobanchaceae. Populations with different flowering times exist, correlated with differences in a number of morphological characters. The present study evaluates the correlation of morphological characters and genetic differentiation of populations of Rhinanthus alectorolophus. Thirty-nine populations of three different subspecies from southwestern Germany were sampled. A total of 798 individuals were used for morphological analyses and 187 of these for AFLP analyses. Principal component analysis showed that morphological variation is mostly continuous. In a discriminant analysis based on morphological characters, only 89.7 % of all individuals were correctly assigned to their previously determined subspecies, indicating that subspecies identification is ambiguous for some populations. Using AFLP data and Bayesian assignment analysis, the sampled individuals could be grouped in three genetic clusters which do not correspond to the three subspecies. Instead, the clustering shows a clear geographic pattern and a Mantel test likewise revealed a significant correlation between genetic and geographic distances. Correlations of genetic distances with differences in morphological characters were weak and mostly insignificant. The results indicate that the subspecies of R. alectorolophus do not form discrete entities and that the character combinations distinguishing them are homoplastic.

Source attribution of human Campylobacter isolates by MLST and fla-typing and association of genotypes with quinolone resistance

Campylobacteriosis is the most frequent zoonosis in developed countries and various domestic animals can function as reservoir for the main pathogens Campylobacter jejuni and Campylobacter coli. In the present study we compared population structures of 730 C. jejuni and C. coli from human cases, 610 chicken, 159 dog, 360 pig and 23 cattle isolates collected between 2001 and 2012 in Switzerland. All isolates had been typed with multi locus sequence typing (MLST) and flaB-typing and their genotypic resistance to quinolones was determined. We used complementary approaches by testing for differences between isolates from different hosts with the proportion similarity as well as the fixation index and by attributing the source of the human isolates with Bayesian assignment using the software STRUCTURE. Analyses were done with MLST and flaB data in parallel and both typing methods were tested for associations of genotypes with quinolone resistance. Results obtained with MLST and flaB data corresponded remarkably well, both indicating chickens as the main source for human infection for both Campylobacter species. Based on MLST, 70.9% of the human cases were attributed to chickens, 19.3% to cattle, 8.6% to dogs and 1.2% to pigs. Furthermore we found a host independent association between sequence type (ST) and quinolone resistance. The most notable were ST-45, all isolates of which were susceptible, while for ST-464 all were resistant.

Validity of Charlson Comorbidity Index in patients hospitalised with acute coronary syndrome. Insights from the nationwide AMIS Plus registry 2002-2012

OBJECTIVE This study aimed to assess the impact of individual comorbid conditions as well as the weight assignment, predictive properties and discriminating power of the Charlson Comorbidity Index (CCI) on outcome in patients with acute coronary syndrome (ACS). METHODS A prospective multicentre observational study (AMIS Plus Registry) from 69 Swiss hospitals with 29 620 ACS patients enrolled from 2002 to 2012. The main outcome measures were in-hospital and 1-year follow-up mortality. RESULTS Of the patients, 27% were female (age 72.1±12.6 years) and 73% were male (64.2±12.9 years). 46.8% had comorbidities and they were less likely to receive guideline-recommended drug therapy and reperfusion. Heart failure (adjusted OR 1.88; 95% CI 1.57 to 2.25), metastatic tumours (OR 2.25; 95% CI 1.60 to 3.19), renal diseases (OR 1.84; 95% CI 1.60 to 2.11) and diabetes (OR 1.35; 95% CI 1.19 to 1.54) were strong predictors of in-hospital mortality. In this population, CCI weighted the history of prior myocardial infarction higher (1 instead of -0.4, 95% CI -1.2 to 0.3 points) but heart failure (1 instead of 3.7, 95% CI 2.6 to 4.7) and renal disease (2 instead of 3.5, 95% CI 2.7 to 4.4) lower than the benchmark, where all comorbidities, age and gender were used as predictors. However, the model with CCI and age has an identical discrimination to this benchmark (areas under the receiver operating characteristic curves were both 0.76). CONCLUSIONS Comorbidities greatly influenced clinical presentation, therapies received and the outcome of patients admitted with ACS. Heart failure, diabetes, renal disease or metastatic tumours had a major impact on mortality. CCI seems to be an appropriate prognostic indicator for in-hospital and 1-year outcomes in ACS patients. CLINICALTRIALSGOV IDENTIFIER NCT01305785.

Role of diuretics, blockers, and statins in increasing the risk of diabetes in patients with impaired glucose tolerance: reanalysis of data from the NAVIGATOR study

OBJECTIVE To examine the degree to which use of β blockers, statins, and diuretics in patients with impaired glucose tolerance and other cardiovascular risk factors is associated with new onset diabetes. DESIGN Reanalysis of data from the Nateglinide and Valsartan in Impaired Glucose Tolerance Outcomes Research (NAVIGATOR) trial. SETTING NAVIGATOR trial. PARTICIPANTS Patients who at baseline (enrolment) were treatment naïve to β blockers (n=5640), diuretics (n=6346), statins (n=6146), and calcium channel blockers (n=6294). Use of calcium channel blocker was used as a metabolically neutral control. MAIN OUTCOME MEASURES Development of new onset diabetes diagnosed by standard plasma glucose level in all participants and confirmed with glucose tolerance testing within 12 weeks after the increased glucose value was recorded. The relation between each treatment and new onset diabetes was evaluated using marginal structural models for causal inference, to account for time dependent confounding in treatment assignment. RESULTS During the median five years of follow-up, β blockers were started in 915 (16.2%) patients, diuretics in 1316 (20.7%), statins in 1353 (22.0%), and calcium channel blockers in 1171 (18.6%). After adjusting for baseline characteristics and time varying confounders, diuretics and statins were both associated with an increased risk of new onset diabetes (hazard ratio 1.23, 95% confidence interval 1.06 to 1.44, and 1.32, 1.14 to 1.48, respectively), whereas β blockers and calcium channel blockers were not associated with new onset diabetes (1.10, 0.92 to 1.31, and 0.95, 0.79 to 1.13, respectively). CONCLUSIONS Among people with impaired glucose tolerance and other cardiovascular risk factors and with serial glucose measurements, diuretics and statins were associated with an increased risk of new onset diabetes, whereas the effect of β blockers was non-significant.