Learning Paradigms Exemplified by Virtual Experiments with Honey Bees

Learning is based on rules that can be elucidated by behavioural experiments. This article focuses on virtual experiments, in which non-associative learning (habituation, sensitization) and principles of associative learning (contiguity, inhibitory learning, generalization, overshadowing, positive and negative patterning) can be examined using 'virtual' honey bees in PER (Proboscis Reaction Extension) conditioning experiments. Users can develop experimental designs, simulate and document the experiments and find explanations and suggestions for the analysis of the learning experiments. The virtual experiments are based on video sequences and data from actual learning experiments. The bees' responses are determined by probability-based learning profiles.

Code-specific learning rules improve action selection by populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral decisions. We previously introduced reinforcement learning for population-based decision making by spiking neurons. Here we generalize population reinforcement learning to spike-based plasticity rules that take account of the postsynaptic neural code. We consider spike/no-spike, spike count and spike latency codes. The multi-valued and continuous-valued features in the postsynaptic code allow for a generalization of binary decision making to multi-valued decision making and continuous-valued action selection. We show that code-specific learning rules speed up learning both for the discrete classification and the continuous regression tasks. The suggested learning rules also speed up with increasing population size as opposed to standard reinforcement learning rules. Continuous action selection is further shown to explain realistic learning speeds in the Morris water maze. Finally, we introduce the concept of action perturbation as opposed to the classical weight- or node-perturbation as an exploration mechanism underlying reinforcement learning. Exploration in the action space greatly increases the speed of learning as compared to exploration in the neuron or weight space.

The effect of heart rate reduction by ivabradine on collateral function in patients with chronic stable coronary artery disease

Objective To evaluate the effect of heart rate reduction by ivabradine on coronary collateral function in patients with chronic stable coronary artery disease (CAD). Methods This was a prospective randomised placebo-controlled monocentre trial in a university hospital setting. 46 patients with chronic stable CAD received placebo (n=23) or ivabradine (n=23) for the duration of 6 months. The main outcome measure was collateral flow index (CFI) as obtained during a 1 min coronary artery balloon occlusion at study inclusion (baseline) and at the 6-month follow-up examination. CFI is the ratio between simultaneously recorded mean coronary occlusive pressure divided by mean aortic pressure both subtracted by mean central venous pressure. Results During follow-up, heart rate changed by +0.2±7.8 beats/min in the placebo group, and by –8.1±11.6 beats/min in the ivabradine group (p=0.0089). In the placebo group, CFI decreased from 0.140±0.097 at baseline to 0.109±0.067 at follow-up (p=0.12); it increased from 0.107±0.077 at baseline to 0.152±0.090 at follow-up in the ivabradine group (p=0.0461). The difference in CFI between the 6-month follow-up and baseline examination amounted to −0.031±0.090 in the placebo group and to +0.040±0.094 in the ivabradine group (p=0.0113). Conclusions Heart rate reduction by ivabradine appears to have a positive effect on coronary collateral function in patients with chronic stable CAD.

Fear-learning deficits in subjects with fibromyalgia syndrome?

BACKGROUND: Fibromyalgia syndrome (FMS) is frequently associated with psychiatric conditions, particularly anxiety. Deficits in contingency learning during fear conditioning have been hypothesized to increase anxiety and, consequently, pain sensation in susceptible individuals. The goal of this study was to examine the relationship between contingency learning and pain experience in subjects with FMS and rheumatoid arthritis (RA). METHODS: Fourteen female FMS subjects, 14 age-matched female RA subjects and 14 age-matched female healthy controls (HCs) were included in a fear-conditioning experiment. The conditioned stimulus (CS) consisted of visual signs, the unconditioned stimulus (US) of thermal stimuli. CS- predicted low-temperature exposure (US), while CS+ was followed by low or high temperature. RESULTS: In the FMS group, only 50% of the subjects were aware of the US-CS contingency, whereas 86% of the RA subjects and all of the HCs were aware of the contingency. CS+ induced more anxiety than CS- in RA subjects and HCs. As expected, low-temperature exposure was experienced as less painful after CS- than after CS+ in these subjects. FMS subjects did not show such adaptive conditioning. The effects of the type of CS on heart rate changes were significant in the HCs and the aware FMS subjects, but not in the unaware FMS subjects. CONCLUSIONS: Contingency learning deficits represent a potentially promising and specific, but largely unstudied, psychopathological factor in FMS. Deficits in contingency learning may increase anxiety and, consequently, pain sensation. These findings have the potential to contribute to the development of novel therapeutic approaches for FMS.

Estimation of heart weight by post-mortem cardiac magnetic resonance imaging

Introduction The aim of this study was to determine which single measurement on post-mortem cardiac MR reflects actual heart weight as measured at autopsy, assess the intra- and inter-observer reliability of MR measurements, derive a formula to predict heart weight from MR measurements and test the accuracy of the formula to prospectively predict heart weight. Materials and methods 53 human cadavers underwent post-mortem cardiac MR and forensic autopsy. In Phase 1, left ventricular area and wall thickness were measured on short axis and four chamber view images of 29 cases. All measurements were correlated to heart weight at autopsy using linear regression analysis. In Phase 2, single left ventricular area measurements on four chamber view images (LVA_4C) from 24 cases were used to predict heart weight at autopsy based on equations derived during Phase 1. Intra-class correlation coefficient (ICC) was used to determine inter- and intra-reader agreement. Results Heart weight strongly correlates with LVA_4C (r=0.78 M; p<0.001). Intra-reader and inter-reader reliability was excellent for LVA_4C (ICC=0.81–0.91; p<0.001 and ICC=0.90; p<0.001 respectively). A simplified formula for heart weight ([g]≈LVA_4C [mm2]×0.11) was derived based on linear regression analysis. Conclusions This study shows that single circumferential area measurements of the left ventricle in the four chamber view on post-mortem cardiac MR reflect actual heart weight as measured at autopsy. These measurements yield an excellent intra- and inter-reader reliability and can be used to predict heart weight prior to autopsy or to give a reasonable estimate of heart weight in cases where autopsy is not performed.

Improving memory in elderly adults by instructing them in professional actors' learning strategies

This study examined a new type of cognitive intervention. For four weeks, participants (ages 65 to 82) were instructed in professional acting techniques, followed by rehearsal and performance of theatrical scenes. Although the training was not targeted in any way to the tasks used in pre- and post-testing, participants produced significantly higher recall and recognition scores after the intervention. It is suggested that the cognitive effort involved in analyzing and adopting theatrical characters' motivations (and then experiencing those characters' mental/emotional states during performance) is responsible for the observed improvement. A secondary strand of this study showed that participants who were given annotated scripts in which the implied goals of the characters were made explicit demonstrated significantly faster access to the stored material, as measured by a computer latency task.

Perceptual learning of motion discrimination by mental imagery.

Perceptual learning can occur when stimuli are only imagined, i.e., without proper stimulus presentation. For example, perceptual learning improved bisection discrimination when only the two outer lines of the bisection stimulus were presented and the central line had to be imagined. Performance improved also with other static stimuli. In non-learning imagery experiments, imagining static stimuli is different from imagining motion stimuli. We hypothesized that those differences also affect imagery perceptual learning. Here, we show that imagery training also improves motion direction discrimination. Learning occurs when no stimulus at all is presented during training, whereas no learning occurs when only noise is presented. The interference between noise and mental imagery possibly hinders learning. For static bisection stimuli, the pattern is just the opposite. Learning occurs when presented with the two outer lines of the bisection stimulus, i.e., with only a part of the visual stimulus, while no learning occurs when no stimulus at all is presented.

Sustainable Wastewater Management: Is it Possible to Regulate Micropollution in the Future by Learning from the Past? A Policy Analysis

This paper applies a policy analysis approach to the question of how to effectively regulate micropollution in a sustainable manner. Micropollution is a complex policy problem characterized by a huge number and diversity of chemical substances, as well as various entry paths into the aquatic environment. It challenges traditional water quality management by calling for new technologies in wastewater treatment and behavioral changes in industry, agriculture and civil society. In light of such challenges, the question arises as to how to regulate such a complex phenomenon to ensure water quality is maintained in the future? What can we learn from past experiences in water quality regulation? To answer these questions, policy analysis strongly focuses on the design and choice of policy instruments and the mix of such measures. In this paper, we review instruments commonly used in past water quality regulation. We evaluate their ability to respond to the characteristics of a more recent water quality problem, i.e., micropollution, in a sustainable way. This way, we develop a new framework that integrates both the problem dimension (i.e., causes and effects of a problem) as well as the sustainability dimension (e.g., long-term, cross-sectoral and multi-level) to assess which policy instruments are best suited to regulate micropollution. We thus conclude that sustainability criteria help to identify an appropriate instrument mix of end-of-pipe and source-directed measures to reduce aquatic micropollution.

Details of left ventricular radial wall motion supporting the ventricular theory of the third heart sound obtained by cardiac MR.

OBJECTIVE Obtaining new details of radial motion of left ventricular (LV) segments using velocity-encoding cardiac MRI. METHODS Cardiac MR examinations were performed on 14 healthy volunteers aged between 19 and 26 years. Cine images for navigator-gated phase contrast velocity mapping were acquired using a black blood segmented κ-space spoiled gradient echo sequence with a temporal resolution of 13.8 ms. Peak systolic and diastolic radial velocities as well as radial velocity curves were obtained for 16 ventricular segments. RESULTS Significant differences among peak radial velocities of basal and mid-ventricular segments have been recorded. Particular patterns of segmental radial velocity curves were also noted. An additional wave of outward radial movement during the phase of rapid ventricular filling, corresponding to the expected timing of the third heart sound, appeared of particular interest. CONCLUSION The technique has allowed visualization of new details of LV radial wall motion. In particular, higher peak systolic radial velocities of anterior and inferior segments are suggestive of a relatively higher dynamics of anteroposterior vs lateral radial motion in systole. Specific patterns of radial motion of other LV segments may provide additional insights into LV mechanics. ADVANCES IN KNOWLEDGE The outward radial movement of LV segments impacted by the blood flow during rapid ventricular filling provides a potential substrate for the third heart sound. A biphasic radial expansion of the basal anteroseptal segment in early diastole is likely to be related to the simultaneous longitudinal LV displacement by the stretched great vessels following repolarization and their close apposition to this segment.

The Effect of Direct Instruction versus Discovery Learning on the Understanding of Science Lessons by Second Grade Students

This study examined the effectiveness of discovery learning and direct instruction in a diverse second grade classroom. An assessment test and transfer task were given to students to examine which method of instruction enabled the students to grasp the content of a science lesson to a greater extent. Results demonstrated that students in the direct instruction group scored higher on the assessment test and completed the transfer task at a faster pace; however, this was not statistically significant. Results also suggest that a mixture of instructional styles would serve to effectively disseminate information, as well as motivate students to learn.

The effect of genotype-by-environment interaction on longitudinal triglyceride profiles in the Bogalusa Heart Study

Triglyceride levels are a component of plasma lipids that are thought to be an important risk factor for coronary heart disease and are influenced by genetic and environmental factors, such as single nucleotide polymorphisms (SNPs), alcohol intake, and smoking. This study used longitudinal data from the Bogalusa Heart Study, a biracial community-based survey of cardiovascular disease risk factors. A sample of 1191 individuals, 4 to 38 years of age, was measured multiple times from 1973 to 2000. The study sample consisted of 730 white and 461 African American participants. Individual growth models were developed in order to assess gene-environment interactions affecting plasma triglycerides over time. After testing for inclusion of significant covariates and interactions, final models, each accounting for the effects of a different SNP, were assessed for fit and normality. After adjustment for all other covariates and interactions, LIPC -514C/T was found to interact with age3, age2, and age and a non-significant interaction of CETP -971G/A genotype with smoking status was found (p = 0.0812). Ever-smokers had higher triglyceride levels than never smokers, but persons heterozygous at this locus, about half of both races, had higher triglyceride levels after smoking cessation compared to current smokers. Since tobacco products increase free fatty acids circulating in the bloodstream, smoking cessation programs have the potential to ultimately reduce triglyceride levels for many persons. However, due to the effect of smoking cessation on the triglyceride levels of CETP -971G/A heterozygotes, the need for smoking prevention programs is also demonstrated. Both smoking cessation and prevention programs would have a great public health impact on minimizing triglyceride levels and ultimately reducing heart disease. ^

Regulation of Protein Degradation in the Heart by AMP-Activated Protein Kinase

The degradation of proteins by the ubiquitin proteasome system is essential for cellular homeostasis in the heart. An important regulator of metabolic homeostasis is AMP-activated protein kinase (AMPK). During nutrient deprivation, AMPK is activated and intracellular proteolysis is enhanced through the ubiquitin proteasome system (UPS). Whether AMPK plays a role in protein degradation through the UPS in the heart is not known. Here I present data in support of the hypothesis that AMPK transcriptionally regulates key players in the UPS, which, under extreme conditions can be detrimental to the heart. The ubiquitin ligases MAFbx /Atrogin-1 and MuRF1, key regulators of protein degradation, and AMPK activity are increased during nutrient deprivation. Pharmacologic and genetic activation of AMPK is sufficient for the induction of MAFbx/Atrogin-1 and MuRF1 in cardiomyocytes and in the heart in vivo. Comprehensive experiments demonstrate that the molecular mechanism by which AMPK regulates MuRF1 expression is through the transcription factor myocyte enhancer factor 2 (MEF2), which is involved in stress response and cardiomyocyte remodeling. MuRF1 is required for AMPK-mediated protein degradation through the UPS in cardiomyocytes. Consequently, the absence of MuRF1 during chronic fasting preserves cardiac function, possibly by limiting degradation of critical metabolic enzymes. Furthermore, during cardiac hypertrophy, chronic activation of AMPK also leads to cardiac dysfunction, possibly through enhanced protein degradation and metabolic dysregulation. Collectively, my findings demonstrate that AMPK regulates expression of ubiquitin ligases which are required for UPS-mediated protein degradation in the heart. Based on these results, I propose that specific metabolic signals may serve as modulators of intracellular protein degradation in the heart.

Regulation of Protein Degradation in the Heart by AMP-Activated Protein Kinase

The degradation of proteins by the ubiquitin proteasome system is essential for cellular homeostasis in the heart. An important regulator of metabolic homeostasis is AMP-activated protein kinase (AMPK). During nutrient deprivation, AMPK is activated and intracellular proteolysis is enhanced through the ubiquitin proteasome system (UPS). Whether AMPK plays a role in protein degradation through the UPS in the heart is not known. Here I present data in support of the hypothesis that AMPK transcriptionally regulates key players in the UPS, which, under extreme conditions can be detrimental to the heart. The ubiquitin ligases MAFbx /Atrogin-1 and MuRF1, key regulators of protein degradation, and AMPK activity are increased during nutrient deprivation. Pharmacologic and genetic activation of AMPK is sufficient for the induction of MAFbx/Atrogin-1 and MuRF1 in cardiomyocytes and in the heart in vivo. Comprehensive experiments demonstrate that the molecular mechanism by which AMPK regulates MuRF1 expression is through the transcription factor myocyte enhancer factor 2 (MEF2), which is involved in stress response and cardiomyocyte remodeling. MuRF1 is required for AMPK-mediated protein degradation through the UPS in cardiomyocytes. Consequently, the absence of MuRF1 during chronic fasting preserves cardiac function, possibly by limiting degradation of critical metabolic enzymes. Furthermore, during cardiac hypertrophy, chronic activation of AMPK also leads to cardiac dysfunction, possibly through enhanced protein degradation and metabolic dysregulation. Collectively, my findings demonstrate that AMPK regulates expression of ubiquitin ligases which are required for UPS-mediated protein degradation in the heart. Based on these results, I propose that specific metabolic signals may serve as modulators of intracellular protein degradation in the heart.

Stress Detection by means of Stress Physiological Template

This paper describes a stress detection system based on fuzzy logic and two physiological signals: Galvanic Skin Response and Heart Rate. Instead of providing a global stress classification, this approach creates an individual stress templates, gathering the behaviour of individuals under situations with different degrees of stress. The proposed method is able to detect stress properly with a rate of 99.5%, being evaluated with a database of 80 individuals. This result improves former approaches in the literature and well-known machine learning techniques like SVM, k-NN, GMM and Linear Discriminant Analysis. Finally, the proposed method is highly suitable for real-time applications