Learning by Not Doing: Subsidy Disciplines in Services Trade

This paper explores the hitherto futile quest for developing disciplines on the trade- and investment-distorting effects of services subsidies. It sheds light on the multiplicity of factors that have weighed on the conduct of negotiations on subsidy disciplines in a services trade context at both the global and preferential levels, and advances a few thoughts on what the future may hold for the adoption of such disciplines. The analysis suggests that it is rather unlikely that WTO Members will any time soon reach a consensus on the matter of subsidy disciplines for services beyond those that currently (and timidly) obtain in the GATS and in many preferential trade agreements. The main reason behind such a conclusion stems from a marked rise in the value of preserving policy space in a trading environment characterized by considerably greater global market contestability than two decades ago.

Spatio-temporal credit assignment in population learning

Learning by reinforcement is important in shaping animal behavior, and in particular in behavioral decision making. Such decision making is likely to involve the integration of many synaptic events in space and time. However, using a single reinforcement signal to modulate synaptic plasticity, as suggested in classical reinforcement learning algorithms, a twofold problem arises. Different synapses will have contributed differently to the behavioral decision, and even for one and the same synapse, releases at different times may have had different effects. Here we present a plasticity rule which solves this spatio-temporal credit assignment problem in a population of spiking neurons. The learning rule is spike-time dependent and maximizes the expected reward by following its stochastic gradient. Synaptic plasticity is modulated not only by the reward, but also by a population feedback signal. While this additional signal solves the spatial component of the problem, the temporal one is solved by means of synaptic eligibility traces. In contrast to temporal difference (TD) based approaches to reinforcement learning, our rule is explicit with regard to the assumed biophysical mechanisms. Neurotransmitter concentrations determine plasticity and learning occurs fully online. Further, it works even if the task to be learned is non-Markovian, i.e. when reinforcement is not determined by the current state of the system but may also depend on past events. The performance of the model is assessed by studying three non-Markovian tasks. In the first task, the reward is delayed beyond the last action with non-related stimuli and actions appearing in between. The second task involves an action sequence which is itself extended in time and reward is only delivered at the last action, as it is the case in any type of board-game. The third task is the inspection game that has been studied in neuroeconomics, where an inspector tries to prevent a worker from shirking. Applying our algorithm to this game yields a learning behavior which is consistent with behavioral data from humans and monkeys, revealing themselves properties of a mixed Nash equilibrium. The examples show that our neuronal implementation of reward based learning copes with delayed and stochastic reward delivery, and also with the learning of mixed strategies in two-opponent games.

Spatio-temporal credit assignment in population learning

Learning by reinforcement is important in shaping animal behavior. But behavioral decision making is likely to involve the integration of many synaptic events in space and time. So in using a single reinforcement signal to modulate synaptic plasticity a twofold problem arises. Different synapses will have contributed differently to the behavioral decision and, even for one and the same synapse, releases at different times may have had different effects. Here we present a plasticity rule which solves this spatio-temporal credit assignment problem in a population of spiking neurons. The learning rule is spike time dependent and maximizes the expected reward by following its stochastic gradient. Synaptic plasticity is modulated not only by the reward but by a population feedback signal as well. While this additional signal solves the spatial component of the problem, the temporal one is solved by means of synaptic eligibility traces. In contrast to temporal difference based approaches to reinforcement learning, our rule is explicit with regard to the assumed biophysical mechanisms. Neurotransmitter concentrations determine plasticity and learning occurs fully online. Further, it works even if the task to be learned is non-Markovian, i.e. when reinforcement is not determined by the current state of the system but may also depend on past events. The performance of the model is assessed by studying three non-Markovian tasks. In the first task the reward is delayed beyond the last action with non-related stimuli and actions appearing in between. The second one involves an action sequence which is itself extended in time and reward is only delivered at the last action, as is the case in any type of board-game. The third is the inspection game that has been studied in neuroeconomics. It only has a mixed Nash equilibrium and exemplifies that the model also copes with stochastic reward delivery and the learning of mixed strategies.

Spatio-temporal credit assignment in population learning

We present a model for plasticity induction in reinforcement learning which is based on a cascade of synaptic memory traces. In the cascade of these so called eligibility traces presynaptic input is first corre lated with postsynaptic events, next with the behavioral decisions and finally with the external reinforcement. A population of leaky integrate and fire neurons endowed with this plasticity scheme is studied by simulation on different tasks. For operant co nditioning with delayed reinforcement, learning succeeds even when the delay is so large that the delivered reward reflects the appropriateness, not of the immediately preceeding response, but of a decision made earlier on in the stimulus - decision sequence . So the proposed model does not rely on the temporal contiguity between decision and pertinent reward and thus provides a viable means of addressing the temporal credit assignment problem. In the same task, learning speeds up with increasing population si ze, showing that the plasticity cascade simultaneously addresses the spatial problem of assigning credit to the different population neurons. Simulations on other task such as sequential decision making serve to highlight the robustness of the proposed sch eme and, further, contrast its performance to that of temporal difference based approaches to reinforcement learning.

Different molecular and structural adaptations with eccentric and conventional strength training in elderly men and women

Reprogramming of gene expression contributes to structural and functional adaptation of muscle tissue in response to altered use. The aim of this study was to investigate mechanisms for observed improvements in leg extension strength, gain in relative thigh muscle mass and loss of body and thigh fat content in response to eccentric and conventional strength training in elderly men (n = 14) and women (n = 14; average age of the men and women: 80.1 ± 3.7 years) by means of structural and molecular analyses. Biopsies were collected from m. vastus lateralis in the resting state before and after 12 weeks of training with two weekly resistance exercise sessions (RET) or eccentric ergometer sessions (EET). Gene expression was analyzed using custom-designed low-density PCR arrays. Muscle ultrastructure was evaluated using EM morphometry. Gain in thigh muscle mass was paralleled by an increase in muscle fiber cross-sectional area (hypertrophy) with RET but not with EET, where muscle growth is likely occurring by the addition of sarcomeres in series or by hyperplasia. The expression of transcripts encoding factors involved in muscle growth, repair and remodeling (e.g., IGF-1, HGF, MYOG, MYH3) was increased to a larger extent after EET than RET. MicroRNA 1 expression was decreased independent of the training modality, and was paralleled by an increased expression of IGF-1 representing a potential target. IGF-1 is a potent promoter of muscle growth, and its regulation by microRNA 1 may have contributed to the gain of muscle mass observed in our subjects. EET depressed genes encoding mitochondrial and metabolic transcripts. The changes of several metabolic and mitochondrial transcripts correlated significantly with changes in mitochondrial volume density. Intramyocellular lipid content was decreased after EET concomitantly with total body fat. Changes in intramyocellular lipid content correlated with changes in body fat content with both RET and EET. In the elderly, RET and EET lead to distinct molecular and structural adaptations which might contribute to the observed small quantitative differences in functional tests and body composition parameters. EET seems to be particularly convenient for the elderly with regard to improvements in body composition and strength but at the expense of reducing muscular oxidative capacity.

Dopamine-related deficit in reward learning after catecholamine depletion in unmedicated, remitted subjects with bulimia nervosa

Disturbances in reward processing have been implicated in bulimia nervosa (BN). Abnormalities in processing reward-related stimuli might be linked to dysfunctions of the catecholaminergic neurotransmitter system, but findings have been inconclusive. A powerful way to investigate the relationship between catecholaminergic function and behavior is to examine behavioral changes in response to experimental catecholamine depletion (CD). The purpose of this study was to uncover putative catecholaminergic dysfunction in remitted subjects with BN who performed a reinforcement-learning task after CD. CD was achieved by oral alpha-methyl-para-tyrosine (AMPT) in 19 unmedicated female subjects with remitted BN (rBN) and 28 demographically matched healthy female controls (HC). Sham depletion administered identical capsules containing diphenhydramine. The study design consisted of a randomized, double-blind, placebo-controlled crossover, single-site experimental trial. The main outcome measures were reward learning in a probabilistic reward task analyzed using signal-detection theory. Secondary outcome measures included self-report assessments, including the Eating Disorder Examination-Questionnaire. Relative to healthy controls, rBN subjects were characterized by blunted reward learning in the AMPT-but not in placebo-condition. Highlighting the specificity of these findings, groups did not differ in their ability to perceptually distinguish between stimuli. Increased CD-induced anhedonic (but not eating disorder) symptoms were associated with a reduced response bias toward a more frequently rewarded stimulus. In conclusion, under CD, rBN subjects showed reduced reward learning compared with healthy control subjects. These deficits uncover disturbance of the central reward processing systems in rBN related to altered brain catecholamine levels, which might reflect a trait-like deficit increasing vulnerability to BN.

Chronotropic incompetence predicts impaired response to exercise training in heart failure patients in sinus rhythm

Background: In most patients with chronic heart failure (CHF), endurance training improves exercise capacity. However, some patients do not respond favourably. The purpose of this study was to explore the reasons of non-response and to determine their predictive value.Methods: We studied a cohort of 120 consecutive CHF patients with sinus rhythm (mean age 57 ± 12 years, ejection fraction 29.3 ± 9.9%, peak VO2 17.3 ± 5.1 ml/min/kg), participating in a 3-month outpatient cardiac rehabilitation programme. Responders were defined as subjects who improved peak VO2 by more than 5%, work load by more than 10%, or VE/VCO2 slope by more than 5%. Subjects who did not fulfil at least one of the above criteria were characterized as non-responders. Multivariate regression analyses were performed to identify parameters that were predictive for a response. Receiver operating characteristic (ROC) analyses were performed for predictive parameters to identify thresholds for response or non-response.Results: Multivariate regression analyses revealed heart rate (HR) reserve, HR recovery at 1 min, and peak HR as significant predictors for a positive training response. ROC curves revealed the optimal thresholds separating responders from non-responders at less than 30 bpm for HR reserve, less than 6 bpm for HR recovery and less than 101 bpm for peak HR.Conclusions: The presence of impaired chronotropic competence is a major predictor of poor training response in CHF patients with sinus rhythm.

Exercise training in normobaric hypoxia in endurance runners. II. Improvement of mitochondrial properties in skeletal muscle

This study investigates whether adaptations of mitochondrial function accompany the improvement of endurance performance capacity observed in well-trained athletes after an intermittent hypoxic training program. Fifteen endurance-trained athletes performed two weekly training sessions on treadmill at the velocity associated with the second ventilatory threshold (VT2) with inspired O2 fraction = 14.5% [hypoxic group (Hyp), n = 8] or with inspired O2 fraction = 21% [normoxic group (Nor), n = 7], integrated into their usual training, for 6 wk. Before and after training, oxygen uptake (VO2) and speed at VT2, maximal VO2 (VO2 max), and time to exhaustion at velocity of VO2 max (minimal speed associated with VO2 max) were measured, and muscle biopsies of vastus lateralis were harvested. Muscle oxidative capacities and sensitivity of mitochondrial respiration to ADP (Km) were evaluated on permeabilized muscle fibers. Time to exhaustion, VO2 at VT2, and VO2 max were significantly improved in Hyp (+42, +8, and +5%, respectively) but not in Nor. No increase in muscle oxidative capacity was obtained with either training protocol. However, mitochondrial regulation shifted to a more oxidative profile in Hyp only as shown by the increased Km for ADP (Nor: before 476 +/- 63, after 524 +/- 62 microM, not significant; Hyp: before 441 +/- 59, after 694 +/- 51 microM, P < 0.05). Thus including hypoxia sessions into the usual training of athletes qualitatively ameliorates mitochondrial function by increasing the respiratory control by creatine, providing a tighter integration between ATP demand and supply.

Facial affect recognition training in autism: can we animate the fusiform gyrus?

One of the most consistent findings in the neuroscience of autism is hypoactivation of the fusiform gyrus (FG) during face processing. In this study the authors examined whether successful facial affect recognition training is associated with an increased activation of the FG in autism. The effect of a computer-based program to teach facial affect identification was examined in 10 individuals with high-functioning autism. Blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) changes in the FG and other regions of interest, as well as behavioral facial affect recognition measures, were assessed pre- and posttraining. No significant activation changes in the FG were observed. Trained participants showed behavioral improvements, which were accompanied by higher BOLD fMRI signals in the superior parietal lobule and maintained activation in the right medial occipital gyrus.

Structured training in intraosseous infusion to improve potentially life saving skills in pediatric emergencies - Results of an open prospective national quality development project over 3 years

BACKGROUND: Children in emergencies need peripheral intravenous (IV) access in order to receive drugs or fluids. The success of IV access is associated with the age of patients and fails in up to 50% of children younger than 6 years. In such situations, it is essential that physicians and paramedics have a tool and easily learnable skills with a high chance of success. According to international guidelines intraosseous (IO) access would be the next step after failed IV access. Our hypothesis was that the success rate in IO puncturing can be improved by standardizing the training; so we developed an IO workshop. METHODS: Twenty-eight hospitals and ambulance services participated in an evaluation process over 3 years. IO workshops and the distribution of standardized IO sets were coordinated by the study group of the University Hospital of Berne. Any attempted or successful IO punctures were evaluated with a standardized interview. RESULTS: We investigated 35 applications in 30 patients (a total of 49 punctures) between November 2001 and December 2004. IO puncture was not successful in 5 patients. The success rate depended neither on the occupation nor the experience of users. Attendance at a standardized IO workshop increased the overall success rate from 77% to 100%, which was statistically not significant (P = 0.074). CONCLUSIONS: Standardized training in IO puncturing seems to improve success more than previous experience and occupation of providers. However, we could not show a significant increase in success rate after this training. Larger supranational studies are needed to show a significant impact of teaching on rarely used emergency skills.

Training in hypoxia and its effects on skeletal muscle tissue

It is well established that local muscle tissue hypoxia is an important consequence and possibly a relevant adaptive signal of endurance exercise training in humans. It has been reasoned that it might be advantageous to increase this exercise stimulus by working in hypoxia. However, as long-term exposure to severe hypoxia has been shown to be detrimental to muscle tissue, experimental protocols were developed that expose subjects to hypoxia only for the duration of the exercise session and allow recovery in normoxia (live low-train high or hypoxic training). This overview reports data from 27 controlled studies using some implementation of hypoxic training paradigms. Hypoxia exposure varied between 2300 and 5700 m and training duration ranged from 10 days to 8 weeks. A similar number of studies was carried out on untrained and on trained subjects. Muscle structural, biochemical and molecular findings point to a specific role of hypoxia in endurance training. However, based on the available data on global estimates of performance capacity such as maximal oxygen uptake (VO2max) and maximal power output (Pmax), hypoxia as a supplement to training is not consistently found to be of advantage for performance at sea level. There is some evidence mainly from studies on untrained subjects for an advantage of hypoxic training for performance at altitude. Live low-train high may be considered when altitude acclimatization is not an option.

Eccentric endurance training in subjects with coronary artery disease: a novel exercise paradigm in cardiac rehabilitation?

This study evaluated the effects of 8 weeks of eccentric endurance training (EET) in male subjects (age range 42-66 years) with coronary artery disease (CAD). EET was compared to concentric endurance training (CET) carried out at the same metabolic exercise intensity, three times per week for half an hour. CET ( n=6) was done on a conventional cycle ergometer and EET ( n=6) on a custom-built motor-driven ergometer. During the first 5 weeks of the training program the metabolic load was progressively increased to 60% of peak oxygen uptake in both groups. At this metabolic load, mechanical work rate achieved was 97 (8) W [mean (SE)] for CET and 338 (34) W for EET, respectively. Leg muscle mass was determined by dual-energy X-ray absorptiometry, quadriceps strength with an isokinetic dynamometer and muscle fibre composition of the vastus lateralis muscle with morphometry. The leg muscle mass increased significantly in both groups by some 3%. Strength parameters of knee extensors improved in EET only. Significant changes of +11 (4.9)%, +15 (3.2)% and +9 (2.5)% were reached for peak isometric torque and peak concentric torques at 60 degrees s(-1) and 120 degrees s(-1), respectively. Fibre size increased significantly by 19% in CET only. In conclusion, the present investigation showed that EET is feasible in middle-aged CAD patients and has functional advantages over CET by increasing muscle strength. Muscle mass increased similarly in both groups whereas muscle structural composition was differently affected by the respective training protocols. Potential limitations of this study are the cautiously chosen conditioning protocol and the restricted number of subjects.

Learning by the Dendritic Prediction of Somatic Spiking

Recent modeling of spike-timing-dependent plasticity indicates that plasticity involves as a third factor a local dendritic potential, besides pre- and postsynaptic firing times. We present a simple compartmental neuron model together with a non-Hebbian, biologically plausible learning rule for dendritic synapses where plasticity is modulated by these three factors. In functional terms, the rule seeks to minimize discrepancies between somatic firings and a local dendritic potential. Such prediction errors can arise in our model from stochastic fluctuations as well as from synaptic input, which directly targets the soma. Depending on the nature of this direct input, our plasticity rule subserves supervised or unsupervised learning. When a reward signal modulates the learning rate, reinforcement learning results. Hence a single plasticity rule supports diverse learning paradigms.

Matching Recall and Storage in Sequence Learning with Spiking Neural Networks

Storing and recalling spiking sequences is a general problem the brain needs to solve. It is, however, unclear what type of biologically plausible learning rule is suited to learn a wide class of spatiotemporal activity patterns in a robust way. Here we consider a recurrent network of stochastic spiking neurons composed of both visible and hidden neurons. We derive a generic learning rule that is matched to the neural dynamics by minimizing an upper bound on the Kullback–Leibler divergence from the target distribution to the model distribution. The derived learning rule is consistent with spike-timing dependent plasticity in that a presynaptic spike preceding a postsynaptic spike elicits potentiation while otherwise depression emerges. Furthermore, the learning rule for synapses that target visible neurons can be matched to the recently proposed voltage-triplet rule. The learning rule for synapses that target hidden neurons is modulated by a global factor, which shares properties with astrocytes and gives rise to testable predictions.