Spatio-Temporal Credit Assignment in Neuronal Population Learning

n learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain.

Dopamine-related deficit in reward learning after catecholamine depletion in unmedicated, remitted subjects with bulimia nervosa

Disturbances in reward processing have been implicated in bulimia nervosa (BN). Abnormalities in processing reward-related stimuli might be linked to dysfunctions of the catecholaminergic neurotransmitter system, but findings have been inconclusive. A powerful way to investigate the relationship between catecholaminergic function and behavior is to examine behavioral changes in response to experimental catecholamine depletion (CD). The purpose of this study was to uncover putative catecholaminergic dysfunction in remitted subjects with BN who performed a reinforcement-learning task after CD. CD was achieved by oral alpha-methyl-para-tyrosine (AMPT) in 19 unmedicated female subjects with remitted BN (rBN) and 28 demographically matched healthy female controls (HC). Sham depletion administered identical capsules containing diphenhydramine. The study design consisted of a randomized, double-blind, placebo-controlled crossover, single-site experimental trial. The main outcome measures were reward learning in a probabilistic reward task analyzed using signal-detection theory. Secondary outcome measures included self-report assessments, including the Eating Disorder Examination-Questionnaire. Relative to healthy controls, rBN subjects were characterized by blunted reward learning in the AMPT-but not in placebo-condition. Highlighting the specificity of these findings, groups did not differ in their ability to perceptually distinguish between stimuli. Increased CD-induced anhedonic (but not eating disorder) symptoms were associated with a reduced response bias toward a more frequently rewarded stimulus. In conclusion, under CD, rBN subjects showed reduced reward learning compared with healthy control subjects. These deficits uncover disturbance of the central reward processing systems in rBN related to altered brain catecholamine levels, which might reflect a trait-like deficit increasing vulnerability to BN.

The free radical scavenger alpha-phenyl-tert-butyl nitrone aggravates hippocampal apoptosis and learning deficits in experimental pneumococcal meningitis

The effect of adjuvant therapy with the radical scavenger alpha-phenyl-tert-butyl nitrone (PBN; 100 mg/kg given intraperitoneally every 8 h for 5 days) on brain injury and learning function was evaluated in an infant rat model of pneumococcal meningitis. Meningitis led to cortical necrotic injury (median, 3.97% [range, 0%-38.9%] of the cortex), which was reduced to a median of 0% (range, 0%-30.9%) of the cortex (P<.001) by PBN. However, neuronal apoptosis in the hippocampal dentate gyrus was increased by PBN, compared with that by saline (median score, 1.15 [range, 0.04-1.73] vs. 0.31 [range, 0-0.92]; P<.001). Learning function 3 weeks after cured infection, as assessed by the Morris water maze, was decreased, compared with that in uninfected control animals (P<.001). Parallel to the increase in hippocampal apoptosis, PBN further impaired learning in infected animals, compared with that in saline-treated animals (P<.02). These results contrast with those of an earlier study, in which PBN reduced cortical and hippocampal neuronal injury in group B streptococcal meningitis. Thus, in pneumococcal meningitis, antioxidant therapy with PBN aggravates hippocampal injury and learning deficits.

Social Learning Processes in Swiss Soil Protection? The 'From Farmer - To Farmer' Project

Social learning approaches have become a prominent focus in studies related to sustainable agriculture. In order to better understand the potential of social learning for more sustainable development, the present study assessed the processes, effects and facilitating elements of interaction related to social learning in the context of Swiss soil protection and the innovative ‘From Farmer - To Farmer’ project. The study reveals that social learning contributes to fundamental transformations of patterns of interactions. However, the study also demonstrates that a learning-oriented understanding of sustainable development implies including analysis of the institutional environments in which the organizations of the individual representatives of face-to-face-based social learning processes are operating. This has shown to be a decisive element when face-to-face-based learning processes of the organisations’ representatives are translated into organisational learning. Moreover, the study revealed that this was achieved not directly through formalisation of new lines of institutionalised cooperation but by establishing links in a ‘boundary space’ trying out new forms of collaboration, aiming at social learning and co-production of knowledge. It is argued that further research on social learning processes should give greater emphasis to this intermediary level of ‘boundary spaces’.

Explaining Variations in Client Extra Costs between Software Projects Offshored to India

Gaining economic benefits from substantially lower labor costs has been reported as a major reason for offshoring labor-intensive information systems services to low-wage countries. However, if wage differences are so high, why is there such a high level of variation in the economic success between offshored IS projects? This study argues that offshore outsourcing involves a number of extra costs for the ^his paper was recommended for acceptance by Associate Guest Editor Erran Carmel. client organization that account for the economic failure of offshore projects. The objective is to disaggregate these extra costs into their constituent parts and to explain why they differ between offshored software projects. The focus is on software development and maintenance projects that are offshored to Indian vendors. A theoretical framework is developed a priori based on transaction cost economics (TCE) and the knowledge-based view of the firm, comple mented by factors that acknowledge the specific offshore context The framework is empirically explored using a multiple case study design including six offshored software projects in a large German financial service institution. The results of our analysis indicate that the client incurs post contractual extra costs for four types of activities: (1) re quirements specification and design, (2) knowledge transfer, (3) control, and (4) coordination. In projects that require a high level of client-specific knowledge about idiosyncratic business processes and software systems, these extra costs were found to be substantially higher than in projects where more general knowledge was needed. Notably, these costs most often arose independently from the threat of oppor tunistic behavior, challenging the predominant TCE logic of market failure. Rather, the client extra costs were parti cularly high in client-specific projects because the effort for managing the consequences of the knowledge asymmetries between client and vendor was particularly high in these projects. Prior experiences of the vendor with related client projects were found to reduce the level of extra costs but could not fully offset the increase in extra costs in highly client-specific projects. Moreover, cultural and geographic distance between client and vendor as well as personnel turnover were found to increase client extra costs. Slight evidence was found, however, that the cost-increasing impact of these factors was also leveraged in projects with a high level of required client-specific knowledge (moderator effect).

Dexamethasone aggravates hippocampal apoptosis and learning deficiency in pneumococcal meningitis in infant rats.

In an infant rat model of pneumococcal meningitis the effect of dexamethasone on neuronal injury in the hippocampus and on learning disability after recovery from the disease was examined. Treatment with dexamethasone or vehicle was started 18 h after infection, concomitant with antibiotics. Neuronal apoptosis in the hippocampal dentate gyrus 34 h after infection was significantly aggravated by dexamethasone treatment compared with vehicle controls (p = 0.02). Three weeks after acute pneumococcal meningitis, learning capacity of animals was assessed in the Morris water maze. The results showed a significantly impaired learning performance of infected animals treated with dexamethasone compared with vehicle controls (p = 0.01). Dexamethasone had no effect on hippocampal injury or learning in uninfected controls. Thus, dexamethasone as adjuvant therapy increased hippocampal cell injury and reduced learning capacity in this model of pneumococcal meningitis in infant rats.

Interprofessional Education in Anatomy: Learning Together in Medical and Nursing Training

Teamwork and the interprofessional collaboration of all health professions are a guarantee of patient safety and highly qualified treatment in patient care. In the daily clinical routine, physicians and nurses must work together, but the education of the different health professions occurs separately in various places, mostly without interrelated contact. Such training abets mutual misunderstanding and cements professional protectionism, which is why interprofessional education can play an important role in dismantling such barriers to future cooperation. In this article, a pilot project in interprofessional education involving both medical and nursing students is presented, and the concept and the course of training are described in detail. The report illustrates how nursing topics and anatomy lectures can be combined for interprofessional learning in an early phase of training. Evaluation of the course showed that the students were highly satisfied with the collaborative training and believed interprofessional education (IPE) to be an important experience for their future profession and understanding of other health professionals. The results show that the IPE teaching concept, which combines anatomy and nursing topics, provides an optimal setting for learning together and helps nurses and doctors in training to gain knowledge about other health professionals’ roles, thus evolving mutual understanding.

Beyond statistical learning? Continuous sequence repetition matters in implicit sequence learning

Typically, statistical learning is investigated by testing the acquisition of specific items or forming general rules. As implicit sequence learning also involves the extraction of regularities from the environment, it can also be considered as an instance of statistical learning. In the present study, a Serial Reaction Time Task was used to test whether the continuous versus interleaved repetition of a sequence affects implicit learning despite the equal exposure to the sequences. The results revealed a sequence learning advantage for the continuous repetition condition compared to the interleaved condition. This suggests that by repetition, additional sequence information was extracted although the exposure to the sequences was identical as in the interleaved condition. The results are discussed in terms of similarities and potential differences between typical statistical learning paradigms and sequence learning.

Statistical Learning, Syllable Processing, and Speech Production in Healthy Hearing and Hearing-Impaired Preschool Children: A Mismatch Negativity Study

OBJECTIVES The objectives of the present study were to investigate temporal/spectral sound-feature processing in preschool children (4 to 7 years old) with peripheral hearing loss compared with age-matched controls. The results verified the presence of statistical learning, which was diminished in children with hearing impairments (HIs), and elucidated possible perceptual mediators of speech production. DESIGN Perception and production of the syllables /ba/, /da/, /ta/, and /na/ were recorded in 13 children with normal hearing and 13 children with HI. Perception was assessed physiologically through event-related potentials (ERPs) recorded by EEG in a multifeature mismatch negativity paradigm and behaviorally through a discrimination task. Temporal and spectral features of the ERPs during speech perception were analyzed, and speech production was quantitatively evaluated using speech motor maximum performance tasks. RESULTS Proximal to stimulus onset, children with HI displayed a difference in map topography, indicating diminished statistical learning. In later ERP components, children with HI exhibited reduced amplitudes in the N2 and early parts of the late disciminative negativity components specifically, which are associated with temporal and spectral control mechanisms. Abnormalities of speech perception were only subtly reflected in speech production, as the lone difference found in speech production studies was a mild delay in regulating speech intensity. CONCLUSIONS In addition to previously reported deficits of sound-feature discriminations, the present study results reflect diminished statistical learning in children with HI, which plays an early and important, but so far neglected, role in phonological processing. Furthermore, the lack of corresponding behavioral abnormalities in speech production implies that impaired perceptual capacities do not necessarily translate into productive deficits.