Spatio-temporal credit assignment in population learning

Learning by reinforcement is important in shaping animal behavior. But behavioral decision making is likely to involve the integration of many synaptic events in space and time. So in using a single reinforcement signal to modulate synaptic plasticity a twofold problem arises. Different synapses will have contributed differently to the behavioral decision and, even for one and the same synapse, releases at different times may have had different effects. Here we present a plasticity rule which solves this spatio-temporal credit assignment problem in a population of spiking neurons. The learning rule is spike time dependent and maximizes the expected reward by following its stochastic gradient. Synaptic plasticity is modulated not only by the reward but by a population feedback signal as well. While this additional signal solves the spatial component of the problem, the temporal one is solved by means of synaptic eligibility traces. In contrast to temporal difference based approaches to reinforcement learning, our rule is explicit with regard to the assumed biophysical mechanisms. Neurotransmitter concentrations determine plasticity and learning occurs fully online. Further, it works even if the task to be learned is non-Markovian, i.e. when reinforcement is not determined by the current state of the system but may also depend on past events. The performance of the model is assessed by studying three non-Markovian tasks. In the first task the reward is delayed beyond the last action with non-related stimuli and actions appearing in between. The second one involves an action sequence which is itself extended in time and reward is only delivered at the last action, as is the case in any type of board-game. The third is the inspection game that has been studied in neuroeconomics. It only has a mixed Nash equilibrium and exemplifies that the model also copes with stochastic reward delivery and the learning of mixed strategies.

Retraining of interjoint arm coordination after stroke using robot-assisted time-independent functional training

We have developed a haptic-based approach for retraining of interjoint coordination following stroke called time-independent functional training (TIFT) and implemented this mode in the ARMin III robotic exoskeleton. The ARMin III robot was developed by Drs. Robert Riener and Tobias Nef at the Swiss Federal Institute of Technology Zurich (Eidgenossische Technische Hochschule Zurich, or ETH Zurich), in Zurich, Switzerland. In the TIFT mode, the robot maintains arm movements within the proper kinematic trajectory via haptic walls at each joint. These arm movements focus training of interjoint coordination with highly intuitive real-time feedback of performance; arm movements advance within the trajectory only if their movement coordination is correct. In initial testing, 37 nondisabled subjects received a single session of learning of a complex pattern. Subjects were randomized to TIFT or visual demonstration or moved along with the robot as it moved though the pattern (time-dependent [TD] training). We examined visual demonstration to separate the effects of action observation on motor learning from the effects of the two haptic guidance methods. During these training trials, TIFT subjects reduced error and interaction forces between the robot and arm, while TD subject performance did not change. All groups showed significant learning of the trajectory during unassisted recall trials, but we observed no difference in learning between groups, possibly because this learning task is dominated by vision. Further testing in stroke populations is warranted.

Reshaping Rural Extension: Learning for Sustainability (LforS): An Integrative and Learning-Based Advisory Approach for Rural Extension with Small-Scale Farmers

This publication offers concrete suggestions for implementing an integrative and learning-oriented approach to agricultural extension with the goal of fostering sustainable development. It targets governmental and non-governmental organisations, development agencies, and extension staff working in the field of rural development. The book looks into the conditions and trends that influence extension today, and outlines new challenges and necessary adaptations. It offers a basic reflection on the goals, the criteria for success and the form of a state-of-the-art approach to extension. The core of the book consists of a presentation of Learning for Sustainability (LforS), an example of an integrative, learning-oriented approach that is based on three crucial elements: stakeholder dialogue, knowledge management, and organizational development. Awareness raising and capacity building, social mobilization, and monitoring & evaluation are additional building blocks. The structure and organisation of the LforS approach as well as a selection of appropriate methods and tools are presented. The authors also address key aspects of developing and managing a learning-oriented extension approach. The book illustrates how LforS can be implemented by presenting two case studies, one from Madagascar and one from Mongolia. It addresses conceptual questions and at the same time it is practice-oriented. In contrast to other extension approaches, LforS does not limit its focus to production-related aspects and the development of value chains: it also addresses livelihood issues in a broad sense. With its focus on learning processes LforS seeks to create a better understanding of the links between different spheres and different levels of decision-making; it also seeks to foster integration of the different actors’ perspectives.

Does the Presence of a Learning Disability Elicit a Stigmatization?

Aims: To determine whether or not a Learning Disability(LD) label leads to stigmatization. Study Design: This research used a 2(sex of participant) x 2(LD label)x 2 (Sex of stimulus person) factorial design. Place and Duration of Study: Bucknell University, between October 2010 and April 2011. Methodology: Sample: We included 200 participants (137 women and 63 men, ranging in age from 18 – 75 years, M = 26.41. Participants rated the stimulus individual on 27 personality traits, 8 Life success measures, and the Big-5 personality dimensions. Also, participants completed a Social Desirability measure. Results: A MANOVA revealed a main effect for the Learning Disability description, F(6, 185) = 6.41 p< .0001, eta2 = .17,for the Big-5 personality dimensions, Emotional Stability, F(1, 185) = 13.39, p < .001, eta2 = .066, and Openness to Experiences F(1,185) = 7.12, p< .008, eta2 = .036.Stimulus individuals described as having a learning disability were perceived as being less emotionally stable and more open to experiences than those described as not having a learning disability. Another MANOVA revealed a main effect for having a disability or not, F(8, 183) = 4.29, p< .0001, eta2 = .158, for the Life Success items, Attractiveness, F(1, 198) = 16.63, p< .0001, eta2 = .080, and Future Success,F(1, 198) = 4.57, p< .034, eta2 = .023. Stimulus individuals described as having a learning disability were perceived as being less attractive and with less potential for success than those described as not having a learning disability. Conclusion: The results of this research provide evidence that a bias exists toward those who have learning disabilities. The mere presence of an LD label had the ability to cause a differential perception of those with LDs and those without LDs.

Learning My Lessons: Research, Rehearsal, and Reflection on the Greats

A successful actor often requires a specific acting method or style to enhance their performance. Through theatrical research, rehearsal and performance, an actor can narrow down their seemingly endless search for the most productive methodology. By researching, studying, and applying the methods of Constantin Stanislavski, Stella Adler,and Tadashi Suzuki to my rehearsal process, I have found my most effective acting style: Stella Adler?s method. I utilize this acting method during the performance period of my early professional acting career. Experimental research for this thesis was completed inthe studio. I applied each of the three aforementioned methods to a dramatic/classical monologue. The results I gathered helped me to decide upon Adler?s methodology to carry with me through my upcoming professional auditions and career. From casting resulting from the auditions, I will employ the methodology to my professional work asan actress. Each acting teacher has provided the performance world with a new way to experience their stage time. The methods are unique and enable the actor to find the most dynamic performance through engaging technical skill.

Spike-based decision learning of nash equilibria in two-player games

Humans and animals face decision tasks in an uncertain multi-agent environment where an agent's strategy may change in time due to the co-adaptation of others strategies. The neuronal substrate and the computational algorithms underlying such adaptive decision making, however, is largely unknown. We propose a population coding model of spiking neurons with a policy gradient procedure that successfully acquires optimal strategies for classical game-theoretical tasks. The suggested population reinforcement learning reproduces data from human behavioral experiments for the blackjack and the inspector game. It performs optimally according to a pure (deterministic) and mixed (stochastic) Nash equilibrium, respectively. In contrast, temporal-difference(TD)-learning, covariance-learning, and basic reinforcement learning fail to perform optimally for the stochastic strategy. Spike-based population reinforcement learning, shown to follow the stochastic reward gradient, is therefore a viable candidate to explain automated decision learning of a Nash equilibrium in two-player games.

Maternal and Postweaning High-Fat Diets Disturb Hippocampal Gene Expression, Learning, and Memory Function

We tested the hypothesis that excess saturated fat consumption during pregnancy, lactation, and/or postweaning alters the expression of genes mediating hippocampal synaptic efficacy and impairs spatial learning and memory in adulthood. Dams were fed control chow or a diet high in saturated fat before mating, during pregnancy, and into lactation. Offspring were weaned to either standard chow or a diet high in saturated fat. The Morris Water Maze was used to evaluate spatial learning and memory. Open field testing was used to evaluate motor activity. Hippocampal gene expression in adult males was measured using RT-PCR and ELISA. Offspring from high fat-fed dams took longer, swam farther, and faster to try and find the hidden platform during the 5-day learning period. Control offspring consuming standard chow spent the most time in memory quadrant during the probe test. Offspring from high fat-fed dams consuming excess saturated fat spent the least. The levels of mRNA and protein for brain-derived neurotrophic factor and activity-regulated cytoskeletal-associated protein were significantly decreased by maternal diet effects. Nerve growth factor mRNA and protein levels were significantly reduced in response to both maternal and postweaning high-fat diets. Expression levels for the N-methyl-D-aspartate receptor (NMDA) receptor subunit NR2B as well as synaptophysin were significantly decreased in response to both maternal and postweaning diets. Synaptotagmin was significantly increased in offspring from high fat-fed dams. These data support the hypothesis that exposure to excess saturated fat during hippocampal development is associated with complex patterns of gene expression and deficits in learning and memory.

Maintenance of skills, competencies, and performance in allergy and clinical immunology: time to lay the foundation for a universal approach

Allergist/clinical immunologist maintenance of certification and training program reaccreditation are mandatory in some countries. The World Allergy Organization conducted surveys in 2009 and 2011 to assess where such programs were available and to promote the establishment of such programs on a global level. This was done with the presumption that after such an "inventory," World Allergy Organization could offer guidance to its Member Societies on the promotion of such programs to assure the highest standards of practice in the field of allergy and clinical immunology. This review draws on the experience of countries where successful programs are in place and makes recommendations for those wishing to implement such programs for the specialty.

Incidental task sequence learning: perceptual rather than conceptual?

In four experiments we investigated whether incidental task sequence learning occurs when no instructional task cues are available (i.e. with univalent stimuli). We manipulated task sequence by presenting three simple binary-choice tasks (colour, form or letter case decisions) in regular repeated or random order. Participants were required to use the same two response keys for each of the tasks. We manipulated response sequence by ordering the stimuli so as to produce either a regular or a random order of left versus right-hand key presses. When sequencing in both, or either, separate stream (i.e. task sequence and/or response sequence) was changed to random, only those participants who had processed both sequences together showed evidence of sequence learning in terms of significant response time disruption (Experiments 1-3). This effect disappeared when the sequences were uncorrelated (Experiment 4). The results indicate that only the correlated integration of task sequence and response sequence produced a reliable incidental learning effect. As this effect depends on the predictable ordering of stimulus categories, it suggests that task sequence learning is perceptual rather than conceptual in nature.

Moving from sustainable management to sustainable governance of natural resources: The role of social learning processes in rural India, Bolivia and Mali

The present paper discusses a conceptual, methodological and practical framework within which the limitations of the conventional notion of natural resource management (NRM) can be overcome. NRM is understood as the application of scientific ecological knowledge to resource management. By including a consideration of the normative imperatives that arise from scientific ecological knowledge and submitting them to public scrutiny, ‘sustainable management of natural resources’ can be recontextualised as ‘sustainable governance of natural resources’. This in turn makes it possible to place the politically neutralising discourse of ‘management’ in a space for wider societal debate, in which the different actors involved can deliberate and negotiate the norms, rules and power relations related to natural resource use and sustainable development. The transformation of sustainable management into sustainable governance of natural resources can be conceptualised as a social learning process involving scientists, experts, politicians and local actors, and their corresponding scientific and non-scientific knowledges. The social learning process is the result of what Habermas has described as ‘communicative action’, in contrast to ‘strategic action’. Sustainable governance of natural resources thus requires a new space for communicative action aiming at shared, intersubjectively validated definitions of actual situations and the goals and means required for transforming current norms, rules and power relations in order to achieve sustainable development. Case studies from rural India, Bolivia and Mali explore the potentials and limitations for broadening communicative action through an intensification of social learning processes at the interface of local and external knowledge. Key factors that enable or hinder the transformation of sustainable management into sustainable governance of natural resources through social learning processes and communicative action are discussed.

Structural capacity of steel tubular cast-in-place piling

Steel tubular cast-in-place pilings are used throughout the country for many different project types. These piles are a closed-end pipe with varying wall thicknesses and outer diameters, that are driven to depth and then the core is filled with concrete. These piles are typically used for smaller bridges, or secondary structures. Mostly the piling is designed based on a resistance based method which is a function of the soil properties of which the pile is driven through, however there is a structural capacity of these members that is considered to be the upper bound on the loading of the member. This structural capacity is given by the AASHTO LRFD (2010), with two methods. These two methods are based on a composite or non-composite section. Many state agencies and corporations use the non-composite equation because it is requires much less computation and is known to be conservative. However with the trends of the time, more and more structural elements are being investigated to determine ways to better understand the mechanics of the members, which could lead to more efficient and safer designs. In this project, a set of these piling are investigated. The way the cross section reacts to several different loading conditions, along with a more detailed observation of the material properties is considered as part of this research. The evaluation consisted of testing stub sections of pile with varying sizes (10-¾”, 12-¾”), wall thicknesses (0.375”, 0.5”), and testing methods (whole compression, composite compression, push through, core sampling). These stub sections were chosen as they would represent a similar bracing length to many different soils. In addition, a finite element model was developed using ANSYS to predict the strains from the testing of the pile cross sections. This model was able to simulate the strains from most of the loading conditions and sizes that were tested. The bond between the steel shell and the concrete core, along with the concrete strength through the depth of the cross section were some of the material properties of these sections that were investigated.

Effects of instructional changes on student learning of electrochemistry in an IB chemistry course

This study investigated the effectiveness of incorporating several new instructional strategies into an International Baccalaureate (IB) chemistry course in terms of how they supported high school seniors’ understanding of electrochemistry. The three new methods used were (a) providing opportunities for visualization of particle movement by student manipulation of physical models and interactive computer simulations, (b) explicitly addressing common misconceptions identified in the literature, and (c) teaching an algorithmic, step-wise approach for determining the products of an aqueous solution electrolysis. Changes in student understanding were assessed through test scores on both internally and externally administered exams over a two-year period. It was found that visualization practice and explicit misconception instruction improved student understanding, but the effect was more apparent in the short-term. The data suggested that instruction time spent on algorithm practice was insufficient to cause significant test score improvement. There was, however, a substantial increase in the percentage of the experimental group students who chose to answer an optional electrochemistry-related external exam question, indicating an increase in student confidence. Implications for future instruction are discussed.

Comparison of the effects of inquiry-based cooperative learning and demonstrations in science education

The reported research project involved studying how teaching science using demonstrations, inquiry-based cooperative learning groups, or a combination of the two methods affected sixth grade students’ understanding of air pressure and density. Three different groups of students were each taught the two units using different teaching methods. Group one learned about the topics through both demonstrations and inquirybased cooperative learning, whereas group two only viewed demonstrations, and group three only participated in inquiry-based learning in cooperative learning groups. The study was designed to answer the following two questions: 1. Which teaching strategy works best for supporting student understanding of air pressure and density: demonstrations, inquirybased labs in cooperative learning groups, or a combination of the two? 2. And what effect does the time spent engaging in a particular learning experience (demonstrations or labs) have on student learning? Overall, the data did not provide sufficient evidence that one method of learning was more effective than the others. The results also suggested that spending more time on a unit does not necessarily equate to a better understanding of the concepts by the students. Implications for science instruction are discussed.

SUPPORTING LEARNING FOR NAVAJO STUDENTS THROUGH ETHNOMATHEMATICS

The purpose of this research was to address how culturally informed ethnomathematical methods of teaching can be utilized to support the learning of Navajo students in mathematics. The study was conducted over the course of four years on the Navajo Reservations at Tohatchi Middle School in Tohatchi New Mexico. The students involved in the study were all in 8th grade and were enrolled either in Algebra 1 or a Response to Intervention, RTI, class. The data collected came in the form of a student survey, student observation and student assessment. The teacher written survey, a math textbook word problem, and two original math textbook problems along with their rewritten version were the sources of these three studies. The first year of the study consisted of a math attitude survey and how Navajo students perceived math as a subject of interest. The students answered four questions pertaining to their thoughts about mathematics. The students’ responses were positive according to their written answers. The second year of the study involved the observation of how students worked through a math word problem as a group. This method tested how the students culturally interacted in order to solve a math problem. Their questions and reasoning to solve the problem were shared with peers and the teacher. The teacher supported the students in understanding and solving the problem by asking questions that kept the students focused on the goal of solving the problem. The students worked collaboratively and openly in order to complete the activity. During the iv study, the teacher was more able to notice the students’ deficiencies individually or as a group, therefore was able to support them in a more specific manner. The last study was conducted over a period of two different years. This study was used to determine how textbook bias in the form of its sentence structure or word choice affects the performance of students who are not culturally familiar with one or both. It was found that the students performed better and took less time on the rewritten problem than on the original problem. The data suggests that focusing on the culture, language and education of Navajo students can affect how the students learn and understand math.

Interference during the implicit learning of two different motor sequences

It has been demonstrated that learning a second motor task after having learned a first task may interfere with the long-term consolidation of the first task. However, little is known about immediate changes in the representation of the motor memory in the early acquisition phase within the first minutes of the learning process. Therefore, we investigated such early interference effects with an implicit serial reaction time task in 55 healthy subjects. Each subject performed either a sequence learning task involving two different sequences, or a random control task. The results showed that learning the first sequence led to only a slight, short-lived interference effect in the early acquisition phase of the second sequence. Overall, learning of neither sequence was impaired. Furthermore, the two processes, sequence-unrelated task learning (i.e. general motor training) and the sequence learning itself did not appear to interfere with each other. In conclusion, although the long-term consolidation of a motor memory has been shown to be sensitive to other interfering memories, the present study suggests that the brain is initially able to acquire more than one new motor sequence within a short space of time without significant interference.