Spatio-temporal credit assignment in population learning

Learning by reinforcement is important in shaping animal behavior, and in particular in behavioral decision making. Such decision making is likely to involve the integration of many synaptic events in space and time. However, using a single reinforcement signal to modulate synaptic plasticity, as suggested in classical reinforcement learning algorithms, a twofold problem arises. Different synapses will have contributed differently to the behavioral decision, and even for one and the same synapse, releases at different times may have had different effects. Here we present a plasticity rule which solves this spatio-temporal credit assignment problem in a population of spiking neurons. The learning rule is spike-time dependent and maximizes the expected reward by following its stochastic gradient. Synaptic plasticity is modulated not only by the reward, but also by a population feedback signal. While this additional signal solves the spatial component of the problem, the temporal one is solved by means of synaptic eligibility traces. In contrast to temporal difference (TD) based approaches to reinforcement learning, our rule is explicit with regard to the assumed biophysical mechanisms. Neurotransmitter concentrations determine plasticity and learning occurs fully online. Further, it works even if the task to be learned is non-Markovian, i.e. when reinforcement is not determined by the current state of the system but may also depend on past events. The performance of the model is assessed by studying three non-Markovian tasks. In the first task, the reward is delayed beyond the last action with non-related stimuli and actions appearing in between. The second task involves an action sequence which is itself extended in time and reward is only delivered at the last action, as it is the case in any type of board-game. The third task is the inspection game that has been studied in neuroeconomics, where an inspector tries to prevent a worker from shirking. Applying our algorithm to this game yields a learning behavior which is consistent with behavioral data from humans and monkeys, revealing themselves properties of a mixed Nash equilibrium. The examples show that our neuronal implementation of reward based learning copes with delayed and stochastic reward delivery, and also with the learning of mixed strategies in two-opponent games.

Moving from sustainable management to sustainable governance of natural resources: The role of social learning processes in rural India, Bolivia and Mali

The present paper discusses a conceptual, methodological and practical framework within which the limitations of the conventional notion of natural resource management (NRM) can be overcome. NRM is understood as the application of scientific ecological knowledge to resource management. By including a consideration of the normative imperatives that arise from scientific ecological knowledge and submitting them to public scrutiny, ‘sustainable management of natural resources’ can be recontextualised as ‘sustainable governance of natural resources’. This in turn makes it possible to place the politically neutralising discourse of ‘management’ in a space for wider societal debate, in which the different actors involved can deliberate and negotiate the norms, rules and power relations related to natural resource use and sustainable development. The transformation of sustainable management into sustainable governance of natural resources can be conceptualised as a social learning process involving scientists, experts, politicians and local actors, and their corresponding scientific and non-scientific knowledges. The social learning process is the result of what Habermas has described as ‘communicative action’, in contrast to ‘strategic action’. Sustainable governance of natural resources thus requires a new space for communicative action aiming at shared, intersubjectively validated definitions of actual situations and the goals and means required for transforming current norms, rules and power relations in order to achieve sustainable development. Case studies from rural India, Bolivia and Mali explore the potentials and limitations for broadening communicative action through an intensification of social learning processes at the interface of local and external knowledge. Key factors that enable or hinder the transformation of sustainable management into sustainable governance of natural resources through social learning processes and communicative action are discussed.

Age modeling of young non-varved lake sediments: methods and limits. Examples from two lakes in Central Chile

High-resolution and highly precise age models for recent lake sediments (last 100–150 years) are essential for quantitative paleoclimate research. These are particularly important for sedimentological and geochemical proxies, where transfer functions cannot be established and calibration must be based upon the relation of sedimentary records to instrumental data. High-precision dating for the calibration period is most critical as it determines directly the quality of the calibration statistics. Here, as an example, we compare radionuclide age models obtained on two high-elevation glacial lakes in the Central Chilean Andes (Laguna Negra: 33°38′S/70°08′W, 2,680 m a.s.l. and Laguna El Ocho: 34°02′S/70°19′W, 3,250 m a.s.l.). We show the different numerical models that produce accurate age-depth chronologies based on 210Pb profiles, and we explain how to obtain reduced age-error bars at the bottom part of the profiles, i.e., typically around the end of the 19th century. In order to constrain the age models, we propose a method with five steps: (i) sampling at irregularly-spaced intervals for 226Ra, 210Pb and 137Cs depending on the stratigraphy and microfacies, (ii) a systematic comparison of numerical models for the calculation of 210Pb-based age models: constant flux constant sedimentation (CFCS), constant initial concentration (CIC), constant rate of supply (CRS) and sediment isotope tomography (SIT), (iii) numerical constraining of the CRS and SIT models with the 137Cs chronomarker of AD 1964 and, (iv) step-wise cross-validation with independent diagnostic environmental stratigraphic markers of known age (e.g., volcanic ash layer, historical flood and earthquakes). In both examples, we also use airborne pollutants such as spheroidal carbonaceous particles (reflecting the history of fossil fuel emissions), excess atmospheric Cu deposition (reflecting the production history of a large local Cu mine), and turbidites related to historical earthquakes. Our results show that the SIT model constrained with the 137Cs AD 1964 peak performs best over the entire chronological profile (last 100–150 years) and yields the smallest standard deviations for the sediment ages. Such precision is critical for the calibration statistics, and ultimately, for the quality of the quantitative paleoclimate reconstruction. The systematic comparison of CRS and SIT models also helps to validate the robustness of the chronologies in different sections of the profile. Although surprisingly poorly known and under-explored in paleolimnological research, the SIT model has a great potential in paleoclimatological reconstructions based on lake sediments

Social Learning Processes in Swiss Soil Protection? The 'From Farmer - To Farmer' Project

Social learning approaches have become a prominent focus in studies related to sustainable agriculture. In order to better understand the potential of social learning for more sustainable development, the present study assessed the processes, effects and facilitating elements of interaction related to social learning in the context of Swiss soil protection and the innovative ‘From Farmer - To Farmer’ project. The study reveals that social learning contributes to fundamental transformations of patterns of interactions. However, the study also demonstrates that a learning-oriented understanding of sustainable development implies including analysis of the institutional environments in which the organizations of the individual representatives of face-to-face-based social learning processes are operating. This has shown to be a decisive element when face-to-face-based learning processes of the organisations’ representatives are translated into organisational learning. Moreover, the study revealed that this was achieved not directly through formalisation of new lines of institutionalised cooperation but by establishing links in a ‘boundary space’ trying out new forms of collaboration, aiming at social learning and co-production of knowledge. It is argued that further research on social learning processes should give greater emphasis to this intermediary level of ‘boundary spaces’.

Landscape mosaics maps as a basis for spatial assessment and negotiation of ecosystem services and their trade-offs at the meso-scale: Examples from Laos, Madagascar and China

Mapping ecosystem services (ES) and their trade-offs is a key requirement for informed decision making for land use planning and management of natural resources that aim to move towards increasing the sustainability of landscapes. The negotiations of the purposes of landscapes and the services they should provide are difficult as there is an increasing number of stakeholders active at different levels with a variety of interests present on one particular landscape.Traditionally, land cover data is at the basis for mapping and spatial monitoring of ecosystem services. In light of complex landscapes it is however questionable whether land cover per se and as a spatial base unit is suitable for monitoring and management at the meso-scale. Often the characteristics of a landscape are defined by prevalence, composition and specific spatial and temporal patterns of different land cover types. The spatial delineation of shifting cultivation agriculture represents a prominent example of a land use system with its different land use intensities that requires alternative methodologies that go beyond the common remote sensing approaches of pixel-based land cover analysis due to the spatial and temporal dynamics of rotating cultivated and fallow fields.Against this background we advocate that adopting a landscape perspective to spatial planning and decision making offers new space for negotiation and collaboration, taking into account the needs of local resource users, and of the global community. For this purpose we introduce landscape mosaicsdefined as new spatial unit describing generalized land use types. Landscape mosaics have allowed us to chart different land use systems and land use intensities and permitted us to delineate changes in these land use systems based on changes of external claims on these landscapes. The underlying idea behindthe landscape mosaics is to use land cover data typically derived from remote sensing data and to analyse and classify spatial patterns of this land cover data using a moving window approach. We developed the landscape mosaics approach in tropical, forest dominated landscapesparticularly shifting cultivation areas and present examples ofour work from northern Laos, eastern Madagascarand Yunnan Province in China.

The potential of stomata analysis in conifers to estimate presence of conifer trees: examples from the Alps

To estimate whether or not a plant taxon found in the fossil record was locally present may be difficult if only pollen is analyzed. Plant macrofossils, in contrast, provide a clear indication of a taxon's local presence, although in some lake sediments or peats, macrofossils may be rare or degraded. For conifers, the stomata found on pollen slides are derived from needles and thus provide a valuable proxy for local presence and they can be identified to genus level. From previously published studies, a transect across the Alps based on 13 sites is presented. For basal samples in sandy silt above the till with high pollen values of Pinus, for example, we may distinguish pine pollen from distant sources (samples with no stomata), from reworked pollen (samples with stomata present). The first apparent local presence of most conifer genera based on stomata often but not always occurs together with the phase of rapid pollen increase (rational limit). An exception is Larix, with its annual deposition of needles and heavy poorly dispersed pollen, for it often shows the first stomata earlier, at the empirical pollen limit. The decline and potential local extinction of a conifer can sometimes be shown in the stomata record. The decline may have been caused by climatic change, competition, or human impact. In situations where conifers form the timberline, the stomata record may indicate timberline fluctuations. In the discussion of immigration or migration of taxa we advocate the use of the cautious term ``apparent local presence'' to include some uncertainties. Absence of a taxon is impossible to prove.

Learning processes in student teaching: Analyses from a study using learning diaries

The present study seeks to obtain deeper insight into the learning processes in practical training in primary teacher education in Upper Austria. Based on the offer-and-use model of instruction, 230 diary entries of 46 student teachers (28 students in their third semester, 18 students in their fifth semester) were analysed with legard to the learning topics, learning sourcesJ and Ìealning processes involved in practical training. The results show a variety of learning forms, ranging from the unreflective imitation of school mentors' practices to active knowledge construction. In addition, they illustrate that the available learning offers were suboptimally utilized by stuclent teachers who failed to work systernatically and continuously on their professional development.