905 resultados para reward competition
Resumo:
Establishing a function for the neuromodulator serotonin in human decision-making has proved remarkably difficult because if its complex role in reward and punishment processing. In a novel choice task where actions led concurrently and independently to the stochastic delivery of both money and pain, we studied the impact of decreased brain serotonin induced by acute dietary tryptophan depletion. Depletion selectively impaired both behavioral and neural representations of reward outcome value, and hence the effective exchange rate by which rewards and punishments were compared. This effect was computationally and anatomically distinct from a separate effect on increasing outcome-independent choice perseveration. Our results provide evidence for a surprising role for serotonin in reward processing, while illustrating its complex and multifarious effects.
Resumo:
Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.
Resumo:
Food preferences are acquired through experience and can exert strong influence on choice behavior. In order to choose which food to consume, it is necessary to maintain a predictive representation of the subjective value of the associated food stimulus. Here, we explore the neural mechanisms by which such predictive representations are learned through classical conditioning. Human subjects were scanned using fMRI while learning associations between arbitrary visual stimuli and subsequent delivery of one of five different food flavors. Using a temporal difference algorithm to model learning, we found predictive responses in the ventral midbrain and a part of ventral striatum (ventral putamen) that were related directly to subjects' actual behavioral preferences. These brain structures demonstrated divergent response profiles, with the ventral midbrain showing a linear response profile with preference, and the ventral striatum a bivalent response. These results provide insight into the neural mechanisms underlying human preference behavior.
Resumo:
Recent experiments have shown that spike-timing-dependent plasticity is influenced by neuromodulation. We derive theoretical conditions for successful learning of reward-related behavior for a large class of learning rules where Hebbian synaptic plasticity is conditioned on a global modulatory factor signaling reward. We show that all learning rules in this class can be separated into a term that captures the covariance of neuronal firing and reward and a second term that presents the influence of unsupervised learning. The unsupervised term, which is, in general, detrimental for reward-based learning, can be suppressed if the neuromodulatory signal encodes the difference between the reward and the expected reward-but only if the expected reward is calculated for each task and stimulus separately. If several tasks are to be learned simultaneously, the nervous system needs an internal critic that is able to predict the expected reward for arbitrary stimuli. We show that, with a critic, reward-modulated spike-timing-dependent plasticity is capable of learning motor trajectories with a temporal resolution of tens of milliseconds. The relation to temporal difference learning, the relevance of block-based learning paradigms, and the limitations of learning with a critic are discussed.
Resumo:
Despite it is widely acknowledged that the ability to hydrolyze dissolved organic matter using extracellular phosphatases is diverse in fresh water phytoplankton, the competition within single species related to presence and quantity of cell-surface-bound phosphatases has not been examined in natural conditions yet. Here, we studied phytoplankton species competition in a freshwater reservoir during an in situ experiment. A natural plankton community, with the exclusion of large zooplankton, was enclosed in permeable dialysis bags inside two large containers of different bioavailable phosphate concentrations. Phytoplankton species biomass and the abundance of bacteria were determined in purpose to compare the development of enclosed microbial communities. Total and cell-surface-bound phosphatase activities in the phytoplankton were investigated using the Fluorescently Labelled Enzyme Activity (FLEA) technique that allows for direct microscopic detection of phosphatase-positive cells and, with image cytometry, enables quantification of phosphatase hydrolytic capacity. Production of extracellular phosphatases was not completely inhibited or stopped in the phosphate-enriched environment, phytoplankton cells only showed the activity less often. Under the phosphate-nonenriched conditions, the production of phosphatases was enhanced, but active species did not proliferate amongst phytoplankton assemblage. Further, specific growth rates of the phosphatase-positive species in the non-enriched environment were lower than the same phosphatase-positive species in phosphate-enriched environment. Interestingly, the phosphatase-positive cells of Ankyra ancora increased their size in both treatments equally, although the population in phosphate-enriched environment grew much faster and the cell-specific phosphatase activity was lower. We hypothesize that brand new daughter cells had sufficient phosphorus reserves and therefore did not employ extracellular phosphatases until they matured and needed extra bioavailable phosphorus to support their metabolism before cell division. Based on presented in situ experiment, we propose that the ability to hydrolyze organic polymers and particles with cell-surface-hound phosphatases is advantageous for longer persistence of given population in a phosphate-scarce environment; although phosphatase-positive species cannot dominate the reservoir phytoplankton solely because of specific phosphorus-scavenging strategy.
Resumo:
Silver and bighead carps were cultured in large fish pens to reduce the risks of cyanobacterial bloom outbreaks in Meiliang Bay, Lake Tauhu in 2004 and 2005. Diet compositions and growth rates of the carps were studied from April to November each year. Both carp species fed mainly on zooplankton (> 50% in diet) in 2004 when competition was low, but selected more phytoplankton in 2005 when competition was high. Silver carp had a broader diet breadth than did bighead carp. Higher densities and fewer food resources increased diet breadths but decreased the diet overlap in both types of carps. It can be predicted that silver and bighead carps would be released from diet competition and shift to feed mainly on zooplankton at low densities, decreasing the efficiency of controlling cyanobacterial blooms. Conclusively, when silver and bighead carps are used to control cyanobacterial blooms, a sufficiently high stocking density is very important for a successful practice.
Resumo:
Undoped GaN epilayer on c-face (0 0 0 1) sapphire substrate has been grown by metalorganic vapor-phase epitaxy (MOVPE) in a horizontal-type low-pressure two-channel reactor. Photoluminescence (PL) as a function of temperature and excitation intensity have been systematically studied, and the competition between near band gap ultraviolet (UV) and defect-related yellow luminescence (YL) has been extensively investigated, It is revealed that the ratio of the UV-to-YL peak intensities depends strongly on the excitation intensity and the measurement temperature. The obtained results have been analyzed in comparison with the theoretical predications based on a bimolecular model. (C) 2001 Elsevier Science B.V. All rights reserved.
Resumo:
The study of rotation-alignment of quasiparticles probes sensitively the properties of high-j intruder orbits. The distribution of very-high-j orbits, which are consequences of the fundamental spin-orbit interaction, links with the important question of single-particle levels in superheavy nuclei. With the deformed single-particle states generated by the standard Nilsson potential, we perform Projected Shell Model calculations for transfermium nuclei where detailed spectroscopy experiments are currently possible. Specifically, we study the systematical behavior of rotation-alignment and associated band-crossing phenomenon in Cf, Fm, and No isotopes. Neutrons and protons from the high-j orbits are found to compete strongly in rotation-alignment, which gives rise to testable effects. Observation of these effects will provide direct information on the single-particle states in the heaviest nuclear mass region.
Resumo:
Langmuir-Blodgett (LB) film of stearic acid was used as template to induce the nucleation and growth of KCl crystals when the KCl solution was cooled from 50 to 25 degrees C. When the LB film template was vertically dipped into the solution, only induced crystals with (1 1 0) orientation were formed. However, if the template was horizontally placed into solutions, both the induced nuclei at the solution/film interface and spontaneous nuclei formed in solution were simultaneously absorbed onto the LB film, and then grew further to form crystals. X-ray diffraction (XRD) patterns and optical microscopy images showed that the orientation and morphology of the crystals were controlled properly by changing the orientation and position of the LB films in the solutions.
Resumo:
We investigate the dewetting behavior of the bilayer of air/PS/PMMA/silanized Si wafer and find the two competing dewetting pathways in the dewetting process. The upper layer dewets on the lower layer (dewetting pathway 1, the liquid-liquid dewetting) and the two layers rupture on the solid substrate (dewetting pathway 2, the liquid-solid dewetting). To the two competing dewetting pathways, the process of forming holes and the process of hole growth, influence their competing relation. In the process of forming holes, the time of forming holes is a main factor that influences their competing relation. During the process of hole growth, the dewetting velocity is a main factor that influences their competing relation.
Resumo:
We have studied the lamellar orientation in thin films of a model diblock copolymer, symmetric poly(styrene)-b-poly(L-lactide) (PS-PLLA), in the melt state on supported silicon wafer surface. In this system, while the PLLA block prefers to wet the polymer/substrate interface, the polymer/air as well as polymer/polymer interface is neutral for both blocks due to the similar surface energies of PS and PLLA in melt state. Our results demonstrate that the interplay of the interfaces during phase separation results in a series of structures before approaching the equilibrium state. Lamellar orientation of thin films with different initial film thicknesses at different annealing stages has been investigated using atomic force microscopy (AFM), transmission electronic microscopy (TEM), and X-ray photoelectron spectroscopy (XPS). It is found that in the early stage (annealing time t < 10 min), the polymer/substrate interface dominates the structure evolution, leading to a parallel lamellar structure with holes or islands formed depending on the initial film thickness. Later on, the neutral air interface becomes important and leads to a transition of lamellar orientation from parallel to perpendicular. It is interesting to see that for films with thickness h > 2L, where L is the bulk lamellar period, the lamellar orientation transition can occur independently in different parallel lamellar domains due to the neutrality of polymer/polymer interface.
Resumo:
The ordered double perovskites, Sr2-xLaxMnMoO6, were prepared by sol-gel reaction. Structural, magnetic, and electrical properties were investigated for a series of ordered double perovskites Sr2-xLaxMnMoO6(0 <= x <= 1). The compounds have a monoclinic structure (space group P2(1)/n) and the cell volume expands monotonically with La doping. The T-C and the magnetic moment rise and the cusp-like transition temperature below which the magnetic frustration occurs shifts to high temperature as x increases. With La doping, electrical resistivity of Sr2-xLaxMnMoO6 decreases only at low doping levels (x <= 0.2); while at high doping levels (0.8 <= x <= 1), electrical resistivity tends to increase greatly. The results suggest that the competition between band filling effect and steric effect coexists in the whole doping range, and the formation of ferrimagnetic interactions is not simply at the expense of antiferromagnetic interactions.