870 resultados para reinforcement
Resumo:
In order to fabricate a biomimetic skin for an octopus inspired robot, a new process was developed based on mechanical properties measured from real octopus skin. Various knitted nylon textiles were tested and the one of 10-denier nylon was chosen as reinforcement. A combination of Ecoflex 0030 and 0010 silicone rubbers was used as matrix of the composite to obtain the right stiffness for the skin-analogue system. The open mould fabrication process developed allows air bubble to escape easily and the artificial skin produced was thin and waterproof. Material properties of the biomimetic skin were characterised using static tensile and instrumented scissors cutting tests. The Young’s moduli of the artificial skin are 0.08 MPa and 0.13 MPa in the longitudinal and transverse directions, which are much lower than those of the octopus skin. The strength and fracture toughness of the artificial skin, on the other hand are higher than those of real octopus skins. Conically-shaped skin prototypes to be used to cover the robotic arm unit were manufactured and tested. The biomimetic skin prototype was stiff enough to maintain it conical shape when filled with water. The driving force for elongation was reduced significantly compared with previous prototypes.
Resumo:
We examined the maturation of decision-making from early adolescence to mid-adulthood using fMRI of a variant of the Iowa gambling task. We have previously shown that performance in this task relies on sensitivity to accumulating negative outcomes in ventromedial PFC and dorsolateral PFC. Here, we further formalize outcome evaluation (as driven by prediction errors [PE], using a reinforcement learning model) and examine its development. Task performance improved significantly during adolescence, stabilizing in adulthood. Performance relied on greater impact of negative compared with positive PEs, the relative impact of which matured from adolescence into adulthood. Adolescents also showed increased exploratory behavior, expressed as a propensity to shift responding between options independently of outcome quality, whereas adults showed no systematic shifting patterns. The correlation between PE representation and improved performance strengthened with age for activation in ventral and dorsal PFC, ventral striatum, and temporal and parietal cortices. There was a medial-lateral distinction in the prefrontal substrates of effective PE utilization between adults and adolescents: Increased utilization of negative PEs, a hallmark of successful performance in the task, was associated with increased activation in ventromedial PFC in adults, but decreased activation in ventrolateral PFC and striatum in adolescents. These results suggest that adults and adolescents engage qualitatively distinct neural and psychological processes during decision-making, the development of which is not exclusively dependent on reward-processing maturation.
Resumo:
Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This “undermining effect” has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.
Resumo:
Position in the social hierarchy can influence brain dopamine function and cocaine reinforcement in nonhuman primates during early cocaine exposure. With prolonged exposure, however, initial differences in rates of cocaine self-administration between dominant and subordinate monkeys dissipate. The present studies used a choice procedure to assess the relative reinforcing strength of cocaine in group-housed male cynomolgus monkeys with extensive cocaine self-administration histories. Responding was maintained under a concurrent fixed-ratio 50 schedule of food and cocaine (0.003-0.1 mg/kg per injection) presentation. Responding on the cocaine-associated lever increased as a function of cocaine dose in all monkeys. Although response distribution was similar across social rank when saline or relatively low or high cocaine doses were the alternative to food, planned t tests indicated that cocaine choice was significantly greater in subordinate monkeys when choice was between an intermediate dose (0.01 mg/kg) and food. When a between-session progressive-ratio procedure was used to increase response requirements for the preferred reinforcer (either cocaine or food), choice of that reinforcer decreased in all monkeys. The average response requirement that produced a shift in response allocation from the cocaine-associated lever to the food-associated lever was higher in subordinates across cocaine doses, an effect that trended toward significance (p = 0.053). These data indicate that despite an extensive history of cocaine self-administration, most subordinate monkeys were more sensitive to the relative reinforcing strength of cocaine than dominant monkeys.
Resumo:
Extinction following positively reinforced operant conditioning reduces response frequency, at least in part through the aversive or frustrative effects of non-reinforcement. According to J.A. Gray's theory, non-reinforcement activates the behavioural inhibition system which in turn causes anxiety. As predicted, anxiolytic drugs including benzodiazepines affect the operant extinction process. Recent studies have shown that reducing GABA-mediated neurotransmission retards extinction of aversive conditioning. We have shown in a series of studies that anxiolytic compounds that potentiate GABA facilitate extinction of positively reinforced fixed-ratio operant behaviour in C57B1/6 male mice. This effect does not occur in the early stages of extinction, nor is it dependent on cumulative effects of the compound administered. Potentiation of GABA at later stages has the effect of increasing sensitivity to the extinction contingency and facilitates the inhibition of the behaviour that is no longer required. The GABAergic hypnotic, zolpidem, has the same selective effects on operant extinction in this procedure. The effects of zolpidem are not due to sedative action. There is evidence across our series of experiments that different GABA-A subtype receptors are involved in extinction facilitation and anxiolysis. Consequently, this procedure may not be an appropriate model for anxiolytic drug action, but it may be a useful technique for analysing the neural bases of extinction and designing therapeutic interventions in humans where failure to extinguish inappropriate behaviours can lead to pathological conditions such as post-traumatic stress disorder.
Resumo:
Relatively little is known about the role of the inhibitory neurotransmitter gamma-aminobutyric acid (GABA) in extinction of appetitively motivated tasks. The benzodiazepine (BZ) chlordiazepoxide (CDP) was administered during extinction and re-acquisition of lever pressing by mice following food reinforced discrete-trial fixed-ratio 5 (FR-5) training. Typical FR behaviour was established during baseline training and persisted for several extinction sessions. There were 15 extinction sessions in all, followed by six re-acquisition sessions where food reinforcement was re-introduced. In a 2x2x2 between-group design, CDP (15 mg/kg) or vehicle injections were given prior to either the last two food reinforcement sessions and the first 10 extinction sessions, or the final five extinction sessions, or the six re-acquisition sessions. Initially CDP had no effect on the rate of extinction, but after several extinction sessions it significantly facilitated it. Surprisingly, if CDP was administered only after several sessions of extinction, it immediately produced facilitation. Thus the delayed effects of CDP are not due to drug accumulation. These data suggest that some neural change must occur before CDP can affect extinction processes. In re-acquisition sessions, CDP facilitated the reinstatement of food-reinforced lever pressing. Implications for neural and behavioural accounts of operant extinction are discussed.
Resumo:
The Distribution Network Operators (DNOs) role is becoming more difficult as electric vehicles and electric heating penetrate the network, increasing the demand. As a result it becomes harder for the distribution networks infrastructure to remain within its operating constraints. Energy storage is a potential alternative to conventional network reinforcement such as upgrading cables and transformers. The research presented here in this paper shows that due to the volatile nature of the LV network, the control approach used for energy storage has a significant impact on performance. This paper presents and compares control methodologies for energy storage where the objective is to get the greatest possible peak demand reduction across the day from a pre-specified storage device. The results presented show the benefits and detriments of specific types of control on a storage device connected to a single phase of an LV network, using aggregated demand profiles based on real smart meter data from individual homes. The research demonstrates an important relationship between how predictable an aggregation is and the best control methodology required to achieve the objective.
Resumo:
The ability to change an established stimulus–behavior association based on feedback is critical for adaptive social behaviors. This ability has been examined in reversal learning tasks, where participants first learn a stimulus–response association (e.g., select a particular object to get a reward) and then need to alter their response when reinforcement contingencies change. Although substantial evidence demonstrates that the OFC is a critical region for reversal learning, previous studies have not distinguished reversal learning for emotional associations from neutral associations. The current study examined whether OFC plays similar roles in emotional versus neutral reversal learning. The OFC showed greater activity during reversals of stimulus–outcome associations for negative outcomes than for neutral outcomes. Similar OFC activity was also observed during reversals involving positive outcomes. Furthermore, OFC activity is more inversely correlated with amygdala activity during negative reversals than during neutral reversals. Overall, our results indicate that the OFC is more activated by emotional than neutral reversal learning and that OFC's interactions with the amygdala are greater for negative than neutral reversal learning.
Resumo:
Reinforcing the Low Voltage (LV) distribution network will become essential to ensure it remains within its operating constraints as demand on the network increases. The deployment of energy storage in the distribution network provides an alternative to conventional reinforcement. This paper presents a control methodology for energy storage to reduce peak demand in a distribution network based on day-ahead demand forecasts and historical demand data. The control methodology pre-processes the forecast data prior to a planning phase to build in resilience to the inevitable errors between the forecasted and actual demand. The algorithm uses no real time adjustment so has an economical advantage over traditional storage control algorithms. Results show that peak demand on a single phase of a feeder can be reduced even when there are differences between the forecasted and the actual demand. In particular, results are presented that demonstrate when the algorithm is applied to a large number of single phase demand aggregations that it is possible to identify which of these aggregations are the most suitable candidates for the control methodology.
Resumo:
This paper assesses the impact of the location and configuration of Battery Energy Storage Systems (BESS) on Low-Voltage (LV) feeders. BESS are now being deployed on LV networks by Distribution Network Operators (DNOs) as an alternative to conventional reinforcement (e.g. upgrading cables and transformers) in response to increased electricity demand from new technologies such as electric vehicles. By storing energy during periods of low demand and then releasing that energy at times of high demand, the peak demand of a given LV substation on the grid can be reduced therefore mitigating or at least delaying the need for replacement and upgrade. However, existing research into this application of BESS tends to evaluate the aggregated impact of such systems at the substation level and does not systematically consider the impact of the location and configuration of BESS on the voltage profiles, losses and utilisation within a given feeder. In this paper, four configurations of BESS are considered: single-phase, unlinked three-phase, linked three-phase without storage for phase-balancing only, and linked three-phase with storage. These four configurations are then assessed based on models of two real LV networks. In each case, the impact of the BESS is systematically evaluated at every node in the LV network using Matlab linked with OpenDSS. The location and configuration of a BESS is shown to be critical when seeking the best overall network impact or when considering specific impacts on voltage, losses, or utilisation separately. Furthermore, the paper also demonstrates that phase-balancing without energy storage can provide much of the gains on unbalanced networks compared to systems with energy storage.
Resumo:
The objective of this work was to analyze mechanical, physical and thermal performance of roofing tiles produced with several formulations of cement-based matrices reinforced with sisal and eucalyptus fibers. The physical properties of the tiles were more influenced by the fiber content of the composite than by the type of reinforcement. The type of the fiber was the main variable for the achievement of the best results of mechanical properties. Exposure to tropical climate has caused a severe reduction in the mechanical properties of the composites. After approximately four months of age under external weathering the toughness of the vegetable fiber-cement fell to 53-68% of the initial toughness at 28 days of age. The thermal performance showed that roofing tiles reinforced with vegetable fiber are acceptable as substitutes of asbestos-cement sheets. (c) 2006 Elsevier Ltd. All rights reserved.
Resumo:
The impact of the inter-El Nio (EN) variability on the moisture availability over Southeastern South America (SESA) is investigated. Also, an automatic tracking scheme was used to analyze the extratropical cyclones properties (system density - SD and central pressure - CP) in this region. During the austral summer period from 1977-2000, the differences for the upper-level wave train anomaly composites seem to determine the rainfall composite differences. In fact, the positive rainfall anomalies over most of the SESA domain during the strong EN events are explained by an upper-level cyclonic center over the tropics and an anticyclonic center over the eastern subtropical area. This pattern seems to contribute to upward vertical motion at 500 hPa and reinforcement of the meridional moisture transport from the equatorial Atlantic Ocean and western Amazon basin to the SESA region. These features may contribute to the positive SD and negative CP anomalies explaining part of the positive rainfall anomalies found there. On the other hand, negative rainfall anomalies are located in the northern part of SESA for the weak EN years when compared to those for the strong events. Also, positive anomalies are found in the southern part, albeit less intense. It was associated with the weakening of the meridional moisture transport from the tropics to the SESA that seems have to contributed with smaller SD and CP anomalies over the most part of subtropics, when compared to the strong EN years.
Resumo:
Negative anticipatory contrast (NAC) corresponds to the suppression in consumption of a first rewarding substance (e.g., saccharin 0.15%) when it is followed daily by a second preferred substance (e.g., sucrose 32%). The NAC has been interpreted as resulting from anticipation of the impending preferred reward and its comparison with the currently available first reward [Flaherty, CF., Rowan, G.A., 1985. Anticipatory contrast: within-subjects analysis. Anim. Learn. Behav. 13, 2-5]. In this context, one should expect that devaluation of the preferred substance after the establishment of the NAC would either reduce or abolish the contrast effect. However, contrary to this prediction, the results of the present study show that the NAC is insensitive to devaluation of the second, preferred, substance. This allows one to question that interpretation. The results reported in this study support the view that the NAC effect is controlled by memory of the relative value of the first solution, which is updated daily by means of both a gustatory and/or post-ingestive comparison of the first and second solutions, and memory of past pairings. (C) 2010 Elsevier B.V. All rights reserved.
Resumo:
Sociable robots are embodied agents that are part of a heterogeneous society of robots and humans. They Should be able to recognize human beings and each other, and to engage in social, interactions. The use of a robotic architecture may strongly reduce the time and effort required to construct a sociable robot. Such architecture must have structures and mechanisms to allow social interaction. behavior control and learning from environment. Learning processes described oil Science of Behavior Analysis may lead to the development of promising methods and Structures for constructing robots able to behave socially and learn through interactions from the environment by a process of contingency learning. In this paper, we present a robotic architecture inspired from Behavior Analysis. Methods and structures of the proposed architecture, including a hybrid knowledge representation. are presented and discussed. The architecture has been evaluated in the context of a nontrivial real problem: the learning of the shared attention, employing an interactive robotic head. The learning capabilities of this architecture have been analyzed by observing the robot interacting with the human and the environment. The obtained results show that the robotic architecture is able to produce appropriate behavior and to learn from social interaction. (C) 2009 Elsevier Inc. All rights reserved.
Resumo:
Social and economical development is closely associated with technological innovation and a well-developed biotechnological industry. In the last few years, Brazil`s scientific production has been steadily increasing; however, the number of patents is lagging behind, with technological and translational research requiring governmental incentive and reinforcement. The Cell and Molecular Therapy Center (NUCEL) was created to develop activities in the translational research field, addressing concrete problems found in biomedical and veterinary areas and actively searching for solutions by employing a genetic engineering approach to generate cell lines over-expressing recombinant proteins to be transferred to local biotech companies, aiming at furthering the development of a national competence for local production of biopharmaceuticals of widespread use and of life-saving importance. To this end, mammalian cell engineering technologies were used to generate cell lines over-expressing several different recombinant proteins of biomedical and biotechnological interest, namely, recombinant human Amylin/IAPP for diabetes treatment, human FVIII and FIX clotting factors for hemophilia, human and bovine FSH for fertility and reproduction, and human bone repair proteins (BMPs). Expression of some of these proteins is also being sought with the baculovirus/insect cell system (BEVS) which, in many cases, is able to deliver high-yield production of recombinant proteins with biological activity comparable to that of mammalian systems, but in a much more cost-effective manner. Transfer of some of these recombinant products to local Biotech companies has been pursued by taking advantage of the Sao Paulo State Foundation (FAPESP) and Federal Government (FINEP, CNPq) incentives for joint Research Development and Innovation partnership projects.