Influence of the reinforcement magnitude on omission effects

Reinforcement Omission Effects (ROEs), indicated by higher rate of responses after nonreinforced trials in a partial reinforcement schedule, have been interpreted as behavioral transient facilitation after nonreinforcement induced by primary frustration, and/or behavioral transient inhibition after reinforcement induced by demotivation or temporal control. The size of the ROEs should depend directly on the reinforcement magnitude. The present experiment aimed to clarify the relationship between reinforcement magnitude and the omission effects manipulating the magnitude linked to discriminative stimuli in a partial reinforcement FI schedule. The results showed that response rates were higher after omission than after reinforcement delivery. Besides, response rates were highest immediately after the reinforcement omission of a larger magnitude than of a smaller magnitude. These data are interpreted in terms of ROEs multiple process behavioral facilitation after nonreinforcement, and behavioral transient inhibition after reinforcement. (C) 2011 Elsevier B.V. All rights reserved.

Involvement of the basolateral complex and central nucleus of amygdala in the omission effects of different magnitudes of reinforcement

Evidence from appetitive Pavlovian and instrumental conditioning studies suggest that the amygdala is involved in modulation of responses correlated with motivational states, and therefore, to the modulation of processes probably underlying reinforcement omission effects. The present study aimed to clarify whether or not the mechanisms related to reinforcement omission effects of different magnitudes depend on basolateral complex and central nucleus of amygdala. Rats were trained on a fixed-interval 12 s with limited hold 6 s signaled schedule in which correct responses were always followed by one of two reinforcement magnitudes. Bilateral lesions of the basolateral complex and central nucleus were made after acquisition of stable performance. After postoperative recovery, the training was changed from 100% to 50% reinforcement schedules. The results showed that lesions of the basolateral complex and central nucleus did not eliminate or reduce, but interfere with reinforcement omission effects. The response from rats of both the basolateral complex and central nucleus lesioned group was higher relative to that of the rats of their respective sham-lesioned groups after reinforcement omission. Thus, the lesioned rats were more sensitive to the omission effect. Moreover, the basolateral complex lesions prevented the magnitude effect on reinforcement omission effects. Basolateral complex lesioned rats showed no differential performance following omission of larger and smaller reinforcement magnitude. Thus, the basolateral complex is involved in incentive processes relative to omission of different reinforcement magnitudes. Therefore, it is possible that reinforcement omission effects are modulated by brain circuitry which involves amygdala. (C) 2012 Elsevier B.V. All rights reserved.

Reinforcement Lernen mit Regularisierungsnetzwerken

Die Arbeit behandelt das Problem der Skalierbarkeit von Reinforcement Lernen auf hochdimensionale und komplexe Aufgabenstellungen. Unter Reinforcement Lernen versteht man dabei eine auf approximativem Dynamischen Programmieren basierende Klasse von Lernverfahren, die speziell Anwendung in der Künstlichen Intelligenz findet und zur autonomen Steuerung simulierter Agenten oder realer Hardwareroboter in dynamischen und unwägbaren Umwelten genutzt werden kann. Dazu wird mittels Regression aus Stichproben eine Funktion bestimmt, die die Lösung einer "Optimalitätsgleichung" (Bellman) ist und aus der sich näherungsweise optimale Entscheidungen ableiten lassen. Eine große Hürde stellt dabei die Dimensionalität des Zustandsraums dar, die häufig hoch und daher traditionellen gitterbasierten Approximationsverfahren wenig zugänglich ist. Das Ziel dieser Arbeit ist es, Reinforcement Lernen durch nichtparametrisierte Funktionsapproximation (genauer, Regularisierungsnetze) auf -- im Prinzip beliebig -- hochdimensionale Probleme anwendbar zu machen. Regularisierungsnetze sind eine Verallgemeinerung von gewöhnlichen Basisfunktionsnetzen, die die gesuchte Lösung durch die Daten parametrisieren, wodurch die explizite Wahl von Knoten/Basisfunktionen entfällt und so bei hochdimensionalen Eingaben der "Fluch der Dimension" umgangen werden kann. Gleichzeitig sind Regularisierungsnetze aber auch lineare Approximatoren, die technisch einfach handhabbar sind und für die die bestehenden Konvergenzaussagen von Reinforcement Lernen Gültigkeit behalten (anders als etwa bei Feed-Forward Neuronalen Netzen). Allen diesen theoretischen Vorteilen gegenüber steht allerdings ein sehr praktisches Problem: der Rechenaufwand bei der Verwendung von Regularisierungsnetzen skaliert von Natur aus wie O(n**3), wobei n die Anzahl der Daten ist. Das ist besonders deswegen problematisch, weil bei Reinforcement Lernen der Lernprozeß online erfolgt -- die Stichproben werden von einem Agenten/Roboter erzeugt, während er mit der Umwelt interagiert. Anpassungen an der Lösung müssen daher sofort und mit wenig Rechenaufwand vorgenommen werden. Der Beitrag dieser Arbeit gliedert sich daher in zwei Teile: Im ersten Teil der Arbeit formulieren wir für Regularisierungsnetze einen effizienten Lernalgorithmus zum Lösen allgemeiner Regressionsaufgaben, der speziell auf die Anforderungen von Online-Lernen zugeschnitten ist. Unser Ansatz basiert auf der Vorgehensweise von Recursive Least-Squares, kann aber mit konstantem Zeitaufwand nicht nur neue Daten sondern auch neue Basisfunktionen in das bestehende Modell einfügen. Ermöglicht wird das durch die "Subset of Regressors" Approximation, wodurch der Kern durch eine stark reduzierte Auswahl von Trainingsdaten approximiert wird, und einer gierigen Auswahlwahlprozedur, die diese Basiselemente direkt aus dem Datenstrom zur Laufzeit selektiert. Im zweiten Teil übertragen wir diesen Algorithmus auf approximative Politik-Evaluation mittels Least-Squares basiertem Temporal-Difference Lernen, und integrieren diesen Baustein in ein Gesamtsystem zum autonomen Lernen von optimalem Verhalten. Insgesamt entwickeln wir ein in hohem Maße dateneffizientes Verfahren, das insbesondere für Lernprobleme aus der Robotik mit kontinuierlichen und hochdimensionalen Zustandsräumen sowie stochastischen Zustandsübergängen geeignet ist. Dabei sind wir nicht auf ein Modell der Umwelt angewiesen, arbeiten weitestgehend unabhängig von der Dimension des Zustandsraums, erzielen Konvergenz bereits mit relativ wenigen Agent-Umwelt Interaktionen, und können dank des effizienten Online-Algorithmus auch im Kontext zeitkritischer Echtzeitanwendungen operieren. Wir demonstrieren die Leistungsfähigkeit unseres Ansatzes anhand von zwei realistischen und komplexen Anwendungsbeispielen: dem Problem RoboCup-Keepaway, sowie der Steuerung eines (simulierten) Oktopus-Tentakels.

Response-reinforcement learning is dependent on N-methyl-d-aspartate receptor activation in the nucleus accumbens core

The nucleus accumbens, a site within the ventral striatum, is best known for its prominent role in mediating the reinforcing effects of drugs of abuse such as cocaine, alcohol, and nicotine. Indeed, it is generally believed that this structure subserves motivated behaviors, such as feeding, drinking, sexual behavior, and exploratory locomotion, which are elicited by natural rewards or incentive stimuli. A basic rule of positive reinforcement is that motor responses will increase in magnitude and vigor if followed by a rewarding event. It is likely, therefore, that the nucleus accumbens may serve as a substrate for reinforcement learning. However, there is surprisingly little information concerning the neural mechanisms by which appetitive responses are learned. In the present study, we report that treatment of the nucleus accumbens core with the selective competitive N-methyl-d-aspartate (NMDA) antagonist 2-amino-5-phosphonopentanoic acid (AP-5; 5 nmol/0.5 μl bilaterally) impairs response-reinforcement learning in the acquisition of a simple lever-press task to obtain food. Once the rats learned the task, AP-5 had no effect, demonstrating the requirement of NMDA receptor-dependent plasticity in the early stages of learning. Infusion of AP-5 into the accumbens shell produced a much smaller impairment of learning. Additional experiments showed that AP-5 core-treated rats had normal feeding and locomotor responses and were capable of acquiring stimulus-reward associations. We hypothesize that stimulation of NMDA receptors within the accumbens core is a key process through which motor responses become established in response to reinforcing stimuli. Further, this mechanism, may also play a critical role in the motivational and addictive properties of drugs of abuse.

Determinação em tempo real da magnitude de danos físicos por impacto em linhas de beneficiamento e em condições de laboratório e seus efeitos na qualidade de tomate

Tomatoes are one of the most important vegetable crops grown in Brazil and are among the crops that have one of the highest post-harvest losses indexes in the country. The present work aimed at evaluating impact damage observed in packing lines of fresh tomatoes as well as to determine, under laboratory conditions, quality alterations of tomato fruits submitted to impact damage in different surface types. Critical points evaluation was accomplished using an instrumented sphere. Critical transference points found showed variations in acceleration levels from 30 to 129 G (m s-2). Tests carried out under laboratory conditions showed that padded surfaces reduced up to 31% impact damage. Incidence of severe internal physical damage was evaluated by a subjective scale and increased by 79% on hard surfaces for the highest fall drop. On the other hand, it was observed an effective reduction in physical damage on fruits when padded surfaces were used. When a 10-cm drop was performed, the maximum reduction measured was 10% for hard surfaces and 5% for previously padded surfaces. For quality parameters, it was observed for high drops on hard surfaces, highest values for weight loss, total acidity, lower values for vitamin C and Soluble Solids.

Comparação da magnitude do dano muscular após ações excêntricas com diferentes velocidades em mulheres jovens e na pós-menopausa

Universidade Estadual de Campinas . Faculdade de Educação Física

Influence of different catilever extensions and glass or polyamaramid reinforcement fibers on fracture strength of implant-supported temporary

In long-term oral rehabilitation treatments, resistance of provisional crowns is a very important factor, especially in cases of an extensive edentulous distal space. The aim of this laboratorial study was to evaluate an acrylic resin cantilever-type prosthesis regarding the flexural strength of its in-balance portion as a function of its extension variation and reinforcement by two types of fibers (glass and polyaramid), considering that literature is not conclusive on this subject. Each specimen was composed by 3 total crowns at its mesial portion, each one attached to an implant component (abutment), while the distal portion (cantilever) had two crowns. Each specimen was constructed by injecting acrylic resin into a two-part silicone matrix placed on a metallic base. In each specimen, the crowns were fabricated with either acrylic resin (control group) or acrylic resin reinforced by glass (Fibrante, Angelus) or polyaramide (Kevlar 49, Du Pont) fibers. Compression load was applied on the cantilever, in a point located 7, 14 or 21 mm from the distal surface of the nearest crown with abutment, to simulate different extensions. The specimen was fixed on the metallic base and the force was applied until fracture in a universal test machine. Each one of the 9 sub-groups was composed by 10 specimens. Flexural strength means (in kgf) for the distances of 7, 14 and 21 mm were, respectively, 28.07, 8.27 and 6.39 for control group, 31.89, 9.18 and 5.16 for Kevlar 49 and 30.90, 9.31 and 6.86 for Fibrante. Data analysis ANOVA showed statistically significant difference (p<0.05) only regarding cantilever extension. Tukey's test detected significantly higher flexural strength for the 7 mm-distance, followed by 14 and 21 mm. Fracture was complete only on specimens of non-reinforced groups.

Sisal organosolv pulp as reinforcement for cement based composites

The present work describes non-conventional sisal (Agave sisalana) chemical (organosolv) pulp from residues of cordage as reinforcement to cement based materials. Sisal organosolv pulp was produced in a 1:1 ethanol/water mixture and post chemically and physically characterized in order to compare its properties with sisal kraft pulp. Cement based composites reinforced with organosolv or kraft pulps and combined with polypropylene (PP) fibres were produced by the slurry de-watering and pressing method as a crude simulation of the Hatschek process. Composites were evaluated at 28 days of age, after exposition to accelerated carbonation and after 100 soak/dry cycles. Composites containing organosolv pulp presented lower mechanical strength, water absorption and apparent porosity than composites reinforced with kraft pulp. The best mechanical performance after ageing was also achieved by samples reinforced with kraft pulp. The addition of PP fibres favoured the maintenance of toughness after ageing. Accelerated carbonation promoted the densification of the composites reinforced with sisal organosolv + PP fibres.

Prospective and Randomized Comparison of Two Techniques of Staple Line Reinforcement During Open Roux-en-Y Gastric Bypass: Oversewing and Bioabsorbable Seamguard (R)

Aims: Surgical staple line dehiscence usually leads to severe complications. Several techniques and materials have been used to reinforce this stapling and thus reduce the related complications. The objective was to compare safety of two types of anastomotic reinforcement in open gastric bypass. Methods: A prospective, randomized study comparing an extraluminal suture, fibrin glue, and a nonpermanent buttressing material, Seamguard (R), for staple line reinforcement. Fibrin glue was excluded from the study and analysis after two leaks, requiring surgical reintervention, antibiotic therapy, and prolonged patient hospitalization. Results: Twenty patients were assigned to the suture and Seamguard reinforcement groups. The groups were similar in terms of preoperative characteristics. No staple line dehiscence occurred in the two groups, whereas two cases of dehiscence occurred in the fibrin glue group. No mortality occurred and surgical time was statistically similar for both techniques. Seamguard made the surgery more expensive. Conclusion: In our service, staple line reinforcement in open bariatric surgery with oversewing or Seamguard was considered to be safe. Seamguard application was considered to be easier than oversewing, but more expensive.

Relatedness and HLA-DRB1 typing may discriminate the magnitude of the genetic susceptibility to tuberculosis using a household contact model

Background Tuberculosis clusters in families may be due to increased household exposure, shared genetic factors, or both. Household contact studies are useful to control exposure because socioeconomic and environmental conditions are similar to all subjects, allowing the evaluation of the contribution of relatedness to disease development. Methods In this study, the familial aggregation of tuberculosis using relatedness and a specific inherited marker (HLA-DRB1) was evaluated. Fifty families, which had at least two cases of tuberculosis diagnosed within the past 5 years, were selected from a cohort of tuberculosis carried out in Recife, Brazil. The first case diagnosed was considered to be a primary case. The secondary attack rate of tuberculosis in household contacts was estimated according to the degree of relatedness. The relative risk of having tuberculosis based on the degree of relatedness household and the population attributable fraction to relatedness were also estimated. HLA-DRB1 typing and attributable etiologic/preventive fractions were calculated among sick and healthy household contacts. Results Compared to unrelated contacts, the relative risk for tuberculosis adjusted for age was 1.38 (95% CI 0.86 to 2.21). Relatedness contributed 23% to the development of tuberculosis at the population levels. The HLA-DRB1*04 allele group (OR = 2.44; p =0.0324; etiologic fraction =0.15) was overrepresented and the DRB1*15 allele group (OR=0.48; p=0.0488; protective fraction=0.19) was underrepresented among household contacts exhibiting tuberculosis. The presence of DRB1 shared alleles between primary cases and their contacts was a risk factor for tuberculosis (p=0.0281). Conclusion This household contact model together with the utilisation of two genetic variables permitted the evaluation of genetic factors contributing towards tuberculosis development.

Tooth Movement Activates the Central Amygdala and the Lateral Hypothalamus by the Magnitude of the Force Applied

Objective: To determine if the magnitude of the force used to induce incisor tooth movement promotes distinct activation in cells in the central amygdala (CEA) and lateral hypothalamus (LH) of rats. Also, the effect of morphine on Fos immunoreactivity (Fos-IR) was investigated in these nuclei. Materials and Methods: Adult male rats were anesthetized and divided into six groups: only anesthetized (control), without orthodontic appliance (OA), OA but without force, OA activated with 30g or 70g, OA with 70g in animals pretreated with morphine (2 mg/kg, intraperitoneal). Three hours after the onset of the experiment the rats were reanesthetized and perfused with 4% paraformaldehyde. The brains were removed and fixed, and sections containing CEA and LH were processed for Fos protein immunohistochemistry. Results: The results show that in the control group, the intramuscular injection of a ketamine/xylazine mixture did not induce Fos-IR cells in the CEA or in the LH. Again, the without force group showed a little Fos-IR. However, in the 70g group the Fos-IR was the biggest observed (P < .05, Tukey) in the CEA and LH compared with the other groups. In the 30g group, the Fos-IR did not differ from the control group, the without OA group, and the without force group. Furthermore, pretreatment with morphine in the 70g group reduced Fos-IR in these regions. Conclusions: Tooth movement promotes Fos-IR in the CEA and LH according to the magnitude of the force applied. (Angle Orthod. 2010;80:111-115.)

Increase in the magnitude of the energy barrier distribution in Ni nanoparticles due to dipolar interactions

The energy barrier distribution E(b) of five samples with different concentrations x of Ni nanoparticles using scaling plots from ac magnetic susceptibility data has been determined. The scaling of the imaginary part of the susceptibility chi""(v, T) versus T ln (iota t/tau(0)) remains valid for all samples, which display Ni nanoparticles with similar shape and size. The mean value < E(b)> increases appreciably with increasing x, or more appropriately with increasing dipolar interactions between Ni nanoparticles. We argue that such an increase in < E(b)> constitutes a powerful tool for quality control in magnetic recording media technology where the dipolar interaction plays an important role. (c) 2011 American Institute of Physics. [doi: 10.1063/1.3533911]

Prevalence, magnitude, and methods of rapid weight loss among judo competitors

ARTIOLI, G. G., B. GUALANO, E. FRANCHINI, F. B. SCAGLIUSI, M. TAKESIAN, M. FUCHS, and A. H. LANCHA. Prevalence, Magnitude, and Methods of Rapid Weight Loss among Judo Competitors. Med. Sci. Sports Exerc., Vol. 42, No. 3, pp. 436-442, 2010. Purpose: To identify the prevalence, magnitude, and methods of rapid weight loss among judo competitors. Methods: Athletes (607 males and 215 females; age = 19.3 +/- 5.3 yr, weight = 70 +/- 7.5 kg, height = 170.6 +/- 9.8 cm) completed a previously validated questionnaire developed to evaluate rapid weight loss in judo athletes, which provides a score. The higher the score obtained, the more aggressive the weight loss behaviors. Data were analyzed using descriptive statistics and frequency analyses. Mean scores obtained in the questionnaire were used to compare specific groups of athletes using, when appropriate, Mann-Whitney U-test or general linear model one-way ANOVA followed by Tamhane post hoc test. Results: Eighty-six percent of athletes reported that have already lost weight to compete. When heavyweights are excluded, this percentage rises to 89%. Most athletes reported reductions of up to 5% of body weight (mean +/- SD: 2.5 +/- 2.3%). The most weight ever lost was 2%-5%, whereas a great part of athletes reported reductions of 5%-10% (mean +/- SD: 6 +/- 4%). The number of reductions underwent in a season was 3 +/- 5. The reductions usually occurred within 7 +/- 7 d. Athletes began cutting weight at 12.6 +/- 6.1 yr. No significant differences were found in the score obtained by male versus female athletes as well as by athletes from different weight classes. Elite athletes scored significantly higher in the questionnaire than nonelite. Athletes who began cutting weight earlier also scored higher than those who began later. Conclusions: Rapid weight loss is highly prevalent in judo competitors. The level of aggressiveness in weight management behaviors seems to not be influenced by the gender or by the weight class, but it seems to be influenced by competitive level and by the age at which athletes began cutting weight.

Eucalyptus pulp fibres as alternative reinforcement to engineered cement-based composites

This paper evaluates the advantages of using hardwood short fibre pulp (eucalyptus) as alternative to softwood long fibre pulp (pinus) and polymer fibres, traditionally used in reinforcement of cement-based materials. The effects of cellulose fibre length on microstructure and on mechanical performance of fibre-cement composites were evaluated before and after accelerated ageing cycles. Hardwood pulp fibres were better dispersed in the cement matrix and provided higher number of fibres per unitary weight or volume, in relation to softwood long fibre pulp. The short reinforcing elements lead to an effective crack bridging of the fragile matrix, which contributes to the improvement of the mechanical performance of the composite after ageing. These promising results show the potential of eucalyptus short fibres for reducing costs by both the partial replacement of expensive synthetic fibres in air curing process and the energy savings during pulp refining. (C) 2009 Elsevier B.V. All rights reserved.

Hybrid Reinforcement of Sisal and Polypropylene Fibers in Cement-Based Composites

Several studies using vegetable fibers as the exclusive reinforcement in fiber-cement composites have shown acceptable mechanical performance at the first ages. However, after the exposure to accelerated aging tests, these composites have shown significant reduction in the toughness or increase in embrittlement. This was mainly attributed to the improved fiber-matrix adhesion and fiber mineralization after aging process. The objective of the present research was to evaluate composites produced by the slurry dewatering technique followed by pressing and air curing, reinforced with combinations of polypropylene fibers and sisal kraft pulp at different pulp freeness. The physical properties, mechanical performance, and microstructural characteristics of the composites were evaluated before and after accelerated and natural aging. Results showed the great contribution of pulp refinement on the improvement of the mechanical strength in the composites. Higher intensities of refinement resulted in higher modulus of rupture for the composites with hybrid reinforcement after accelerated and natural aging. The more compact microstructure was due to the improved packing of the mineral particles with refined sisal pulp. The toughness of the composites after aging was maintained in relation to the composites at 28 days of cure.