Experience generalization for multi-agent reinforcement learning

On-line learning methods have been applied successfully in multi-agent systems to achieve coordination among agents. Learning in multi-agent systems implies in a non-stationary scenario perceived by the agents, since the behavior of other agents may change as they simultaneously learn how to improve their actions. Non-stationary scenarios can be modeled as Markov Games, which can be solved using the Minimax-Q algorithm a combination of Q-learning (a Reinforcement Learning (RL) algorithm which directly learns an optimal control policy) and the Minimax algorithm. However, finding optimal control policies using any RL algorithm (Q-learning and Minimax-Q included) can be very time consuming. Trying to improve the learning time of Q-learning, we considered the QS-algorithm. in which a single experience can update more than a single action value by using a spreading function. In this paper, we contribute a Minimax-QS algorithm which combines the Minimax-Q algorithm and the QS-algorithm. We conduct a series of empirical evaluation of the algorithm in a simplified simulator of the soccer domain. We show that even using a very simple domain-dependent spreading function, the performance of the learning algorithm can be improved.

Effects of a muscarinic type-2 antagonist on cardiorespiratory function and intestinal transit in horses anesthetized with halothane and xylazine

Objective-To evaluate the cardiorespiratory and intestinal effects of the muscarinic type-2 (M-2) antagonist, methoctramine, in anesthetized horses.Animals-6 horses.Procedure-Horses were allocated to 2 treatments in a randomized complete block design. Anesthesia was maintained with halothane (1% end-tidal concentration) combined with a constant-rate infusion of xylazine hydrochloride (1 mg/kg/h, IV) and mechanical ventilation. Hemodynamic variables were monitored after induction of anesthesia and for 120 minutes after administration of methoctramine or saline (0.9% NaCl) solution (control treatment). Methoctramine was given at 10-minute intervals (10 mug/kg, IV) until heart rate (HR) increased at least 30% above baseline values or until a maximum cumulative dose of 30 mug/kg had been administered. Recovery characteristics, intestinal auscultation scores, and intestinal transit determined by use of chromium oxide were assessed during the postanesthetic period.Results-Methoctramine was given at a total cumulative dose of 30 mug/kg to 4 horses, whereas 2 horses received 10 mug/kg. Administration of methoctramine resulted in increases in HR, cardiac output, arterial blood pressure, and tissue oxygen delivery. Intestinal auscultation scores and intestinal transit time (interval to first and last detection of chromium oxide in the feces) did not differ between treatment groups.Conclusions and Clinical Relevance-Methoctramine improved hemodynamic function in horses anesthetized by use of halothane and xylazine without causing a clinically detectable delay in the return to normal intestinal motility during the postanesthetic period. Because of their selective positive chronotropic effects, M-2 antagonists may represent a safe alternative for treatment of horses with intraoperative bracycardia.

Effects of glycopyrrolate on cardiorespiratory function in horses anesthetized with halothane and xylazine

Objective-To evaluate cardiopulmonary effects of glycopyrrolate in horses anesthetized with halothane and xylazine.Animals-6 horses.Procedure-Horses were allocated to 2 treatment groups in a randomized complete block design. Anesthesia was maintained in mechanically ventilated horses by administration of halothane (1% end-tidal concentration) combined with a constant-rate infusion of xylazine hydrochloride (1 mg/kg/h, IV). Hemodynamic variables were monitored after induction of anesthesia and for 120 minutes after administration of glycopyrrolate or saline (0.9% NaCl) solution. Glycopyrrolate (2.5 mug/kg, IV) was administered at 10-minute intervals until heart rate (HR) increased at least 30% above baseline or a maximum cumulative dose of 75 mug/kg had been injected. Recovery characteristics and intestinal auscultation scores were evaluated for 24 hours after the end of anesthesia.Results-Cumulative dose of glycopyrrolate administered to 5 horses was 5 mug/kg, whereas 1 horse received 75 mug/kg. The positive chronotropic effects of glycopyrrolate were accompanied by an increase in cardiac output, arterial blood pressure, and tissue oxygen delivery. Whereas HR increased by 53% above baseline values at 20 minutes after the last glycopyrrolate injection, cardiac output and mean arterial pressure increased by 38% and 31%, respectively. Glycopyrrolate administration was associated with impaction of the large colon in I horse and low intestinal auscultation scores lasting 24 hours in 3 horses.Conclusions and Clinical Relevance-The positive chronotropic effects of glycopyrrolate resulted in improvement of hemodynamic function in horses anesthetized with halothane and xylazine. However, prolonged intestinal stasis and colic may limit its use during anesthesia.

Effect of high-dose fentanyl on renal function in dogs

OBJETIVOS: Estudamos os efeitos de alta dose de fentanil (F) em atributos de função renal (FR) do cão. DESENHO: Anestesiamos com pentobarbital sódico (PS) 16 cães divididos aleatoriamente em 2 grupos: manutenção com PS (Gi) e PS com F (0,05 mg.kg-1) (G2). INTERVENÇÃO: os cães foram ventilados artificialmente e tiveram cateterizadas as veias femorais esquerda e direita e a artéria femoral esquerda para infusão de drogas e coleta de dados hemodinâmicos e de sangue para dosagens laboratoriais. Coletou-se urina durante todo experimento. MENSURAÇÃO: Determinaram-se os valores de atributos de FR.. RESULTADOS: PS não mudou a FR e o comportamento de G1 deveu-se à expansão do volume extracelular. O F diminuiu significativamente freqüência cardíaca, pressão arterial média, clearance de creatinina, volume urinário, clearance osmolar e excreção fracionária de sódio e potássio. CONCLUSÕES: A diminuição da FR foi provavelmente devida às alterações hemodinâmicas induzidas pelo F, não se descartando possível ação da aldosterona.

Evolução da terminoliga princípio contábil baseada na Escola Norte-Americana

This research has as objective of study the evolution of the accountancy princliple terminology which is present in the accounting conceptual framework. The scene of this research will have as target the North American School of Accounting. The choice of the searched terminology is its relevance in the study of the Accounting Theory. To understand the evolution of the accountancy thought, will be boarded: the influence of the Feudal System and the Mercantilism in the European economic conception; the importance of the Industrial Revolution in the beginning of the accounting standards and the influence of England in the formation of the North American School of Accounting. With relation to U.S.A., the development of the economic-financial scene of the American society will be evaluated, focusing the contribution in the search of the construction of an applied theoretical framework to the Accounting. The economic-financial development of U.S.A. provided the sprouting of new users with specific necessities. The necessity of the user for useful information for the decision taking, unchained the process of research directed toward the establishment of an applied Accountancy terminology. In this process, the paper exerted for the responsible accountancy organisms for the accounting standards will be boarded, as well as the professionals associations which had invested in researches, aiming at to elaborate a body of accountancy principles and to adjust the accountancy procedures to the necessities of the users. To reach the research objective, a bibliographical revision in specialized literature will be effected, adopting the historical method, in the period that understands the development of the North American School of Accounting. As result of the research, it can conclude that the evolution process of the terminology which is studied presents a structural logical problem, because the impossibility of the construction of a theoretical framework, having as bases the principle terminology. The impossibility occurred in function of the reach attributed to the term, which made a difficult in its application in the elaboration of the accountancy procedures

Follow-up study of morphology and cardiac function in rats undergoing induction of supravalvular aortic stenosis

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Effects of protein-calorie restriction on mechanical function of hypertrophied cardiac muscle

OBJECTIVE: To assess the effect of food restriction (FR) on hypertrophied cardiac muscle in spontaneously hypertensive rats (SHR). METHODS: Isolated papillary muscle preparations of the left ventricle (LV) of 60-day-old SHR and of normotensive Wistar-Kyoto (WKY) rats were studied. The rats were fed either an unrestricted diet or FR diet (50% of the intake of the control diet) for 30 days. The mechanical function of the muscles was evaluated through monitoring isometric and isotonic contractions. RESULTS: FR caused: 1) reduction in the body weight and LV weight of SHR and WKY rats; 2) increase in the time to peak shortening and the time to peak developed tension (DT) in the hypertrophied myocardium of the SHR; 3) diverging changes in the mechanical function of the normal cardiac muscles of WKY rats with reduction in maximum velocity of isotonic shortening and of the time for DT to decrease 50% of its maximum value, and increase of the resting tension and of the rate of tension decline. CONCLUSION: Short-term FR causes prolongation of the contraction time of hypertrophied muscles and paradoxal changes in mechanical performance of normal cardiac fibers, with worsening of the shortening indices and of the resting tension, and improvement of the isometric relaxation.

A dominant function of p38 mitogen-activated protein kinase signaling in receptor activator of nuclear factor-kappa B ligand expression and osteoclastogenesis induction by Aggregatibacter actinomycetemcomitans and Escherichia coli lipopolysaccharide

Background and Objective: Lipopolysaccharide from gram-negative bacteria is one of the microbial-associated molecular patterns that initiate the immune/inflammatory response, leading to the tissue destruction observed in periodontitis. The aim of this study was to evaluate the role of the p38 mitogen-activated protein kinase (MAPK) signaling pathway in lipopolysaccharide-induced receptor activator of nuclear factor-kappa B ligand (RANKL) expression by murine periodontal ligament cells.Material and Methods: Expression of RANKL and osteoprotegerin mRNA was studied by reverse transcription-polymerase chain reaction upon stimulation with lipopolysaccharide from Escherichia coli and Aggregatibacter actinomycetemcomitans. The biochemical inhibitor SB203580 was used to evaluate the contribution of the p38 MAPK signaling pathway to lipopolysaccharide-induced RANKL and osteoprotegerin expression. Stable cell lines expressing dominant-negative forms of MAPK kinase (MKK)-3 and MKK6 were generated to confirm the role of the p38 MAPK pathway. An osteoclastogenesis assay using a coculture model of the murine monocytic cell line RAW 264.7 was used to determine if osteoclast differentiation induced by lipopolysaccharide-stimulated periodontal ligament was correlated with RANKL expression.Results: Inhibiting p38 MAPK prior to lipopolysaccharide stimulation resulted in a significant decrease of RANKL mRNA expression. Osteoprotegerin mRNA expression was not affected by lipopolysaccharide or p38 MAPK. Lipopolysaccharide-stimulated periodontal ligament cells increased osteoclast differentiation, an effect that was completely blocked by osteoprotegerin and significantly decreased by inhibition of MKK3 and MKK6, upstream activators of p38 MAPK. Conditioned medium from murine periodontal ligament cultures did not increase osteoclast differentiation, indicating that periodontal ligament cells produced membrane-bound RANKL.Conclusion: Lipopolysaccharide resulted in a significant increase of RANKL in periodontal ligament cells. The p38 MAPK pathway is required for lipopolysaccharide-induced membrane-bound RANKL expression in these cells.

Impairment of adult male reproductive function in rats exposed to ethanol since puberty

The objective of this work was to evaluate reproductive function in adult male rats exposed to ethanol since puberty. Male Wistar rats, 50 days old, received a liquid diet with 36% of the daily calories derived from ethanol or an isocaloric control diet for 55 days. The ethanol treatment impaired sexual behavior and only 22% of these rats reached ejaculation. The fertility of ethanol-treated animals was significantly reduced, mainly after natural mating. Serum testosterone levels, daily sperm production and sperm count in the epididymis were also significantly diminished after ethanol treatment, associated with an acceleration of the sperm transit time in the cauda epididymidis, decrease in sperm motility and increased percentage of abnormal shaped sperm cells. The results showed that chronic consumption of ethanol beginning at puberty impairs the reproductive function of adult male rats. (c) 2006 Elsevier B.V. All rights reserved.

Effects of cement thickness and bonding on the failure loads of CAD/CAM ceramic crowns: Multi-physics FEA modeling and monotonic testing

Objective. To determine the influence of cement thickness and ceramic/cement bonding on stresses and failure of CAD/CAM crowns, using both multi-physics finite element analysis and monotonic testing.Methods. Axially symmetric FEA models were created for stress analysis of a stylized monolithic crown having resin cement thicknesses from 50 to 500 mu m under occlusal loading. Ceramic-cement interface was modeled as bonded or not-bonded (cement-dentin as bonded). Cement polymerization shrinkage was simulated as a thermal contraction. Loads necessary to reach stresses for radial cracking from the intaglio surface were calculated by FEA. Experimentally, feldspathic CAD/CAM crowns based on the FEA model were machined having different occlusal cementation spaces, etched and cemented to dentin analogs. Non-bonding of etched ceramic was achieved using a thin layer of poly(dimethylsiloxane). Crowns were loaded to failure at 5 N/s, with radial cracks detected acoustically.Results. Failure loads depended on the bonding condition and the cement thickness for both FEA and physical testing. Average fracture loads for bonded crowns were: 673.5 N at 50 mu m cement and 300.6 N at 500 mu m. FEA stresses due to polymerization shrinkage increased with the cement thickness overwhelming the protective effect of bonding, as was also seen experimentally. At 50 mu m cement thickness, bonded crowns withstood at least twice the load before failure than non-bonded crowns.Significance. Occlusal "fit" can have structural implications for CAD/CAM crowns; pre-cementation spaces around 50-100 mu m being recommended from this study. Bonding benefits were lost at thickness approaching 450-500 mu m due to polymerization shrinkage stresses. (C) 2012 Academy of Dental Materials. Published by Elsevier Ltd. All rights reserved.

Immunologic aspects of West syndrome and evidence of plasma inhibitory effects on T cell function

OBJETIVO: O objetivo deste estudo foi determinar o perfil da deficiência imune em um grupo bem definido de epilepsia: crianças com síndrome de West (SW) e seus padrões EEG de evolução, idade-dependentes, como os complexos onda-aguda- onda lenta generalizadas da síndrome de Lenox-Gastaut (SLG) e as pontas multifocais independentes (PMI). MÉTODO: Um grupo de 50 crianças, 33 com SW, 10 com SLG, 7 com PMI e 20 crianças sadias (controle) foram avaliadas em relação aos seguintes parâmetros:determinação de subpopulações de linfócitos T (CD1, CD3, CD4 e CD8), relação CD4/CD8 e resposta proliferativa de linfócitos frente a fitohemaglutinina (PHA), na presença de plasma autólogo ou de plasma AB (homólogo). A prova cutânea de sensibilização ao Dinitroclorobenzeno (DNCB) foi realizada apenas nos pacientes. Os níveis séricos de IgG, IgA e IgM foram comparados aos valores normais em crianças Brasileiras, em diferentes faixas etárias. RESULTADOS: A resposta ao DNCB foi ausente ou fracamente reativa em 76% dos pacientes. Níveis séricos elevados de IgG (45,7%) e de IgM (61,4%) e baixos de IgA (23,9%) foram detectados nos pacientes. A determinação das subpopulações de linfócitos T em sangue periférico mostrou: deficiência nas proporções de células CD3+ (p<0,05) e de CD4+ (p<0,05), aumento de CD8+ (p<0,01) e diminuição da relação CD4 / CD8 (p<0,001). A proporção de células CD1+ no grupo controle manteve-se menor que 3%, enquanto que em 18% dos pacientes esses níveis variaram entre 3 e 11%. A resposta proliferativa de linfócitos frente a PHA revelou índices blastogênicos significativamente mais baixos apenas quando células dos pacientes foram cultivadas na presença do próprio plasma (plasma autólogo). Quando estas células foram cultivadas na presença de plasma AB, não se evidenciou diferença significativa em relação ao grupo controle. CONCLUSÃO: A imunodeficiência na SW caracterizou-se por: anergia, alteração de imunidade mediada por células e dos níveis de imunoglobulinas, presença de timócitos imaturos na circulação periférica e deficiência funcional de linfócitos T induzida por fatores plasmáticos inibidores. Discutem-se as principais evidências de disfunção imune como imunodeficiência e autoimunidade.

Multi-wavelength holography in Bi12TiO20 crystals: Applications in refractometry

We present a recent development in holography with multimode, large free-spectral range (FSR) diode lasers in photorefractive sillenite crystals. A novel refractometry method based on this type of holographic recording in Bi12TiO20 (BTO) crystals is proposed. The holographic image of a prism-shaped transparent sample appears covered of interference fringes, and as the sample is properly translated, the fringes run along the holographic image. An expression providing the refractive index of the medium as a function of the sample displacement and the correspondent number of running fringes was derived. The refractive indexes of optical (BK7) glass, ethanol, hexan, cumene and aqueous solution of NaCl with different concentrations were measured in order to test the method. The obtained results are in good agreement with the ones reported in literature or measured by us using a commercial Abbe refractometre. (c) 2006 Elsevier B.V. All rights reserved.

Effects of remifentanil infusion regimens on cardiovascular function and responses to noxious stimulation in propofol-anesthetized cats

Objective-To evaluate the effects of 2 remifentanil infusion regimens on cardiovascular function and responses to nociceptive stimulation in propofol-anesthetized cats.Animals-8 adult cats.Procedures-On 2 occasions, cats received acepromazine followed by propofol (6 mg/kg then 0.3 mg/kg/min, IV) and a constant rate infusion (CRI) of remifentanil (0.2 or 0.3 mu g/kg/min,IV) for 90 minutes and underwent mechanical ventilation (phase I). After recording physiologic variables, an electrical stimulus (50 V; 50 Hz; 10 milliseconds) was applied to a forelimb to assess motor responses to nociceptive stimulation. After an interval (>= 10 days), the same cats were anesthetized via administration of acepromazine and a similar infusion regimen of propofol; the remifentanil infusion rate adjustments that were required to inhibit cardiovascular responses to ovariohysterectomy were recorded (phase II).Results-In phase I, heart rate and arterial pressure did not differ between remifentanil-treated groups. From 30 to 90 minutes, cats receiving 0.3 mu g of remifentanil/kg/min had no response to noxious stimulation. Purposeful movement was detected more frequently in cats receiving 0.2 mu g of remifentanil/kg/min. In phase II, the highest dosage (mean +/- SEM) of remifentanil that prevented cardiovascular responses was 0.23 +/- 0.01 mu g/kg/min. For all experiments, mean time from infusion cessation until standing ranged from 115 to 140 minutes.Conclusions and Clinical Relevance-Although the lower infusion rate of remifentanil allowed ovariohysterectomy to be performed, a CRI of 0.3 mu g/kg/min was necessary to prevent motor response to electrical stimulation in propofol-anesthetized cats. Recovery from anesthesia was prolonged with this technique.

Analysis of camphorquinone in composite resins as a function of shade

Objective. To identify and quantify the camphorquinone (CQ) used in different brands of composite resins as a function of the shade analyzed.Materials and methods. Filtek Z250 A3 (FZA3), Filtek Z-250 Incisal (FZI), Pyramid Enamel A1 (PEA1), Pyramid Enamel Translucent (PET), Filtek Supreme A3E (FSA3) and Filtek Supreme GT (FSGT) were used. Five hundred milligrams of each resin were weighed and then dissolved in 1.0 ml of methanol. The samples were centrifuged to accelerate the sedimentation of the inorganic particles. 0.8 ml of the supernatant solution was collected with a pipette and assessed under gas chromatography coupled to the mass spectrometer (GC-MS). The results were compared to pure CQ solutions, used as a standard. Student's t-test, (p = 0.05) significant at the level of 5%, compared the results of each brand shade.Results. A smaller amount of camphorquinone was found in Filtek Z-250 (FZI) resin incisal shade when compared to (FZA3) A3 shade. on the other hand, Filtek Supreme resin featured a statistically larger camphorquinone amount in the incisal shade. in Pyramid Enamel resin camphorquinone was found only in shade Al, while the photoinitiator used in the Translucent shade was not identified.Significance. Based on the data obtained, it is possible to conclude that a single composite resin brand may feature differences in amount and type of photoinitiator used. (C) 2006 Academy of Dental Materials. Published by Elsevier Ltd. All rights reserved.

A homological version of the implicit function theorem

Our objective in this paper is to prove an Implicit Function Theorem for general topological spaces. As a consequence, we show that, under certain conditions, the set of the invertible elements of a topological monoid X is an open topological group in X and we use the classical topological group theory to conclude that this set is a Lie group.