Experience generalization for multi-agent reinforcement learning

On-line learning methods have been applied successfully in multi-agent systems to achieve coordination among agents. Learning in multi-agent systems implies in a non-stationary scenario perceived by the agents, since the behavior of other agents may change as they simultaneously learn how to improve their actions. Non-stationary scenarios can be modeled as Markov Games, which can be solved using the Minimax-Q algorithm a combination of Q-learning (a Reinforcement Learning (RL) algorithm which directly learns an optimal control policy) and the Minimax algorithm. However, finding optimal control policies using any RL algorithm (Q-learning and Minimax-Q included) can be very time consuming. Trying to improve the learning time of Q-learning, we considered the QS-algorithm. in which a single experience can update more than a single action value by using a spreading function. In this paper, we contribute a Minimax-QS algorithm which combines the Minimax-Q algorithm and the QS-algorithm. We conduct a series of empirical evaluation of the algorithm in a simplified simulator of the soccer domain. We show that even using a very simple domain-dependent spreading function, the performance of the learning algorithm can be improved.

Experimental and theoretical studies on the enhanced photoluminescence activity of zinc sulfide with a capping agent

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Direct and simultaneous spectrophotometric determination of Ni (II) and Co (II) using diethanoldithiocarbamate as complexing agent

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Multi-Agent Simulation of Urban Social Dynamics for Spatial Load Forecasting

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Attachment of 2,2-bipyridine onto a silica gel for application as a sequestering agent for copper, cadmium and lead ions from an aqueous medium

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Black bean (Phaseolus vulgaris L.) as a protective agent against DNA damage in mice

This study was designed to evaluate the toxicogenetic or protective effect of cooked and dehydrated black beans (Phaseolus vulgaris L.) in bone marrow and peripheral blood cells of exposed mice. The frequency of micronuclei detected using the bone marrow erythrocyte micronucleus test and level of DNA lesions detected by the comet assay were chosen as end-points reflecting mutagenic and genotoxic damage, respectively. Initially, Swiss male mice were fed with a 20% black bean diet in order to detect mutagenic and genotoxic activity. However, no increase in the frequency of bone marrow micronucleated polychromatic erythrocytes (MN PCEs) or DNA lesion in leukocytes was observed. In contrast, received diets containing 1, 10 or 20% of black beans, a clear, but not dose-dependent reduction in the frequency of MN PCEs were observed in animals simultaneously treated with cyclophosphamide, an indirect acting mutagen. Similar results were observed in leukocytes by the comet assay. Commercial anthocyanin was also tested in an attempt to identify the bean components responsible for this protective effect. However, instead of being protective, the flavonoid, at the highest dose administered (50 mg/kg bw), induced primary DNA lesion, as detected by the comet assay. These data indicate the importance of food components in preventing genetic damage induced by chemical mutagens, and also reinforce the role of toxicogenetic techniques in protecting human health. (C) 2003 Elsevier Ltd. All rights reserved.

Silver nanoparticles: influence of stabilizing agent and diameter on antifungal activity against Candida albicans and Candida glabrata biofilms

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Short-term evaluation of the pulpo-dentin complex response to a resin-modified glass-ionomer cement and a bonding agent applied in deep cavities

Objectives. To evaluate the response of the pulpo-dentin complex following application of a resin-modified glass-ionomer cement or an adhesive system in deep cavities performed in human teeth.Methods. Deep class V cavities were prepared on the buccal surface of 26 premolars. In Group I the cavity walls (dentin) and enamel were conditioned with 32% phosphoric acid and the dentin adhesive system One Step (Bisco, Inc., Itasca, IL, USA) was applied. In Groups 2 and 3, before total etching and application of bonding agent, the cavity floor was lined with the resin-modified glass-ionomer cement-Vitrebond (3M ESPE Dental Products Division, St. Paul, MN, USA) or the calcium hydroxide cement-Dycal (control group, Dentsply, Mildford, DE, USA), respectively. The cavities were restored using light-cured Z-100 composite resin (3M ESPE). The teeth were extracted between 5 and 30 days and prepared for microscopic assessment. Serial sections were stained with H/E, Masson's trichrome, and Brown and Brenn techniques.Results. In Group 1, the inflammatory response was more evident than in Groups 2 and 3. Diffusion of dental material components across dentinal tubules was observed only in Group 1, in which the intensity of the pulp response increased as the remaining dentin thickness decreased. Bacteria were evidenced in the lateral walls of two samples (Group 2) which exhibited no inflammatory response or tissue disorganization.Conclusions. Based on the experimental conditions, it was concluded total acid etching followed by application of One Step bonding agent cannot be recommended as adequate procedures. In this clinical condition the cavity walls should be lined with a biocompatible dental material, such as Vitrebond or Dycal. 2003 Academy of Dental Materials. Published by Elsevier Ltd. All rights reserved.

Response of human pulps following acid conditioning and application of a bonding agent in deep cavities

Objectives. The aim of this in vivo study was to evaluate the human dental pulp response when a one-bottle adhesive system was applied on etched or unetched deep dentine.Methods. Eighteen class V deep cavity preparations were divided in three groups: group 1-total etching + two coats of single bond (SB) + composite resin (Z-100); group 2-enamel etching + two coats of SB + Z-100, group 3-cavity floor lined with a calcium hydroxide liner (Dycal) + acid-etching of enamel and lateral walls + two coats of SB + Z-100. Two teeth were used as intact control group. After 30 days the teeth were extracted and processed through H and E, Masson's trichrome and Brown and Brenn staining techniques.Results. Moderate inflammatory response, disorganization of pulp tissue, as well as, deposition of thin layer of reactionary dentin were observed in group 1 teeth in which the remaining dentin thickness (RDT) was less than 300 mum. These histological findings appear to be related to long resin tags formation and bonding agent diffusion through dentinal tubules. In group 2, slight inflammatory response was observed only in one tooth in which the RDT was 162 mum. In group 3, all the teeth showed normal histological characteristics which were similar to the intact control group. Presence of bacteria was not correlated with the intensity of pulpal response. The patients reported no symptoms during the experiment. Radiographic evaluation showed no periapical pathology for any of the teeth,Significance and conclusions. Acid-etched deep dentin (RDT less than 300 mum) lined with SB causes more intense pulpal response than unetched deep dentin. Based on the results observed in the present study and the conditions in which it was carried out, we recommend the application of a biocompatible liner before etching deep dentin and applying SB. (C) 2002 Academy of Dental Materials. Published by Elsevier B.V. Ltd. All rights reserved.

Diametral tensile strength and film thickness of an experimental dental luting agent derived from castor oil

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

EFFECT of DIFFERENT AIRBORNE-PARTICLE ABRASION/BONDING AGENT COMBINATIONS on THE BOND STRENGTH of A RESIN CEMENT TO A BASE METAL ALLOY

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Should Anacardium humile St. Hil be used as an antiulcer agent? A scientific approach to the traditional knowledge

The crude methanolic extract (ME) obtained from the leaves of Anacardium humile was evaluated orally at doses of 250-500-1000 mg/kg on gastric lesion on ethanol and piroxicam induced gastric lesions in rodents. All the tested doses significantly inhibited gastric lesions by 56 to 100%. These results seems to support the traditional use of this species in the treatment of gastric diseases. (C) 2007 Elsevier B.V. All rights reserved.

Indigofera suffruticosa Mill as new source of healing agent: Involvement of prostaglandin and mucus and heat shock proteins

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Can a Strychnos species be used as antiulcer agent? Ulcer healing action from alkaloid fraction of Strychnos pseudoquina St. Hil. (Loganiaceae)

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Can the aqueous decoction of mango flowers be used as an antiulcer agent?

This study was designed to determine the effect of Mangifera indica flowers decoction, on the acute and subacute models of induced ulcer in mice and rats. A single oral administration of the aqueous decoction (AD) from M. indica up to a dose of 5 g/kg, p.o. did not produce any signs or symptom of toxicity in the treated animals. The oral pre-treatment with AD (250, 500 and 1000 mg/kg) in rats with gastric lesions induced by ethanol, decreased the gastric lesions from 89.0 +/- 6.71 (control group) to 9.25 +/- 2.75, 4.50 +/- 3.30 and 0, respectively. Pretreatment with AD (250, 500 and 1000 mg/kg) to mice with HCl/ethanol- or stress-induced gastric lesions resulted in a dose-dependent significant decrease of lesion index. In the piroxicam-induced gastric lesions, the gastroprotective effect of AD was reducing with the increase of the AD dose. In the pylorus-ligature, AD (p.o.) significantly decreased the acid output indicating the antisecretory property involved in the gastroprotective effect of M. indica. Treatment with AD during 14 consecutive days significantly accelerated the healing process in subacute gastric ulcer induced by acetic acid in rats. Pretreatment with N-nitro-L-arginine methyl ester (L-NAME), an inhibitor of NO-synthase, did not abolish the gastroprotective effects (99% with saline versus 80% With L-NAME) of AD against ethanol-induced gastric lesions. Pretreatment with N-ethylmaleimide (NEM), a blocker of endogenous sulphydryl group, significantly abolished the protective effects of AD against ethanol-induced gastric ulcers (95% with saline versus 47% with NEM). Phytochemical screening showed the presence of steroids, triterpenes, phenolic compounds and flavonoids. Estimation of the global polyphenol content in the AD was performed by Folin-Ciocalteu method and showed approximately 53% of total phenolic on this extract. These findings indicate the potential gastroprotective and ulcer-healing properties of aqueous decoction of M. indica flowers and further support its popular use in gastrointestinal disorders in Caribbean. (c) 2005 Elsevier B.V.. All rights reserved.