Experience generalization for multi-agent reinforcement learning

On-line learning methods have been applied successfully in multi-agent systems to achieve coordination among agents. Learning in multi-agent systems implies in a non-stationary scenario perceived by the agents, since the behavior of other agents may change as they simultaneously learn how to improve their actions. Non-stationary scenarios can be modeled as Markov Games, which can be solved using the Minimax-Q algorithm a combination of Q-learning (a Reinforcement Learning (RL) algorithm which directly learns an optimal control policy) and the Minimax algorithm. However, finding optimal control policies using any RL algorithm (Q-learning and Minimax-Q included) can be very time consuming. Trying to improve the learning time of Q-learning, we considered the QS-algorithm. in which a single experience can update more than a single action value by using a spreading function. In this paper, we contribute a Minimax-QS algorithm which combines the Minimax-Q algorithm and the QS-algorithm. We conduct a series of empirical evaluation of the algorithm in a simplified simulator of the soccer domain. We show that even using a very simple domain-dependent spreading function, the performance of the learning algorithm can be improved.

Experimental and theoretical studies on the enhanced photoluminescence activity of zinc sulfide with a capping agent

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Direct and simultaneous spectrophotometric determination of Ni (II) and Co (II) using diethanoldithiocarbamate as complexing agent

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Multi-Agent Simulation of Urban Social Dynamics for Spatial Load Forecasting

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Attachment of 2,2-bipyridine onto a silica gel for application as a sequestering agent for copper, cadmium and lead ions from an aqueous medium

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Prevalence and antifungal susceptibility of Candida parapsilosis complex isolates collected from oral cavities of HIV-infected individuals

At present, few data are available on the prevalence and antifungal susceptibility of Candida parapsilosis complex isolates from HIV-infected individuals. The C. parapsilosis complex comprises three species, C. parapsilosis sensu stricto, C. metapsilosis and C. orthopsilosis. Fifteen of 318 Candida isolates were identified as members of the C. parapsilosis complex by PCR and restriction fragment length polymorphism (RFLP). The prevalence of C. parapsilosis complex isolates was 4.7 %, 2.2 % being identified as C. parapsilosis sensu stricto and 2.5% as C. metapsilosis, while no C. orthopsilosis was isolated. This is believed to be the first study that has identified isolates of C. metapsilosis obtained from the oral cavity of HIV-infected individuals. Antifungal susceptibility tests indicated that all the isolates were susceptible to amphotericin B (AMB), fluconazole (FLC), ketoconazole (KTC), itraconazole (ITC), voriconazole (VRC) and caspofungin (CASPO). Although isolates of C. parapsilosis sensu stricto and C. metapsilosis were susceptible to FLC, isolates of C. metapsilosis showed a tendency for higher MICs (>= 1.0 mu g ml(-1)). Based upon the frequency of candidiasis and the fact that certain isolates of the C. parapsilosis complex respond differently to FLC therapy, our data may be of therapeutic relevance with respect to susceptibility and potential resistance to specific antifungal agents. Our data suggest that C. metapsilosis can be a human commensal; its importance as a pathogen has yet to be confirmed.

Black bean (Phaseolus vulgaris L.) as a protective agent against DNA damage in mice

This study was designed to evaluate the toxicogenetic or protective effect of cooked and dehydrated black beans (Phaseolus vulgaris L.) in bone marrow and peripheral blood cells of exposed mice. The frequency of micronuclei detected using the bone marrow erythrocyte micronucleus test and level of DNA lesions detected by the comet assay were chosen as end-points reflecting mutagenic and genotoxic damage, respectively. Initially, Swiss male mice were fed with a 20% black bean diet in order to detect mutagenic and genotoxic activity. However, no increase in the frequency of bone marrow micronucleated polychromatic erythrocytes (MN PCEs) or DNA lesion in leukocytes was observed. In contrast, received diets containing 1, 10 or 20% of black beans, a clear, but not dose-dependent reduction in the frequency of MN PCEs were observed in animals simultaneously treated with cyclophosphamide, an indirect acting mutagen. Similar results were observed in leukocytes by the comet assay. Commercial anthocyanin was also tested in an attempt to identify the bean components responsible for this protective effect. However, instead of being protective, the flavonoid, at the highest dose administered (50 mg/kg bw), induced primary DNA lesion, as detected by the comet assay. These data indicate the importance of food components in preventing genetic damage induced by chemical mutagens, and also reinforce the role of toxicogenetic techniques in protecting human health. (C) 2003 Elsevier Ltd. All rights reserved.

Silver colloidal nanoparticles: antifungal effect against adhered cells and biofilms of Candida albicans and Candida glabrata

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Short-term evaluation of the pulpo-dentin complex response to a resin-modified glass-ionomer cement and a bonding agent applied in deep cavities

Objectives. To evaluate the response of the pulpo-dentin complex following application of a resin-modified glass-ionomer cement or an adhesive system in deep cavities performed in human teeth.Methods. Deep class V cavities were prepared on the buccal surface of 26 premolars. In Group I the cavity walls (dentin) and enamel were conditioned with 32% phosphoric acid and the dentin adhesive system One Step (Bisco, Inc., Itasca, IL, USA) was applied. In Groups 2 and 3, before total etching and application of bonding agent, the cavity floor was lined with the resin-modified glass-ionomer cement-Vitrebond (3M ESPE Dental Products Division, St. Paul, MN, USA) or the calcium hydroxide cement-Dycal (control group, Dentsply, Mildford, DE, USA), respectively. The cavities were restored using light-cured Z-100 composite resin (3M ESPE). The teeth were extracted between 5 and 30 days and prepared for microscopic assessment. Serial sections were stained with H/E, Masson's trichrome, and Brown and Brenn techniques.Results. In Group 1, the inflammatory response was more evident than in Groups 2 and 3. Diffusion of dental material components across dentinal tubules was observed only in Group 1, in which the intensity of the pulp response increased as the remaining dentin thickness decreased. Bacteria were evidenced in the lateral walls of two samples (Group 2) which exhibited no inflammatory response or tissue disorganization.Conclusions. Based on the experimental conditions, it was concluded total acid etching followed by application of One Step bonding agent cannot be recommended as adequate procedures. In this clinical condition the cavity walls should be lined with a biocompatible dental material, such as Vitrebond or Dycal. 2003 Academy of Dental Materials. Published by Elsevier Ltd. All rights reserved.

Comparison of denture microwave disinfection and conventional antifungal therapy in the treatment of denture stomatitis: a randomized clinical study

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Comparison of Photodynamic Therapy versus conventional antifungal therapy for the treatment of denture stomatitis: a randomized clinical trial

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Response of human pulps following acid conditioning and application of a bonding agent in deep cavities

Objectives. The aim of this in vivo study was to evaluate the human dental pulp response when a one-bottle adhesive system was applied on etched or unetched deep dentine.Methods. Eighteen class V deep cavity preparations were divided in three groups: group 1-total etching + two coats of single bond (SB) + composite resin (Z-100); group 2-enamel etching + two coats of SB + Z-100, group 3-cavity floor lined with a calcium hydroxide liner (Dycal) + acid-etching of enamel and lateral walls + two coats of SB + Z-100. Two teeth were used as intact control group. After 30 days the teeth were extracted and processed through H and E, Masson's trichrome and Brown and Brenn staining techniques.Results. Moderate inflammatory response, disorganization of pulp tissue, as well as, deposition of thin layer of reactionary dentin were observed in group 1 teeth in which the remaining dentin thickness (RDT) was less than 300 mum. These histological findings appear to be related to long resin tags formation and bonding agent diffusion through dentinal tubules. In group 2, slight inflammatory response was observed only in one tooth in which the RDT was 162 mum. In group 3, all the teeth showed normal histological characteristics which were similar to the intact control group. Presence of bacteria was not correlated with the intensity of pulpal response. The patients reported no symptoms during the experiment. Radiographic evaluation showed no periapical pathology for any of the teeth,Significance and conclusions. Acid-etched deep dentin (RDT less than 300 mum) lined with SB causes more intense pulpal response than unetched deep dentin. Based on the results observed in the present study and the conditions in which it was carried out, we recommend the application of a biocompatible liner before etching deep dentin and applying SB. (C) 2002 Academy of Dental Materials. Published by Elsevier B.V. Ltd. All rights reserved.

Diametral tensile strength and film thickness of an experimental dental luting agent derived from castor oil

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

EFFECT of DIFFERENT AIRBORNE-PARTICLE ABRASION/BONDING AGENT COMBINATIONS on THE BOND STRENGTH of A RESIN CEMENT TO A BASE METAL ALLOY

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)