A formalization for multi-agent decision support in cooperative environments. A framework for situated agents

La tesis propone un marco de trabajo para el soporte de la toma de decisiones adecuado para soportar la ejecución distribuida de acciones cooperativas en entornos multi-agente dinámicos y complejos. Soporte para la toma de decisiones es un proceso que intenta mejorar la ejecución de la toma de decisiones en escenarios cooperativos. Este proceso ocurre continuamente en la vida diaria. Los humanos, por ejemplo, deben tomar decisiones acerca de que ropa usar, que comida comer, etc. En este sentido, un agente es definido como cualquier cosa que está situada en un entorno y que actúa, basado en su observación, su interpretación y su conocimiento acerca de su situación en tal entorno para lograr una acción en particular.Por lo tanto, para tomar decisiones, los agentes deben considerar el conocimiento que les permita ser consientes en que acciones pueden o no ejecutar. Aquí, tal proceso toma en cuenta tres parámetros de información con la intención de personificar a un agente en un entorno típicamente físico. Así, el mencionado conjunto de información es conocido como ejes de decisión, los cuales deben ser tomados por los agentes para decidir si pueden ejecutar correctamente una tarea propuesta por otro agente o humano. Los agentes, por lo tanto, pueden hacer mejores decisiones considerando y representando apropiadamente tal información. Los ejes de decisión, principalmente basados en: las condiciones ambientales, el conocimiento físico y el valor de confianza del agente, provee a los sistemas multi-agente un confiable razonamiento para alcanzar un factible y exitoso rendimiento cooperativo.Actualmente, muchos investigadores tienden a generar nuevos avances en la tecnología agente para incrementar la inteligencia, autonomía, comunicación y auto-adaptación en escenarios agentes típicamente abierto y distribuidos. En este sentido, esta investigación intenta contribuir en el desarrollo de un nuevo método que impacte tanto en las decisiones individuales como colectivas de los sistemas multi-agente. Por lo tanto, el marco de trabajo propuesto ha sido utilizado para implementar las acciones concretas involucradas en el campo de pruebas del fútbol robótico. Este campo emula los juegos de fútbol real, donde los agentes deben coordinarse, interactuar y cooperar entre ellos para solucionar tareas complejas dentro de un escenario dinámicamente cambiante y competitivo, tanto para manejar el diseño de los requerimientos involucrados en las tareas como para demostrar su efectividad en trabajos colectivos. Es así que los resultados obtenidos tanto en el simulador como en el campo real de experimentación, muestran que el marco de trabajo para el soporte de decisiones propuesto para agentes situados es capaz de mejorar la interacción y la comunicación, reflejando en un adecuad y confiable trabajo en equipo dentro de entornos impredecibles, dinámicos y competitivos. Además, los experimentos y resultados también muestran que la información seleccionada para generar los ejes de decisión para situar a los agentes, es útil cuando tales agentes deben ejecutar una acción o hacer un compromiso en cada momento con la intención de cumplir exitosamente un objetivo colectivo. Finalmente, algunas conclusiones enfatizando las ventajas y utilidades del trabajo propuesto en la mejora del rendimiento colectivo de los sistemas multi-agente en situaciones tales como tareas coordinadas y asignación de tareas son presentadas.

The Dynamic Structure of Everyday Life

Computational theories of action have generally understood the organized nature of human activity through the construction and execution of plans. By consigning the phenomena of contingency and improvisation to peripheral roles, this view has led to impractical technical proposals. As an alternative, I suggest that contingency is a central feature of everyday activity and that improvisation is the central kind of human activity. I also offer a computational model of certain aspects of everyday routine activity based on an account of improvised activity called running arguments and an account of representation for situated agents called deictic representation .

Interaction and Intelligent Behavior

We introduce basic behaviors as primitives for control and learning in situated, embodied agents interacting in complex domains. We propose methods for selecting, formally specifying, algorithmically implementing, empirically evaluating, and combining behaviors from a basic set. We also introduce a general methodology for automatically constructing higher--level behaviors by learning to select from this set. Based on a formulation of reinforcement learning using conditions, behaviors, and shaped reinforcement, out approach makes behavior selection learnable in noisy, uncertain environments with stochastic dynamics. All described ideas are validated with groups of up to 20 mobile robots performing safe--wandering, following, aggregation, dispersion, homing, flocking, foraging, and learning to forage.

Designing and Programming Organizational Infrastructures for Agents situated in Artifact-based Environments

Actual trends in software development are pushing the need to face a multiplicity of diverse activities and interaction styles characterizing complex and distributed application domains, in such a way that the resulting dynamics exhibits some grade of order, i.e. in terms of evolution of the system and desired equilibrium. Autonomous agents and Multiagent Systems are argued in literature as one of the most immediate approaches for describing such a kind of challenges. Actually, agent research seems to converge towards the definition of renewed abstraction tools aimed at better capturing the new demands of open systems. Besides agents, which are assumed as autonomous entities purposing a series of design objectives, Multiagent Systems account new notions as first-class entities, aimed, above all, at modeling institutional/organizational entities, placed for normative regulation, interaction and teamwork management, as well as environmental entities, placed as resources to further support and regulate agent work. The starting point of this thesis is recognizing that both organizations and environments can be rooted in a unifying perspective. Whereas recent research in agent systems seems to account a set of diverse approaches to specifically face with at least one aspect within the above mentioned, this work aims at proposing a unifying approach where both agents and their organizations can be straightforwardly situated in properly designed working environments. In this line, this work pursues reconciliation of environments with sociality, social interaction with environment based interaction, environmental resources with organizational functionalities with the aim to smoothly integrate the various aspects of complex and situated organizations in a coherent programming approach. Rooted in Agents and Artifacts (A&A) meta-model, which has been recently introduced both in the context of agent oriented software engineering and programming, the thesis promotes the notion of Embodied Organizations, characterized by computational infrastructures attaining a seamless integration between agents, organizations and environmental entities.

Dynamic management and restoration of virtual paths in broadband networks based on distributed software agents

La gestió de xarxes és un camp molt ampli i inclou molts aspectes diferents. Aquesta tesi doctoral està centrada en la gestió dels recursos en les xarxes de banda ampla que disposin de mecanismes per fer reserves de recursos, com per exemple Asynchronous Transfer Mode (ATM) o Multi-Protocol Label Switching (MPLS). Es poden establir xarxes lògiques utilitzant els Virtual Paths (VP) d'ATM o els Label Switched Paths (LSP) de MPLS, als que anomenem genèricament camins lògics. Els usuaris de la xarxa utilitzen doncs aquests camins lògics, que poden tenir recursos assignats, per establir les seves comunicacions. A més, els camins lògics són molt flexibles i les seves característiques es poden canviar dinàmicament. Aquest treball, se centra, en particular, en la gestió dinàmica d'aquesta xarxa lògica per tal de maximitzar-ne el rendiment i adaptar-la a les connexions ofertes. En aquest escenari, hi ha diversos mecanismes que poden afectar i modificar les característiques dels camins lògics (ample de banda, ruta, etc.). Aquests mecanismes inclouen els de balanceig de la càrrega (reassignació d'ample de banda i reencaminament) i els de restauració de fallades (ús de camins lògics de backup). Aquests dos mecanismes poden modificar la xarxa lògica i gestionar els recursos (ample de banda) dels enllaços físics. Per tant, existeix la necessitat de coordinar aquests mecanismes per evitar possibles interferències. La gestió de recursos convencional que fa ús de la xarxa lògica, recalcula periòdicament (per exemple cada hora o cada dia) tota la xarxa lògica d'una forma centralitzada. Això introdueix el problema que els reajustaments de la xarxa lògica no es realitzen en el moment en què realment hi ha problemes. D'altra banda també introdueix la necessitat de mantenir una visió centralitzada de tota la xarxa. En aquesta tesi, es proposa una arquitectura distribuïda basada en un sistema multi agent. L'objectiu principal d'aquesta arquitectura és realitzar de forma conjunta i coordinada la gestió de recursos a nivell de xarxa lògica, integrant els mecanismes de reajustament d'ample de banda amb els mecanismes de restauració preplanejada, inclosa la gestió de l'ample de banda reservada per a la restauració. Es proposa que aquesta gestió es porti a terme d'una forma contínua, no periòdica, actuant quan es detecta el problema (quan un camí lògic està congestionat, o sigui, quan està rebutjant peticions de connexió dels usuaris perquè està saturat) i d'una forma completament distribuïda, o sigui, sense mantenir una visió global de la xarxa. Així doncs, l'arquitectura proposada realitza petits rearranjaments a la xarxa lògica adaptant-la d'una forma contínua a la demanda dels usuaris. L'arquitectura proposada també té en consideració altres objectius com l'escalabilitat, la modularitat, la robustesa, la flexibilitat i la simplicitat. El sistema multi agent proposat està estructurat en dues capes d'agents: els agents de monitorització (M) i els de rendiment (P). Aquests agents estan situats en els diferents nodes de la xarxa: hi ha un agent P i diversos agents M a cada node; aquests últims subordinats als P. Per tant l'arquitectura proposada es pot veure com una jerarquia d'agents. Cada agent és responsable de monitoritzar i controlar els recursos als que està assignat. S'han realitzat diferents experiments utilitzant un simulador distribuït a nivell de connexió proposat per nosaltres mateixos. Els resultats mostren que l'arquitectura proposada és capaç de realitzar les tasques assignades de detecció de la congestió, reassignació dinàmica d'ample de banda i reencaminament d'una forma coordinada amb els mecanismes de restauració preplanejada i gestió de l'ample de banda reservat per la restauració. L'arquitectura distribuïda ofereix una escalabilitat i robustesa acceptables gràcies a la seva flexibilitat i modularitat.

I feel you: Towards affect-sensitive domotic Spoken Conversational Agents

We describe the work on infusion of emotion into limitedtask autonomous spoken conversational agents (SCAs) situated in the domestic environment, using a Need-inspired task-independentEmotion model (NEMO). In order to demonstrate the generation of a?ect through the use of the model, we describe the work of integrating it with a naturallanguage mixed-initiative HiFi-control SCA. NEMO and the host system communicates externally, removing the need for the Dialog Manager to be modi?ed as done in most existing dialog systems, in order to be adaptive. We also summarize the work on automatic a?ect prediction, namely frustration and contentment from dialog features, a non-conventional source, in the attempt of moving towards a more user-centric approach.

Autonomous Acquisition of Natural Situated Communication

An important part of human intelligence, both historically and operationally, is our ability to communicate. We learn how to communicate, and maintain our communicative skills, in a society of communicators – a highly effective way to reach and maintain proficiency in this complex skill. Principles that might allow artificial agents to learn language this way are in completely known at present – the multi-dimensional nature of socio-communicative skills are beyond every machine learning framework so far proposed. Our work begins to address the challenge of proposing a way for observation-based machine learning of natural language and communication. Our framework can learn complex communicative skills with minimal up-front knowledge. The system learns by incrementally producing predictive models of causal relationships in observed data, guided by goal-inference and reasoning using forward-inverse models. We present results from two experiments where our S1 agent learns human communication by observing two humans interacting in a realtime TV-style interview, using multimodal communicative gesture and situated language to talk about recycling of various materials and objects. S1 can learn multimodal complex language and multimodal communicative acts, a vocabulary of 100 words forming natural sentences with relatively complex sentence structure, including manual deictic reference and anaphora. S1 is seeded only with high-level information about goals of the interviewer and interviewee, and a small ontology; no grammar or other information is provided to S1 a priori. The agent learns the pragmatics, semantics, and syntax of complex utterances spoken and gestures from scratch, by observing the humans compare and contrast the cost and pollution related to recycling aluminum cans, glass bottles, newspaper, plastic, and wood. After 20 hours of observation S1 can perform an unscripted TV interview with a human, in the same style, without making mistakes.

Comparison Of The Solution Of Histidine-tryptophan-alfacetoglutarate With Histidine-tryptophan-glutamate As Cardioplegic Agents In Isolated Rat Hearts: An Immunohistochemical Study.

Cardiac arrest during heart surgery is a common procedure and allows the surgeon to perform surgical procedures in an environment free of blood and movement. Using a model of isolated rat heart, the authors compare a new cardioplegic solution containing histidine-tryptophan-glutamate (group 2) with the histidine-tryptophan-alphacetoglutarate (group 1) routinely used by some cardiac surgeons. To assess caspase, IL-8 and KI-67 in isolated rat hearts using immunohistochemistry. 20 Wistar male rats were anesthetized and heparinized. The chest was opened, cardioctomy was performed and 40 ml/kg of the appropriate cardioplegic solution was infused. The hearts were kept for 2 hours at 4ºC in the same solution, and thereafter, placed in the Langendorff apparatus for 30 minutes with Ringer-Locke solution. Immunohistochemistry analysis of caspase, IL-8, and KI-67 were performed. The concentration of caspase was lower in group 2 and Ki-67 was higher in group 2, both P<0.05. There was no statistical difference between the values of IL-8 between the groups. Histidine-tryptophan-glutamate solution was better than histidine-tryptophan-alphacetoglutarate solution because it reduced caspase (apoptosis), increased KI-67 (cell proliferation), and showed no difference in IL-8 levels compared to group 1. This suggests that the histidine-tryptophan-glutamate solution was more efficient than the histidine-tryptophan-alphacetoglutarate for the preservation of hearts of rat cardiomyocytes.

Perianal Complete Remission With Combined Therapy (seton Placement And Anti-tnf Agents) In Crohn's Disease: A Brazilian Multicenter Observational Study.

Perianal fistulizing Crohn's disease is one of the most severe phenotypes of inflammatory bowel diseases. Combined therapy with seton placement and anti-TNF therapy is the most common strategy for this condition. The aim of this study was to analyze the rates of complete perianal remission after combined therapy for perianal fistulizing Crohn's disease. This was a retrospective observational study with perianal fistulizing Crohn's disease patients submitted to combined therapy from four inflammatory bowel diseases referral centers. We analyzed patients' demographic characteristics, Montreal classification, concomitant medication, classification of the fistulae, occurrence of perianal complete remission and recurrence after remission. Complete perianal remission was defined as absence of drainage from the fistulae associated with seton removal. A total of 78 patients were included, 44 (55.8%) females with a mean age of 33.8 (±15) years. Most patients were treated with Infliximab, 66.2%, than with Adalimumab, 33.8%. Complex fistulae were found in 52/78 patients (66.7%). After a medium follow-up of 48.2 months, 41/78 patients (52.6%) had complete perianal remission (95% CI: 43.5%-63.6%). Recurrence occurred in four (9.8%) patients (95% CI: 0.7%-18.8%) in an average period of 74.8 months. Combined therapy lead to favorable and durable results in perianal fistulizing Crohn's disease.

Correlation between margin fit and microleakage in complete crowns cemented with three luting agents

Microleakage can be related to margin misfit. Also, traditional microleakage techniques are time-consuming. This study evaluated the existence of correlation between in vitro margin fit and a new microleakage technique for complete crowns cemented with 3 different luting agents. Thirty human premolars were prepared for full-coverage crowns with a convergence angle of 6 degrees, chamfer margin of 1.2 mm circumferentially, and occlusal reduction of 1.5 mm. Ni-Cr cast crowns were cemented with either zinc phosphate (ZP) (S.S. White), resin-modified glass-ionomer (RMGI) (Rely X Luting Cement) or a resin-based luting agent (RC) (Enforce). Margin fit (seating discrepancy and margin gap) was evaluated according to criteria in the literature under microscope with 0.001 mm accuracy. After thermal cycling, crowns were longitudinally sectioned and microleakage scores at tooth-cement interface were obtained and recorded at ×100 magnification. Margin fit parameters were compared with the one-way ANOVA test and microleakage scores with Kruskal-Wallis and Dunn's tests (alpha=0.05). Correlation between margin fit and microleakage was analyzed with the Spearman's test (alpha=0.05). Seating discrepancy and marginal gap values ranged from 81.82 µm to 137.22 µm (p=0.117), and from 75.42 µm to 78.49 µm (p=0.940), respectively. Marginal microleakage scores were ZP=3.02, RMGI=0.35 and RC=0.12 (p<0.001), with no differences between RMGI and RC scores. The correlation coefficient values ranged from -0.27 to 0.30 (p>0.05). Conclusion: Margin fit parameters and microleakage showed no strong correlations; cast crowns cemented with RMGI and RC had lower microleakage scores than ZP cement.

Comparison among four commonly used demineralizing agents for root conditioning: a scanning electron microscopy

Dental roots that have been exposed to the oral cavity and periodontal pocket environment present superficial changes, which can prevent connective tissue reattachment. Demineralizing agents have been used as an adjunct to the periodontal treatment aiming at restoring the biocompatibility of roots. OBJECTIVE: This study compared four commonly used demineralizing agents for their capacity of removing smear layer and opening dentin tubules. METHODS: Fifty fragments of human dental roots previously exposed to periodontal disease were scaled and randomly divided into the following groups of treatment: 1) CA: demineralization with citric acid for 3 min; 2) TC-HCl: demineralization with tetracycline-HCl for 3 min; 3) EDTA: demineralization with EDTA for 3 min; 4) PA: demineralization with 37% phosphoric acid for 3 min; 5) Control: rubbing of saline solution for 3 min. Scanning electron microscopy was used to check for the presence of residual smear layer and for measuring the number and area of exposed dentin tubules. RESULTS: Smear layer was present in 100% of the specimens from the groups PA and control; in 80% from EDTA group; in 33.3% from TC-HCl group and 0% from CA group. The mean numbers of exposed dentin tubules in a standardized area were: TC-HCl=43.8±25.2; CA=39.3±37; PA=12.1±16.3; EDTA=4.4±7.5 and Control=2.3±5.7. The comparison showed significant differences between the following pairs of groups: TC-HCl and Control; TC-HCl and EDTA; CA and Control; and CA and EDTA. The mean percentages of area occupied by exposed dentin tubules were: CA=0.12±0.17%; TC-HCl=0.08±0.06%; PA=0.03±0.05%; EDTA=0.01±0.01% and Control=0±0%. The CA group differed significantly from the others except for the TC-HCl group. CONCLUSION: There was a decreasing ability for smear layer removal and dentin tubule widening as follows: AC>TC-HCl>PA>EDTA. This information can be of value as an extra parameter for choosing one of them for root conditioning.

Flavoring agents present in a dentifrice can modify volatile sulphur compounds (VSCs) formation in morning bad breath

This study aimed to evaluate the effects of a flavor-containing dentifrice on the formation of volatile sulphur compounds (VSCs) in morning bad breath. A two-step, blinded, crossover, randomized study was carried out in 50 dental students with a healthy periodontium divided into two experimental groups: flavor-containing dentifrice (test) and non-flavor-containing dentifrice (control). The volunteers received the designated dentifrice and a new toothbrush for a 3 X/day brushing regimen for 2 periods of 30 days. A seven-day washout interval was used between the periods. The assessed parameters were: plaque index (PI), gingival index (GI), organoleptic breath scores (ORG), VSC levels (as measured by a portable sulphide monitor) before (H1) and after (H2) cleaning of the tongue, tongue coating (TC) wet weight and BANA test from TC samples. The intra-group analysis showed a decrease in ORG, from 3 to 2, after 30 days for the test group (p < 0.05). The inter-group analysis showed lower values in ORG, H1 and H2 for the test group (p < 0.05). There was no difference between the amount of TC between groups and the presence of flavor also did not interfere in the BANA results between groups (p > 0.05). These findings suggest that a flavor-containing dentifrice seems to prevent VSCs formation in morning bad breath regardless of the amount of TC in periodontally healthy subjects.