Estratégias baseadas em aprendizado para coordenação de uma frota de robôs em tarefas cooperativas

In multi-robot systems, both control architecture and work strategy represent a challenge for researchers. It is important to have a robust architecture that can be easily adapted to requirement changes. It is also important that work strategy allows robots to complete tasks efficiently, considering that robots interact directly in environments with humans. In this context, this work explores two approaches for robot soccer team coordination for cooperative tasks development. Both approaches are based on a combination of imitation learning and reinforcement learning. Thus, in the first approach was developed a control architecture, a fuzzy inference engine for recognizing situations in robot soccer games, a software for narration of robot soccer games based on the inference engine and the implementation of learning by imitation from observation and analysis of others robotic teams. Moreover, state abstraction was efficiently implemented in reinforcement learning applied to the robot soccer standard problem. Finally, reinforcement learning was implemented in a form where actions are explored only in some states (for example, states where an specialist robot system used them) differently to the traditional form, where actions have to be tested in all states. In the second approach reinforcement learning was implemented with function approximation, for which an algorithm called RBF-Sarsa($lambda$) was created. In both approaches batch reinforcement learning algorithms were implemented and imitation learning was used as a seed for reinforcement learning. Moreover, learning from robotic teams controlled by humans was explored. The proposal in this work had revealed efficient in the robot soccer standard problem and, when implemented in other robotics systems, they will allow that these robotics systems can efficiently and effectively develop assigned tasks. These approaches will give high adaptation capabilities to requirements and environment changes.

Arquitetura de Software para Barcos Robóticos

We propose in this work a software architecture for robotic boats intended to act in diverse aquatic environments, fully autonomously, performing telemetry to a base station and getting this mission to be accomplished. This proposal aims to apply within the project N-Boat Lab NatalNet DCA, which aims to empower a sailboat navigating autonomously. The constituent components of this architecture are the memory modules, strategy, communication, sensing, actuation, energy, security and surveillance, making these systems the boat and base station. To validate the simulator was developed in C language and implemented using the graphics API OpenGL resources, whose main results were obtained in the implementation of memory, performance and strategy modules, more specifically data sharing, control of sails and rudder and planning short routes based on an algorithm for navigation, respectively. The experimental results, shown in this study indicate the feasibility of the actual use of the software architecture developed and their application in the area of autonomous mobile robotics

On 3-Parameter Families of Piecewise Smooth Vector Fields in the Plane

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Short Lyapunov time: a method for identifying confined chaos

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Optimal placement of piezoelectric sensor/actuators for smart structures vibration control

Smart material technology has become an area of increasing interest for the development of lighter and stronger structures that are able to incorporate actuator and sensor capabilities for collocated control. In the design of actively controlled structures, the determination of the actuator locations and the controller gains is a very important issue. For that purpose, smart material modeling, modal analysis methods, and control and optimization techniques are the most important ingredients to be taken into account. The optimization problem to be solved in this context presents two interdependent aspects. The first is related to the discrete optimal actuator location selection problem, which is solved in this paper using genetic algorithms. The second is represented by a continuous variable optimization problem, through which the control gains are determined using classical techniques. A cantilever Euler-Bernoulli beam is used to illustrate the presented methodology.

Processo de difusão com agregação e reorganização espontânea em uma rede 2D

Difusive processes are extremely common in Nature. Many complex systems, such as microbial colonies, colloidal aggregates, difusion of fluids, and migration of populations, involve a large number of similar units that form fractal structures. A new model of difusive agregation was proposed recently by Filoche and Sapoval [68]. Based on their work, we develop a model called Difusion with Aggregation and Spontaneous Reorganization . This model consists of a set of particles with excluded volume interactions, which perform random walks on a square lattice. Initially, the lattice is occupied with a density p = N/L2 of particles occupying distinct, randomly chosen positions. One of the particles is selected at random as the active particle. This particle executes a random walk until it visits a site occupied by another particle, j. When this happens, the active particle is rejected back to its previous position (neighboring particle j), and a new active particle is selected at random from the set of N particles. Following an initial transient, the system attains a stationary regime. In this work we study the stationary regime, focusing on scaling properties of the particle distribution, as characterized by the pair correlation function ø(r). The latter is calculated by averaging over a long sequence of configurations generated in the stationary regime, using systems of size 50, 75, 100, 150, . . . , 700. The pair correlation function exhibits distinct behaviors in three diferent density ranges, which we term subcritical, critical, and supercritical. We show that in the subcritical regime, the particle distribution is characterized by a fractal dimension. We also analyze the decay of temporal correlations

Losing identity: structural diversity of transposable elements belonging to different classes in the genome of Anopheles gambiae

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Time series analysis for minority game simulations of financial markets

The minority game (MG) model introduced recently provides promising insights into the understanding of the evolution of prices, indices and rates in the financial markets. In this paper we perform a time series analysis of the model employing tools from statistics, dynamical systems theory and stochastic processes. Using benchmark systems and a financial index for comparison, several conclusions are obtained about the generating mechanism for this kind of evolution. The motion is deterministic, driven by occasional random external perturbation. When the interval between two successive perturbations is sufficiently large, one can find low dimensional chaos in this regime. However, the full motion of the MG model is found to be similar to that of the first differences of the SP500 index: stochastic, nonlinear and (unit root) stationary. (C) 2002 Elsevier B.V. B.V. All rights reserved.

Transition to turbulence in the Reynolds' experiment

In this study we simulate numerically the Reynolds' experiment for the transition from laminar to turbulent flow in a pipe. We present a discussion of the results from a dynamical systems perspective when a control parameter, the Reynolds number, is increased. The Landau scenario, where the transition is described by the excitation of infinite oscillatory modes within the fluid, is not observed. Instead what happens is best explained by the Ruelle-Takens scenario in terms of strange attractors. The Lyapunov exponent and fractal dimension for the attractor are calculated together with a measure of complex behaviour called the Lempel-Ziv complexity. (C) 2001 Elsevier B.V. B.V. All rights reserved.

Brane cosmic string compactification in Brans-Dicke theory

We investigate an alternative compactification of extra dimensions using local cosmic string in the Brans-Dicke gravity framework. In the context of dynamical systems it is possible to show that there exist a stable field configuration for the Einstein-Brans-Dicke equations. We explore the analogies between this particular model and the Randall-Sundrum scenario.

Transition to complete synchronization in phase-coupled oscillators with nearest neighbor coupling

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Escape and transport for an open bouncer: Stretched exponential decays

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Dissipation as a mechanism of energy gain

Some properties of the annular billiard under the presence of weak dissipation are studied. We show, in a dissipative system, that the average energy of a particle acquires higher values than its average energy of the conservative case. The creation of attractors, associated with a chaotic dynamics in the conservative regime, both in appropriated regions of the phase space, constitute a generic mechanism to increase the average energy of dynamical systems.

Divergent diagrams of folds and simultaneous conjugacy of involutions

In this work we show that the smooth classification of divergent diagrams of folds (f(1),..., f(s)) : (R-n, 0) -> (R-n x(...)xR(n), 0) can be reduced to the classification of the s-tuples (p(1)., W) of associated involutions. We apply the result to obtain normal forms when s <= n and {p(1),...,p(s)} is a transversal set of linear involutions. A complete description is given when s = 2 and n >= 2. We also present a brief discussion on applications of our results to the study of discontinuous vector fields and discrete reversible dynamical systems.

Percepção e ação: direções teóricas e experimentais atuais

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)