Experience generalization for multi-agent reinforcement learning

On-line learning methods have been applied successfully in multi-agent systems to achieve coordination among agents. Learning in multi-agent systems implies in a non-stationary scenario perceived by the agents, since the behavior of other agents may change as they simultaneously learn how to improve their actions. Non-stationary scenarios can be modeled as Markov Games, which can be solved using the Minimax-Q algorithm a combination of Q-learning (a Reinforcement Learning (RL) algorithm which directly learns an optimal control policy) and the Minimax algorithm. However, finding optimal control policies using any RL algorithm (Q-learning and Minimax-Q included) can be very time consuming. Trying to improve the learning time of Q-learning, we considered the QS-algorithm. in which a single experience can update more than a single action value by using a spreading function. In this paper, we contribute a Minimax-QS algorithm which combines the Minimax-Q algorithm and the QS-algorithm. We conduct a series of empirical evaluation of the algorithm in a simplified simulator of the soccer domain. We show that even using a very simple domain-dependent spreading function, the performance of the learning algorithm can be improved.

Generalization of the Y-differential autotransformer for 12- and 18-pulse converters

This work proposes a methodology to generalize the Y-connections for 12- and 18-pulse autotransformers. A single mathematical expression, obtained through simple trigonometric operations, represents all the connections. The proposed methodology allows choosing any ratio between the input and the output voltages. The converters can operate either as step-up or as step-down voltage. To simplify the design of the windings, graphics are generated to calculate the turn-ratio and the polarity of each secondary winding, with respect to the primary winding. A design example, followed by digital simulations, illustrates the presented steps. Experimental results of two prototypes (12 and 18 pulses) are presented. The results also show that high power factor is an inherent characteristic of multi-pulse converters, without any active or passive power factor pre-regulators needs. (c) 2005 Elsevier B.V. All rights reserved.

Lie symmetry analysis and reductions of a two-dimensional integrable generalization of the Camassa-Holm equation

In this Letter we investigate Lie symmetries of a (2 + 1)-dimensional integrable generalization of the Camassa-Holm (CH) equation. Through the similarity reductions we obtain four different (1 + 1)-dimensional systems of partial differential equations in which one of them turns out to be a (1 + 1)-dimensional CH equation. We establish their integrability by providing the Lax pair for all of them. Further, we present a brief analysis for some types of particular solutions which include the cuspon, peakon and soliton solutions for the two-dimensional generalization of the CH equation. (C) 2000 Published by Elsevier B.V. B.V.

Generalization of the Hamilton-Jacobi approach for higher-order singular systems

We generalize the Hamilton-Jacobi formulation for higher-order singular systems and obtain the equations of motion as total differential equations. To do this we first study the constraints structure present in such systems.

Generalization of the delta-differential autotransformer for 12 and 18-pulse converters

This work proposes a methodology to generalize the A-connections for 12 and 18-pulse autotransformers. A single mathematical expression, obtained through simple trigonometric operations, represents all the connections. The proposed methodology allows choosing any ratio between the input and the output voltages. The converters can operate either as step-up or as step-down voltage. To simplify the design of the windings, graphics are generated to calculate the turn-ratio and the polarity of each secondary winding, with respect to the primary winding. A design example, followed by digital simulations, and experimental results illustrate the presented steps. The results also show that high power factor is an inherent characteristic of multi-pulse converters, without any active or passive power factor pre-regulators needs.

Simple generalization of Wisdom's perturbative method

A simple generalization of Wisdom's perturbative method, as originally proposed by Wisdom (1985), is obtained. Any number of resonant cosines can be handled and the method can also accommodate more involved disturbing functions. Averaged trajectories are easily obtained by drawing level curves of the action. Here, the method is first tested for simple models of 3:1 and 2:1 resonant problems. Comparisons with numerical integration and surface-section curves show very good agreements.

Supersymmetric and shape-invariant generalization for nonresonant and intensity-dependent Jaynes-Cummings systems

A class of shape-invariant bound-state problems which represent transitions in a two-level system introduced earlier are generalized to include arbitrary energy splittings between the two levels as well as intensity-dependent interactions. We show that the coupled-channel Hamiltonians obtained correspond to the generalizations of the nonresonant and intensity-dependent Jaynes-Cummings Hamiltonians, widely used in quantized theories of lasers. In this general context, we determine the eigenstates, eigenvalues, the time evolution matrix and the population inversion matrix factor.

Microscopic generalization of the standard interacting boson model Hamiltonian in the restricted dynamics approach

The evaluation of the microscopic generalized interacting boson model (GIBM) Hamiltonian, deduced from the general microscopic nuclear Hamiltonian via the collective O-A-1 invariant microscopic Hamiltonian of the general restricted dynamics model (RDM) in the case of central multipole and multipole-Gauss type effective NN-potential is briefly discussed. The GIBM version, which includes all sixth-order terms in the expansion of the collective part of the NN-potential, has been obtained. This GIBM Hamiltonian contains additional terms compared with the standard (sd-boson) interacting boson model (IBM). The microscopic expressions for the standard IBM Hamiltonian parameters in terms of the employed effective NN-potential parameters have also been obtained.

A Family of Autoconnected Transformers for 12-and 18-Pulse Converters-Generalization for Delta and Wye Topologies

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Two-dimensional integrable generalization of the Camassa-Holm equation

In this letter we discuss the (2 + 1)-dimensional generalization of the Camassa-Holm equation. We require that this generalization be, at the same time, integrable and physically derivable under the same asymptotic analysis as the original Camassa-Holm equation. First, we find the equation in a perturbative calculation in shallow-water theory. We then demonstrate its integrability and find several particular solutions describing (2 + 1) solitary-wave like solutions. © 1999 Published by Elsevier Science B.V. All rights reserved.

Variational studies and replica symmetry breaking in the generalization problem of the binary perceptron

We analyze the average performance of a general class of learning algorithms for the nondeterministic polynomial time complete problem of rule extraction by a binary perceptron. The examples are generated by a rule implemented by a teacher network of similar architecture. A variational approach is used in trying to identify the potential energy that leads to the largest generalization in the thermodynamic limit. We restrict our search to algorithms that always satisfy the binary constraints. A replica symmetric ansatz leads to a learning algorithm which presents a phase transition in violation of an information theoretical bound. Stability analysis shows that this is due to a failure of the replica symmetric ansatz and the first step of replica symmetry breaking (RSB) is studied. The variational method does not determine a unique potential but it allows construction of a class with a unique minimum within each first order valley. Members of this class improve on the performance of Gibbs algorithm but fail to reach the Bayesian limit in the low generalization phase. They even fail to reach the performance of the best binary, an optimal clipping of the barycenter of version space. We find a trade-off between a good low performance and early onset of perfect generalization. Although the RSB may be locally stable we discuss the possibility that it fails to be the correct saddle point globally. ©2000 The American Physical Society.

Generalization of Wye and Delta auto-connections: Analysis of voltages and currents

Multipulse rectifier topologies based on autoconnections, or differential connections, are more and more applied as interface stages between the mains and power converters. These topologies mitigate many low-order current harmonics in the utility, reducing the THD (total harmonic distortion) and increasing the power factor. This paper presents a mathematical model based on phasor diagrams, that results in a single expression able to unify all differential topologies connections (Delta and Wye), for both step-up or step-down autotransformers, for 12 and 18-pulse AC-DC converters. The proposed family of converters can be designed for any relationship between the input voltage and the load voltage. An immediate application would be the retrofit, i.e. to replace a conventional rectifier with poor quality of the processed energy by the 12 or 18 pulses rectifier with Wye or Delta-differential connection. The design procedure, simple and fast, is developed and tested for a prototype rating 6 kW and 250 V on the DC load © 2010 IEEE.

Zero mode effect generalization for the electromagnetic current in the light front

We consider in this work the electromagnetic current for a system composed of two charged bosons and show that it has a structure of many bodies even in the impulse approximation, when described in the light-front time x+. In terms of the two-body component for the bound state, the current contains two-body operators. We consider the photon interacting with two bosons and the process of pair creation connected to this interaction, interpreting it as a zero mode contribution to the current and discuss the consequences of this pair creation to the components of currents in the light front. © 2013 American Physical Society.

On the zeros of polynomials: An extension of the Enestrom-Kakeya theorem

This paper presents an extension of the Enestrom-Kakeya theorem concerning the roots of a polynomial that arises from the analysis of the stability of Brown (K, L) methods. The generalization relates to relaxing one of the inequalities on the coefficients of the polynomial. Two results concerning the zeros of polynomials will be proved, one of them providing a partial answer to a conjecture by Meneguette (1994)[6]. (C) 2011 Elsevier B.V. All rights reserved.