Intelligent decision making in electricity markets: simulated annealing Q-Learning

Electricity markets are complex environments, involving a large number of different entities, playing in a dynamic scene to obtain the best advantages and profits. MASCEM is a multi-agent electricity market simulator to model market players and simulate their operation in the market. Market players are entities with specific characteristics and objectives, making their decisions and interacting with other players. MASCEM is integrated with ALBidS, a system that provides several dynamic strategies for agents’ behavior. This paper presents a method that aims at enhancing ALBidS competence in endowing market players with adequate strategic bidding capabilities, allowing them to obtain the higher possible gains out of the market. This method uses a reinforcement learning algorithm to learn from experience how to choose the best from a set of possible actions. These actions are defined accordingly to the most probable points of bidding success. With the purpose of accelerating the convergence process, a simulated annealing based algorithm is included.

Complex-order forced van der Pol oscillator

In this paper we consider a complex-order forced van der Pol oscillator. The complex derivative Dα1jβ, with α, β ∈ ℝ+, is a generalization of the concept of an integer derivative, where α = 1, β = 0. The Fourier transforms of the periodic solutions of the complex-order forced van der Pol oscillator are computed for various values of parameters such as frequency ω and amplitude b of the external forcing, the damping μ, and parameters α and β. Moreover, we consider two cases: (i) b = 1, μ = {1.0, 5.0, 10.0}, and ω = {0.5, 2.46, 5.0, 20.0}; (ii) ω = 20.0, μ = {1.0, 5.0, 10.0}, and b = {1.0, 5.0, 10.0}. We verified that most of the signal energy is concentrated in the fundamental harmonic ω0. We also observed that the fundamental frequency of the oscillations ω0 varies with α and μ. For the range of tested values, the numerical fitting led to logarithmic approximations for system (7) in the two cases (i) and (ii). In conclusion, we verify that by varying the parameter values α and β of the complex-order derivative in expression (7), we accomplished a very effective way of perturbing the dynamical behavior of the forced van der Pol oscillator, which is no longer limited to parameters b and ω.

Complex order van der Pol oscillator

In this paper a complex-order van der Pol oscillator is considered. The complex derivative Dα±ȷβ , with α,β∈R + is a generalization of the concept of integer derivative, where α=1, β=0. By applying the concept of complex derivative, we obtain a high-dimensional parameter space. Amplitude and period values of the periodic solutions of the two versions of the complex-order van der Pol oscillator are studied for variation of these parameters. Fourier transforms of the periodic solutions of the two oscillators are also analyzed.

Linear algebra: selected problems

Linear Algebra—Selected Problems is a unique book for senior undergraduate and graduate students to fast review basic materials in Linear Algebra. Vector spaces are presented first, and linear transformations are reviewed secondly. Matrices and Linear systems are presented. Determinants and Basic geometry are presented in the last two chapters. The solutions for proposed excises are listed for readers to references.

Deciding Kleene Algebra Terms Equivalence in Coq

This paper presents a mechanically verified implementation of an algorithm for deciding the equivalence of Kleene algebra terms within the Coq proof assistant. The algorithm decides equivalence of two given regular expressions through an iterated process of testing the equivalence of their partial derivatives and does not require the construction of the corresponding automata. Recent theoretical and experimental research provides evidence that this method is, on average, more efficient than the classical methods based on automata. We present some performance tests, comparisons with similar approaches, and also introduce a generalization of the algorithm to decide the equivalence of terms of Kleene algebra with tests. The motivation for the work presented in this paper is that of using the libraries developed as trusted frameworks for carrying out certified program verification.