Reinforcement learning with reference tracking control in continuous state spaces

The contribution described in this paper is an algorithm for learning nonlinear, reference tracking, control policies given no prior knowledge of the dynamical system and limited interaction with the system through the learning process. Concepts from the field of reinforcement learning, Bayesian statistics and classical control have been brought together in the formulation of this algorithm which can be viewed as a form of indirect self tuning regulator. On the task of reference tracking using a simulated inverted pendulum it was shown to yield generally improved performance on the best controller derived from the standard linear quadratic method using only 30 s of total interaction with the system. Finally, the algorithm was shown to work on the simulated double pendulum proving its ability to solve nontrivial control tasks. © 2011 IEEE.

Multiple color reflection in a single unit cell using double-layer electrochromic reaction

Multiple color states have been realized in single unit cell using double electrochromic (EC) reaction. The precise control of bistability in EC compounds which can maintain several colors on the two separated electrodes allows this new type of pixel to be realized. The specific electrical driving gives a way to maintain both sides in the reduced EC states and this colors overlapping in the vertical view direction can achieve the black state. The four color states (G, B, W, BK) in one cell/pixel can make a valuable progress to achieve a high quality color devices such like electronic paper, outdoor billboard, smart window and flexible display using external light source. © 2012 Optical Society of America.