A neural network based automatic generation control design through reinforcement learning

This paper presents the design and implementation of a learning controller for the Automatic Generation Control (AGC) in power systems based on a reinforcement learning (RL) framework. In contrast to the recent RL scheme for AGC proposed by us, the present method permits handling of power system variables such as Area Control Error (ACE) and deviations from scheduled frequency and tie-line flows as continuous variables. (In the earlier scheme, these variables have to be quantized into finitely many levels). The optimal control law is arrived at in the RL framework by making use of Q-learning strategy. Since the state variables are continuous, we propose the use of Radial Basis Function (RBF) neural networks to compute the Q-values for a given input state. Since, in this application we cannot provide training data appropriate for the standard supervised learning framework, a reinforcement learning algorithm is employed to train the RBF network. We also employ a novel exploration strategy, based on a Learning Automata algorithm,for generating training samples during Q-learning. The proposed scheme, in addition to being simple to implement, inherits all the attractive features of an RL scheme such as model independent design, flexibility in control objective specification, robustness etc. Two implementations of the proposed approach are presented. Through simulation studies the attractiveness of this approach is demonstrated.

A new approach to the design of reinforcement schemes for learning automata

On introduit une nouvelle classe de schémas de renforcement des automates d'apprentissage utilisant les estimations des caractéristiques aléatoires de l'environnement. On montre que les algorithmes convergent en probabilité vers le choix optimal des actions. On présente les résultats de simulation et on suggère des applications à un environnement à plusieurs apprentissages

Mechanism design for cost optimal PAC learning in the presence of strategic noisy annotators

We consider the problem of Probably Ap-proximate Correct (PAC) learning of a bi-nary classifier from noisy labeled exam-ples acquired from multiple annotators(each characterized by a respective clas-sification noise rate). First, we consider the complete information scenario, where the learner knows the noise rates of all the annotators. For this scenario, we derive sample complexity bound for the Mini-mum Disagreement Algorithm (MDA) on the number of labeled examples to be ob-tained from each annotator. Next, we consider the incomplete information sce-nario, where each annotator is strategic and holds the respective noise rate as a private information. For this scenario, we design a cost optimal procurement auc-tion mechanism along the lines of Myer-son’s optimal auction design framework in a non-trivial manner. This mechanism satisfies incentive compatibility property,thereby facilitating the learner to elicit true noise rates of all the annotators.

A direct adaptive neural command controller design for an unstable helicopter

This paper presents an off-line (finite time interval) and on-line learning direct adaptive neural controller for an unstable helicopter. The neural controller is designed to track pitch rate command signal generated using the reference model. A helicopter having a soft inplane four-bladed hingeless main rotor and a four-bladed tail rotor with conventional mechanical controls is used for the simulation studies. For the simulation study, a linearized helicopter model at different straight and level flight conditions is considered. A neural network with a linear filter architecture trained using backpropagation through time is used to approximate the control law. The controller network parameters are adapted using updated rules Lyapunov synthesis. The off-line trained (for finite time interval) network provides the necessary stability and tracking performance. The on-line learning is used to adapt the network under varying flight conditions. The on-line learning ability is demonstrated through parameter uncertainties. The performance of the proposed direct adaptive neural controller (DANC) is compared with feedback error learning neural controller (FENC).

An Adaptive Scheme for Learning the Probability Threshold in Pattern Recognition

The statistical minimum risk pattern recognition problem, when the classification costs are random variables of unknown statistics, is considered. Using medical diagnosis as a possible application, the problem of learning the optimal decision scheme is studied for a two-class twoaction case, as a first step. This reduces to the problem of learning the optimum threshold (for taking appropriate action) on the a posteriori probability of one class. A recursive procedure for updating an estimate of the threshold is proposed. The estimation procedure does not require the knowledge of actual class labels of the sample patterns in the design set. The adaptive scheme of using the present threshold estimate for taking action on the next sample is shown to converge, in probability, to the optimum. The results of a computer simulation study of three learning schemes demonstrate the theoretically predictable salient features of the adaptive scheme.

Probing Fluorine Interactions in a Polyhydroxylated Environment: Conservation of a C-F center dot center dot center dot H-C Recognition Motif in Presence of O-H center dot center dot center dot O Hydrogen Bonds

Three conformationally locked fluorinated polycyclitols have been specially crafted on a rigid trans-decalin backbone, employing a surprisingly facile pyridine-poly(hydrogen fluoride)-mediated stereospecific epoxide ring opening as the key reaction. Molecula design of the three fluorinated probes under study focused on providing an efficient platform for (a) evaluating the ability of covalently bonded fluorine, vis-a-vis the isosteric hydroxy group, to act as a H-bond acceptor and (b) examining the possibility for an organic fluorine moiety, placed suitably in a spatially invariant position, to engage an 1,3-diaxial OH functionality in a purported intramolecular O-H center dot center dot center dot F hydrogen bond. The present endeavour reveals that C(sp(3))-F center dot center dot center dot H-C(sp(3)) hydrogen bonds, though weak and lesser investigated, can indeed be observed and supramolecular recognition motifs, involving such interactions, can be conserved even in crystal structures laden with stronger O-H center dot center dot center dot O hydrogen bonds.

An Estimator Algorithm For Learning Automata With Changing Number Of Actions

In many problems of decision making under uncertainty the system has to acquire knowledge of its environment and learn the optimal decision through its experience. Such problems may also involve the system having to arrive at the globally optimal decision, when at each instant only a subset of the entire set of possible alternatives is available. These problems can be successfully modelled and analysed by learning automata. In this paper an estimator learning algorithm, which maintains estimates of the reward characteristics of the random environment, is presented for an automaton with changing number of actions. A learning automaton using the new scheme is shown to be e-optimal. The simulation results demonstrate the fast convergence properties of the new algorithm. The results of this study can be extended to the design of other types of estimator algorithms with good convergence properties.

Advances in the analysis and design of concrete structures, metal containments and liner plate for extreme loads

The material presented in this paper summarizes the progress that has been made in the analysis, design, and testing of concrete structures. The material is summarized in the following documents: 1. Part I - Containment Design Criteria and Loading Combinations - J.D. Stevenson (Stevenson and Associates, Cleveland, Ohio, USA) 2. Part II - Reinforced and Prestressed Concrete Behavior - J. Eibl and M. Curbach (Karlsruhe University, Karlsruhe, Germany) 3. Part III - Concrete Containment Analysis, Design and Related Testing - T.E. Johnson and M.A. Daye (Bechtel Power Corporation, Gaithersburg, Maryland USA) 4. Part IV - Impact and Impulse Loading and Response Prediction - J.D. Riera (School of Engineering - UFRGS, Porto Alegre, RS, Brazil) 5. Part V - Metal Containments and Liner Plate Systems - N.J. Krutzik (Siemens AG, Offenbach Am Main, Germany) 6. Part VI - Prestressed Reactor Vessel Design, Testing and Analysis - J. Nemet (Austrian Research Center, Seibersdorf, Austria) and K.T.S. Iyengar (Indian Institute of Science, Bangalore, India).

Flow-Acoustic Performance of Perforated Element Mufflers With Application to Design

A fairly comprehensive computer program incorporating explicit expressions for the four-pole parameters of concentric-tube resonators, plug mufflers, and three-duct cross-flow perforated elements has been used for parametric studies. The parameters considered are hole diameter, the center-to-center distance between consecutive holes (which decides porosity), the incoming mean flow Mach number, the area expansion ratio, the number of partitions of chambers within a given overall shell length, and the relative lengths of these partitions or chambers, all normalized with respect to the exhaust pipe diameter. Transmission loss has been plotted as a function of a normalized frequency parameter. Additionally, the effect of the tail pipe length on insertion loss for an anechoic source has also been studied. These studies have been supplemented by empirical expressions for the normalized static pressure drop for different types of perforated-element mufflers developed from experimental observations.

Charge Density Analysis of Heterohalogen (Cl center dot center dot center dot F) and Homohalogen (F center dot center dot center dot F) Intermolecular Interactions

Experimental charge density distribution in 2-chloro-4-fluorobenzoic acid and 4-fluorobenzamide has been carried out using high resolution X-ray diffraction data collected at 100 K using Hansen-Coppens multipolar formalism of electron density. These compounds display short Cl center dot center dot center dot F and F center dot center dot center dot F interactions, respectively. The experimental results are compared with the theoretical charge densities using theoretical structure factors obtained from periodic quantum calculation at the B3LYP/6-31G** level. The topological features were derived from Bader's ``atoms in molecules'' (AIM) approach. Intermolecular Cl center dot center dot center dot F interaction in 2-chloro-4-fluorobenzoic acid is attractive in nature (type II interaction) while the nature of F center dot center dot center dot F interactions in 4-fluorobenzamide shows indication of a minor decrease in repulsion (type I interaction), though the extent of polarization on the fluorine atom is arguably small.

High-Throughput Study of the Cu(CH3COO)(2)center dot H2O-5-Nitroisophthalic Acid Heterocyclic Ligand System: Synthesis, Structure, Magnetic, and Heterogeneous Catalytic Studies of Three Copper Nitroisophthalates

A high-throughput screening was employed to identify new compounds in Cu(CH3COO)(2)center dot H2O-NIPA-heterocyclic ligand systems. Of the compounds identified, three compounds, Cu-3{(NO2)-C6H3-(COO)(2)}(3)(C3N6H6)] (1), Cu-2(mu(3)-OH)(H2O){(NO2)-C6H3-(COO)(2)}(CN4H)]center dot-(H2O) (II), and Cu-2(mu(3)-OH)(H2O){(NO2)-C6H3-(COO)(2}-)(CN5H2)]center dot 2(H2O) (III), have been isolated as good quality single crystals by employing conventional hydrothermal methods. Three other compounds, Cu-2{(NO2)-C6H3-(COO)(2)}-(CN4H)(H2O) (IIa), Cu-2{(NO2)-C6H3-(COO)(2)}(CN5H2) (IIIa), and Cu-2{(NO2)-C6H3-(COO)(2)}{(CN5H2)(2)}2H(2)O (IIIb), were identified by a combination of elemental analysis, thermogravimetric analysis (TGA), and IR spectroscopic studies, although their structures are yet to be determined. The single crystalline compounds were also characterized by elemental analysis, TGA, IR, UV vis, magnetic, and catalytic studies. The structures of the compounds have paddle wheel (I) and infinite Cu 0(H) Cu chains (II and HI) connected with NLPA and heterocyclic ligands forming two-(II) and three-dimensional (I and III) structures. The bound and lattice water molecules in 11 and 111 could be reversibly removed/inserted without affecting the structure. In the case of II, the removal of water gives rise to a structural transition, but the dehydrated phase reverts back to the original phase on prolonged exposure to atmospheric conditions. Magnetic studies indicate an overall antiferromagnetism in all of the compounds. Lewis acid catalytic studies indicate that compounds II and HI are active for cyanosilylation of imines.

Role of Hetero-Halogen (F center dot center dot center dot X, X = Cl, Br, and I) or Homo-Halogen (X center dot center dot center dot X, X = F, Cl, Br, and I) Interactions in Substituted Benzanilides

A series of halogen-substituted benzanilides have been synthesized and characterized, and crystallization studies directed toward generation of polymorphs have been performed to delineate the importance of interactions involving halogens. The effect of halogen substitution on the molecular conformation and supramolecular packing has been investigated. The N-H center dot center dot center dot O H-bond is a key structure-directing element acting in conjunction with C-H center dot center dot center dot O and C-H center dot center dot center dot pi interactions. In addition, it is of importance to note that organic fluorine prefers Type I F center dot center dot center dot F contacts, whereas Cl, Br, and I prefer Type II contacts. Hetero-halogen center dot center dot center dot halogen interactions on the other hand are predominately of Type II geometry, and this is due to the greater polarizability of the electron density associated with the heavier halogens. It is of importance to evaluate the contributing role of these interactions in crystal structure packing and the co-operativity associated with such interactions in the solid state.

Manipulation of the Hydration Levels in Minerals of Sodium Cadmium Bisulfate toward the Design of Functional Materials

Several variants of hydrated sodium cadmium bisulfate, Na(2)Cd(2)(SO(4))(3) center dot 3H(2)O, Na(2)Cd(SO(4))(2) center dot 2H(2)O, and Na(2)Cd(SO(4))(2) center dot 4H(2)O have been synthesized, and their thermal properties followed by phase transitions have been invesigated. The formation of these phases depends on the stochiometry and the time taken for crystallization from water. Na(2)Cd(2)(SO(4))(3)center dot 3H(2)O, which crystallizes in the trigonal system, space group P3c, is grown from the aqueous solution in about four weeks. The krohnkite type mineral Na(2)Cd(SO(4))(2) center dot 2H(2)O and the mineral astrakhanite, also known as blodite, Na(2)Cd (SO(4))(2)center dot 4H(2)O, crystallize concomittantly in about 24 weeks. Both these minerals belong to the monoclinic system(space group P2(1)/c). Na(2)Cd(2)(SO(4))(3)center dot 3H(2)O loses water completely when heated to 250 degrees C and transforms to a dehydrated phase (cubic system, space group I (4) over bar 3d) whose structure has been established using ab initio powder diffration techniques. Na(2)Cd(SO(4))(2)center dot 2H(2)O transforms to alpha-Na(2)Cd(SO(4))(2) (space group C2/c) on heating to 150 degrees C which is a known high ionic conductor and remains intact over prolonged periods of exposure to moisture (over six months). However, when alpha-Na(2)Cd(SO(4))(2) is heated to 570 degrees C followed by sudden quenching in liquid nitrogen beta-Na(2)Cd(SO(4))(2) (P2(1)/c) is formed. beta-Na(2)Cd(SO(4))(2) takes up water from the atmosphere and gets converted completely to the krohnkite type mineral in about four weeks. Further, beta-Na(2)Cd(SO(4))(2) has a conductivity behavior comparable to the a-form up to 280 degrees C, the temperature required for the transformation of the beta- to alpha-form. These experiments demonstrate the possibility of utilizing the abundantly available mineral sources as precursors to design materials with special properties.

Aids in the design of microstrip components I: Getsinger's chart

Charts relating the capacitance to the width, spacing, thickness and height above the ground plane of coupled microstrips have been obtained. These are used to design hairpin line and hybrid hairpin line filters as well as multiplexers using microstrip comb line filters. The experimental results agree reasonably well with the design specifications. Getsinger's original charts for parallel coupled bars between parallel plates have been formulated for the microstrip case. Corresponding charts relating the capacitances to the width, spacing, thickness and height above the ground plane of coupled microstrips have been obtained. Examples of the use of these charts are shown in the design of hairpin lines and hybrid hairpin line filters as well as multiplexers using comb line filters. The hairpin line/hybrid hairpin line filters were designed to operate at a central frequency of 9÷5 GHz with 11 per cent bandwidth and 0÷5 dB ripple. The three filters constituting the comb line filters have center frequencies of 2÷4, 3÷0 and 3÷6 GHz. The components so designed were fabricated and tested. The dielectric used for the microstrip was teflon. Experimental curves for the attenuation (insertion loss) and VSWR are given. The design specifications arc satisfied quite well.