Reinforcement learning controllers for automatic generation control in power systems having re-heat units with GRC and dead-band

A new automatic generation controller (AGC) design approach, adopting reinforcement learning (RL) techniques, was recently pro- posed [1]. In this paper we demonstrate the design and performance of controllers based on this RL approach for automatic generation control of systems consisting of units having complex dynamics—the reheat type of thermal units. For such systems, we also assess the capabilities of RL approach in handling realistic system features such as network changes, parameter variations, generation rate constraint (GRC), and governor deadband.

New Insights into Optimal Discrete Rate Adaptation for Average Power Constrained Single and Multi-Node Systems

The throughput-optimal discrete-rate adaptation policy, when nodes are subject to constraints on the average power and bit error rate, is governed by a power control parameter, for which a closed-form characterization has remained an open problem. The parameter is essential in determining the rate adaptation thresholds and the transmit rate and power at any time, and ensuring adherence to the power constraint. We derive novel insightful bounds and approximations that characterize the power control parameter and the throughput in closed-form. The results are comprehensive as they apply to the general class of Nakagami-m (m >= 1) fading channels, which includes Rayleigh fading, uncoded and coded modulation, and single and multi-node systems with selection. The results are appealing as they are provably tight in the asymptotic large average power regime, and are designed and verified to be accurate even for smaller average powers.

Dual-Stage Power Management Algorithms for Energy Harvesting Sensors

In this paper, we propose power management algorithms for maximizing the utility of energy harvesting sensors (EHS) that operate purely on the basis of energy harvested from the environment. In particular, we consider communication (i.e., transmission and reception) power management issues for EHS under an energy neutrality constraint. We also consider the fixed power loss effects of the circuitry, the battery inefficiency and its storage capacity, in the design of the algorithms. We propose a two-stage structure that exploits the inherent difference in the timescales at which the energy harvesting and channel fading processes evolve, without loss of optimality of the resulting solution. The outer stage schedules the power that can be used by an inner stage algorithm, so as to maximize the long term average utility and at the same time maintain energy neutrality. The inner stage optimizes the communication parameters to achieve maximum utility in the short-term, subject to the power constraint imposed by the outer stage. We optimize the algorithms for different transmission schemes such as the truncated channel inversion and retransmission strategies. The performance of the algorithms is illustrated via simulations using solar irradiance data, and for the case of Rayleigh fading channels. The results demonstrate the significant performance benefits that can be obtained using the proposed power management algorithms compared to the energy efficient (optimum when there is no storage) and the uniform power consumption (optimum when the battery has infinite capacity and is perfectly efficient) approaches.

Quasi-static crack tip fields in rate-sensitive FCC single crystals

In this work, the effects of loading rate, material rate sensitivity and constraint level on quasi-static crack tip fields in a FCC single crystal are studied. Finite element simulations are performed within a mode I, plane strain modified boundary layer framework by prescribing the two term (K-T) elastic crack tip field as remote boundary conditions. The material is assumed to obey a rate-dependent crystal plasticity theory. The orientation of the single crystal is chosen so that the crack surface coincides with the crystallographic (010) plane and the crack front lies along 101] direction. Solutions corresponding to different stress intensity rates K., T-stress values and strain rate exponents m are obtained. The results show that the stress levels ahead of the crack tip increase with K. which is accompanied by gradual shrinking of the plastic zone size. However, the nature of the shear band patterns around the crack tip is not affected by the loading rate. Further, it is found that while positive T-stress enhances the opening and hydrostatic stress levels ahead of crack tip, they are considerably reduced with imposition of negative T-stress. Also, negative T-stress promotes formation of shear bands in the forward sector ahead of the crack tip and suppresses them behind the tip.

Reactivity of Bispropargyl Sulfones under Basic Conditions: Interplay Between Garratt-Braverman and Schmittel/Myers-Saito Cyclization Pathway

The preference for GarrattBraverman (GB) over MyersSaito (MS) and Schmittel (SCM) cyclizations has recently been demonstrated in sulfones capable of undergoing all three of the processes. As the GB cyclization is a self-quenching process, there is a need to change the selectivity to the non-self-quenching MS or SCM pathway so as to enhance the DNA-cleaving efficiency that operates through the radical-mediated process. Herein we report a conformational constraint-based strategy developed by using computations (M06-2X/6-31+G*) to switch the selectivity from GB to MS/SCM pathway which also results in greater DNA-cleavage activity. The preference for GB could be brought back by easing the constraint with the help of spacers.

An Online Actor-Critic Algorithm with Function Approximation for Constrained Markov Decision Processes

We develop an online actor-critic reinforcement learning algorithm with function approximation for a problem of control under inequality constraints. We consider the long-run average cost Markov decision process (MDP) framework in which both the objective and the constraint functions are suitable policy-dependent long-run averages of certain sample path functions. The Lagrange multiplier method is used to handle the inequality constraints. We prove the asymptotic almost sure convergence of our algorithm to a locally optimal solution. We also provide the results of numerical experiments on a problem of routing in a multi-stage queueing network with constraints on long-run average queue lengths. We observe that our algorithm exhibits good performance on this setting and converges to a feasible point.

A Numerical Scheme for Three-Dimensional Front Propagation and Control of Jordan Mode

As an example of a front propagation, we study the propagation of a three-dimensional nonlinear wavefront into a polytropic gas in a uniform state and at rest. The successive positions and geometry of the wavefront are obtained by solving the conservation form of equations of a weakly nonlinear ray theory. The proposed set of equations forms a weakly hyperbolic system of seven conservation laws with an additional vector constraint, each of whose components is a divergence-free condition. This constraint is an involution for the system of conservation laws, and it is termed a geometric solenoidal constraint. The analysis of a Cauchy problem for the linearized system shows that when this constraint is satisfied initially, the solution does not exhibit any Jordan mode. For the numerical simulation of the conservation laws we employ a high resolution central scheme. The second order accuracy of the scheme is achieved by using MUSCL-type reconstructions and Runge-Kutta time discretizations. A constrained transport-type technique is used to enforce the geometric solenoidal constraint. The results of several numerical experiments are presented, which confirm the efficiency and robustness of the proposed numerical method and the control of the Jordan mode.

Structure and deformation correlation of closed-cell aluminium foam subject to uniaxial compression

We report the results of an experimental and numerical study conducted on a closed-cell aluminium foam that was subjected to uniaxial compression with lateral constraint. X-ray computed tomography was utilized to gain access into the three-dimensional (3-D) structure of the foam and some aspects of the deformation mechanisms. A series of advanced 3-D image analyses are conducted on the 3-D images aimed at characterizing the strain localization regions. We identify the morphological/geometrical features that are responsible for the collapse of the cells and the strain localization. A novel mathematical approach based on a Minkowski tensor analysis along with the mean intercept length technique were utilized to search for signatures of anisotropy across the foam sample and its evolution as a function of loading. Our results show that regions with higher degrees of anisotropy in the undeformed foam have a tendency to initiate the onset of cell collapse. Furthermore, we show that strain hardening occurs predominantly in regions with large cells and high anisotropy. We combine the finite element method with the tomographic images to simulate the mechanical response of the foam. We predict further deformation in regions where the foam is already deformed. Crown Copyright (C) 2012 Published by Elsevier Ltd. on behalf of Acta Materialia Inc. All rights reserved.

Signal-Powered Low-Drop-Diode Equivalent Circuit for Full-Wave Bridge Rectifier

Piezoelectric-device-based vibration energy harvesting requires a rectifier for conversion of input ac to usable dc form. Power loss due to diode drop in rectifier is a significant fraction of the already low levels of harvested power. The proposed circuit is a low-drop-diode equivalent, which mimics a diode using linear region-operated MOSFET. The proposed diode equivalent is powered directly from input signal and requires no additional power supply for its control. Power used by the control circuit is kept at a bare minimum to have an overall output power improvement. Diode equivalent was used to replace the four diodes in a full-wave bridge rectifier, which is the basic full- wave rectifier and is a part of the more advanced rectifiers like switch-only and bias-flip rectifiers. Simulation in 130-nm technology and experiment with discrete components show that a bridge rectifier with the proposed diode provides a 30-169% increase in output power extracted from piezoelectric device, as compared to a bridge rectifier with diode-connected MOSFETs. The bridge rectifier with the proposed diode can extract 90% of the maximum available power from an ideal piezoelectric device-bridge rectifier circuit. Setting aside the constraint of power loss, simulations indicate that diode drop as low as 10 mV at 38 mu A can be achieved.

The Treewidth of MDS and Reed-Muller Codes

The constraint complexity of a graphical realization of a linear code is the maximum dimension of the local constraint codes in the realization. The treewidth of a linear code is the least constraint complexity of any of its cycle-free graphical realizations. This notion provides a useful parameterization of the maximum-likelihood decoding complexity for linear codes. In this paper, we show the surprising fact that for maximum distance separable codes and Reed-Muller codes, treewidth equals trelliswidth, which, for a code, is defined to be the least constraint complexity (or branch complexity) of any of its trellis realizations. From this, we obtain exact expressions for the treewidth of these codes, which constitute the only known explicit expressions for the treewidth of algebraic codes.

A Technique to Compute Smooth Amplitude, Phase, and Frequency Modulations From the Analytic Signal

Gabor's analytic signal (AS) is a unique complex signal corresponding to a real signal, but in general, it admits infinitely-many combinations of amplitude and frequency modulations (AM and FM, respectively). The standard approach is to enforce a non-negativity constraint on the AM, but this results in discontinuities in the corresponding phase modulation (PM), and hence, an FM with discontinuities particularly when the underlying AM-FM signal is over-modulated. In this letter, we analyze the phase discontinuities and propose a technique to compute smooth AM and FM from the AS, by relaxing the non-negativity constraint on the AM. The proposed technique is effective at handling over-modulated signals. We present simulation results to support the theoretical calculations.

Averting biodiversity collapse in tropical forest protected areas

The rapid disruption of tropical forests probably imperils global biodiversity more than any other contemporary phenomenon(1-3). With deforestation advancing quickly, protected areas are increasingly becoming final refuges for threatened species and natural ecosystem processes. However, many protected areas in the tropics are themselves vulnerable to human encroachment and other environmental stresses(4-9). As pressures mount, it is vital to know whether existing reserves can sustain their biodiversity. A critical constraint in addressing this question has been that data describing a broad array of biodiversity groups have been unavailable for a sufficiently large and representative sample of reserves. Here we present a uniquely comprehensive data set on changes over the past 20 to 30 years in 31 functional groups of species and 21 potential drivers of environmental change, for 60 protected areas stratified across the world's major tropical regions. Our analysis reveals great variation in reserve `health': about half of all reserves have been effective or performed passably, but the rest are experiencing an erosion of biodiversity that is often alarmingly widespread taxonomically and functionally. Habitat disruption, hunting and forest-product exploitation were the strongest predictors of declining reserve health. Crucially, environmental changes immediately outside reserves seemed nearly as important as those inside in determining their ecological fate, with changes inside reserves strongly mirroring those occurring around them. These findings suggest that tropical protected areas are often intimately linked ecologically to their surrounding habitats, and that a failure to stem broad-scale loss and degradation of such habitats could sharply increase the likelihood of serious biodiversity declines.

Expanding universe: thermodynamical aspects from different models

The pivotal point of the paper is to discuss the behavior of temperature, pressure, energy density as a function of volume along with determination of caloric EoS from following two model: w(z)=w (0)+w (1)ln(1+z) & . The time scale of instability for this two models is discussed. In the paper we then generalize our result and arrive at general expression for energy density irrespective of the model. The thermodynamical stability for both of the model and the general case is discussed from this viewpoint. We also arrive at a condition on the limiting behavior of thermodynamic parameter to validate the third law of thermodynamics and interpret the general mathematical expression of integration constant U (0) (what we get while integrating energy conservation equation) physically relating it to number of micro states. The constraint on the allowed values of the parameters of the models is discussed which ascertains stability of universe. The validity of thermodynamical laws within apparent and event horizon is discussed.

Optimal Hop Distance and Power Control for a Single Cell, Dense, Ad Hoc Wireless Network

We consider a dense, ad hoc wireless network, confined to a small region. The wireless network is operated as a single cell, i.e., only one successful transmission is supported at a time. Data packets are sent between source-destination pairs by multihop relaying. We assume that nodes self-organize into a multihop network such that all hops are of length d meters, where d is a design parameter. There is a contention-based multiaccess scheme, and it is assumed that every node always has data to send, either originated from it or a transit packet (saturation assumption). In this scenario, we seek to maximize a measure of the transport capacity of the network (measured in bit-meters per second) over power controls (in a fading environment) and over the hop distance d, subject to an average power constraint. We first motivate that for a dense collection of nodes confined to a small region, single cell operation is efficient for single user decoding transceivers. Then, operating the dense ad hoc wireless network (described above) as a single cell, we study the hop length and power control that maximizes the transport capacity for a given network power constraint. More specifically, for a fading channel and for a fixed transmission time strategy (akin to the IEEE 802.11 TXOP), we find that there exists an intrinsic aggregate bit rate (Theta(opt) bits per second, depending on the contention mechanism and the channel fading characteristics) carried by the network, when operating at the optimal hop length and power control. The optimal transport capacity is of the form d(opt)((P) over bar (t)) x Theta(opt) with d(opt) scaling as (P) over bar (t) (1/eta), where (P) over bar (t) is the available time average transmit power and eta is the path loss exponent. Under certain conditions on the fading distribution, we then provide a simple characterization of the optimal operating point. Simulation results are provided comparing the performance of the optimal strategy derived here with some simple strategies for operating the network.

Mixture solubilities of nitrobenzoic acid isomers in supercritical carbon dioxide

The ternary solubilities of solid isomers of nitrobenzoic acid (NBA) were experimentally determined at 308, 318 and 328K over a pressure range of 12-18 MPa in supercritical carbon dioxide (SCCO2). Compared to its binary solubility, the ternary solubilities of m-NBA increased at 308 K while it decreased at 328 K. However, the ternary solubilities of p-NBA increased at all temperatures and pressures except at 13 MPa and 328K. A new model was developed by applying solution model and activity coefficient model for the ternary solubilities of pharmaceutical and non-pharmaceutical solid mixtures in terms of temperature, density and cosolute composition. The model equation involves four temperature independent constraint-free parameters. The model equation correlates the ternary solubilities of seven pharmaceutical solid mixtures along with current data with an average AARD around 9.5% and sixteen non-pharmaceutical solid mixtures with 9% AARD. (C) 2012 Elsevier B.V. All rights reserved.