Reinforcement Learning Approaches to Power System Scheduling

One major component of power system operation is generation scheduling. The objective of the work is to develop efficient control strategies to the power scheduling problems through Reinforcement Learning approaches. The three important active power scheduling problems are Unit Commitment, Economic Dispatch and Automatic Generation Control. Numerical solution methods proposed for solution of power scheduling are insufficient in handling large and complex systems. Soft Computing methods like Simulated Annealing, Evolutionary Programming etc., are efficient in handling complex cost functions, but find limitation in handling stochastic data existing in a practical system. Also the learning steps are to be repeated for each load demand which increases the computation time.Reinforcement Learning (RL) is a method of learning through interactions with environment. The main advantage of this approach is it does not require a precise mathematical formulation. It can learn either by interacting with the environment or interacting with a simulation model. Several optimization and control problems have been solved through Reinforcement Learning approach. The application of Reinforcement Learning in the field of Power system has been a few. The objective is to introduce and extend Reinforcement Learning approaches for the active power scheduling problems in an implementable manner. The main objectives can be enumerated as:(i) Evolve Reinforcement Learning based solutions to the Unit Commitment Problem.(ii) Find suitable solution strategies through Reinforcement Learning approach for Economic Dispatch. (iii) Extend the Reinforcement Learning solution to Automatic Generation Control with a different perspective. (iv) Check the suitability of the scheduling solutions to one of the existing power systems.First part of the thesis is concerned with the Reinforcement Learning approach to Unit Commitment problem. Unit Commitment Problem is formulated as a multi stage decision process. Q learning solution is developed to obtain the optimwn commitment schedule. Method of state aggregation is used to formulate an efficient solution considering the minimwn up time I down time constraints. The performance of the algorithms are evaluated for different systems and compared with other stochastic methods like Genetic Algorithm.Second stage of the work is concerned with solving Economic Dispatch problem. A simple and straight forward decision making strategy is first proposed in the Learning Automata algorithm. Then to solve the scheduling task of systems with large number of generating units, the problem is formulated as a multi stage decision making task. The solution obtained is extended in order to incorporate the transmission losses in the system. To make the Reinforcement Learning solution more efficient and to handle continuous state space, a fimction approximation strategy is proposed. The performance of the developed algorithms are tested for several standard test cases. Proposed method is compared with other recent methods like Partition Approach Algorithm, Simulated Annealing etc.As the final step of implementing the active power control loops in power system, Automatic Generation Control is also taken into consideration.Reinforcement Learning has already been applied to solve Automatic Generation Control loop. The RL solution is extended to take up the approach of common frequency for all the interconnected areas, more similar to practical systems. Performance of the RL controller is also compared with that of the conventional integral controller.In order to prove the suitability of the proposed methods to practical systems, second plant ofNeyveli Thennal Power Station (NTPS IT) is taken for case study. The perfonnance of the Reinforcement Learning solution is found to be better than the other existing methods, which provide the promising step towards RL based control schemes for practical power industry.Reinforcement Learning is applied to solve the scheduling problems in the power industry and found to give satisfactory perfonnance. Proposed solution provides a scope for getting more profit as the economic schedule is obtained instantaneously. Since Reinforcement Learning method can take the stochastic cost data obtained time to time from a plant, it gives an implementable method. As a further step, with suitable methods to interface with on line data, economic scheduling can be achieved instantaneously in a generation control center. Also power scheduling of systems with different sources such as hydro, thermal etc. can be looked into and Reinforcement Learning solutions can be achieved.

Design, Fabrication and Characterization of Passive and Active Polymer Photonic Devices

The rapid developments in fields such as fibre optic communication engineering and integrated optical electronics have expanded the interest and have increased the expectations about guided wave optics, in which optical waveguides and optical fibres play a central role. The technology of guided wave photonics now plays a role in generating information (guided-wave sensors) and processing information (spectral analysis, analog-to-digital conversion and other optical communication schemes) in addition to its original application of transmitting information (fibre optic communication). Passive and active polymer devices have generated much research interest recently because of the versatility of the fabrication techniques and the potential applications in two important areas – short distant communication network and special functionality optical devices such as amplifiers, switches and sensors. Polymer optical waveguides and fibres are often designed to have large cores with 10-1000 micrometer diameter to facilitate easy connection and splicing. Large diameter polymer optical fibres being less fragile and vastly easier to work with than glass fibres, are attractive in sensing applications. Sensors using commercial plastic optical fibres are based on ideas already used in silica glass sensors, but exploiting the flexible and cost effective nature of the plastic optical fibre for harsh environments and throw-away sensors. In the field of Photonics, considerable attention is centering on the use of polymer waveguides and fibres, as they have a great potential to create all-optical devices. By attaching organic dyes to the polymer system we can incorporate a variety of optical functions. Organic dye doped polymer waveguides and fibres are potential candidates for solid state gain media. High power and high gain optical amplification in organic dye-doped polymer waveguide amplifier is possible due to extremely large emission cross sections of dyes. Also, an extensive choice of organic dye dopants is possible resulting in amplification covering a wide range in the visible region.

Studies On Vulcanization, Rheology And Reinforcement Of Natural Rubber Latex With Special Reference To Accelerator Combinations, Surface Active Agents And Gamma Irradiation

In the present work, studies on vulcanization, rheology and reinforcement of natural rubber latex with special reference to accelerator combinations, surface active agents and gamma irradiation have been undertaken. In vulcanization, the choice of vulcanization system, the extent and mc-zie of vulcanization and network structure of the vulcanizate are important factors contributing to the overall quality of the product. The vulcanization system may be conventional type using elemental sulfur or a system involving sulfur donors. The latter type is used mainly in the manufacture of heat resistant products. For improving the technical properties of the products such as modulus and tensile strength, different accelerator combinations are used. It is known that accelerators have a strong effect on the physical properties of rubber vulcanizates. A perusal of the literature indicates that fundamental studies on the above aspects of latex technology are very limited. Thereforea systematic study on vulcanization, rheology and reinforcement of natural rubber latex with reference to the effect of accelerator combinations, surface active agents and gamma irradiation has been undertaken. The preparation and evaluation of some products like latex thread was also undertaken as a part of the study. The thesis consists of six chapter

Performance analysis of FIR digital filter design: RNS versus traditional

Residue Number System (RNS) based Finite Impulse Response (FIR) digital filters and traditional FIR filters. This research is motivated by the importance of an efficient filter implementation for digital signal processing. The comparison is done in terms of speed and area requirement for various filter specifications. RNS based FIR filters operate more than three times faster and consumes only about 60% of the area than traditional filter when number of filter taps is more than 32. The area for RNS filter is increasing at a lesser rate than that for traditional resulting in lower power consumption. RNS is a nonweighted number system without carry propogation between different residue digits.This enables simultaneous parallel processing on all the digits resulting in high speed addition and multiplication in the RNS domain

RNS based programmable multi-mode decimation filter for WCDMA and WiMAX

The recent trends envisage multi-standard architectures as a promising solution for the future wireless transceivers to attain higher system capacities and data rates. The computationally intensive decimation filter plays an important role in channel selection for multi-mode systems. An efficient reconfigurable implementation is a key to achieve low power consumption. To this end, this paper presents a dual-mode Residue Number System (RNS) based decimation filter which can be programmed for WCDMA and 802.16e standards. Decimation is done using multistage, multirate finite impulse response (FIR) filters. These FIR filters implemented in RNS domain offers high speed because of its carry free operation on smaller residues in parallel channels. Also, the FIR filters exhibit programmability to a selected standard by reconfiguring the hardware architecture. The total area is increased only by 24% to include WiMAX compared to a single mode WCDMA transceiver. In each mode, the unused parts of the overall architecture is powered down and bypassed to attain power saving. The performance of the proposed decimation filter in terms of critical path delay and area are tabulated.

Dual-mode RNS based programmable decimation filter for WCDMA and WLANa

The recent trends envisage multi-standard architectures as a promising solution for the future wireless transceivers. The computationally intensive decimation filter plays an important role in channel selection for multi-mode systems. An efficient reconfigurable implementation is a key to achieve low power consumption. To this end, this paper presents a dual-mode Residue Number System (RNS) based decimation filter which can be programmed for WCDMA and 802.11a standards. Decimation is done using multistage, multirate finite impulse response (FIR) filters. These FIR filters implemented in RNS domain offers high speed because of its carry free operation on smaller residues in parallel channels. Also, the FIR filters exhibit programmability to a selected standard by reconfiguring the hardware architecture. The total area is increased only by 33% to include WLANa compared to a single mode WCDMA transceiver. In each mode, the unused parts of the overall architecture is powered down and bypassed to attain power saving. The performance of the proposed decimation filter in terms of critical path delay and area are tabulated

Manifestation of Colossal Thermoelectric Power by Charge Ordered Small and Intermediate Bandwidth Manganites

Thermoelectric materials are revisited for various applications including power generation. The direct conversion of temperature differences into electric voltage and vice versa is known as thermoelectric effect. Possible applications of thermoelectric materials are in eco-friendly refrigeration, electric power generation from waste heat, infrared sensors, temperature controlled-seats and portable picnic coolers. Thermoelectric materials are also extensively researched upon as an alternative to compression based refrigeration. This utilizes the principle of Peltier cooling. The performance characteristic of a thermoelectric material, termed as figure of merit (ZT) is a function of several transport coefficients such as electrical conductivity (σ), thermal conductivity (κ) and Seebeck coefficient of the material (S). ZT is expressed asκσTZTS2=, where T is the temperature in degree absolute. A large value of Seebeck coefficient, high electrical conductivity and low thermal conductivity are necessary to realize a high performance thermoelectric material. The best known thermoelectric materials are phonon-glass electron – crystal (PGEC) system where the phonons are scattered within the unit cell by the rattling structure and electrons are scattered less as in crystals to obtain a high electrical conductivity. A survey of literature reveals that correlated semiconductors and Kondo insulators containing rare earth or transition metal ions are found to be potential thermoelectric materials. The structural magnetic and charge transport properties in manganese oxides having the general formula of RE1−xAExMnO3 (RE = rare earth, AE= Ca, Sr, Ba) are solely determined by the mixed valence (3+/4+) state of Mn ions. In strongly correlated electron systems, magnetism and charge transport properties are strongly correlated. Within the area of strongly correlated electron systems the study of manganese oxides, widely known as manganites exhibit unique magneto electric transport properties, is an active area of research.Strongly correlated systems like perovskite manganites, characterized by their narrow localized band and hoping conduction, were found to be good candidates for thermoelectric applications. Manganites represent a highly correlated electron system and exhibit a variety of phenomena such as charge, orbital and magnetic ordering, colossal magneto resistance and Jahn-Teller effect. The strong inter-dependence between the magnetic order parameters and the transport coefficients in manganites has generated much research interest in the thermoelectric properties of manganites. Here, large thermal motion or rattling of rare earth atoms with localized magnetic moments is believed to be responsible for low thermal conductivity of these compounds. The 4f levels in these compounds, lying near the Fermi energy, create large density of states at the Fermi level and hence they are likely to exhibit a fairly large value of Seebeck coefficient.