Reinforcement Learning Approaches to Power System Scheduling

One major component of power system operation is generation scheduling. The objective of the work is to develop efficient control strategies to the power scheduling problems through Reinforcement Learning approaches. The three important active power scheduling problems are Unit Commitment, Economic Dispatch and Automatic Generation Control. Numerical solution methods proposed for solution of power scheduling are insufficient in handling large and complex systems. Soft Computing methods like Simulated Annealing, Evolutionary Programming etc., are efficient in handling complex cost functions, but find limitation in handling stochastic data existing in a practical system. Also the learning steps are to be repeated for each load demand which increases the computation time.Reinforcement Learning (RL) is a method of learning through interactions with environment. The main advantage of this approach is it does not require a precise mathematical formulation. It can learn either by interacting with the environment or interacting with a simulation model. Several optimization and control problems have been solved through Reinforcement Learning approach. The application of Reinforcement Learning in the field of Power system has been a few. The objective is to introduce and extend Reinforcement Learning approaches for the active power scheduling problems in an implementable manner. The main objectives can be enumerated as:(i) Evolve Reinforcement Learning based solutions to the Unit Commitment Problem.(ii) Find suitable solution strategies through Reinforcement Learning approach for Economic Dispatch. (iii) Extend the Reinforcement Learning solution to Automatic Generation Control with a different perspective. (iv) Check the suitability of the scheduling solutions to one of the existing power systems.First part of the thesis is concerned with the Reinforcement Learning approach to Unit Commitment problem. Unit Commitment Problem is formulated as a multi stage decision process. Q learning solution is developed to obtain the optimwn commitment schedule. Method of state aggregation is used to formulate an efficient solution considering the minimwn up time I down time constraints. The performance of the algorithms are evaluated for different systems and compared with other stochastic methods like Genetic Algorithm.Second stage of the work is concerned with solving Economic Dispatch problem. A simple and straight forward decision making strategy is first proposed in the Learning Automata algorithm. Then to solve the scheduling task of systems with large number of generating units, the problem is formulated as a multi stage decision making task. The solution obtained is extended in order to incorporate the transmission losses in the system. To make the Reinforcement Learning solution more efficient and to handle continuous state space, a fimction approximation strategy is proposed. The performance of the developed algorithms are tested for several standard test cases. Proposed method is compared with other recent methods like Partition Approach Algorithm, Simulated Annealing etc.As the final step of implementing the active power control loops in power system, Automatic Generation Control is also taken into consideration.Reinforcement Learning has already been applied to solve Automatic Generation Control loop. The RL solution is extended to take up the approach of common frequency for all the interconnected areas, more similar to practical systems. Performance of the RL controller is also compared with that of the conventional integral controller.In order to prove the suitability of the proposed methods to practical systems, second plant ofNeyveli Thennal Power Station (NTPS IT) is taken for case study. The perfonnance of the Reinforcement Learning solution is found to be better than the other existing methods, which provide the promising step towards RL based control schemes for practical power industry.Reinforcement Learning is applied to solve the scheduling problems in the power industry and found to give satisfactory perfonnance. Proposed solution provides a scope for getting more profit as the economic schedule is obtained instantaneously. Since Reinforcement Learning method can take the stochastic cost data obtained time to time from a plant, it gives an implementable method. As a further step, with suitable methods to interface with on line data, economic scheduling can be achieved instantaneously in a generation control center. Also power scheduling of systems with different sources such as hydro, thermal etc. can be looked into and Reinforcement Learning solutions can be achieved.

Studies On The Dynamics And Water Quality Of The Muvattupuzha River In Relation To Effluent Discharge

The present study aims at the investigation of the 1ysico—chemical features of a tropical tidal river viz. we Muvattupuzha river. This river is expected to receive Jderate to heavy pollution loads in years to come, from we lone industrial unit, already set up on its bank. ilike other rivers, the geographical disposition of this Lver attains unique importance as regards its dynamics for 3) availability of natural runoff water from catchment :eas, which becomes very heavy during the monsoon season 3) regular steady availability of tail race water from a /dro—electric power station throughout the yearThe study also aims at arriving at the balancing forces of inherent self~purification of the river verses pollution loads from the factory effluents. The investigation period falls ahead of actual pollution occurrence and so the ambient conditions for a period of nearly one-and-a—half years were investigated, the analyses of which providflz to formulate the inter-relations of parameters varying with seasons. Tracer experiments were carried out which revealed the dispersion and dilution characteristics of the river in the vicinity of effluent outfall. The studv covers the trial—cum-capacity production periods of the factory during which effluents of various strength and quantity were discharged into the river; a few computed values arQ’cjmpgrQdl ... with the observed values. The base data along with the profiles of Oxygen sag equation have been utilized fb develop a mathematical model of the river with regard to its water quality

Photodegradation of Methylorange over Zirconia Doped TiO2 Using Solar Energy

The heterogeneous photocatalytic degradation of methylorange over TiO2 is studied and is found to be cost effective. Effect of Zirconium metal incorporation over titania system is investigated. Photocatalytic degradation of methylorange using solar radiation is found to be highly economical when compared with the processes using artificial UV radiation, which require substantial electrical power input. The characterization of titania as well as modified zirconium metal doped titania systems are done using XRD, FTIR and EDAX measurements. The catalytic activities of different systems are also compared and is tried to correlate with the crystallite size and presence of dopant metal.

Drastic variation in the surface boundary layer parameters over Cochin during the annular solar eclipse: Analysis using sonic anemometer data

Atmospheric surface boundary layer parameters vary anomalously in response to the occurrence of annular solar eclipse on 15th January 2010 over Cochin. It was the longest annular solar eclipse occurred over South India with high intensity. As it occurred during the noon hours, it is considered to be much more significant because of its effects in all the regions of atmosphere including ionosphere. Since the insolation is the main driving factor responsible for the anomalous changes occurred in the surface layer due to annular solar eclipse, occurred on 15th January 2010, that played very important role in understanding dynamics of the atmosphere during the eclipse period because of its coincidence with the noon time. The Sonic anemometer is able to give data of zonal, meridional and vertical wind as well as the air temperature at a temporal resolution of 1 s. Different surface boundary layer parameters and turbulent fluxes were computed by the application of eddy correlation technique using the high resolution station data. The surface boundary layer parameters that are computed using the sonic anemometer data during the period are momentum flux, sensible heat flux, turbulent kinetic energy, frictional velocity (u*), variance of temperature, variances of u, v and w wind. In order to compare the results, a control run has been done using the data of previous day as well as next day. It is noted that over the specified time period of annular solar eclipse, all the above stated surface boundary layer parameters vary anomalously when compared with the control run. From the observations we could note that momentum flux was 0.1 Nm 2 instead of the mean value 0.2 Nm-2 when there was eclipse. Sensible heat flux anomalously decreases to 50 Nm 2 instead of the mean value 200 Nm 2 at the time of solar eclipse. The turbulent kinetic energy decreases to 0.2 m2s 2 from the mean value 1 m2s 2. The frictional velocity value decreases to 0.05 ms 1 instead of the mean value 0.2 ms 1. The present study aimed at understanding the dynamics of surface layer in response to the annular solar eclipse over a tropical coastal station, occurred during the noon hours. Key words: annular solar eclipse, surface boundary layer, sonic anemometer

Hybrid Multiferroic Nanostructure with Magnetic−Dielectric Coupling

The development of methods to economically synthesize single wire structured multiferroic systems with room temperature spin−charge coupling is expected to be important for building next-generation multifunctional devices with ultralow power consumption. We demonstrate the fabrication of a single nanowire multiferroic system, a new geometry, exhibiting room temperature magnetodielectric coupling. A coaxial nanotube/nanowire heterostructure of barium titanate (BaTiO3, BTO) and cobalt (Co) has been synthesized using a template-assisted method. Room temperature ferromagnetism and ferroelectricity were exhibited by this coaxial system, indicating the coexistence of more than one ferroic interaction in this composite system