Reinforcement Learning Approaches to Power System Scheduling

One major component of power system operation is generation scheduling. The objective of the work is to develop efficient control strategies to the power scheduling problems through Reinforcement Learning approaches. The three important active power scheduling problems are Unit Commitment, Economic Dispatch and Automatic Generation Control. Numerical solution methods proposed for solution of power scheduling are insufficient in handling large and complex systems. Soft Computing methods like Simulated Annealing, Evolutionary Programming etc., are efficient in handling complex cost functions, but find limitation in handling stochastic data existing in a practical system. Also the learning steps are to be repeated for each load demand which increases the computation time.Reinforcement Learning (RL) is a method of learning through interactions with environment. The main advantage of this approach is it does not require a precise mathematical formulation. It can learn either by interacting with the environment or interacting with a simulation model. Several optimization and control problems have been solved through Reinforcement Learning approach. The application of Reinforcement Learning in the field of Power system has been a few. The objective is to introduce and extend Reinforcement Learning approaches for the active power scheduling problems in an implementable manner. The main objectives can be enumerated as:(i) Evolve Reinforcement Learning based solutions to the Unit Commitment Problem.(ii) Find suitable solution strategies through Reinforcement Learning approach for Economic Dispatch. (iii) Extend the Reinforcement Learning solution to Automatic Generation Control with a different perspective. (iv) Check the suitability of the scheduling solutions to one of the existing power systems.First part of the thesis is concerned with the Reinforcement Learning approach to Unit Commitment problem. Unit Commitment Problem is formulated as a multi stage decision process. Q learning solution is developed to obtain the optimwn commitment schedule. Method of state aggregation is used to formulate an efficient solution considering the minimwn up time I down time constraints. The performance of the algorithms are evaluated for different systems and compared with other stochastic methods like Genetic Algorithm.Second stage of the work is concerned with solving Economic Dispatch problem. A simple and straight forward decision making strategy is first proposed in the Learning Automata algorithm. Then to solve the scheduling task of systems with large number of generating units, the problem is formulated as a multi stage decision making task. The solution obtained is extended in order to incorporate the transmission losses in the system. To make the Reinforcement Learning solution more efficient and to handle continuous state space, a fimction approximation strategy is proposed. The performance of the developed algorithms are tested for several standard test cases. Proposed method is compared with other recent methods like Partition Approach Algorithm, Simulated Annealing etc.As the final step of implementing the active power control loops in power system, Automatic Generation Control is also taken into consideration.Reinforcement Learning has already been applied to solve Automatic Generation Control loop. The RL solution is extended to take up the approach of common frequency for all the interconnected areas, more similar to practical systems. Performance of the RL controller is also compared with that of the conventional integral controller.In order to prove the suitability of the proposed methods to practical systems, second plant ofNeyveli Thennal Power Station (NTPS IT) is taken for case study. The perfonnance of the Reinforcement Learning solution is found to be better than the other existing methods, which provide the promising step towards RL based control schemes for practical power industry.Reinforcement Learning is applied to solve the scheduling problems in the power industry and found to give satisfactory perfonnance. Proposed solution provides a scope for getting more profit as the economic schedule is obtained instantaneously. Since Reinforcement Learning method can take the stochastic cost data obtained time to time from a plant, it gives an implementable method. As a further step, with suitable methods to interface with on line data, economic scheduling can be achieved instantaneously in a generation control center. Also power scheduling of systems with different sources such as hydro, thermal etc. can be looked into and Reinforcement Learning solutions can be achieved.

Power Profile of Effective Managers: An Exploration among the Branch Managers of a Commercial Bank in Kerala

Managers are central to any fuction in a complex and developed society. Their talents are reckoned to be cardinal in developed economies and a basic yearning of all developing economies.In order to survive and produce results in a turbulent and transient environment, the task is to understand the nature of factors contributing to managerial effectiveness. This study is an attempt towards this core issue of the present from a different perspective. This study tries to focus attention on a group of managers functioning in the field of banking, a core sector in the country's economy. The gamut of economic activities in Kerala being predominantly service-oriented, importance of commercial banking is almost indisputable. Though economists would argue that the disproportionate development of service sector is anomalous when viewed against the hazy scenarios in the primary and secondary sectors of the state’s economy, the extent and pace of growth in the banking sector has had its dole meted out by ambitious and productive managers fiinctioning in the field. Researcher’s attempt here is to thresh the grain and chaff among bank managers in terms of their effectiveness and to account for the variations in the light of their ability to affect the thoughts and actions of their subordinates. To put it succinctly, the attempt herein is to explain the effectiveness of bank managers in the light of their ‘Power Profile’ taken to be comprising Power Differentials, Power Bases, their Visibility and Credibility in the organisation and, the Power Styles typically used by them for influencing subordinates.

The power of taxation under the indian constitution

The Power Of Taxation Under The lndian Constitution, the subject of the present thesis has a wide ambit covering the entire federal field end deep constitutional significance traversing many of the principles like pith and substance, colourability, severebility etc. However, considerations of time, space and areas already investigated have indicated that the present study may be confined to the fundamental constitutional limitations end the federal problem. Thus the effect of fundamental rights, the commerce clause, immunity of instrumentalitis and the principle limiting the power of legislative delegation on the power of taxation has been studied. The distribution of taxes between the Union and units of the Indian federation leans so much over to the former and that part of this study has been directed to discover what devices can help the units to gain economic viability

Coastal regulation zone rules in coastal panchayats (villages) of Kerala, India vis-a` -vis socio-economic impacts from the recently introduced peoples’ participatory program for local self-governance and sustainable development

Coastal Regulation Zone (CRZ) notification was issued by the Ministry of Environment and Forest of Government of India in February 1991 as a part of the Environmental Protection Act of 1986 to protect the coast from eroding and to preserve its natural resources. The initial notification did not distinguish the variability and diversity of various coastal states before enforcing it on the various states and Union Territories. Impact assessments were not carried out to assess its impact on socio-economic life of the coastal population. For the very same reason, it was unnoticed or rather ignored till 1994 when the Supreme Court of India made a land mark judgment on the fate of the coastal aquaculture which by then had established as an economically successful industry in many South Indian States. Coastal aquaculture in its modern form was a prohibited activity within CRZ. Lately, only various stakeholders of the coast realized the real impact of the CRZ rules on their property rights andbusiness. To overcome the initial drawbacks several amendments were made in the regulation to suit regional needs. In 1995, another great transformation took place in the State of Kerala as a part of the reorganization of the local self government institutions into a decentralized three tier system called ‘‘Panchayathi Raj System’’. In 1997, the state government also decided to transfer the power with the required budget outlay to the grass root level panchayats (villages) and municipalities to plan and implement the various projects in their localities with the full participation of the local people by constituting Grama Sabhas (Peoples’ Forum). It is called the ‘‘Peoples’ Planning Campaign’’(Peoples’ Participatory Programme—PPP for Local Level Self-Governance). The management of all the resources including the local natural resources was largely decentralized to the level of local communities and villages. Integrated, sustainable coastal zone management has become the concern of the local population. The paper assesses the socio-economic impact of the centrally enforced CRZ and the state sponsored PPP on the coastal community in Kerala and suggests measures to improve the system and living standards of the coastal people within the framework of CRZ.

A Reinforcement Learning Algorithm to Economic Dispatch Considering Transmission Losses

Reinforcement Learning (RL) refers to a class of learning algorithms in which learning system learns which action to take in different situations by using a scalar evaluation received from the environment on performing an action. RL has been successfully applied to many multi stage decision making problem (MDP) where in each stage the learning systems decides which action has to be taken. Economic Dispatch (ED) problem is an important scheduling problem in power systems, which decides the amount of generation to be allocated to each generating unit so that the total cost of generation is minimized without violating system constraints. In this paper we formulate economic dispatch problem as a multi stage decision making problem. In this paper, we also develop RL based algorithm to solve the ED problem. The performance of our algorithm is compared with other recent methods. The main advantage of our method is it can learn the schedule for all possible demands simultaneously.

Reinforcement Learning approaches to Economic Dispatch problem

This paper presents Reinforcement Learning (RL) approaches to Economic Dispatch problem. In this paper, formulation of Economic Dispatch as a multi stage decision making problem is carried out, then two variants of RL algorithms are presented. A third algorithm which takes into consideration the transmission losses is also explained. Efficiency and flexibility of the proposed algorithms are demonstrated through different representative systems: a three generator system with given generation cost table, IEEE 30 bus system with quadratic cost functions, 10 generator system having piecewise quadratic cost functions and a 20 generator system considering transmission losses. A comparison of the computation times of different algorithms is also carried out.

A Reinforcement Learning Approach to Economic Dispatch using Neural Networks

This paper presents a Reinforcement Learning (RL) approach to economic dispatch (ED) using Radial Basis Function neural network. We formulate the ED as an N stage decision making problem. We propose a novel architecture to store Qvalues and present a learning algorithm to learn the weights of the neural network. Even though many stochastic search techniques like simulated annealing, genetic algorithm and evolutionary programming have been applied to ED, they require searching for the optimal solution for each load demand. Also they find limitation in handling stochastic cost functions. In our approach once we learn the Q-values, we can find the dispatch for any load demand. We have recently proposed a RL approach to ED. In that approach, we could find only the optimum dispatch for a set of specified discrete values of power demand. The performance of the proposed algorithm is validated by taking IEEE 6 bus system, considering transmission losses