Reinforcement Learning approaches to Economic Dispatch problem

This paper presents Reinforcement Learning (RL) approaches to Economic Dispatch problem. In this paper, formulation of Economic Dispatch as a multi stage decision making problem is carried out, then two variants of RL algorithms are presented. A third algorithm which takes into consideration the transmission losses is also explained. Efficiency and flexibility of the proposed algorithms are demonstrated through different representative systems: a three generator system with given generation cost table, IEEE 30 bus system with quadratic cost functions, 10 generator system having piecewise quadratic cost functions and a 20 generator system considering transmission losses. A comparison of the computation times of different algorithms is also carried out.

Multipole Theory Analysis of Cutoff Wavenumbers of Waveguides Partially Filled with Dielectric

A new approach, the multipole theory (MT) method, is presented for the computation of cutoff wavenumbers of waveguides partially filled with dielectric. The MT formulation of the eigenvalue problem of an inhomogeneous waveguide is derived. Representative computational examples, including dielectric-rod-loaded rectangular and double-ridged waveguides, are given to validate the theory, and to demonstrate the degree of its efficiency

Strategies for Inverse Profiling of Two Dimensional Dielectric Scatterers Using Electromagnetic Illumination

Electromagnetic tomography has been applied to problems in nondestructive evolution, ground-penetrating radar, synthetic aperture radar, target identification, electrical well logging, medical imaging etc. The problem of electromagnetic tomography involves the estimation of cross sectional distribution dielectric permittivity, conductivity etc based on measurement of the scattered fields. The inverse scattering problem of electromagnetic imaging is highly non linear and ill posed, and is liable to get trapped in local minima. The iterative solution techniques employed for computing the inverse scattering problem of electromagnetic imaging are highly computation intensive. Thus the solution to electromagnetic imaging problem is beset with convergence and computational issues. The attempt of this thesis is to develop methods suitable for improving the convergence and reduce the total computations for tomographic imaging of two dimensional dielectric cylinders illuminated by TM polarized waves, where the scattering problem is defmed using scalar equations. A multi resolution frequency hopping approach was proposed as opposed to the conventional frequency hopping approach employed to image large inhomogeneous scatterers. The strategy was tested on both synthetic and experimental data and gave results that were better localized and also accelerated the iterative procedure employed for the imaging. A Degree of Symmetry formulation was introduced to locate the scatterer in the investigation domain when the scatterer cross section was circular. The investigation domain could thus be reduced which reduced the degrees of freedom of the inverse scattering process. Thus the entire measured scattered data was available for the optimization of fewer numbers of pixels. This resulted in better and more robust reconstructions of the scatterer cross sectional profile. The Degree of Symmetry formulation could also be applied to the practical problem of limited angle tomography, as in the case of a buried pipeline, where the ill posedness is much larger. The formulation was also tested using experimental data generated from an experimental setup that was designed. The experimental results confirmed the practical applicability of the formulation.

Studies on some generalizations of line graph and the power domination problem in graphs

Department of Mathematics, Cochin University of Science and Technology

Reinforcement Learning Approaches to Power System Scheduling

One major component of power system operation is generation scheduling. The objective of the work is to develop efficient control strategies to the power scheduling problems through Reinforcement Learning approaches. The three important active power scheduling problems are Unit Commitment, Economic Dispatch and Automatic Generation Control. Numerical solution methods proposed for solution of power scheduling are insufficient in handling large and complex systems. Soft Computing methods like Simulated Annealing, Evolutionary Programming etc., are efficient in handling complex cost functions, but find limitation in handling stochastic data existing in a practical system. Also the learning steps are to be repeated for each load demand which increases the computation time.Reinforcement Learning (RL) is a method of learning through interactions with environment. The main advantage of this approach is it does not require a precise mathematical formulation. It can learn either by interacting with the environment or interacting with a simulation model. Several optimization and control problems have been solved through Reinforcement Learning approach. The application of Reinforcement Learning in the field of Power system has been a few. The objective is to introduce and extend Reinforcement Learning approaches for the active power scheduling problems in an implementable manner. The main objectives can be enumerated as:(i) Evolve Reinforcement Learning based solutions to the Unit Commitment Problem.(ii) Find suitable solution strategies through Reinforcement Learning approach for Economic Dispatch. (iii) Extend the Reinforcement Learning solution to Automatic Generation Control with a different perspective. (iv) Check the suitability of the scheduling solutions to one of the existing power systems.First part of the thesis is concerned with the Reinforcement Learning approach to Unit Commitment problem. Unit Commitment Problem is formulated as a multi stage decision process. Q learning solution is developed to obtain the optimwn commitment schedule. Method of state aggregation is used to formulate an efficient solution considering the minimwn up time I down time constraints. The performance of the algorithms are evaluated for different systems and compared with other stochastic methods like Genetic Algorithm.Second stage of the work is concerned with solving Economic Dispatch problem. A simple and straight forward decision making strategy is first proposed in the Learning Automata algorithm. Then to solve the scheduling task of systems with large number of generating units, the problem is formulated as a multi stage decision making task. The solution obtained is extended in order to incorporate the transmission losses in the system. To make the Reinforcement Learning solution more efficient and to handle continuous state space, a fimction approximation strategy is proposed. The performance of the developed algorithms are tested for several standard test cases. Proposed method is compared with other recent methods like Partition Approach Algorithm, Simulated Annealing etc.As the final step of implementing the active power control loops in power system, Automatic Generation Control is also taken into consideration.Reinforcement Learning has already been applied to solve Automatic Generation Control loop. The RL solution is extended to take up the approach of common frequency for all the interconnected areas, more similar to practical systems. Performance of the RL controller is also compared with that of the conventional integral controller.In order to prove the suitability of the proposed methods to practical systems, second plant ofNeyveli Thennal Power Station (NTPS IT) is taken for case study. The perfonnance of the Reinforcement Learning solution is found to be better than the other existing methods, which provide the promising step towards RL based control schemes for practical power industry.Reinforcement Learning is applied to solve the scheduling problems in the power industry and found to give satisfactory perfonnance. Proposed solution provides a scope for getting more profit as the economic schedule is obtained instantaneously. Since Reinforcement Learning method can take the stochastic cost data obtained time to time from a plant, it gives an implementable method. As a further step, with suitable methods to interface with on line data, economic scheduling can be achieved instantaneously in a generation control center. Also power scheduling of systems with different sources such as hydro, thermal etc. can be looked into and Reinforcement Learning solutions can be achieved.

Analysis of Fluctuations in the Early Universe Using Fokker-Planck Formalism

The thesis begins with a review of basic elements of general theory of relativity (GTR) which forms the basis for the theoretical interpretation of the observations in cosmology. The first chapter also discusses the standard model in cosmology, namely the Friedmann model, its predictions and problems. We have also made a brief discussion on fractals and inflation of the early universe in the first chapter. In the second chapter we discuss the formulation of a new approach to cosmology namely a stochastic approach. In this model, the dynam ics of the early universe is described by a set of non-deterministic, Langevin type equations and we derive the solutions using the Fokker—Planck formalism. Here we demonstrate how the problems with the standard model, can be eliminated by introducing the idea of stochastic fluctuations in the early universe. Many recent observations indicate that the present universe may be approximated by a many component fluid and we assume that only the total energy density is conserved. This, in turn, leads to energy transfer between different components of the cosmic fluid and fluctuations in such energy transfer can certainly induce fluctuations in the mean to factor in the equation of state p = wp, resulting in a fluctuating expansion rate for the universe. The third chapter discusses the stochastic evolution of the cosmological parameters in the early universe, using the new approach. The penultimate chapter is about the refinements to be made in the present model, by means of a new deterministic model The concluding chapter presents a discussion on other problems with the conventional cosmology, like fractal correlation of galactic distribution. The author attempts an explanation for this problem using the stochastic approach.

Properties of Anisotropic Superconductors in SR Model

The present thesis deals with the theoretical investigations on the effect of anisotropy on various properties of magnetically doped superconductors described by fihiba — Rusinov model.Chapter 1 is introductory. It contains a brief account of the current status of theory of superconductivity. In’ chapter 2 we give the formulation of the problem. Chapter 2.1 gives the BCS theory. The effect of magnetic impurities in superconductors as described by A8 theory is given in chapter 2.2A and that described by SR model is discussed in chapter 2.28. Chapter 2.2c deals with Kondo effect. In chapter 2.3 the anisotropy problem is reviewed. Our calculations, results and discussions are given in chapter 3. Chapter 3.1 deals with Josephson tunnel effect. In chapter 3.2 the thermodynamic critical field H62 is described. Chtpter 3.3 deals with the density of states. The ultrasonic attenuation coefficient and ufitlear spin relaxation are given in chapter 3.4 and 3.5 respectively. In chapter 3.6 we give the upper critical field calculations and chapter 3.7 deals with the response function. The Kondo effect is given in chapter 3.8. In chapter 4 we give the sumary of our results

Wage policy in Indian industries

India is on the threshold of industrial and economic development. The growth would be retarded if harmonious employer-employee relations are not maintained. 'Wages' plays a fundamental role in establishing this relationship. However, much controversy in the industrial sphere revolves round the question of wages. Though formerly the laissez faire doctrine prevailed, with the emergence of the welfare state ideology, notions of national economy and social justice gained prominence. The problem of wages has became one with social, political, economic, psychological and legal dimensions. Formulation of a proper wage policy is thus a riddle. Realities of the present have to be fused with perspectives about the future. With due recognition of all significant factors, a proper balance has to be struck, which should be the hard core of any wage policy. This study emphasises the need for a wage policy which may meet the requirements of rapid economic growth and stable industrial relations. The study also indicates the proper bases for the promotien of such a policy.

The Fishing Industry in Kerala - Problem and Potentials

importance of fishing and other allied industries in the economy was realised only very recently. Consequently only very few studies are available on the subject. Here an attempt is made to survey the available literature on the subject.

On the generalized obnoxious center problem: antimedian subsets

The set of vertices that maximize (minimize) the remoteness is the antimedian (median) set of the profile. It is proved that for an arbitrary graph G and S V (G) it can be decided in polynomial time whether S is the antimedian set of some profile. Graphs in which every antimedian set is connected are also considered.

Reinforcement Learning Solution for Unit Commitment Problem Considering Minimum Start Up and Shut Down Times

Unit Commitment Problem (UCP) in power system refers to the problem of determining the on/ off status of generating units that minimize the operating cost during a given time horizon. Since various system and generation constraints are to be satisfied while finding the optimum schedule, UCP turns to be a constrained optimization problem in power system scheduling. Numerical solutions developed are limited for small systems and heuristic methodologies find difficulty in handling stochastic cost functions associated with practical systems. This paper models Unit Commitment as a multi stage decision making task and an efficient Reinforcement Learning solution is formulated considering minimum up time /down time constraints. The correctness and efficiency of the developed solutions are verified for standard test systems

Reinforcement Learning solution for Unit Commitment Problem through pursuit method

Unit commitment is an optimization task in electric power generation control sector. It involves scheduling the ON/OFF status of the generating units to meet the load demand with minimum generation cost satisfying the different constraints existing in the system. Numerical solutions developed are limited for small systems and heuristic methodologies find difficulty in handling stochastic cost functions associated with practical systems. This paper models Unit Commitment as a multi stage decision task and Reinforcement Learning solution is formulated through one efficient exploration strategy: Pursuit method. The correctness and efficiency of the developed solutions are verified for standard test systems

Testing Isotropy and a related Random Walk problem

One comes across directions as the observations in a number of situations. The first inferential question that one should answer when dealing with such data is, “Are they isotropic or uniformly distributed?” The answer to this question goes back in history which we shall retrace a bit and provide an exact and approximate solution to this so-called “Pearson’s Random Walk” problem.

Strength Predictions of Hat Stiffened Plate

Hat Stiffened Plates are used in composite ships and are gaining popularity in metallic ship construction due to its high strength-to-weight ratio. Light weight structures will result in greater payload, higher speeds, reduced fuel consumption and environmental emissions. Numerical Investigations have been carried out using the commercial Finite Element software ANSYS 12 to substantiate the high strength-to-weight ratio of Hat Stiffened Plates over other open section stiffeners which are commonly used in ship building. Analysis of stiffened plate has always been a matter of concern for the structural engineers since it has been rather difficult to quantify the actual load sharing between stiffeners and plating. Finite Element Method has been accepted as an efficient tool for the analysis of stiffened plated structure. Best results using the Finite Element Method for the analysis of thin plated structures are obtained when both the stiffeners and the plate are modeled using thin plate elements having six degrees of freedom per node. However, one serious problem encountered with this design and analysis process is that the generation of the finite element models for a complex configuration is time consuming and laborious. In order to overcome these difficulties two different methods viz., Orthotropic Plate Model and Superelement for Hat Stiffened Plate have been suggested in the present work. In the Orthotropic Plate Model geometric orthotropy is converted to material orthotropy i.e., the stiffeners are smeared and they vanish from the field of analysis and the structure can be analysed using any commercial Finite Element software which has orthotropic elements in its element library. The Orthotropic Plate Model developed has predicted deflection, stress and linear buckling load with sufficiently good accuracy in the case of all four edges simply supported boundary condition. Whereas, in the case of two edges fixed and other two edges simply supported boundary condition even though the stress has been predicted with good accuracy there has been large variation in the deflection predicted. This variation in the deflection predicted is because, for the Orthotropic Plate Model the rigidity is uniform throughout the plate whereas in the actual Hat Stiffened Plate the rigidity along the line of attachment of the stiffeners to the plate is large as compared to the unsupported portion of the plate. The Superelement technique is a method of treating a portion of the structure as if it were a single element even though it is made up of many individual elements. The Superelement has predicted the deflection and in-plane stress of Hat Stiffened Plate with sufficiently good accuracy for different boundary conditions. Formulation of Superelement for composite Hat Stiffened Plate has also been presented in the thesis. The capability of Orthotropic Plate Model and Superelement to handle typical boundary conditions and characteristic loads in a ship structure has been demonstrated through numerical investigations.

Employment Realm in Technical Education in Kerala-A Study on the Problem of Unemployment among Engineers

The The The The growing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demand for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of the the the the publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system of education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goods emphasized emphasized emphasized emphasized emphasized emphasized emphasized emphasized emphasized emphasized on large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation of funds on of funds on of funds on of funds on of funds on of funds on of funds on of funds on of funds on of funds on of funds for promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting education. Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to the rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of India, Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect primarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the earlierarlierarlierarlierarlierarlier political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social compulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions of the state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The presumption of sumption of sumption of sumption of sumption of sumption of sumption of sumption of sumption of sumption of sumption of assured assured assured assured assured assured assured assured and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed employment in employment in employment in employment in employment in employment in employment in employment in employment in employment in employment in employment in the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other countries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased further the scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher education in KeralaKeralaKeralaKeralaKeralaKerala, particularparticularparticularparticularparticularparticularparticularparticularparticularparticularly the technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe