Reinforcement Learning approaches to Economic Dispatch problem

This paper presents Reinforcement Learning (RL) approaches to Economic Dispatch problem. In this paper, formulation of Economic Dispatch as a multi stage decision making problem is carried out, then two variants of RL algorithms are presented. A third algorithm which takes into consideration the transmission losses is also explained. Efficiency and flexibility of the proposed algorithms are demonstrated through different representative systems: a three generator system with given generation cost table, IEEE 30 bus system with quadratic cost functions, 10 generator system having piecewise quadratic cost functions and a 20 generator system considering transmission losses. A comparison of the computation times of different algorithms is also carried out.

Design, Development and Realization of Quadratic Volterra Filters for Selected Applications

The basic concepts of digital signal processing are taught to the students in engineering and science. The focus of the course is on linear, time invariant systems. The question as to what happens when the system is governed by a quadratic or cubic equation remains unanswered in the vast majority of literature on signal processing. Light has been shed on this problem when John V Mathews and Giovanni L Sicuranza published the book Polynomial Signal Processing. This book opened up an unseen vista of polynomial systems for signal and image processing. The book presented the theory and implementations of both adaptive and non-adaptive FIR and IIR quadratic systems which offer improved performance than conventional linear systems. The theory of quadratic systems presents a pristine and virgin area of research that offers computationally intensive work. Once the area of research is selected, the next issue is the choice of the software tool to carry out the work. Conventional languages like C and C++ are easily eliminated as they are not interpreted and lack good quality plotting libraries. MATLAB is proved to be very slow and so do SCILAB and Octave. The search for a language for scientific computing that was as fast as C, but with a good quality plotting library, ended up in Python, a distant relative of LISP. It proved to be ideal for scientific computing. An account of the use of Python, its scientific computing package scipy and the plotting library pylab is given in the appendix Initially, work is focused on designing predictors that exploit the polynomial nonlinearities inherent in speech generation mechanisms. Soon, the work got diverted into medical image processing which offered more potential to exploit by the use of quadratic methods. The major focus in this area is on quadratic edge detection methods for retinal images and fingerprints as well as de-noising raw MRI signals

Invariant density for a class of initial distributions under quadratic mapping

For the discrete-time quadratic map xt+1=4xt(1-xt) the evolution equation for a class of non-uniform initial densities is obtained. It is shown that in the t to infinity limit all of them approach the invariant density for the map.

Studies on some generalizations of line graph and the power domination problem in graphs

Department of Mathematics, Cochin University of Science and Technology

The Fishing Industry in Kerala - Problem and Potentials

importance of fishing and other allied industries in the economy was realised only very recently. Consequently only very few studies are available on the subject. Here an attempt is made to survey the available literature on the subject.

On the generalized obnoxious center problem: antimedian subsets

The set of vertices that maximize (minimize) the remoteness is the antimedian (median) set of the profile. It is proved that for an arbitrary graph G and S V (G) it can be decided in polynomial time whether S is the antimedian set of some profile. Graphs in which every antimedian set is connected are also considered.

Enhancement of Calcifications in Mammograms using Volterra Series based Quadratic Filter

The paper summarizes the design and implementation of a quadratic edge detection filter, based on Volterra series, for enhancing calcifications in mammograms. The proposed filter can account for much of the polynomial nonlinearities inherent in the input mammogram image and can replace the conventional edge detectors like Laplacian, gaussian etc. The filter gives rise to improved visualization and early detection of microcalcifications, which if left undetected, can lead to breast cancer. The performance of the filter is analyzed and found superior to conventional spatial edge detectors

Reinforcement Learning Solution for Unit Commitment Problem Considering Minimum Start Up and Shut Down Times

Unit Commitment Problem (UCP) in power system refers to the problem of determining the on/ off status of generating units that minimize the operating cost during a given time horizon. Since various system and generation constraints are to be satisfied while finding the optimum schedule, UCP turns to be a constrained optimization problem in power system scheduling. Numerical solutions developed are limited for small systems and heuristic methodologies find difficulty in handling stochastic cost functions associated with practical systems. This paper models Unit Commitment as a multi stage decision making task and an efficient Reinforcement Learning solution is formulated considering minimum up time /down time constraints. The correctness and efficiency of the developed solutions are verified for standard test systems

Reinforcement Learning solution for Unit Commitment Problem through pursuit method

Unit commitment is an optimization task in electric power generation control sector. It involves scheduling the ON/OFF status of the generating units to meet the load demand with minimum generation cost satisfying the different constraints existing in the system. Numerical solutions developed are limited for small systems and heuristic methodologies find difficulty in handling stochastic cost functions associated with practical systems. This paper models Unit Commitment as a multi stage decision task and Reinforcement Learning solution is formulated through one efficient exploration strategy: Pursuit method. The correctness and efficiency of the developed solutions are verified for standard test systems

Quadratic Predictor based Differential Encoding and Decoding of Speech Signals

Modeling nonlinear systems using Volterra series is a century old method but practical realizations were hampered by inadequate hardware to handle the increased computational complexity stemming from its use. But interest is renewed recently, in designing and implementing filters which can model much of the polynomial nonlinearities inherent in practical systems. The key advantage in resorting to Volterra power series for this purpose is that nonlinear filters so designed can be made to work in parallel with the existing LTI systems, yielding improved performance. This paper describes the inclusion of a quadratic predictor (with nonlinearity order 2) with a linear predictor in an analog source coding system. Analog coding schemes generally ignore the source generation mechanisms but focuses on high fidelity reconstruction at the receiver. The widely used method of differential pnlse code modulation (DPCM) for speech transmission uses a linear predictor to estimate the next possible value of the input speech signal. But this linear system do not account for the inherent nonlinearities in speech signals arising out of multiple reflections in the vocal tract. So a quadratic predictor is designed and implemented in parallel with the linear predictor to yield improved mean square error performance. The augmented speech coder is tested on speech signals transmitted over an additive white gaussian noise (AWGN) channel.

Testing Isotropy and a related Random Walk problem

One comes across directions as the observations in a number of situations. The first inferential question that one should answer when dealing with such data is, “Are they isotropic or uniformly distributed?” The answer to this question goes back in history which we shall retrace a bit and provide an exact and approximate solution to this so-called “Pearson’s Random Walk” problem.

Employment Realm in Technical Education in Kerala-A Study on the Problem of Unemployment among Engineers

The The The The growing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demandgrowing demand for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of for the expansion of the the the the publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system publicly funded system of education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goodof education as merit and free goods emphasized emphasized emphasized emphasized emphasized emphasized emphasized emphasized emphasized emphasized on large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation large allocation of funds on of funds on of funds on of funds on of funds on of funds on of funds on of funds on of funds on of funds on of funds for promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting educationfor promoting education. Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to . Compared to the rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of Indiathe rest of India, Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead , Kerala is far ahead in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect in this respect primarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the eprimarily because of the earlierarlierarlierarlierarlierarlier political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social political and social compulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions ofcompulsions of the state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The prethe state. The presumption of sumption of sumption of sumption of sumption of sumption of sumption of sumption of sumption of sumption of sumption of assured assured assured assured assured assured assured assured and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed and guaranteed employment in employment in employment in employment in employment in employment in employment in employment in employment in employment in employment in employment in the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East the Middle East and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other and also in other countries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased furthecountries increased further the scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher educationthe scope of higher education in KeralaKeralaKeralaKeralaKeralaKerala, particularparticularparticularparticularparticularparticularparticularparticularparticularparticularly the technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe technical educationthe