Reinforcement Learning Approaches to Power System Scheduling

One major component of power system operation is generation scheduling. The objective of the work is to develop efficient control strategies to the power scheduling problems through Reinforcement Learning approaches. The three important active power scheduling problems are Unit Commitment, Economic Dispatch and Automatic Generation Control. Numerical solution methods proposed for solution of power scheduling are insufficient in handling large and complex systems. Soft Computing methods like Simulated Annealing, Evolutionary Programming etc., are efficient in handling complex cost functions, but find limitation in handling stochastic data existing in a practical system. Also the learning steps are to be repeated for each load demand which increases the computation time.Reinforcement Learning (RL) is a method of learning through interactions with environment. The main advantage of this approach is it does not require a precise mathematical formulation. It can learn either by interacting with the environment or interacting with a simulation model. Several optimization and control problems have been solved through Reinforcement Learning approach. The application of Reinforcement Learning in the field of Power system has been a few. The objective is to introduce and extend Reinforcement Learning approaches for the active power scheduling problems in an implementable manner. The main objectives can be enumerated as:(i) Evolve Reinforcement Learning based solutions to the Unit Commitment Problem.(ii) Find suitable solution strategies through Reinforcement Learning approach for Economic Dispatch. (iii) Extend the Reinforcement Learning solution to Automatic Generation Control with a different perspective. (iv) Check the suitability of the scheduling solutions to one of the existing power systems.First part of the thesis is concerned with the Reinforcement Learning approach to Unit Commitment problem. Unit Commitment Problem is formulated as a multi stage decision process. Q learning solution is developed to obtain the optimwn commitment schedule. Method of state aggregation is used to formulate an efficient solution considering the minimwn up time I down time constraints. The performance of the algorithms are evaluated for different systems and compared with other stochastic methods like Genetic Algorithm.Second stage of the work is concerned with solving Economic Dispatch problem. A simple and straight forward decision making strategy is first proposed in the Learning Automata algorithm. Then to solve the scheduling task of systems with large number of generating units, the problem is formulated as a multi stage decision making task. The solution obtained is extended in order to incorporate the transmission losses in the system. To make the Reinforcement Learning solution more efficient and to handle continuous state space, a fimction approximation strategy is proposed. The performance of the developed algorithms are tested for several standard test cases. Proposed method is compared with other recent methods like Partition Approach Algorithm, Simulated Annealing etc.As the final step of implementing the active power control loops in power system, Automatic Generation Control is also taken into consideration.Reinforcement Learning has already been applied to solve Automatic Generation Control loop. The RL solution is extended to take up the approach of common frequency for all the interconnected areas, more similar to practical systems. Performance of the RL controller is also compared with that of the conventional integral controller.In order to prove the suitability of the proposed methods to practical systems, second plant ofNeyveli Thennal Power Station (NTPS IT) is taken for case study. The perfonnance of the Reinforcement Learning solution is found to be better than the other existing methods, which provide the promising step towards RL based control schemes for practical power industry.Reinforcement Learning is applied to solve the scheduling problems in the power industry and found to give satisfactory perfonnance. Proposed solution provides a scope for getting more profit as the economic schedule is obtained instantaneously. Since Reinforcement Learning method can take the stochastic cost data obtained time to time from a plant, it gives an implementable method. As a further step, with suitable methods to interface with on line data, economic scheduling can be achieved instantaneously in a generation control center. Also power scheduling of systems with different sources such as hydro, thermal etc. can be looked into and Reinforcement Learning solutions can be achieved.

Performance and efficiency in Colombia's power utilities: an assessment of the 1994 reform

El artículo describe las características centrales de la reforma regulatoria al sector eléctrico en 1994 y evalúa el desempeño y la eficiencia de las empresas públicas antes y después de la reforma. El análisis de desempeño evalúa los cambios en medias y medianas en ganancias, eficiencia, inversión y ventas de las empresas privatizadas en el sector. La eficiencia técnica es estimada mediante la técnica DEA en una muestra de 33 plantas térmicas de energía, que representan el 85% del parque térmico; y 12 empresas distribuidoras de energía. La muestra de plantas generadoras está compuesta por plantas que estaban activas antes de la reforma y plantas nuevas que entraron en operación después de la reforma. Los principales resultados muestran que la eficiencia mejoro después de la reforma y que la política regulatoria ha tenido un efecto positivo en la eficiencia de la generación térmica de energía. Por el contrario, las distribuidoras de energía menos eficientes empeoraron después de la reforma y no llevaron a cabo una reestructuración para alcanzar la eficiencia productiva respecto a las empresas que conforman la frontera de eficiencia en distribución de energía.

Privatization in Colombia: a plant performance analysis

El artículo describe el programa de privatización en el sector real de la economía Colombiana durante los años noventa y ubica esta política en un contexto de desregulación de mercados y promoción de la inversión privada en la oferta de infraestructura publica y servicios públicos domiciliarios. El articulo evalúa el programa de privatización en los sectores manufacturero y de generación de energía eléctrica. Se hacen mediciones ex - post y análisis econométrico del desempeño de las firmas privatizadas. En el sector manufacturero la muestra analizada esta compuesta por 30 firmas manufactureras de gran tamaño, donde el Instituto de Fomento Industrial era socio fundador. Los principales resultados sugieren que estas firmas mantuvieron un comportamiento pro - cíclico relativo a su principal competidor privado y desestimaron planes drásticos de reestructuración operativa. Para el grupo de firmas de generación de energía el articulo estudia el impacto de la reforma regulatoria en el proceso de entrada al mercado, estructura de propiedad, competencia de mercado y eficiencia productiva. La medición de eficiencia productiva usa la técnica de Data Envelope Análisis para 33 plantas que representan el 85% de la capacidad instalada en la generación térmica de energía eléctrica. La muestra esta compuesta por plantas que estaban en funcionamiento antes de la reforma y las entrantes que comenzaron su operación comercial después de la reforma. Los resultados sugieren que los niveles de evidencia en la generación térmica a mejorado después de la reforma y que la política regulatoria ha tenido un efecto positivo en la eficiencia productiva.

Phyto-activity of biocides used to manipulate herbivory: tests of three pesticides on fourteen plant species

1. We tested three pesticides used for field manipulations of herbivory for direct phytoactive effects on the germination and growth of 14 herbaceous plant species selected to provide a range of life-history strategies and functional groups. 2. We report three companion experiments: (A) Two insecticides, chlorpyrifos (granular soil insecticide) and dimethoate (foliar spray), were applied in fully-factorial combination to pot-germinated individuals of 12 species. (B) The same fully-factorial design was used to test for direct effects on the germination of four herbaceous legumes. (C) The molluscicide, metaldehyde, was tested for direct effects on the germination and growth of six plant species. 3. The insecticides had few significant effects on growth and germination. Dimethoate acted only on growth stimulating Anisantha sterilis, Sonchus asper and Stellaria graminea. In contrast, chlorpyrifos acted on germination increasing the germination of Trifolium dubium and Trifolium pratense. There was also a significant interactive effect of chlorpyrifos and dimethoate on the germination of T pratense. However, all. effects were relatively small in magnitude and explanatory power. The molluscicide had no significant effect on plant germination or growth. 4. The small number and size of direct effects of the pesticides on plant performance is encouraging for the use of these pesticides in manipulative experiments on herbivory, especially for the molluscicide. However, a smatt number of direct (positive) effects of the insecticides on some plant species need to be taken into account when interpreting field manipulations of herbivory with these compounds, and emphasises the importance of conducting tests for direct phyto-active effects. (C) 2004 Elsevier GmbH. All rights reserved.

Concentration in the ownership of plant variety rights: Some implications for developing countries

This paper explores concentration levels in the ownership of intellectual property rights over plant varieties worldwide. An analysis of data for 30 UPOV member-countries shows a high degree of concentration in the ownership of plant variety rights for six major crops at the national level in the developed world. Much of this concentration has arisen owing to the rapid consolidation of the seed industry through mergers and acquisitions, especially in the 1990s. A high degree of concentration in the ownership of plant variety rights, in combination with recent efforts to strengthen plant variety protection regimes, is likely to have significant effects on the prospects for future innovation in plant breeding and the distribution of market power between companies. For developing countries, concentration in intellectual property right ownership may have important implications for the structure of domestic seed industries and access to protected varieties and associated plant breeding technologies. These implications for developing countries are likely to become apparent in the context of the rapid spread of plant variety protection and access legislation, emerging changes in the international exchange regime for plant material and liberalised investment policies permitting foreign investment in the seeds sector.

Concentration in ownership of plant variety rights: some implications for developing countries

This paper explores concentration levels in the ownership of intellectual property rights over plant varieties worldwide. An analysis of data for 30 UPOV member-countries shows a high degree of concentration in the ownership of plant variety rights for six major crops at the national level in the developed world. Much of this concentration has arisen owing to the rapid consolidation of the seed industry through mergers and acquisitions, especially in the 1990s. A high degree of concentration in the ownership of plant variety rights, in combination with recent efforts to strengthen plant variety protection regimes, is likely to have significant effects on the prospects for future innovation in plant breeding and the distribution of market power between companies. For developing countries, concentration in intellectual property right ownership may have important implications for the structure of domestic seed industries and access to protected varieties and associated plant breeding technologies. These implications for developing countries are likely to become apparent in the context of the rapid spread of plant variety protection and access legislation, emerging changes in the international exchange regime for plant material and liberalised investment policies permitting foreign investment in the seeds sector. (C) 2003 Elsevier Ltd. All rights reserved.

Stress generation in the tension wood of poplar is based on the lateral swelling power of the G-layer

The mechanism of active stress generation in tension wood is still not fully understood. To characterize the functional interdependency between the G-layer and the secondary cell wall, nanostructural characterization and mechanical tests were performed on native tension wood tissues of poplar (Populus nigra x Populus deltoids) and on tissues in which the G-layer was removed by an enzymatic treatment. In addition to the well-known axial orientation of the cellulose fibrils in the G-layer, it was shown that the microfibril angle of the S2-layer was very large (about 36 degrees). The removal of the G-layer resulted in an axial extension and a tangential contraction of the tissues. The tensile stress-strain curves of native tension wood slices showed a jagged appearance after yield that could not be seen in the enzyme-treated samples. The behaviour of the native tissue was modelled by assuming that cells deform elastically up to a critical strain at which the G-layer slips, causing a drop in stress. The results suggest that tensile stresses in poplar are generated in the living plant by a lateral swelling of the G-layer which forces the surrounding secondary cell wall to contract in the axial direction.

Phylogenies reveal predictive power of traditional medicine in bioprospecting

There is controversy about whether traditional medicine can guide drug discovery, and investment in ethnobotanically led research has fluctuated. One view is that traditionally used plants are not necessarily efficacious and there are no robust methods for distinguishing the ones that are most likely to be bioactive when selecting species for further testing. Here, we reconstruct a genus-level molecular phylogeny representing the 20,000 species found in the floras of three disparate biodiversity hotspots: Nepal, New Zealand and the Cape of South Africa. Borrowing phylogenetic methods from community ecology, we reveal significant clustering of the 1,500 traditionally used species, and provide a direct measure of the relatedness of the three medicinal floras. We demonstrate shared phylogenetic patterns across the floras: related plants from these regions are used to treat medical conditions in the same therapeutic areas. This strongly suggests independent discovery of plant efficacy, an interpretation corroborated by the presence of a significantly greater proportion of known bioactive species in these plant groups than in a random sample. Phylogenetic cross-cultural comparison can focus screening efforts on a subset of traditionally used plants that are richer in bioactive compounds, and could revitalise the use of traditional knowledge in bioprospecting.

EDF and the Brazilian Power Sector

Electricité de France (EDF) is a leading player in the European energy market by being both the first electricity producer in Europe and the world’s leading nuclear plant operator. EDF is also the first electricity producer and supplier in France. However, Europe, EDF’s core market, is currently underperforming: the European sovereign debt crisis is lowering significantly the growth perspective of an energy market that has already reached its maturity. As a consequence, European energy companies are now looking at international markets and especially BRIC economies where economic growth potential remains high. Among them, Brazil is expected to keep its strong economic and electricity demand growth perspectives for the coming decades. Though Brazil has not been considered as a strategic priority for EDF after the Light reversal in 2006, the current economic situation has led the Group to reconsider its position toward the country. EDF’s current presence in Brazil is limited to its stake in UTE Norte Fluminense, a thermal plant, located in the state of Rio de Janeiro. This report investigates the possibility and the feasibility of EDF’s activities expansion in Brazil and what added value it could bring for the Brazilian power market. Considering that the status quo would not allow EDF to take full advantage of Brazil’s future growth, this work is identifying the various options that are currently opened to EDF: market exit, status quo, EDF alone, local partner. For that purpose, this study collects and analyses the latest energy market data as well as generation companies’ information which are necessary to give a relevant overview of the current brazilian power sector and to present EDF strategic options for the country.

Entry on the Brazilian renewable power market: a case study

Conferências internacionais sobre o clima, bem como crescente conscientização sobre as questões de sustentabilidade lançaram luz sobre o papel fundamental que as energias renováveis poderiam desempenhar na transição energética. Ao contrário de combustíveis fósseis, elas podem ser regeneradas em um curto período de tempo e, por conseguinte, espera-se que sejam uma parte da solução para reduzir o aquecimento global. O Brasil sempre teve um forte setor hidrelétrico, mas agora está na vanguarda em relação a todas as outras fontes de energias alternativas, como energia eólica, biomassa o energia solar. Estas indústrias são uma promessa para um futuro próspero, graças ao potencial natural do país, bem como uma legislação de apoio, e estão atraindo muitas empresas locais e internacionais. Este estudo tem como objetivo preencher uma lacuna na literatura analisando o exemplo de uma empresa estrangeira que entra no mercado da energia renovável no Brasil. Baseando-se na literatura como um fundo conceptual, um único estudo de caso têm sido realizados para delinear todos os aspectos do processo de entrada. Neste desenvolvimento, relações causais entre as orientações estratégicas e a evolução do negócio foram identificadas. Esta pesquisa traz uma contribuição para as discussões acadêmicas sobre as dinâmicas de entrada no setor de energia renovável através de evidências do mercado brasileiro.

Variabilidade genética de acessos de aguapé coletados no Estado de São Paulo

No presente trabalho foram coletados acessos de Eichhornia crassipes (aguapé) nos reservatórios das hidrelétricas de Barra Bonita, Bariri, Três Irmãos, Ilha Solteira, Salto Grande, Promissão, Ibitinga, Nova Avanhandava, Mogi-Guaçu, Euclides da Cunha, Jaguari, Jurumirim, Jupiá, Paraibuna e Porto Primavera, do Estado de São Paulo. Estes acessos foram submetidos a um estudo de variabilidade genética por meio de RAPD. Os primers utilizados foram OP X02, OP X07, OP X11 e OP P10 (TTCCGCCACC, GAGCGAGGCT, GGAGCCTCAG, TCCCGCCTAG, respectivamente). Dentre os acessos coletados e analisados, 21 apresentaram índice de identidade genética acima de 0,90. O dendrograma gerado com dados entre populações revelou forte coerência com a distribuição geográfica dos reservatórios que continham as plantas de aguapé. A variabilidade genética encontrada entre os acessos coletados nos diferentes reservatórios estudados foi elevada, considerando que a principal via de reprodução dessa espécie é a vegetativa.

Thermoeconomic analysis method for optimization of combined heat and power systems - part II

In this paper, a thermoeconomic functional analysis method based on the Second Law of Thermodynamics and applied to analyze four cogeneration systems is presented. The objective of the developed technique is to minimize the operating costs of the cogeneration plant, namely exergetic production cost (EPC), assuming fixed rates of electricity production and process steam in exergy base. In this study a comparison is made between the same four configurations of part I. The cogeneration system consisting of a gas turbine with a heat recovery steam generator, without supplementary firing, has the lowest EPC. (C) 2004 Published by Elsevier Ltd.

Line-pack management for producing electric power on peak periods

The distribution of natural gas is carried out by means of long ducts and intermediate compression stations to compensate the pressure drops due to friction. The natural gas compressors are usually driven by an electric motor or a gas turbine system, offering possibilities for energy management, one of these consisting in generating energy for use in-plant or to commercialize as independent power producer. It can be done by matching the natural gas demand, at the minimum pressure allowed in the reception point, and the storage capacity of the feed duct with the maximum compressor capacity, for storing the natural gas at the maximum permitted pressure. This allows the gas turbine to drive an electric generator during the time in which the decreasing pressure in duct is above the minimum acceptable by the sink unit. In this paper, a line-pack management analysis is done for an existing compression station considering its actual demand curve for determining the economic feasibility of maintaining the gas turbine system driver generating electricity in a peak and off-peak tariff structure. The potential of cost reduction from the point of view of energy resources (natural gas and electric costs) is also analyzed. (C) 2010 Elsevier Ltd. All rights reserved.

Short term hydroelectric scheduling combining network flow and interior point approaches

In this paper, short term hydroelectric scheduling is formulated as a network flow optimization model and solved by interior point methods. The primal-dual and predictor-corrector versions of such interior point methods are developed and the resulting matrix structure is explored. This structure leads to very fast iterations since it avoids computation and factorization of impedance matrices. For each time interval, the linear algebra reduces to the solution of two linear systems, either to the number of buses or to the number of independent loops. Either matrix is invariant and can be factored off-line. As a consequence of such matrix manipulations, a linear system which changes at each iteration has to be solved, although its size is reduced to the number of generating units and is not a function of time intervals. These methods were applied to IEEE and Brazilian power systems, and numerical results were obtained using a MATLAB implementation. Both interior point methods proved to be robust and achieved fast convergence for all instances tested. (C) 2004 Elsevier Ltd. All rights reserved.

The need of subsidy for the implementation of photovoltaic solar energy as supporting of decentralized electrical power generation in Brazil

The growing demand for electrical power and the limited capital invested to provide this power is forcing countries like Brazil to search for new alternatives for electrical power generation. The purpose of this paper is to present a technical and economic study on a 15 kW solar plant installed in an isolated community, highlighting the importance of the need for financial subsidy from the government. It evaluates the importance of parameters such as the annual interest rate, specific investment, the marginal cost of expanding the electrical power supply and the government subsidy on amortization time of capital invested. © 2012 Elsevier Ltd All rights reserved.