Reinforcement Learning Approaches to Power System Scheduling

One major component of power system operation is generation scheduling. The objective of the work is to develop efficient control strategies to the power scheduling problems through Reinforcement Learning approaches. The three important active power scheduling problems are Unit Commitment, Economic Dispatch and Automatic Generation Control. Numerical solution methods proposed for solution of power scheduling are insufficient in handling large and complex systems. Soft Computing methods like Simulated Annealing, Evolutionary Programming etc., are efficient in handling complex cost functions, but find limitation in handling stochastic data existing in a practical system. Also the learning steps are to be repeated for each load demand which increases the computation time.Reinforcement Learning (RL) is a method of learning through interactions with environment. The main advantage of this approach is it does not require a precise mathematical formulation. It can learn either by interacting with the environment or interacting with a simulation model. Several optimization and control problems have been solved through Reinforcement Learning approach. The application of Reinforcement Learning in the field of Power system has been a few. The objective is to introduce and extend Reinforcement Learning approaches for the active power scheduling problems in an implementable manner. The main objectives can be enumerated as:(i) Evolve Reinforcement Learning based solutions to the Unit Commitment Problem.(ii) Find suitable solution strategies through Reinforcement Learning approach for Economic Dispatch. (iii) Extend the Reinforcement Learning solution to Automatic Generation Control with a different perspective. (iv) Check the suitability of the scheduling solutions to one of the existing power systems.First part of the thesis is concerned with the Reinforcement Learning approach to Unit Commitment problem. Unit Commitment Problem is formulated as a multi stage decision process. Q learning solution is developed to obtain the optimwn commitment schedule. Method of state aggregation is used to formulate an efficient solution considering the minimwn up time I down time constraints. The performance of the algorithms are evaluated for different systems and compared with other stochastic methods like Genetic Algorithm.Second stage of the work is concerned with solving Economic Dispatch problem. A simple and straight forward decision making strategy is first proposed in the Learning Automata algorithm. Then to solve the scheduling task of systems with large number of generating units, the problem is formulated as a multi stage decision making task. The solution obtained is extended in order to incorporate the transmission losses in the system. To make the Reinforcement Learning solution more efficient and to handle continuous state space, a fimction approximation strategy is proposed. The performance of the developed algorithms are tested for several standard test cases. Proposed method is compared with other recent methods like Partition Approach Algorithm, Simulated Annealing etc.As the final step of implementing the active power control loops in power system, Automatic Generation Control is also taken into consideration.Reinforcement Learning has already been applied to solve Automatic Generation Control loop. The RL solution is extended to take up the approach of common frequency for all the interconnected areas, more similar to practical systems. Performance of the RL controller is also compared with that of the conventional integral controller.In order to prove the suitability of the proposed methods to practical systems, second plant ofNeyveli Thennal Power Station (NTPS IT) is taken for case study. The perfonnance of the Reinforcement Learning solution is found to be better than the other existing methods, which provide the promising step towards RL based control schemes for practical power industry.Reinforcement Learning is applied to solve the scheduling problems in the power industry and found to give satisfactory perfonnance. Proposed solution provides a scope for getting more profit as the economic schedule is obtained instantaneously. Since Reinforcement Learning method can take the stochastic cost data obtained time to time from a plant, it gives an implementable method. As a further step, with suitable methods to interface with on line data, economic scheduling can be achieved instantaneously in a generation control center. Also power scheduling of systems with different sources such as hydro, thermal etc. can be looked into and Reinforcement Learning solutions can be achieved.

International Initiatives for Regulating Access to Genetic Resources

In light of the various international instruments and international agencies that are actively engaged in resolving the issue of ABS, the present work tries to find an answer to the larger question how far the above agencies have succeeded in regulating access and make sure of benefit sharing. In this process, the work comprehensively analyses the work of different agencies involved in the process. It tries to find out the major obstacles that stand in the way of fulfilment of the benefit sharing objective and proposes the ways and means to tackle them. The study first traces the legal foundations of the concept of property in GRs and associated TK.For this, it starts with analysis of the nature of property and the questions related to ownership in GRs as contained in the CBD as well as in various State legislations. It further examines the notion of property before and after the enactment of the CBD and establishes that the CBD contains strong private property jurisprudence.Based on the theoretical foundation of private property right,Chapter 3 analyses the benefit sharing mechanism of the CBD, i.e. the Nagoya Protocol. It searches for a theoretical convergence of the notion of property as reflected in the two instruments and successfully establishes the same. It makes an appraisal of the Nagoya regime to find out how far it has gone beyond the CBD in ensuring the task of benefit sharing and the impediments in its way.Realizing that the ITPGRFA forms part of the CBD system, Chapter 4 analyses the benefit sharing structure of ITPGRFA as revealed through its multilateral system. This gives the work the benefit of comparing two different benefit sharing models operating on the same philosophy of property. This chapter tries to find out whether there is conceptual coherence in the notion of property when the benefit sharing model changes. It alsocompares the merits and demerits of both the systems and tries to locate the hurdles in achieving benefit sharing. Aware of the legal impediments caused by IPRs in the process of ABS, Chapter 5 tries to explore the linkages between IPRs and GRs and associated TK and assesses why contract-based CBD system fails before the monopoly rights under TRIPS. Chapter 6 analyses the different solutions suggested by the international community at the TRIPS Council as well as the WIPO (World Intellectual property Organisation) and examines their effectiveness. Chapter 7 concludes that considering the inability of the present IP system to understand the grass root realities of the indigenous communities as well as the varying situations of the country of origin, the best possible way to recognise the CBD goals in the TRIPS could be better achieved through linking the two instruments by means of the triple disclosure requirement in Article 29 as suggested by the Disclosure Group during the TRIPS Council deliberations. It also recommends that considering the nature of property in GR, a new section/chapter in the TRIPS dealing with GRs would be another workable solution.

Sequential interactions of Silver-silica nanocomposite (Ag-SiO2NC) with cell wall, metabolism and genetic stability of Psedomonas aeruginosa, a multiple antibiotic resistant bacterium

The study was carried out to understand the effect of silver-silica nanocomposite (Ag-SiO2NC) on the cell wall integrity, metabolism and genetic stability of Pseudomonas aeruginosa, a multiple drugresistant bacterium. Bacterial sensitivity towards antibiotics and Ag-SiO2NC was studied using standard disc diffusion and death rate assay, respectively. The effect of Ag-SiO2NC on cell wall integrity was monitored using SDS assay and fatty acid profile analysis while the effect on metabolism and genetic stability was assayed microscopically, using CTC viability staining and comet assay, respectively. P. aeruginosa was found to be resistant to β-lactamase, glycopeptidase, sulfonamide, quinolones, nitrofurantoin and macrolides classes of antibiotics. Complete mortality of the bacterium was achieved with 80 μgml-1 concentration of Ag-SiO2NC. The cell wall integrity reduced with increasing time and reached a plateau of 70 % in 110 min. Changes were also noticed in the proportion of fatty acids after the treatment. Inside the cytoplasm, a complete inhibition of electron transport system was achieved with 100 μgml-1 Ag-SiO2NC, followed by DNA breakage. The study thus demonstrates that Ag-SiO2NC invades the cytoplasm of the multiple drug-resistant P. aeruginosa by impinging upon the cell wall integrity and kills the cells by interfering with electron transport chain and the genetic stability

Sanctity of Human Life in the Context of Human Genetic Research

The study on the concept of sanctity of human life is a journey in finding out what is it said to be “human” in human life. It is an evaluation of the universal concept and the role it plays in controlling and moulding human conduct and relationships. This concept is a foundational principle of human rights law and the grundnorm of every legal system. However, of late, the challenges by way of certain advances in human genetic research had prompted the need to evaluate the significance and extent of the concept in human endeavours. Scientific advances by way of human genetic research promises significant diagnostic and therapeutic advances but at the same time pose threat to fundamental notions and assumptions on humanity, hence there is a global concern to derive common legal standards, Thus the major challenge is to analyse universal principles which can be a common criteria for evolving legal standards to control certain advances in human genetic research. Hence the relevance of the study. The study aims at analysing the content, scope, extent and limitation of the concept of sanctity of human life. In this attempt it evaluates the extent to which the concept had been accommodated by legal systems and international human rights regimes. The problem which had been undertaken in the study is the extent of intrusion made to the concept by virtue of certain advances in human genetic research.