Reinforcement Learning Approaches to Power System Scheduling

One major component of power system operation is generation scheduling. The objective of the work is to develop efficient control strategies to the power scheduling problems through Reinforcement Learning approaches. The three important active power scheduling problems are Unit Commitment, Economic Dispatch and Automatic Generation Control. Numerical solution methods proposed for solution of power scheduling are insufficient in handling large and complex systems. Soft Computing methods like Simulated Annealing, Evolutionary Programming etc., are efficient in handling complex cost functions, but find limitation in handling stochastic data existing in a practical system. Also the learning steps are to be repeated for each load demand which increases the computation time.Reinforcement Learning (RL) is a method of learning through interactions with environment. The main advantage of this approach is it does not require a precise mathematical formulation. It can learn either by interacting with the environment or interacting with a simulation model. Several optimization and control problems have been solved through Reinforcement Learning approach. The application of Reinforcement Learning in the field of Power system has been a few. The objective is to introduce and extend Reinforcement Learning approaches for the active power scheduling problems in an implementable manner. The main objectives can be enumerated as:(i) Evolve Reinforcement Learning based solutions to the Unit Commitment Problem.(ii) Find suitable solution strategies through Reinforcement Learning approach for Economic Dispatch. (iii) Extend the Reinforcement Learning solution to Automatic Generation Control with a different perspective. (iv) Check the suitability of the scheduling solutions to one of the existing power systems.First part of the thesis is concerned with the Reinforcement Learning approach to Unit Commitment problem. Unit Commitment Problem is formulated as a multi stage decision process. Q learning solution is developed to obtain the optimwn commitment schedule. Method of state aggregation is used to formulate an efficient solution considering the minimwn up time I down time constraints. The performance of the algorithms are evaluated for different systems and compared with other stochastic methods like Genetic Algorithm.Second stage of the work is concerned with solving Economic Dispatch problem. A simple and straight forward decision making strategy is first proposed in the Learning Automata algorithm. Then to solve the scheduling task of systems with large number of generating units, the problem is formulated as a multi stage decision making task. The solution obtained is extended in order to incorporate the transmission losses in the system. To make the Reinforcement Learning solution more efficient and to handle continuous state space, a fimction approximation strategy is proposed. The performance of the developed algorithms are tested for several standard test cases. Proposed method is compared with other recent methods like Partition Approach Algorithm, Simulated Annealing etc.As the final step of implementing the active power control loops in power system, Automatic Generation Control is also taken into consideration.Reinforcement Learning has already been applied to solve Automatic Generation Control loop. The RL solution is extended to take up the approach of common frequency for all the interconnected areas, more similar to practical systems. Performance of the RL controller is also compared with that of the conventional integral controller.In order to prove the suitability of the proposed methods to practical systems, second plant ofNeyveli Thennal Power Station (NTPS IT) is taken for case study. The perfonnance of the Reinforcement Learning solution is found to be better than the other existing methods, which provide the promising step towards RL based control schemes for practical power industry.Reinforcement Learning is applied to solve the scheduling problems in the power industry and found to give satisfactory perfonnance. Proposed solution provides a scope for getting more profit as the economic schedule is obtained instantaneously. Since Reinforcement Learning method can take the stochastic cost data obtained time to time from a plant, it gives an implementable method. As a further step, with suitable methods to interface with on line data, economic scheduling can be achieved instantaneously in a generation control center. Also power scheduling of systems with different sources such as hydro, thermal etc. can be looked into and Reinforcement Learning solutions can be achieved.

An evaluation of Primary health care system in Kerala

The thesis entitled An Evaluation of Primary Health Care System in Kerala. The present study is intended to examine the working of primary health care system and its impact on the health status of people. The hypothesis tested in the thesis includes, a. The changes in the health profile require reallocation of resources of primary health care system, b. Rate of utilization depends on the quality of services provided by primary health centers, and c. There is a significant decline in the operational efficiency of the primary health care system. The major elements of primary health care stated in the report of AlmaAta International Conference on Primary Health Care (WHO, 1994)” is studied on the basis of the classification of the elements in to three: Preventive, Promotive, and Curative measures. Preventive measures include Maternal and Child Health Care including family Planning. Provision of water and sanitation is reviewed under promotive measures. Curative measures are studied using the disease profile of the study area. Collection of primary data was done through a sample survey, using pre-tested interview schedule of households of the study area. Multi stage random sampling design was used for selecting the sample. The design of the present study is both descriptive and analytical in nature. As far as the analytical tools are concerned, growth index, percentages, ratios, rates, time series analysis, analysis of variance, chi square test, Z test were used for analyzing the data. Present study revealed that no one in these areas was covered under any type of health insurance. Conclusion states that considering the present changes in the health profile, traditional pattern of resource allocation should be altered to meet the urgent health care needs of the people. Preventive and promotive measures like health education for giving awareness among people to change health habits, diet pattern, life style etc. are to be developed. Proper diagnosis and treatment of the disease at the beginning of the stage itself may help to cure majority of disease. For that, Public health policy must ensure the primary health care as enunciated at Alma- Ata international Conference. At the same time Public health is not to be treated as the sole responsibility of the government. Active community participation is an essential means to attain the goals.

Numerical Simulation of Two-Part Underwater Towing System

The motion instability is an important issue that occurs during the operation of towed underwater vehicles (TUV), which considerably affects the accuracy of high precision acoustic instrumentations housed inside the same. Out of the various parameters responsible for this, the disturbances from the tow-ship are the most significant one. The present study focus on the motion dynamics of an underwater towing system with ship induced disturbances as the input. The study focus on an innovative system called two-part towing. The methodology involves numerical modeling of the tow system, which consists of modeling of the tow-cables and vehicles formulation. Previous study in this direction used a segmental approach for the modeling of the cable. Even though, the model was successful in predicting the heave response of the tow-body, instabilities were observed in the numerical solution. The present study devises a simple approach called lumped mass spring model (LMSM) for the cable formulation. In this work, the traditional LMSM has been modified in two ways. First, by implementing advanced time integration procedures and secondly, use of a modified beam model which uses only translational degrees of freedoms for solving beam equation. A number of time integration procedures, such as Euler, Houbolt, Newmark and HHT-α were implemented in the traditional LMSM and the strength and weakness of each scheme were numerically estimated. In most of the previous studies, hydrodynamic forces acting on the tow-system such as drag and lift etc. are approximated as analytical expression of velocities. This approach restricts these models to use simple cylindrical shaped towed bodies and may not be applicable modern tow systems which are diversed in shape and complexity. Hence, this particular study, hydrodynamic parameters such as drag and lift of the tow-system are estimated using CFD techniques. To achieve this, a RANS based CFD code has been developed. Further, a new convection interpolation scheme for CFD simulation, called BNCUS, which is blend of cell based and node based formulation, was proposed in the study and numerically tested. To account for the fact that simulation takes considerable time in solving fluid dynamic equations, a dedicated parallel computing setup has been developed. Two types of computational parallelisms are explored in the current study, viz; the model for shared memory processors and distributed memory processors. In the present study, shared memory model was used for structural dynamic analysis of towing system, distributed memory one was devised in solving fluid dynamic equations.

Ecotoxicological Assessment of Antifouling Biocides in the Sediments of Cochin Estuarine System

The pollutants discharged into the estuaries are originate from two main sources-industrial and sewage. The former may be toxic which includes heavy metals, residues from antifouling paint particles and pesticides, while large discharges of sewage will contain pathogenic microorganisms. The contamination is enough to destroy the amenities of the waterfront, and the toxic substances may completely destroy the marine life and damage to birds, fishes and other marine organisms. Antifouling biocides are a type of chemical used in marine structure to prevent biofouling. These antifouling biocides gradually leach from the ships and other marine structures into water and finally settled in sediments. Once a saturation adsorption is reached they desorbed into overlying water and causes threat to marine organisms. Previous reports explained the imposex and shell thickening in bivalves owing to the effect of biocides. So bivalves are used as indicator organisms to understand the status of pollution. The nervous system is one of the best body part to understand the effect of toxicant. Acetylcholine esterase enzyme which is the main neurotransmitter in nervous was used to understand the effect of pollutants. Present study uses Acetylcholine esterase enzyme as pollution monitoring indicator

RNS based programmable multi-mode decimation filter for WCDMA and WiMAX

The recent trends envisage multi-standard architectures as a promising solution for the future wireless transceivers to attain higher system capacities and data rates. The computationally intensive decimation filter plays an important role in channel selection for multi-mode systems. An efficient reconfigurable implementation is a key to achieve low power consumption. To this end, this paper presents a dual-mode Residue Number System (RNS) based decimation filter which can be programmed for WCDMA and 802.16e standards. Decimation is done using multistage, multirate finite impulse response (FIR) filters. These FIR filters implemented in RNS domain offers high speed because of its carry free operation on smaller residues in parallel channels. Also, the FIR filters exhibit programmability to a selected standard by reconfiguring the hardware architecture. The total area is increased only by 24% to include WiMAX compared to a single mode WCDMA transceiver. In each mode, the unused parts of the overall architecture is powered down and bypassed to attain power saving. The performance of the proposed decimation filter in terms of critical path delay and area are tabulated.

Decimation Filter Design Toolbox for Multi-Standard Wireless Transceivers using MATLAB.

The demand for new telecommunication services requiring higher capacities, data rates and different operating modes have motivated the development of new generation multi-standard wireless transceivers. A multi-standard design often involves extensive system level analysis and architectural partitioning, typically requiring extensive calculations. In this research, a decimation filter design tool for wireless communication standards consisting of GSM, WCDMA, WLANa, WLANb, WLANg and WiMAX is developed in MATLAB® using GUIDE environment for visual analysis. The user can select a required wireless communication standard, and obtain the corresponding multistage decimation filter implementation using this toolbox. The toolbox helps the user or design engineer to perform a quick design and analysis of decimation filter for multiple standards without doing extensive calculation of the underlying methods.

Design and Development of a Remotely Operated Underwater Multi-Robot Manipulator Controller

For the scientific and commercial utilization of Ocean resources, the role of intelligent underwater robotic systems are of great importance. Scientific activities like Marine Bio-technology, Hydrographic mapping, and commercial applications like Marine mining, Ocean energy, fishing, aquaculture, cable laying and pipe lining are a few utilization of ocean resources. As most of the deep undersea exploration are beyond the reachability of divers and also as the use of operator controlled and teleoperated Remotely Operated Vehicles (ROVs) and Diver Transport Vehicles (DTVs) turn out to be highly inefficient, it is essential to have a fully automated system capable providing stable control and communication links for the unstructured undersea environment.

Improved Biometric Authentication System Using Multimodal Cue Integration

Biometrics is an efficient technology with great possibilities in the area of security system development for official and commercial applications. The biometrics has recently become a significant part of any efficient person authentication solution. The advantage of using biometric traits is that they cannot be stolen, shared or even forgotten. The thesis addresses one of the emerging topics in Authentication System, viz., the implementation of Improved Biometric Authentication System using Multimodal Cue Integration, as the operator assisted identification turns out to be tedious, laborious and time consuming. In order to derive the best performance for the authentication system, an appropriate feature selection criteria has been evolved. It has been seen that the selection of too many features lead to the deterioration in the authentication performance and efficiency. In the work reported in this thesis, various judiciously chosen components of the biometric traits and their feature vectors are used for realizing the newly proposed Biometric Authentication System using Multimodal Cue Integration. The feature vectors so generated from the noisy biometric traits is compared with the feature vectors available in the knowledge base and the most matching pattern is identified for the purpose of user authentication. In an attempt to improve the success rate of the Feature Vector based authentication system, the proposed system has been augmented with the user dependent weighted fusion technique.

Many-body theory of laser-induced ultrafast demagnetization and angular momentum transfer in ferromagnetic transition metals

An electronic theory is developed, which describes the ultrafast demagnetization in itinerant ferromagnets following the absorption of a femtosecond laser pulse. The present work intends to elucidate the microscopic physics of this ultrafast phenomenon by identifying its fundamental mechanisms. In particular, it aims to reveal the nature of the involved spin excitations and angular-momentum transfer between spin and lattice, which are still subjects of intensive debate. In the first preliminary part of the thesis the initial stage of the laser-induced demagnetization process is considered. In this stage the electronic system is highly excited by spin-conserving elementary excitations involved in the laser-pulse absorption, while the spin or magnon degrees of freedom remain very weakly excited. The role of electron-hole excitations on the stability of the magnetic order of one- and two-dimensional 3d transition metals (TMs) is investigated by using ab initio density-functional theory. The results show that the local magnetic moments are remarkably stable even at very high levels of local energy density and, therefore, indicate that these moments preserve their identity throughout the entire demagnetization process. In the second main part of the thesis a many-body theory is proposed, which takes into account these local magnetic moments and the local character of the involved spin excitations such as spin fluctuations from the very beginning. In this approach the relevant valence 3d and 4p electrons are described in terms of a multiband model Hamiltonian which includes Coulomb interactions, interatomic hybridizations, spin-orbit interactions, as well as the coupling to the time-dependent laser field on the same footing. An exact numerical time evolution is performed for small ferromagnetic TM clusters. The dynamical simulations show that after ultra-short laser pulse absorption the magnetization of these clusters decreases on a time scale of hundred femtoseconds. In particular, the results reproduce the experimentally observed laser-induced demagnetization in ferromagnets and demonstrate that this effect can be explained in terms of the following purely electronic non-adiabatic mechanism: First, on a time scale of 10–100 fs after laser excitation the spin-orbit coupling yields local angular-momentum transfer between the spins and the electron orbits, while subsequently the orbital angular momentum is very rapidly quenched in the lattice on the time scale of one femtosecond due to interatomic electron hoppings. In combination, these two processes result in a demagnetization within hundred or a few hundred femtoseconds after laser-pulse absorption.

Growing through Connections – A Multi-Case Study of Two Alternative Food Networks in Cluj-Napoca, Romania

In a context of urgent global socio-ecological challenges, the aim of this paper has been to explore the potential of localised and socially connected food systems. More specifically, through a multi-case study of two alternative food networks in the city of Cluj-Napoca, Romania, their contribution to a sustainable food paradigm has been explored. An important synergy within the networks is how good food is equated with peasant produce, but issues regarding quantity, delivery arrangement, power relations and inclusiveness constitute potential conflicts. Although challenged by unfavourable trends on national and EU levels, the networks are becoming more embedded horizontally, through an intrinsic focus on community in one case and through quality food stimulating good relations in the other case. The networks contribute to a sustainable food paradigm by promoting agroecology, by reclaiming socio-cultural factors of food provisioning and by being part of a (re)-peasantisation process. Exploring how these kinds of initiatives can emerge, be sustained and be developed is of relevance, especially considering their potential for improving the prospects of environmentally sustainable and socially just futures in Romania and beyond.

The Koundoum sheep breed in Niger: morpho-biometric study and description of the production system

The diffusion of highly productive breeds across developing countries goes along with a neglect of indigenous breeds, which are well suited to their environment but often show low yields. Thus, in Niger, the flock of Koundoum sheep are rapidly decreasing. The Koundoum is one of the few wool sheep breeds of Africa and shows important adaptive feature to its native environment, i.e. the humid pastures on the banks of the Niger River. To characterise the breed and to understand its production context, a survey has been conducted in 104 herds in four communes along the Niger River (Kollo, Tillabery, Say and Tera). Nine body measurements, including live weight, were taken on 180 adult sheep (101 females and 79 males). The herds varied from 2 to 60 heads, with a median size of eight animals and two thirds of the herds having less than 10 animals. Mainly fed on natural pastures, 85.6% of the herds received crop residues. Only natural mating was practiced. Veterinary care was restricted to anti-helminthic and some indigenous treatments. The frequent affiliation of breeders to professional unions appeared as favourable to the implementation of a collective conservation program. The Koundoum sheep were white or black coated, with the black colour being most frequent (75.6%). Wattles were present in both sexes at similar frequencies of around 14%. All biometric variables were significantly and positively correlated between them. The thoracic perimeter showed the best correlation with live weight in both males and females. Three variables were selected for live weight prediction: thoracic perimeter, height at withers and rump length. From the present study, it is expected that the in situ conservation of the Koundoum sheep will be highly problematic, due to lack of market opportunities for wool and the willingness of smallholders to get involved in pure Koundoum rearing.

An integrated assessment of resource use strategies in the Borana pastoral system of southern Ethiopia

In the pastoral production systems, mobility remains the main technique used to meet livestock’s fodder requirements. Currently, with growing challenges on the pastoral production systems, there is urgent need for an in-depth understanding of how pastoralists continue to manage their grazing resources and how they determine their mobility strategies. This study examined the Borana pastoralists’ regulation of access to grazing resources, mobility practices and cattle reproductive performances in three pastoral zones of Borana region of southern Ethiopia. The central objective of the study was to contribute to the understanding of pastoral land use strategies at a scale relevant to their management. The study applied a multi-scalar methodological approach that allowed zooming in from communal to individual herd level. Through participatory mapping that applied Google Earth image print out as visual aid, the study revealed that the Borana pastoralists conceptualized their grazing areas as distinctive grazing units with names, borders, and specific characteristics. This knowledge enables the herders to communicate the condition of grazing resources among themselves in a precise way which is important in management of livestock mobility. Analysis of grazing area use from the participatory maps showed that the Borana pastoralists apportion their grazing areas into categories that are accessed at different times of the year (temporal use areas). This re-organization is an attempt by the community to cope with the prevailing constraints which results in fodder shortages especially during the dry periods. The re-organization represents a shift in resource use system, as the previous mobility practice across the ecologically varied zones of the rangelands became severely restricted. Grazing itineraries of 91 cattle herds for over 16 months obtained using the seasonal calendar interviews indicated that in the areas with the severest mobility constraints, the herders spent most of their time in the year round use areas that are within close proximity to the settlements. A significant change in mobility strategy was the disallowing of foora practice by the communities in Dirre and Malbe zones in order to reduce competition. With the reduction in mobility practices, there is a general decline in cattle reproductive parameters with the areas experiencing the severest constraints showing the least favourable reproductive performances. The study concludes that the multi-scalar methodology was well suited to zoom into pastoral grazing management practices from communal to individual herd levels. Also the loss of mobility in the Borana pastoral system affects fulfilment of livestock feed requirements thus resulting in reduced reproductive performances and herd growth potentials. While reversal of the conditions of the situations in the Borana rangelands is practically unfeasible, the findings from this research underscore the need to protect the remaining pastoral lands since the pastoral production system remains the most important livelihood option for the majority of the Borana people. In this regards the study emphasises the need to adopt and domesticate regional and international policy frameworks such as that proposed by the African Union in 2010.

Design and Control of an Anthropomorphic Robotic Finger with Multi-point Tactile Sensation

The goal of this research is to develop the prototype of a tactile sensing platform for anthropomorphic manipulation research. We investigate this problem through the fabrication and simple control of a planar 2-DOF robotic finger inspired by anatomic consistency, self-containment, and adaptability. The robot is equipped with a tactile sensor array based on optical transducer technology whereby localized changes in light intensity within an illuminated foam substrate correspond to the distribution and magnitude of forces applied to the sensor surface plane. The integration of tactile perception is a key component in realizing robotic systems which organically interact with the world. Such natural behavior is characterized by compliant performance that can initiate internal, and respond to external, force application in a dynamic environment. However, most of the current manipulators that support some form of haptic feedback either solely derive proprioceptive sensation or only limit tactile sensors to the mechanical fingertips. These constraints are due to the technological challenges involved in high resolution, multi-point tactile perception. In this work, however, we take the opposite approach, emphasizing the role of full-finger tactile feedback in the refinement of manual capabilities. To this end, we propose and implement a control framework for sensorimotor coordination analogous to infant-level grasping and fixturing reflexes. This thesis details the mechanisms used to achieve these sensory, actuation, and control objectives, along with the design philosophies and biological influences behind them. The results of behavioral experiments with a simple tactilely-modulated control scheme are also described. The hope is to integrate the modular finger into an %engineered analog of the human hand with a complete haptic system.

Alteraciones en el material genético de pintores de carros expuestos a solventes orgánicos en una localidad de Bogotá

Los solventes orgánicos son sustancias químicas que por sus propiedades físico-químicas son fácilmente inhalados o absorbidos por la piel, pueden causar daños de diversa índole en la salud. En Colombia existen normas que contemplan las medidas de protección, sin embargo persiste la informalidad en el sector de pintores de autos, por lo cual los trabajadores expuestos, a largo plazo pueden ver afectada su salud. En este estudio se analizó la relación entre individuos expuestos laboralmente a los solventes orgánicos versus no expuestos con respecto a la longitud de sus telómeros y formación de fragilidades. Se emplearon muestras de sangre extraídas por venopunción, recolectada en dos tubos: uno con Heparina, destinado al cultivo de linfocitos, para obtener cromosomas metafásicos y evaluar en ellos la presencia de fragilidades; el otro tubo con EDTA, fue empleado para la extracción de ADN y se utilizó para obtener los valores de longitud telomérica mediante la técnica de PCR cuantitativa. Los análisis estadísticos se realizaron aplicando la prueba de rangos de Wilcoxon, en el caso de la presencia de fragilidades se analizó la razón No.Fragilidades/No.Metafases, aplicando el método de Wilcoxon se encontró que existe diferencia estadísticamente significativa entre expuestos y no expuestos (p = 0,036), en donde los expuestos presentan mayor frecuencia de fragilidades. Por otra parte el valor relativo de longitud telomérica del grupo de expuestos fue mayor que el observado en el grupo de no expuestos, esta diferencia fue estadísticamente significativa (Wilcoxon, p = 0.002).

Resonancia magnética cardiaca: medidas lineales y volumétricas en adultos sanos

Introducción: La gran mayoría de las medidas de normalidad utilizadas para la interpretación de resonancia cardiaca son extrapoladas de las medidas de ecocardiografía. Los limitados registros de medidas de normalidad se encuentran ajustados en poblaciones extranjeras, no hay registros en latinoamericanos. Objetivo: Determinar las dimensiones cardiacas utilizando resonancia magnética en una población de personas sin antecedente médicos con repercusión cardiaca para lograr una muestra de valores que permitan ajustar las medidas de normalidad utilizadas por nuestro servicio. Materiales y métodos: se analizaron 45 sujetos sanos con edad comprendida entre los 21 y 45 años, las adquisiciones se realizaron utilizando un equipo de RM de 1,5 teslas, el análisis de las imágenes se realizó mediante el programa Cardiac Volume Vx. Se evaluaron múltiples parámetros morfofuncionales a través de análisis estadístico por medio del sistema SPSS versión 23. Resultados: Mediciones obtenidas de ventrículo izquierdo principales fueron volumen diastólico en mujeres de 62 ml +/- 7.1 y en hombres de 65 ml +/- 11.2 y fracción de eyección de 60 % +/- 5 en mujeres y de 62 % +/- 9 en hombres. En ventrículo derecho el volumen diastólico final se encontró 81.8 ml +/- 14.6 en mujeres y 100 ml +/- 24.8 en hombres y fracción de eyección de 53 % +/- 17 en mujeres y de 45 % +/- 12 en hombres. Volumen de fin de diástole de 50 +/- 12.7 ml en mujeres y de 49 ml +/- 19 ml en hombres y fracción de eyección de aurícula izquierda de 55 % +/- 0.08 en mujeres y de 50 % +/- 0.07 en hombres. Volumen de fin de diástole de 44.1 ml +/- 18.5 en mujeres y de 49.2 ml +/- 22.9 en hombres y fracción de eyección de aurícula derecha de 50 % +/- 11 en mujeres y de 45 % +/- 8 en hombres. Se obtuvieron otras medidas lineales y volumétricas adicionales de cavidades cardiacas y de grandes vasos supracardiacos. Conclusiones: se describen los valores de referencia de los parámetros morfofuncionales de las cavidades cardiacas y de vasos supracardiacos. El sexo fue tenido en cuenta como covariable relacionada con la modificación de los parámetros evaluados. Se sugieren variaciones en las medidas de cavidades cardiacas para la población estudiada relacionada con aclimatación crónica a la altitud de la ciudad de Bogotá.