Reinforcement learning with average cost for adaptive control of traffic lights at intersections

We propose for the first time two reinforcement learning algorithms with function approximation for average cost adaptive control of traffic lights. One of these algorithms is a version of Q-learning with function approximation while the other is a policy gradient actor-critic algorithm that incorporates multi-timescale stochastic approximation. We show performance comparisons on various network settings of these algorithms with a range of fixed timing algorithms, as well as a Q-learning algorithm with full state representation that we also implement. We observe that whereas (as expected) on a two-junction corridor, the full state representation algorithm shows the best results, this algorithm is not implementable on larger road networks. The algorithm PG-AC-TLC that we propose is seen to show the best overall performance.

Developments in amplitude-comparator techniques for distance relays

The paper reports the development of new amplitude-comparator techniques which allow the instantaneous comparison of the amplitude of the signals derived from primary line quantities. These techniques are used to derive a variety of impedance characteristics. The merits of the new relaying system are: the simple mode of the relay circuitry, the derivation of closed polar characteristics (i.e. quadrilateral) by a single measuring gate and sharp discontinuities in the polar characteristics. Design principles and circuit models in their schematic form are described and, in addition, a comprehensive theoretical basis for comparison is also presented. Dynamic test results are presented for a quadrilateral characteristic of potentially general application.

New approach to distance relays with quadrilateral polar characteristic for e.h.v.-line protection

A new technique is presented using principles of multisignal relaying for the synthesis of a universal-type quadrilateral polar characteristic. The modus operandi consists in the determination of the phase sequence of a set of voltage phasors and the provision of a trip signal for one sequence while blocking for the other. Two versions, one using ferrite-core logic and another using transistor logic, are described in detail. The former version has the merit of simplicity and has the added advantage of not requiring any d.c. supply. The unit is flexible, as it permits independent control of the characteristic along the resistance and reactance axis through suitable adjustments of replica impedance angles. The maximum operating time is about 20ms for all switching angles, and with faults within 95% of the protected section. The maximum transient overreach is about 8%.

New static 3-step distance relay

A new static 3-step distance relay based on the principle of multi-input phase comparison is described in the paper. Design principles and typical discriminating and logic circuits are described for the new relaying system. The relaying system uses semiconductor circuits throughout and features high speed and good performance. The comparator model, which effects multi-input phase comparison, has been devised to provide reliable pickup for closein faults, and to achieve an improved polar characteristic in the complex- impedance plane, which fits around only the fault area of a transmission line. Operating time of the relay is less than 1 cycle for unbalanced faults, and less than a halfcycle for 3-phase faults. Protective circuits have also been added to detect power swing and to block tripping for a predetermined number of power-swing cycles. The operating characteristics of the relay, as expressed by accuracy/range charts, are presented.

Hybrid Comparison Technique for Distance Relays

A new hybrid comparison technique for transmission line protection, providing polar characteristics marked by sharp discontinuities, has been developed. The comparator models, described in block schematic form, accompany a steady state theoretical basis for comparison. Dynamic test results are indicated for a directional quadrilateral characteristic which closely corresponds to the probable fault area of a transmission line.

New possibilities in amplitude- and phase-comparison techniques for distance relays

The paper reports further work on the amplitude-comparison technique described by the same authors in a previous paper. This technique is extended to develop improved polar characteristics. Discontinuous polar characteristics, like directional parallelograms, are obtained by a single measuring gate with a simple mode of relay circuitry, whereas two measuring gates are required to provide a directional-quadrilateral characteristic of potentially general application. The paper also describes some new possibilities in phase-comparison methods for distance-protection schemes. Comparator models which effect the amplitude and phase comparison of the relaying signals are described in their schematic form. A comprehensive theoretical basis for comparison is also presented.

Effectiveness of Series Capacitors in Long Distance Transmission Lines

The effectiveness of series capacitors used with long distance transmission lines in improving system stability is analyzed. Compensation efficiency is defined as the effectiveness of series capacitors. The influence of various factors on compensation efficiency such as capacitor location, line length, and degree of series compensation is investigated. Proper use of shunt reactors with series capacitors, in addition to limiting power frequency over- voltages, increases the maximum power transfer. Analytical expressions are included to aid in the calculation of compensation efficiency for a few typical cases. Curves are also presented indicating the critical value of shunt Mvar required for various degrees of series compensation and line lengths.

Retention Time Variability as a Mechanism for Animal Mediated Long-Distance Dispersal

Long-distance dispersal (LDD) events, although rare for most plant species, can strongly influence population and community dynamics. Animals function as a key biotic vector of seeds and thus, a mechanistic and quantitative understanding of how individual animal behaviors scale to dispersal patterns at different spatial scales is a question of critical importance from both basic and applied perspectives. Using a diffusion-theory based analytical approach for a wide range of animal movement and seed transportation patterns, we show that the scale (a measure of local dispersal) of the seed dispersal kernel increases with the organisms' rate of movement and mean seed retention time. We reveal that variations in seed retention time is a key determinant of various measures of LDD such as kurtosis (or shape) of the kernel, thinkness of tails and the absolute number of seeds falling beyond a threshold distance. Using empirical data sets of frugivores, we illustrate the importance of variability in retention times for predicting the key disperser species that influence LDD. Our study makes testable predictions linking animal movement behaviors and gut retention times to dispersal patterns and, more generally, highlights the potential importance of animal behavioral variability for the LDD of seeds.

Error, Confidence, and Cost in Engineering Computations

The questions that one should answer in engineering computations - deterministic, probabilistic/randomized, as well as heuristic - are (i) how good the computed results/outputs are and (ii) how much the cost in terms of amount of computation and the amount of storage utilized in getting the outputs is. The absolutely errorfree quantities as well as the completely errorless computations done in a natural process can never be captured by any means that we have at our disposal. While the computations including the input real quantities in nature/natural processes are exact, all the computations that we do using a digital computer or are carried out in an embedded form are never exact. The input data for such computations are also never exact because any measuring instrument has inherent error of a fixed order associated with it and this error, as a matter of hypothesis and not as a matter of assumption, is not less than 0.005 per cent. Here by error we imply relative error bounds. The fact that exact error is never known under any circumstances and any context implies that the term error is nothing but error-bounds. Further, in engineering computations, it is the relative error or, equivalently, the relative error-bounds (and not the absolute error) which is supremely important in providing us the information regarding the quality of the results/outputs. Another important fact is that inconsistency and/or near-consistency in nature, i.e., in problems created from nature is completely nonexistent while in our modelling of the natural problems we may introduce inconsistency or near-inconsistency due to human error or due to inherent non-removable error associated with any measuring device or due to assumptions introduced to make the problem solvable or more easily solvable in practice. Thus if we discover any inconsistency or possibly any near-inconsistency in a mathematical model, it is certainly due to any or all of the three foregoing factors. We do, however, go ahead to solve such inconsistent/near-consistent problems and do get results that could be useful in real-world situations. The talk considers several deterministic, probabilistic, and heuristic algorithms in numerical optimisation, other numerical and statistical computations, and in PAC (probably approximately correct) learning models. It highlights the quality of the results/outputs through specifying relative error-bounds along with the associated confidence level, and the cost, viz., amount of computations and that of storage through complexity. It points out the limitation in error-free computations (wherever possible, i.e., where the number of arithmetic operations is finite and is known a priori) as well as in the usage of interval arithmetic. Further, the interdependence among the error, the confidence, and the cost is discussed.

Antimicrobial Properties of Nanostructured TiO2 Plus Fe Additive Thin Films Synthesized by a Cost-Effective Sol-Gel Process

We prepared thin films composed of pure TiO2 or TiO2 with an Fe additive (at concentrations of 0.2-0.8 wt%) via a simple and cost effective sol gel process, and tested their antifungal properties (against Candida albicans (MTCC-1637), Candida tropicalis (MTCC-184), Candida parapsilosis (MTCC-2509), and Candida glabrata (MTCC-3019) and antibacterial properties (against Staphylococcus faecalis (NCIM-2604) Staphylococcus epidermidis (NCIM-2493), Staphylococcus aureus (NCIL-2122), and Bacillus subtilis (NCIM-2549)). The films were deposited on glass and Si substrates and subjected to annealing at 400 degrees C for 3 h in ambient air. The film structural and morphological properties were investigated by X-ray photoelectron spectroscopy profilometry and scanning electron microscopy, respectively. Antifungal and antibacterial tests were conducted using the drop test method. Among the species examined, Candida albicans (MTCC-1637), and Staphylococcus aureus (NCIL-2122) showed complete colony formation inhibition after exposure for 4 h for the TiO2 loaded with 0.8 wt% Fe thin films. These results indicate that increasing the Fe concentration increased the antimicrobial activity, with complete inhibition of colony formation after 4 h exposure.

External-cavity semiconductor laser sensor

The spectral characteristics of a diode laser are significantly affected due to interference caused between the laser diode output and the optical feedback in the external-cavity. This optical feedback effect is of practical use for linewidth reduction, tuning or for sensing applications. A sensor based on this effect is attractive due to its simplicity, low cost and compactness. This optical sensor has been used so far, in different configuration such as for sensing displacement induced by different parameters. In this paper we report a compact optical sensor consisting of a semiconductor laser coupled to an external cavity. Theoretical analysis of the self- mixing interference for optical sensing applications is given for moderate optical feedback case. A comparison is made with our experimental observations. Experimental results are in good agreement with the simulated power modulation based on self-mixing interference theory. Displacements as small as 10-4 nm have been measured using this sensor. The developed sensor showed a fringe sensitivity of one fringe per 400nm displacement for reflector distance of around 10cms. The sensor has also been tested for magnetic field and temperature induced displacement measurements.

Optical, electrical and structural characterization of ZnO:Al thin films prepared by a low cost sol-gel method

ZnO:Al thin films were prepared on glass and silicon substrates by the sol-gel spin coating method. The x-ray diffraction (XRD) results showed that a polycrystalline phase with a hexagonal structure appeared after annealing at 400 degrees C for 1 h. The transmittance increased from 91 to about 93% from pure ZnO films to ZnO film doped with 1 wt% Al and then decreased for 2 wt% Al. The optical band gap energy increased as the doping concentration was increased from 0.5 wt% to 1 wt% Al. The metal oxide semiconductor (MOS) capacitors were fabricated using ZnO films deposited on silicon (100) substrates and electrical properties such as current versus voltage (I-V) and capacitance versus voltage (C-V) characteristics were studied. The electrical resistivity decreased and the leakage current increased with an increase of annealing temperature. The dielectric constant was found to be 3.12 measured at 1 MHz. The dissipation value for the film annealed at 300 degrees C was found to be 3.1 at 5 V. (C) 2011 Elsevier Ltd. All rights reserved.

Knowledge-Based Approach Using Support Vector Machine for Transmission Line Distance Relay Co-ordination

In this paper, knowledge-based approach using Support Vector Machines (SVMs) are used for estimating the coordinated zonal settings of a distance relay. The approach depends on the detailed simulation studies of apparent impedance loci as seen by distance relay during disturbance, considering various operating conditions including fault resistance. In a distance relay, the impedance loci given at the relay location is obtained from extensive transient stability studies. SVMs are used as a pattern classifier for obtaining distance relay co-ordination. The scheme utilizes the apparent impedance values observed during a fault as inputs. An improved performance with the use of SVMs, keeping the reach when faced with different fault conditions as well as system power flow changes, are illustrated with an equivalent 265 bus system of a practical Indian Western Grid.

Optimal placement of Distributed Generation for a projected load increase using Relative Electrical Distance approach

There is a lot of pressure on all the developed and second world countries to produce low emission power and distributed generation (DG) is found to be one of the most viable ways to achieve this. DG generally makes use of renewable energy sources like wind, micro turbines, photovoltaic, etc., which produce power with minimum green house gas emissions. While installing a DG it is important to define its size and optimal location enabling minimum network expansion and line losses. In this paper, a methodology to locate the optimal site for a DG installation, with the objective to minimize the net transmission losses, is presented. The methodology is based on the concept of relative electrical distance (RED) between the DG and the load points. This approach will help to identify the new DG location(s), without the necessity to conduct repeated power flows. To validate this methodology case studies are carried out on a 20 node, 66kV system, a part of Karnataka Transco and results are presented.