Reinforcement learning with average cost for adaptive control of traffic lights at intersections

We propose for the first time two reinforcement learning algorithms with function approximation for average cost adaptive control of traffic lights. One of these algorithms is a version of Q-learning with function approximation while the other is a policy gradient actor-critic algorithm that incorporates multi-timescale stochastic approximation. We show performance comparisons on various network settings of these algorithms with a range of fixed timing algorithms, as well as a Q-learning algorithm with full state representation that we also implement. We observe that whereas (as expected) on a two-junction corridor, the full state representation algorithm shows the best results, this algorithm is not implementable on larger road networks. The algorithm PG-AC-TLC that we propose is seen to show the best overall performance.

A mostly-digital analog scan-out chain for low bandwidth voltage measurement for analog IP test

A method of precise measurement of on-chip analog voltages in a mostly-digital manner, with minimal overhead, is presented. A pair of clock signals is routed to the node of an analog voltage. This analog voltage controls the delay between this pair of clock signals, which is then measured in an all-digital manner using the technique of sub-sampling. This sub-sampling technique, having measurement time and accuracy trade-off, is well suited for low bandwidth signals. This concept is validated by designing delay cells, using current starved inverters in UMC 130nm CMOS process. Sub-mV accuracy is demonstrated for a measurement time of few seconds.

Fuzzy inference based data preprocessing for VBR video traffic prediction

Prediction of variable bit rate compressed video traffic is critical to dynamic allocation of resources in a network. In this paper, we propose a technique for preprocessing the dataset used for training a video traffic predictor. The technique involves identifying the noisy instances in the data using a fuzzy inference system. We focus on three prediction techniques, namely, linear regression, neural network and support vector regression and analyze their performance on H.264 video traces. Our experimental results reveal that data preprocessing greatly improves the performance of linear regression and neural network, but is not effective on support vector regression.

Measurement of probability-distribution functions sensitive technique for the study of conduction phenomena in liquid dielectrics

The paper outlines a technique for sensitive measurement of conduction phenomena in liquid dielectrics. The special features of this technique are the simplicity of the electrical system, the inexpensive instrumentation and the high accuracy. Detection, separation and analysis of a random function of current that is superimposed on the prebreakdown direct current forms the basis of this investigation. In this case, prebreakdown direct current is the output data of a test cell with large electrodes immersed in a liquid medium subjected to high direct voltages. Measurement of the probability-distribution function of a random fluctuating component of current provides a method that gives insight into the mechanism of conduction in a liquid medium subjected to high voltages and the processes that are responsible for the existence of the fluctuating component of the current.

Influence of surge impedance of the connecting lead in response time measurement of u.h.v. damped capacitive voltage dividers

In the determination of the response time of u.h.v. damped capacitive impulse voltage dividers using the CIGRE IMR-1MS group (1) method and the arrangement suggested by the International Electrotechnical Commission (the I EC square loop),the surge impedance of the connecting lead has been found to influence the accuracy of determination. To avoid this difficulty,a new graphical procedure is proposed. As this method uses only those data points which can be determined with good accuracy, errors in response-time area evaluation do not influence the result.

Assessment of estrus cyclicity in the Asian elephant (Elephas maximus) by measurement of fecal progesterone metabolite 5 alpha-P-3OH, using a non-invasive assay

Reproductive management of the Asian elephant (Elephas maximus) is important for its conservation. To monitor its estrous cyclicity, we earlier used an indirect ELISA to show that levels of fecal progesterone (P(4))-metabolite (allopregnanolone: 5 alpha-P-3OH) in semi-captive females sampled randomly positively correlated with serum P(4) levels [12]. In this longitudinal study (51 weeks), we measured levels of fecal 5 alpha-P-3OH and serum P(4) in seven semi-captive female elephants. Females exhibited three types of hormonal profiles. Four females showed cyclical patterns of fecal 5 alpha-P-3OH and serum P(4) typical of normal estrous cycles, two showed acyclic pattern while one showed high values indicative of a pregnant animal. Values for anestrous or follicular phases were <= 0.3 mu g g(-1), (5 alpha-P-3OH) and <= 0.3 ng mL(-1) (P(4)); for luteal phase 0.32-11.09 mu g g(-1) (5 alpha-P-3OH) and 0.32-1.48 ng mL(-1) (P(4)); for pregnancy 1.41-7.38 mu g g(-1) (5 alpha-P-3OH) and 0.39-1.6 ng mL(-1) (R(4)). A positive correlation (t = 8.8, p < 0.01, n = 321) between levels of fecal 5 alpha-P-3OH and serum P4 was observed. A random sample of 30 free-ranging female elephants showed fecal 5 alpha-P-3OH values of 0.06-23.4 mu g g(-1), indicating them to be in different stages of estrous cyclicity. This study is the first to assess the reproductive phases of female Asian elephants based on the correlative-patterns of both the fecal 5 alpha-P-3OH and serum P(4) values over multiple estrous cycles. This has a potential application in the reproductive management and conservation of Asian elephants. (C) 2011 Elsevier Inc. All rights reserved.

Estimation of Series Capacitance of a Transformer Winding Based on Frequency-Response Data: An Indirect Measurement Approach

A novel procedure to determine the series capacitance of a transformer winding, based on frequency-response measurements, is reported. It is based on converting the measured driving-point impedance magnitude response into a rational function and thereafter exploiting the ratio of a specific coefficient in the numerator and denominator polynomial, which leads to the direct estimation of series capacitance. The theoretical formulations are derived for a mutually coupled ladder-network model, followed by sample calculations. The results obtained are accurate and its feasibility is demonstrated by experiments on model-coil and on actual, single, isolated transformer windings (layered, continuous disc, and interleaved disc). The authors believe that the proposed method is the closest one can get to indirectly measuring series capacitance.

Traffic Profiling for Efficient Network Resource Utilization.

Traffic Engineering has been the prime concern for Internet Service Providers (ISPs), with the main focus being minimization of over-utilization of network capacity even though additional capacity is available which is under-utilized, Furthermore, requirements of timely delivery of digitized audiovisual information raises a new challenge of finding a path meeting these requirements. This paper addresses the issue of (a) distributing load to achieve global efficiency in resource utilization. (b) Finding a path satisfying the real time requirements of, delay and bandwidth requested by the applications. In this paper we do a critical study of the link utilization that varies over time and determine the time interval during which the link occupancy remains constant across days. This information helps in pre-determining link utilization that is useful in balancing load in the network Finally, we run simulations that use a dynamic time interval for profiling traffic and show improvement in terms number of calls admitted/blocked.

Performance of cellular CDMA with voice/data traffic with an SIR based admission control

We analyze the performance of an SIR based admission control strategy in cellular CDMA systems with both voice and data traffic. Most studies In the current literature to estimate CDMA system capacity with both voice and data traf-Bc do not take signal-tlFlnterference ratio (SIR) based admission control into account In this paper, we present an analytical approach to evaluate the outage probability for voice trafllc, the average system throughput and the mean delay for data traffic for a volce/data CDMA system which employs an SIR based admission controL We show that for a dataaniy system, an improvement of about 25% In both the Erlang capacity as well as the mean delay performance is achieved with an SIR based admission control as compared to code availability based admission control. For a mixed voice/data srtem with 10 Erlangs of voice traffic, the Lmprovement in the mean delay performance for data Is about 40%.Ah, for a mean delay of 50 ms with 10 Erlangs voice traffic, the data Erlang capacity improves by about 9%.

Real-time monitoring of critical nodes with minimal number of Phasor Measurement Units

This paper presents a method for placement of Phasor Measurement Units, ensuring the monitoring of vulnerable buses which are obtained based on transient stability analysis of the overall system. Real-time monitoring of phase angles across different nodes, which indicates the proximity to instability, the very purpose will be well defined if the PMUs are placed at buses which are more vulnerable. The issue is to identify the key buses where the PMUs should be placed when the transient stability prediction is taken into account considering various disturbances. Integer Linear Programming technique with equality and inequality constraints is used to find out the optimal placement set with key buses identified from transient stability analysis. Results on IEEE-14 bus system are presented to illustrate the proposed approach.

Measurement and Applications of Long-Range Heteronuclear Scalar Couplings: Recent Experimental and Theoretical Developments

The use of long-range heteronuclear couplings, in association with 1H1H scalar couplings and NOE restraints, has acquired growing importance for the determination of the relative stereochemistry, and structural and conformational information of organic and biological molecules. However, the routine use of such couplings is hindered by the inherent difficulties in their measurement. Prior to the advancement in experimental techniques, both long-range homo- and heteronuclear scalar couplings were not easily accessible, especially for very large molecules. The development of a large number of multidimensional NMR experimental methodologies has alleviated the complications associated with the measurement of couplings of smaller strengths. Subsequent application of these methods and the utilization of determined J-couplings for structure calculations have revolutionized this area of research. Problems in organic, inorganic and biophysical chemistry have also been solved by utilizing the short- and long-range heteronuclear couplings. In this minireview, we discuss the advantages and limitations of a number of experimental techniques reported in recent times for the measurement of long-range heteronuclear couplings and a few selected applications of such couplings. This includes the study of medium- to larger-sized molecules in a variety of applications, especially in the study of hydrogen bonding in biological systems. The utilization of these couplings in conjunction with theoretical calculations to arrive at conclusions on the hyperconjugation, configurational analysis and the effect of the electronegativity of the substituents is also discussed.