Reinforcement learning with average cost for adaptive control of traffic lights at intersections

We propose for the first time two reinforcement learning algorithms with function approximation for average cost adaptive control of traffic lights. One of these algorithms is a version of Q-learning with function approximation while the other is a policy gradient actor-critic algorithm that incorporates multi-timescale stochastic approximation. We show performance comparisons on various network settings of these algorithms with a range of fixed timing algorithms, as well as a Q-learning algorithm with full state representation that we also implement. We observe that whereas (as expected) on a two-junction corridor, the full state representation algorithm shows the best results, this algorithm is not implementable on larger road networks. The algorithm PG-AC-TLC that we propose is seen to show the best overall performance.

High voltage DC power supply topology for pulsed load applications with converter switching synchronized to load pulses

High voltage power supplies for radar applications are investigated, which are subjected to pulsed load (125 kHz and 10% duty cycle) with stringent specifications (<0.01% regulation, efficiency>85%, droop<0.5 V/micro-sec.). As good regulation and stable operation requires the converter to be switched at much higher frequency than the pulse load frequency, transformer poses serious problems of insulation failure and higher losses. This paper proposes a methodology to tackle the problems associated with this type of application. Synchronization of converter switching with load pulses enables the converter to switch at half the load switching frequency. Low switching frequency helps in ensuring safety of HV transformer insulation and reduction of losses due to skin and proximity effect. Phase-modulated series resonant converter with ZVS is used as the power converter.

Input voltage modulated high voltage DC power supply topology for pulsed load applications

High voltage power supplies for radar applications are investigated which are subjected to pulsed load with stringent specifications. In the proposed solution, power conversion is done in two stages. A low power-high frequency converter modulates the input voltage of a high power-low frequency converter. This method satisfies all the performance specifications and takes care of the critical aspects of HV transformer.

Beat frequency oscillations in the output voltage of high voltage DC power supplies under pulsed loading

High voltage power supplies for radar applications are investigated, which are subjected to pulsed load (125 kHz and 10% duty cycle) with stringent specifications (<0.01% regulation, efficiency>85%, droop<0.5 V/micro-sec.). As good regulation and stable operation requires the converter to be switched at much higher frequency than the pulse load frequency, transformer poses serious problems of insulation failure and higher losses. Few converter topologies are proposed to tackle these problems. A study is made regarding the beat frequency oscillations that may exist with pulsed loading. It is illustrated with respect to the proposed converter topologies. Methods are proposed to eliminate or minimize these oscillations.

Magnetic arm-switch-based three-phase series-shunt compensated quality AC power supply

This study presents a novel magnetic arm-switch-based integrated magnetic circuit for a three-phase series-shunt compensated uninterruptible power supply (UPS). The magnetic circuit acts as a common interacting field for a number of energy ports, viz., series inverter, shunt inverter, grid and load. The magnetic arm-switching technique ensures equivalent series or shunt connection between the inverters. In normal grid mode (stabiliser mode), the series inverter is used for series voltage correction and the shunt one for current correction. The inverters and the load are effectively connected in parallel when the grid power is not available. These inverters are then used to share the load power. The operation of the inverters in parallel is ensured by the magnetic arm-switching technique. This study also includes modelling of the magnetic circuit. A graphical technique called bond graph is used to model the system. In this model, the magnetic circuit is represented in terms of gyrator-capacitors. Therefore the model is also termed as gyrator-capacitor model. The model is used to extract the dynamic equations that are used to simulate the system using MATLAB/SIMULINK. This study also discusses a synchronously rotating reference frame-based control technique that is used for the control of the series and shunt inverters in different operating modes. Finally, the gyrator-capacitor model is validated by comparing the simulated and experimental results.

Portable HVAC and Pulsed Plasma Sources for Control of NOX in Diesel Engine Exhaust

In this paper studies were carried out on two compact electric discharge plasma sources for controlling nitrogen oxides (NOX) emission in diesel engine exhaust. The plasma sources consist of an old television flyback transformer to generate high frequency high voltage ac (HVAC) and an automobile ignition coil to generate the high voltage pulses (HV Pulse). The compact plasma sources are aimed at retrofitting the existing catalytic converters with electric discharge assisted cleaning technique. To enhance NOX removal efficiency cascaded plasma-adsorbent technique has been used. Studies were reported at different flow rates and load conditions of the diesel engine.

Evidence for low temperature glassy behavior in La0.5Sr0.5CoO3

We report the observed low temperature spin glass like feature in the optimally doped La0.5Sr0.5CoO3 ferromagnetic system. The characteristic of glassy behavior has been identified by noting (i) the frequency-dependent shift of the low temperature hump position in the out of phase ac susceptibility component; (ii) evolution of freezing temperature with dc biasing field that adheres to de Almeida-Thouless relation; (iii) memory effect; and (iv) sluggish magnetic relaxation. The results of magnetic measurements demonstrate that neither the inter-cluster interaction nor the spin disorder at the interface between ferromagnetic clusters is responsible for the manifestation of such collective glassy behavior. Rather, it is believed to arise from a distinct cluster glass like phase that possibly coexists with the dominant ferromagnetic phase. (C) 2012 American Institute of Physics. [doi:10.1063/1.3684610]

A Five-Level Inverter Topology with Single-DC Supply by Cascading a Flying Capacitor Inverter and an H-Bridge

In this paper, a new three-phase, five-level inverter topology with a single-dc source is presented. The proposed topology is obtained by cascading a three-level flying capacitor inverter with a flying H-bridge power cell in each phase. This topology has redundant switching states for generating different pole voltages. By selecting appropriate switching states, the capacitor voltages can be balanced instantaneously (as compared to the fundamental) in any direction of the current, irrespective of the load power factor. Another important feature of this topology is that if any H-bridge fails, it can be bypassed and the configuration can still operate as a three-level inverter at its full power rating. This feature improves the reliability of the circuit. A 3-kW induction motor is run with the proposed topology for the full modulation range. The effectiveness of the capacitor balancing algorithm is tested for the full range of speed and during the sudden acceleration of the motor.

Anomalous low-temperature magnetic and magnetotransport properties in Ru-deficient SrRuO3

SrRuO3 is a well-known itinerant ferromagnet with many intriguing characteristics. The Ru deficiency in this system is believed to play a pivotal role in influencing many of its magnetic and transport properties. The present study involves the magnetic and transport properties of the Ru-deficient SrRu0.93O3 sample to gain more insight into the unusual low-temperature behavior. The ac susceptibility study reveals a sharp ferromagnetic transition at 150 K followed by a hump at T-h similar to 50 K, which has anomalous frequency dependence. Besides, the T-h shifts to lower temperatures with an increase in the superposed dc-biasing field and adheres to H-2 dependence, in accordance with the Gabay and Toulouse line for the Heisenberg spin glass systems. We also observe a pronounced memory effect toward the low-temperature side, signifying the characteristic of glassy behavior. The temperature-dependent magnetoresistance indicates the signature of an additional ordering toward the low-temperature side. All of the interesting findings combined unveil the existence of low-temperature cryptic magnetic phase in SrRu0.93O3. (C) 2012 American Institute of Physics. doi:10.1063/1.3673427]

Signal-Powered Low-Drop-Diode Equivalent Circuit for Full-Wave Bridge Rectifier

Piezoelectric-device-based vibration energy harvesting requires a rectifier for conversion of input ac to usable dc form. Power loss due to diode drop in rectifier is a significant fraction of the already low levels of harvested power. The proposed circuit is a low-drop-diode equivalent, which mimics a diode using linear region-operated MOSFET. The proposed diode equivalent is powered directly from input signal and requires no additional power supply for its control. Power used by the control circuit is kept at a bare minimum to have an overall output power improvement. Diode equivalent was used to replace the four diodes in a full-wave bridge rectifier, which is the basic full- wave rectifier and is a part of the more advanced rectifiers like switch-only and bias-flip rectifiers. Simulation in 130-nm technology and experiment with discrete components show that a bridge rectifier with the proposed diode provides a 30-169% increase in output power extracted from piezoelectric device, as compared to a bridge rectifier with diode-connected MOSFETs. The bridge rectifier with the proposed diode can extract 90% of the maximum available power from an ideal piezoelectric device-bridge rectifier circuit. Setting aside the constraint of power loss, simulations indicate that diode drop as low as 10 mV at 38 mu A can be achieved.