Reinforcement Learning With Function Approximation for Traffic Signal Control

We propose, for the first time, a reinforcement learning (RL) algorithm with function approximation for traffic signal control. Our algorithm incorporates state-action features and is easily implementable in high-dimensional settings. Prior work, e. g., the work of Abdulhai et al., on the application of RL to traffic signal control requires full-state representations and cannot be implemented, even in moderate-sized road networks, because the computational complexity exponentially grows in the numbers of lanes and junctions. We tackle this problem of the curse of dimensionality by effectively using feature-based state representations that use a broad characterization of the level of congestion as low, medium, or high. One advantage of our algorithm is that, unlike prior work based on RL, it does not require precise information on queue lengths and elapsed times at each lane but instead works with the aforementioned described features. The number of features that our algorithm requires is linear to the number of signaled lanes, thereby leading to several orders of magnitude reduction in the computational complexity. We perform implementations of our algorithm on various settings and show performance comparisons with other algorithms in the literature, including the works of Abdulhai et al. and Cools et al., as well as the fixed-timing and the longest queue algorithms. For comparison, we also develop an RL algorithm that uses full-state representation and incorporates prioritization of traffic, unlike the work of Abdulhai et al. We observe that our algorithm outperforms all the other algorithms on all the road network settings that we consider.

Recommendations for driver licensing and traffic law enforcement in India aiming to improve road safety

During the last decade, developing countries such as India have been exhibiting rapid increase in human population and vehicles, and increase in road accidents. Inappropriate driving behaviour is considered one of the major causes of road accidents in India as compared to defective geometric design of pavement or mechanical defects in vehicles. It can result in conditions such as lack of lane discipline, disregard to traffic laws, frequent traffic violations, increase in crashes due to self-centred driving, etc. It also demotivates educated drivers from following good driving practices. Hence, improved driver behaviour can be an effective countermeasure to reduce the vulnerability of road users and inhibit crash risks. This article highlights improved driver behaviour through better driver education, driver training and licensing procedures along with good on-road enforcement; as an effective countermeasure to ensure road safety in India. Based on the review and analysis, the article also recommends certain measures pertaining to driver licensing and traffic law enforcement in India aimed at improving road safety.

Spin and charge density waves in the extended Hubbard model: A slave-boson approach

We use the extended Hubbard model to investigate the properties of the charge- and spin-density-wave phases in the presence of a nearest-neighbors repulsion term in the framework of the slave-boson technique. We show that, contrary to Hartree-Fock results, an instablity may occur for sufficiently high values of the Hubbard repulsion, both in the spin- and charge-density-wave phase, which makes the system discontinuously jump to a phase with a smaller or zero wave amplitude. The limits of applicability of our approach are discussed and our results are compared with previous numerical analysis. The phase diagram of the model at half-filling is determined.

Halogen Bonding in 2,5-Dichloro-1,4-benzoquinone: Insights from Experimental and Theoretical Charge Density Analysis

Experimental charge density distribution in 2, 5-dichloro-1, 4-benzoquinone has been carried out using high resolution X-ray diffraction data at 90 K to quantitatively evaluate the nature of C-Cl center dot center dot center dot O=C halogen bond in molecular crystals. Additionally, the halogen bond is studied from geometrical point of view and the same has been visualized using Hirshfeld surface analysis. The obtained results from experimental charge density analysis are compared with periodic quantum calculations using B3LYP 6-31G(d,p) level of theory. The topological values at bond critical point, three-dimensional static deformation density features and electrostatic potential isosurfaces unequivocally establish the attractive nature of C-Cl center dot center dot center dot O=C halogen bond in crystalline lattice.

Theory of coexisting charge and spin-density waves in (TMTTF)(2)Br, (TMTSF)(2)PF6 and alpha-(BEDT-TTF)(2)MHg(SCN)(4)

We discuss a recently formulated microscopic theory of the unusual coexistence of spin density waves (SDWs) and charge density waves (CDWs) that has been seen in recent experiments on (TMTTF)2Br, (TMTSF)2PF6 and α-(BEDT-TTF)2MHg(SCN)4.

Theory of coexisting charge and spin-density waves in (TMTTF)(2)Br, (TMTSF)(2)PF6, and alpha-(BEDT-TTF)(2)MHg(SCN)(4)

Recent experiments indicate that the spin-density waves (SDWs) in (TMTTF)(2)Br, (TMTSF)(2)PF6, and alpha-(BEDT-TTF)(2)MHg(SCN)(4) are highly unconventional and coexist with charge-density waves (CDWs). We present a microscopic theory of this unusual CDW-SDW coexistence. A complete understanding requires the explicit inclusion of strong Coulomb interactions, lattice discreteness, the anisotropic two-dimensional nature of the lattice, and the correct hand filling within the starting Hamiltonian. [S0031-9007(99)08498-7].

Throughput Maximization of Delay-Constrained Traffic in Wireless Energy Harvesting Sensors

A wireless Energy Harvesting Sensor (EHS) needs to send data packets arriving in its queue over a fading channel at maximum possible throughput while ensuring acceptable packet delays. At the same time, it needs to ensure that energy neutrality is satisfied, i.e., the average energy drawn from a battery should equal the amount of energy deposited in it minus the energy lost due to the inefficiency of the battery. In this work, a framework is developed under which a system designer can optimize the performance of the EHS node using power control based on the current channel state information, when the EHS node employs a single modulation and coding scheme and the channel is Rayleigh fading. Optimal system parameters for throughput optimal, delay optimal and delay-constrained throughput optimal policies that ensure energy neutrality are derived. It is seen that a throughput optimal (maximal) policy is packet delay-unbounded and an average delay optimal (minimal) policy achieves negligibly small throughput. Finally, the influence of the harvested energy profile on the performance of the EHS is illustrated through the example of solar energy harvesting.

Analytical models for energy consumption in infrastructure WLAN STAs carrying TCP traffic

We develop analytical models for estimating the energy spent by stations (STAs) in infrastructure WLANs when performing TCP controlled file downloads. We focus on the energy spent in radio communication when the STAs are in the Continuously Active Mode (CAM), or in the static Power Save Mode (PSM). Our approach is to develop accurate models for obtaining the fraction of times the STA radios spend in idling, receiving and transmitting. We discuss two traffic models for each mode of operation: (i) each STA performs one large file download, and (ii) the STAs perform short file transfers. We evaluate the rate of STA energy expenditure with long file downloads, and show that static PSM is worse than just using CAM. For short file downloads we compute the number of file downloads that can be completed with given battery capacity, and show that PSM performs better than CAM for this case. We provide a validation of our analytical models using the NS-2 simulator.

Density-matrix renormalization-group study of low-lying excitations of polyacene within a Pariser-Parr-Pople model

We have carried out symmetrized density-matrix renormalization-group calculations to study the nature of excited states of long polyacene oligomers within a Pariser-Parr-Pople Hamiltonian. We have used the C-2 symmetry, the electron-hole symmetry, and the spin parity of the system in our calculations. We find that there is a crossover in the lowest dipole forbidden two-photon state and the lowest dipole allowed excited state with size of the oligomer. In the long system limit, the two-photon state lies below the lowest dipole allowed excited state. The triplet state lies well below the two-photon state and energetically does not correspond to its description as being made up of two triplets. These results are in agreement with the general trends in linear conjugated polymers. However, unlike in linear polyenes wherein the two-photon state is a localized excitation, we find that in polyacenes, the two-photon excitation is spread out over the system. We have doped the systems with a hole and an electron and have calculated the charge excitation gap. Using the charge gap and the optical gap, we estimate the binding energy of the 1(1)B(-) exciton to be 2.09 eV. We have also studied doubly doped polyacenes and find that the bipolaron in these systems, to be composed of two separated polarons, as indicated by the calculated charge-density profile and charge-charge correlation function. We have studied bond orders in various states in order to get an idea of the excited state geometry of the system. We find that the ground state, the triplet state, the dipole allowed state, and the polaron excitations correspond to lengthening of the rung bonds in the interior of the oligomer while the two-photon excitation corresponds to the rung bond lengths having two maxima in the system.

Effect of packing density and adsorption parameters on the throughput of a thermal compressor

Vapour adsorption refrigeration systems (VAdS) have the advantage of scalability over a wide range of capacities ranging from a few watts to several kilowatts. In the first instance, the design of a system requires the characteristics of the adsorbate-adsorbent pair. Invariably, the void volume in the adsorbent reduces the throughput of the thermal compressor in a manner similar to the clearance volume in a reciprocating compressor. This paper presents a study of the activated carbon +HFC-134a (1,1,1,2-tetrafluoroethane) system as a possible pair for a typical refrigeration application. The aim of this study is to unfold the nexus between the adsorption parameters, achievable packing densities of charcoal and throughput of a thermal compressor. It is shown that for a thermal compressor, the adsorbent should not only have a high surface area, but should also be able to provide a high packing density. Given the adsorption characteristics of an adsorbent-adsorbate pair and the operating conditions, this paper discloses a method for the calculation of the minimum packing density necessary for an effective throughput of a thermal compressor. (C) 2002 Elsevier Science Ltd. All rights reserved.

Effect of two-level systems on the spectral density of universal conductance fluctuations in doped Si

We have studied the power spectral density [S(f) = gamma/f(alpha)] of universal conductance fluctuations (UCF's) in heavily doped single crystals of Si, when the scatterers themselves act as the primary source of dephasing. We observed that the scatterers, with internal dynamics like two-level-systems, produce a significant, temperature-dependent reduction in the spectral slope alpha when T less than or similar to 10 K, as compared to the bare 1/f (alphaapproximate to1) spectrum at higher temperatures. It is further shown that an upper cutoff frequency (f(m)) in the UCF spectrum is necessary in order to restrict the magnitude of conductance fluctuations, [(deltaG(phi))(2)], per phase coherent region (L-phi(3)) to [(deltaGphi)(2)](1/2) less than or similar to e(2)/h. We find that f(m) approximate to tau(D)(-1), where tau(D) = L-2/D, is the time scale of the diffusive motion of the electron along the active length (L) of the sample (D is the electron diffusivity).

Temperature and density dependent solute vibrational relaxation in supercritical fluoroform

Temperature- and density-dependent vibrational relaxation data for the v6 asymmetric stretch of W(CO)6 in supercritical fluoroform (trifluoromethane, CHF3) are presented and compared to a recent theory of solute vibrational relaxation. The theory, which uses thermodynamic and hydrodynamic conditions of the solvent as input parameters, shows very good agreement in reproducing the temperature- and density-dependent trends of the experimental data with a minimum of adjustable parameters. Once a small number of parameters are fixed by fitting the functional form of the density dependence, there are no adjustable parameters in the calculations of the temperature dependence. © 2001 American Institute of Physics.

density matrix renormalization group study of polyacene

We study the nature of excited states of long polyacene oligomers within a Pariser-Parr-Pople (PPP) Hamiltonian using the Symmetrized Density Matrix Renormalization Group (SDMRG) technique. We find a crossover between the two-photon state and the lowest dipole allowed excited state as the system size is increased from tetracene to pentacene. The spin-gap is the smallest gap. We also study the equilibrium geome tries in the ground and excited states from bond orders and bond-bond correlation functions. We find that the Peierls instability in the ground state of polyacene is conditional both from energetics and structure factors computed froth correlation functions.

Carrier density-dependent transport in poly(3-methylthiophene): from injection-limited to space-charge-limited current

Current-voltage (I-V) and impedance measurements were carried out in doped poly(3-methylthiophene) devices by varying the carrier density. As the carrier concentration reduces the I-V characteristics indicate that the conduction mechanism is limited by metal-polymer interface, as also observed in impedance data. The temperature dependence of I-V in moderately doped samples shows a trap-controlled space-charge-limited conduction (SCLC); whereas in lightly doped devices injection-limited conduction is observed at lower bias and SCLC at higher voltages. The carrier density-dependent quasi-Fermi level adjustment and trap-limited transport could explain this variation in conduction mechanism. Capacitance measurements at lower frequencies and higher bias voltages show a sign change in values due to the significant variations in the relaxation behaviour for lightly and moderately doped samples. The electrical hysteresis increases as carrier density is reduced due to the time scales involved in the de-trapping of carriers.

Geoinformatics for Urbanisation and Urban Sprawl Pattern Analysis

Urbanisation is the increase in the population of cities in proportion to the region's rural population. Urbanisation in India is very rapid with urban population growing at around 2.3 percent per annum. Urban sprawl refers to the dispersed development along highways or surrounding the city and in rural countryside with implications such as loss of agricultural land, open space and ecologically sensitive habitats. Sprawl is thus a pattern and pace of land use in which the rate of land consumed for urban purposes exceeds the rate of population growth resulting in an inefficient and consumptive use of land and its associated resources. This unprecedented urbanisation trend due to burgeoning population has posed serious challenges to the decision makers in the city planning and management process involving plethora of issues like infrastructure development, traffic congestion, and basic amenities (electricity, water, and sanitation), etc. In this context, to aid the decision makers in following the holistic approaches in the city and urban planning, the pattern, analysis, visualization of urban growth and its impact on natural resources has gained importance. This communication, analyses the urbanisation pattern and trends using temporal remote sensing data based on supervised learning using maximum likelihood estimation of multivariate normal density parameters and Bayesian classification approach. The technique is implemented for Greater Bangalore – one of the fastest growing city in the World, with Landsat data of 1973, 1992 and 2000, IRS LISS-3 data of 1999, 2006 and MODIS data of 2002 and 2007. The study shows that there has been a growth of 466% in urban areas of Greater Bangalore across 35 years (1973 to 2007). The study unravels the pattern of growth in Greater Bangalore and its implication on local climate and also on the natural resources, necessitating appropriate strategies for the sustainable management.