Multi-agent Reinforcement Learning for Traffic Signal Control

Optimal control of traffic lights at junctions or traffic signal control (TSC) is essential for reducing the average delay experienced by the road users amidst the rapid increase in the usage of vehicles. In this paper, we formulate the TSC problem as a discounted cost Markov decision process (MDP) and apply multi-agent reinforcement learning (MARL) algorithms to obtain dynamic TSC policies. We model each traffic signal junction as an independent agent. An agent decides the signal duration of its phases in a round-robin (RR) manner using multi-agent Q-learning with either is an element of-greedy or UCB 3] based exploration strategies. It updates its Q-factors based on the cost feedback signal received from its neighbouring agents. This feedback signal can be easily constructed and is shown to be effective in minimizing the average delay of the vehicles in the network. We show through simulations over VISSIM that our algorithms perform significantly better than both the standard fixed signal timing (FST) algorithm and the saturation balancing (SAT) algorithm 15] over two real road networks.

Effect of viscosity contrast on plume formation in density stratified fluids

We perform two and three dimensional numerical simulations of plume formation in density and viscosity stratified fluid systems. We show that the ambient to plume fluid viscosity ratio strongly affects the near wall plume structures (line or sheet plumes) such as plume spacing and shape of plumes. We observe that where mushroom-like plumes are observed for lower viscosity ratios, taller plumes with bulbous heads form for high viscosity ratios. Plume structure and spacing are in good agreement with experimental results. By studying the geometry of the line plumes and the flow in the circulation cells, we discuss the mechanisms of their formation and the dynamics of merging. We show that an increase in the viscosity ratio decreases the total length of line plumes in the planform which indicates a decreased mixing at higher viscosity ratios. (C) 2015 Elsevier Ltd. All rights reserved.

Lesion Detection in Breast Ultrasound Images Using Tissue Transition Analysis

Breast cancer is one of the leading cause of cancer related deaths in women and early detection is crucial for reducing mortality rates. In this paper, we present a novel and fully automated approach based on tissue transition analysis for lesion detection in breast ultrasound images. Every candidate pixel is classified as belonging to the lesion boundary, lesion interior or normal tissue based on its descriptor value. The tissue transitions are modeled using a Markov chain to estimate the likelihood of a candidate lesion region. Experimental evaluation on a clinical dataset of 135 images show that the proposed approach can achieve high sensitivity (95 %) with modest (3) false positives per image. The approach achieves very similar results (94 % for 3 false positives) on a completely different clinical dataset of 159 images without retraining, highlighting the robustness of the approach.

Accurate Indoor Positioning of Firefighters using Dual Foot-mounted Inertial Sensors and Inter-agent Ranging

A real-time cooperative localization system, utilizing dual foot-mounted low-cost inertial sensors and RF-based inter-agent ranging, has been developed. Scenario-based tests have been performed, using fully-equipped firefighters mimicking a search operation in a partly smoke-filled environment, to evaluate the performance of the TOR (Tactical lOcatoR) system. The performed tests included realistic firefighter movements and inter-agent distances, factors that are crucial in order to provide realistic evaluations of the expected performance in real-world operations. The tests indicate that the TOR system may be able to provide a position accuracy of approximately two to three meters during realistic firefighter operations, with only two smoke diving firefighters and one supervising firefighter within range.

Copper oxide nanoparticles: an antidermatophytic agent for Trichophyton spp.

Copper oxide (CuO) is one of the most important transition metal oxides due to its unique properties. It is used in various technological applications such as high critical temperature, superconductors, gas sensors, in photoconductive applications and so on. Recently, it has been used as an antimicrobial agent against various pathogenic bacteria. In the present investigation, we studied the structural and antidermatophytic properties of CuO nanoparticles (NPs) synthesized by a precipitation technique. Copper sulfate was used as a precursor and sodium hydroxide as a reducing agent. Scanning electron microscopy (SEM) showed flower-shaped CuO NPs and X-ray diffraction (XRD) pattern showed the crystalline nature of CuO NPs. These NPs were evaluated against two prevalent species of dermatophytes, i.e. Trichophyton rubrum and T. mentagrophytes by using the broth microdilution technique. Further, the NPs activity was also compared with synthetic sertaconazole. Although better antidermatophytic activity was exhibited with sertaconazole as compared to NPs, being synthetic, sertaconazole may not be preferred, as it shows different adverse effects. Trichophyton mentagrophytes is more susceptible to NPs than T. rubrum. A phylogenetic approach was applied for predicting differences in susceptibility of pathogens.

Performance evaluation of mobile agent based resource management protocol for MANETs

The nodes with dynamicity, and management without administrator are key features of mobile ad hoc networks (1VIANETs). Increasing resource requirements of nodes running different applications, scarcity of resources, and node mobility in MANETs are the important issues to be considered in allocation of resources. Moreover, management of limited resources for optimal allocation is a crucial task. In our proposed work we discuss a design of resource allocation protocol and its performance evaluation. The proposed protocol uses both static and mobile agents. The protocol does the distribution and parallelization of message propagation (mobile agent with information) in an efficient way to achieve scalability and speed up message delivery to the nodes in the sectors of the zones of a MANET. The protocol functionality has been simulated using Java Agent Development Environment (JADE) Framework for agent generation, migration and communication. A mobile agent migrates from central resource rich node with message and navigate autonomously in the zone of network until the boundary node. With the performance evaluation, it has been concluded that the proposed protocol consumes much less time to allocate the required resources to the nodes under requirement, utilize less network resources and increase the network scalability. (C) 2015 Elsevier B.V. All rights reserved.

Detection and estimation of liquid flow through a pipe in a tissue-like object with ultrasound-assisted diffuse correlation spectroscopy

Using coherent light interrogating a turbid object perturbed by a focused ultrasound (US) beam, we demonstrate localized measurement of dynamics in the focal region, termed the region-of-interest (ROI), from the decay of the modulation in intensity autocorrelation of light. When the ROI contains a pipe flow, the decay is shown to be sensitive to the average flow velocity from which the mean-squared displacement (MSD) of the scattering centers in the flow can be estimated. While the MSD estimated is seen to be an order of magnitude higher than that obtainable through the usual diffusing wave spectroscopy (DWS) without the US, it is seen to be more accurate as verified by the volume flow estimated from it. It is further observed that, whereas the MSD from the localized measurement grows with time as tau(alpha) with alpha approximate to 1.65, without using the US, a is seen to be much less. Moreover, with the local measurement, this super-diffusive nature of the pipe flow is seen to persist longer, i.e., over a wider range of initial tau, than with the unassisted DWS. The reason for the super-diffusivity of flow, i.e., alpha < 2, in the ROI is the presence of a fluctuating (thermodynamically nonequilibrium) component in the dynamics induced by the US forcing. Beyond this initial range, both methods measure MSDs that rise linearly with time, indicating that ballistic and near-ballistic photons hardly capture anything beyond the background Brownian motion. (C) 2015 Optical Society of America

The cis-Diammineplatinum(II) Complex of Curcumin: A Dual Action DNA Crosslinking and Photochemotherapeutic Agent

Pt(cur)(NH3)(2)](NO3) (1), a curcumin-bound cis-diammineplatinum(II) complex, nicknamed Platicur, as a novel photoactivated chemotherapeutic agent releases photoactive curcumin and an active platinum(II) species upon irradiation with visible light. The hydrolytic instability of free curcumin reduces upon binding to platinum(II). Interactions of 1 with 5'-GMP and ct-DNA indicated formation of platinum-bound DNA adducts upon exposure to visible light (lambda = 400-700 nm). It showed apoptotic photocytotoxicity in cancer cells (IC50 approximate to 15 mu M), thus forming (OH)-O-center dot, while remaining passive in the darkness (IC50 > 200 mu M). A comet assay and platinum estimation suggest Pt-DNA crosslink formation. The fluorescence microscopic images showed cytosolic localization of curcumin, thus implying possibility of dual action as a chemo-and phototherapeutic agent.

Prior image based temporally constrained reconstruction algorithm for magnetic resonance guided high intensity focused ultrasound

Purpose: A prior image based temporally constrained reconstruction ( PITCR) algorithm was developed for obtaining accurate temperature maps having better volume coverage, and spatial, and temporal resolution than other algorithms for highly undersampled data in magnetic resonance (MR) thermometry. Methods: The proposed PITCR approach is an algorithm that gives weight to the prior image and performs accurate reconstruction in a dynamic imaging environment. The PITCR method is compared with the temporally constrained reconstruction (TCR) algorithm using pork muscle data. Results: The PITCR method provides superior performance compared to the TCR approach with highly undersampled data. The proposed approach is computationally expensive compared to the TCR approach, but this could be overcome by the advantage of reconstructing with fewer measurements. In the case of reconstruction of temperature maps from 16% of fully sampled data, the PITCR approach was 1.57x slower compared to the TCR approach, while the root mean square error using PITCR is 0.784 compared to 2.815 with the TCR scheme. Conclusions: The PITCR approach is able to perform more accurate reconstructions of temperature maps compared to the TCR approach with highly undersampled data in MR guided high intensity focused ultrasound. (C) 2015 American Association of Physicists in Medicine.