Multi-agent Reinforcement Learning for Traffic Signal Control

Optimal control of traffic lights at junctions or traffic signal control (TSC) is essential for reducing the average delay experienced by the road users amidst the rapid increase in the usage of vehicles. In this paper, we formulate the TSC problem as a discounted cost Markov decision process (MDP) and apply multi-agent reinforcement learning (MARL) algorithms to obtain dynamic TSC policies. We model each traffic signal junction as an independent agent. An agent decides the signal duration of its phases in a round-robin (RR) manner using multi-agent Q-learning with either is an element of-greedy or UCB 3] based exploration strategies. It updates its Q-factors based on the cost feedback signal received from its neighbouring agents. This feedback signal can be easily constructed and is shown to be effective in minimizing the average delay of the vehicles in the network. We show through simulations over VISSIM that our algorithms perform significantly better than both the standard fixed signal timing (FST) algorithm and the saturation balancing (SAT) algorithm 15] over two real road networks.

Vacancy-Engineered Nanoceria: Enzyme Mimetic Hotspots for the Degradation of Nerve Agents

Organophosphorus-based nerve agents, such as paraoxon, parathion, and malathion, inhibit acetylcholinesterase, which results in paralysis, respiratory failure, and death. Bacteria are known to use the enzyme phosphotriesterase (PTE) to break down these compounds. In this work, we designed vacancy-engineered nanoceria (VE CeO2 NPs) as PTE mimetic hotspots for the rapid degradation of nerve agents. We observed that the hydrolytic effect of the nano-material is due to the synergistic activity between both Ce3+ and Ce4+ ions located in the active site-like hotspots. Furthermore, the catalysis by nanoceria overcomes the product inhibition generally observed for PTE and small molecule-based PTE mimetics.

Stimuli-responsive protamine-based biodegradable nanocapsules for enhanced bioavailability and intracellular delivery of anticancer agents

Enzyme-and pH-responsive polyelectrolyte nanocapsules having diameters in the range of 200 +/- 20 nm were fabricated by means of Layer-by-Layer assembly of biopolymers, protamine, and heparin, and then loaded with anticancer drug doxorubicin. The incorporation of the FDA-approved peptide drug protamine as a wall component rendered the capsules responsive to enzyme stimuli. The stimuli-responsive drug release from these nanocapsules was evaluated, and further modulation of capsule permeability to avoid premature release was demonstrated by crosslinking the wall components. The interaction of the nanocapsules with cancer cells was studied using MCF-7 breast cancer cells. These capsules were readily internalized and disintegrated inside the cells, culminating in the release of the loaded doxorubicin and subsequent cell death as observed by confocal microscopy and MTT Assay. The bioavailability studies performed using BALB/c mice revealed that the encapsulated doxorubicin exhibited enhanced bioavailability compared to free doxorubicin. Our results indicate that this stimuli-responsive system fabricated from clinically used FDA-approved molecules and exhibiting minimal premature release has great potential for drug-delivery applications.

Vacancy-Engineered Nanoceria: Enzyme Mimetic Hotspots for the Degradation of Nerve Agents

Organophosphorus-based nerve agents, such as paraoxon, parathion, and malathion, inhibit acetylcholinesterase, which results in paralysis, respiratory failure, and death. Bacteria are known to use the enzyme phosphotriesterase (PTE) to break down these compounds. In this work, we designed vacancy-engineered nanoceria (VE CeO2 NPs) as PTE mimetic hotspots for the rapid degradation of nerve agents. We observed that the hydrolytic effect of the nano-material is due to the synergistic activity between both Ce3+ and Ce4+ ions located in the active site-like hotspots. Furthermore, the catalysis by nanoceria overcomes the product inhibition generally observed for PTE and small molecule-based PTE mimetics.

Stimuli-responsive protamine-based biodegradable nanocapsules for enhanced bioavailability and intracellular delivery of anticancer agents

Enzyme-and pH-responsive polyelectrolyte nanocapsules having diameters in the range of 200 +/- 20 nm were fabricated by means of Layer-by-Layer assembly of biopolymers, protamine, and heparin, and then loaded with anticancer drug doxorubicin. The incorporation of the FDA-approved peptide drug protamine as a wall component rendered the capsules responsive to enzyme stimuli. The stimuli-responsive drug release from these nanocapsules was evaluated, and further modulation of capsule permeability to avoid premature release was demonstrated by crosslinking the wall components. The interaction of the nanocapsules with cancer cells was studied using MCF-7 breast cancer cells. These capsules were readily internalized and disintegrated inside the cells, culminating in the release of the loaded doxorubicin and subsequent cell death as observed by confocal microscopy and MTT Assay. The bioavailability studies performed using BALB/c mice revealed that the encapsulated doxorubicin exhibited enhanced bioavailability compared to free doxorubicin. Our results indicate that this stimuli-responsive system fabricated from clinically used FDA-approved molecules and exhibiting minimal premature release has great potential for drug-delivery applications.