Intelligent cuckoo search optimized traffic signal controllers for multi-intersection network

Traffic congestion in urban roads is one of the biggest challenges of 21 century. Despite a myriad of research work in the last two decades, optimization of traffic signals in network level is still an open research problem. This paper for the first time employs advanced cuckoo search optimization algorithm for optimally tuning parameters of intelligent controllers. Neural Network (NN) and Adaptive Neuro-Fuzzy Inference System (ANFIS) are two intelligent controllers implemented in this study. For the sake of comparison, we also implement Q-learning and fixed-time controllers as benchmarks. Comprehensive simulation scenarios are designed and executed for a traffic network composed of nine four-way intersections. Obtained results for a few scenarios demonstrate the optimality of trained intelligent controllers using the cuckoo search method. The average performance of NN, ANFIS, and Q-learning controllers against the fixed-time controller are 44%, 39%, and 35%, respectively.

ANFIS traffic signal controller for an isolated intersection

Traffic signal controlling is one of the solutions to reduce the traffic congestion in cities. To set appropriate green times for traffic signal lights, we have applied Adaptive Neuro-Fuzzy Inference System (ANFIS) method in traffic signal controllers. ANFIS traffic signal controller is used for controlling traffic congestion of a single intersection with the purpose of minimizing travel delay time. The ANFIS traffic controller is an intelligent controller that learns to set an appropriate green time for each phase of traffic signal lights at the start of the phase and based on the traffic information. The controller uses genetic algorithm to tune ANFIS parameters during learning time. The results of the experiments show higher performance of the ANFIS traffic signal controller compared to three other traffic controllers that are developed as benchmarks. One of the benchmarks is GA-FLC (Araghi et al., 2014), next one is a fixed-FLC, and a fixed-time controller with three different values for green phase. Results show the higher performance of ANFIS controller.

Design of distributed adaptive neural traffic signal timing controller by cuckoo search optimization

This paper focuses on designing an adaptive controller for controlling traffic signal timing. Urban traffic is an inevitable part in modern cities and traffic signal controllers are effective tools to control it. In this regard, this paper proposes a distributed neural network (NN) controller for traffic signal timing. This controller applies cuckoo search (CS) optimization methods to find the optimal parameters in design of an adaptive traffic signal timing control system. The evaluation of the performance of the designed controller is done in a multi-intersection traffic network. The developed controller shows a promising improvement in reducing travel delay time compared to traditional fixed-time control systems.

A review on computational intelligence methods for controlling traffic signal timing

Urban traffic as one of the most important challenges in modern city life needs practically effective and efficient solutions. Artificial intelligence methods have gained popularity for optimal traffic light control. In this paper, a review of most important works in the field of controlling traffic signal timing, in particular studies focusing on Q-learning, neural network, and fuzzy logic system are presented. As per existing literature, the intelligent methods show a higher performance compared to traditional controlling methods. However, a study that compares the performance of different learning methods is not published yet. In this paper, the aforementioned computational intelligence methods and a fixed-time method are implemented to set signals times and minimize total delays for an isolated intersection. These methods are developed and compared on a same platform. The intersection is treated as an intelligent agent that learns to propose an appropriate green time for each phase. The appropriate green time for all the intelligent controllers are estimated based on the received traffic information. A comprehensive comparison is made between the performance of Q-learning, neural network, and fuzzy logic system controller for two different scenarios. The three intelligent learning controllers present close performances with multiple replication orders in two scenarios. On average Q-learning has 66%, neural network 71%, and fuzzy logic has 74% higher performance compared to the fixed-time controller.

Design of an optimal ANFIS traffic signal controller by using cuckoo search for an isolated intersection

An optimal design of Adaptive Neuro-Fuzzy Inference System (ANFIS) traffic signal controller is presented in this paper. The proposed controller aims to adjust a set of green times for traffic lights in a single intersection with the purpose of minimizing travel delay time and traffic congestion. The ANFIS controller is trained, to learned how to set green times for each traffic phase. This intelligent controller uses the Cuckoo Search (CS) algorithm to tune its parameters during the learning pried. Evaluating the performance of the proposed controller in comparison with the performance of a FLS controller (FLC) with predefined rules and membership functions, and also three fixed-Time controllers, illustrates the better performance of the optimal ANFIS controller against the other benchmark controllers.

Effect of upstream traffic signal on capacity of a downstream TWSC intersection

This paper investigates the platoon dispersion model that is part of the 2010 Highway Capacity Manual that is used for forecasting downstream traffic flows for analyzing both signalized and TWSC intersections. The paper focuses on the effect of platoon dispersion on the proportion of time blocked, the conflicting flow rate, and the capacity flow rate for the major street left turn movement at a TWSC intersection. The existing HCM 2010 methodology shows little effect on conflicting flow or capacity for various distances downstream from the signalized intersection. Two methods are suggested for computing the conflicting flow and capacity of minor stream movements at the TWSC intersection that have more desirable properties than the existing HCM method. Further, if the existing HCM method is retained, the results suggest that the upstream signals model be dropped from the HCM method for TWSC intersections.

Reinforcement Learning With Function Approximation for Traffic Signal Control

We propose, for the first time, a reinforcement learning (RL) algorithm with function approximation for traffic signal control. Our algorithm incorporates state-action features and is easily implementable in high-dimensional settings. Prior work, e. g., the work of Abdulhai et al., on the application of RL to traffic signal control requires full-state representations and cannot be implemented, even in moderate-sized road networks, because the computational complexity exponentially grows in the numbers of lanes and junctions. We tackle this problem of the curse of dimensionality by effectively using feature-based state representations that use a broad characterization of the level of congestion as low, medium, or high. One advantage of our algorithm is that, unlike prior work based on RL, it does not require precise information on queue lengths and elapsed times at each lane but instead works with the aforementioned described features. The number of features that our algorithm requires is linear to the number of signaled lanes, thereby leading to several orders of magnitude reduction in the computational complexity. We perform implementations of our algorithm on various settings and show performance comparisons with other algorithms in the literature, including the works of Abdulhai et al. and Cools et al., as well as the fixed-timing and the longest queue algorithms. For comparison, we also develop an RL algorithm that uses full-state representation and incorporates prioritization of traffic, unlike the work of Abdulhai et al. We observe that our algorithm outperforms all the other algorithms on all the road network settings that we consider.

Multi-agent Reinforcement Learning for Traffic Signal Control

Optimal control of traffic lights at junctions or traffic signal control (TSC) is essential for reducing the average delay experienced by the road users amidst the rapid increase in the usage of vehicles. In this paper, we formulate the TSC problem as a discounted cost Markov decision process (MDP) and apply multi-agent reinforcement learning (MARL) algorithms to obtain dynamic TSC policies. We model each traffic signal junction as an independent agent. An agent decides the signal duration of its phases in a round-robin (RR) manner using multi-agent Q-learning with either is an element of-greedy or UCB 3] based exploration strategies. It updates its Q-factors based on the cost feedback signal received from its neighbouring agents. This feedback signal can be easily constructed and is shown to be effective in minimizing the average delay of the vehicles in the network. We show through simulations over VISSIM that our algorithms perform significantly better than both the standard fixed signal timing (FST) algorithm and the saturation balancing (SAT) algorithm 15] over two real road networks.

Optimal design of traffic signal controller using neural networks and fuzzy logic systems

This paper aims at optimally adjusting a set of green times for traffic lights in a single intersection with the purpose of minimizing travel delay time and traffic congestion. Neural network (NN) and fuzzy logic system (FLS) are two methods applied to develop intelligent traffic timing controller. For this purpose, an intersection is considered and simulated as an intelligent agent that learns how to set green times in each cycle based on the traffic information. The training approach and data for both these learning methods are similar. Both methods use genetic algorithm to tune their parameters during learning. Finally, The performance of the two intelligent learning methods is compared with the performance of simple fixed-time method. Simulation results indicate that both intelligent methods significantly reduce the total delay in the network compared to the fixed-time method.

Optimal fuzzy traffic signal controller for an isolated intersection

  This paper aims at optimally adjusting a set of green times for traffic lights in a single intersection with the purpose of minimizing travel delay time and traffic congestion. Fuzzy logic system (FLS) is the method applied to develop the intelligent traffic timing controller. For this purpose, an intersection is considered and simulated as an intelligent agent that learns how to set green times in each cycle based on the traffic information. The FLS controller (FLC) uses genetic algorithm to tune its parameters during learning phase. Finally, The performance of the intelligent FLC is compared with the performance of a FLC with predefined parameters and three simple fixed-time controller. Simulation results indicate that intelligent FLC significantly reduces the total delay in the network compared to the fixed-time method and FLC with manual parameter setting.

Computational intelligence-based traffic signal timing optimization

 Traffic congestion has explicit effects on productivity and efficiency, as well as side effects on environmental sustainability and health. Controlling traffic flows at intersections is recognized as a beneficial technique, to decrease daily travel times. This thesis applies computational intelligence to optimize traffic signals' timing and reduce urban traffic.

Traffic control systems handbook - 1985. Revised edition. Final report.

Federal Highway Administration, Office of Implementation, Washington, D.C.

Motor vehicle accidents in relation to geometric and traffic features of highway intersections. Volume III - appendices. Final report.

Federal Highway Administration, Washington, D.C.