Skip to content
Research Article Open access CC BY 4.0

Deep Recurrent Q-learning Method for Area Traffic Coordination Control

Saijiang Shi, Feng Chen

Journal of Advances in Mathematics and Computer Science · pp. 1–11 · Published 16 May 2018

10.9734/JAMCS/2018/41281

Abstract

In order to improve the performance of Deep Q-learning when dealing with the area traffic control which is a partially observable Markov decision process. This paper introduces Deep Recurrent Q-learning by changing the fully connected network layers to LSTM layers. On the other hand, we use transfer learning to achieve the coordination of multiple intersections in the area. By the simulation experiments, this paper compares the average delay of our algorithm with the Deep Q-learning algorithm for three different saturation flows, respectively. We also compare our algorithm with another two popular traffic signal control algorithms, i.e., Q-learning and fixed time control algorithm. The experiment results show that the performance of our improved Deep Recurrent Q-learning algorithm is better than the other three algorithms.

Area traffic coordination control deep recurrent network deep Q-learning deep recurrent Q-learning.

Cited by 11

Improving traffic signal control operations using proximal policy optimization

Liben Huang, Xiaohui Qu · IET Intelligent Transport Systems · 2022

Deep reinforcement learning in transportation research: A review

Nahid Parvez Farazi, Bo Zou, Tanvir Ahamed · Transportation Research Interdisciplinary Perspectives · 2021

Traffic Signal Control Under Mixed Traffic With Connected and Automated Vehicles: A Transfer-Based Deep Reinforcement Learning Approach

Li Song, Wei Fan · IEEE Access · 2021

Reinforcement learning in urban network traffic signal control: A systematic literature review

Mohammad Noaeen, Atharva Naik, Liana Goodman · Expert Systems with Applications · 2022

Control of traffic network signals based on deep deterministic policy gradients

Huifeng Hu, Shu Lin, Ping Wang · Applied Intelligence · 2025

Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey

Ammar Haydari, Yasin Yilmaz · IEEE Transactions on Intelligent Transportation Systems · 2022

A Survey on Deep Reinforcement Learning for Traffic Signal Control

Wei Miao, Long Li, Zhiwen Wang · 2021 33rd Chinese Control and Decision Conference (CCDC) · 2021

Optimized Traffic Routing System for Urban Congestion Management

Rajkumar S., Sandhiya S., Manjusri A. · Journal of Ubiquitous Computing and Communication Technologies · 2025

FP-WDDQN: An improved deep reinforcement learning algorithm for adaptive traffic signal control

Xiao Zhang, Xiaolong Xu · 2023 IEEE International Conference on Data Mining Workshops (ICDMW) · 2023

CenLight: Centralized traffic grid signal optimization via action and state decomposition

Jia Wu, Yunchuan Ran, Yican Lou · IET Intelligent Transport Systems · 2023

Article metrics

Real usage data collected on this platform.

0

Page views

0

PDF downloads

0

Outbound clicks

11

Citations

Views by country

Approximate, from request IP at view time — not citizenship or institution. Countries with fewer than 5 views are grouped as "Other".

No views recorded yet.

Traffic sources

Referring site, by host.

No traffic recorded yet.

Views and downloads exclude known bots/crawlers. Citations combines this platform's own DOI-resolved index with each external source's own reported total — see Cited by above for individually listed citing works. Last refreshed 0 seconds ago.