Garg, Deepeka, Chli, Maria and Vogiatzis, George (2022). Fully-Autonomous, Vision-based Traffic Signal Control: from Simulation to Reality. IN: Proceedings of the 21st International Conference on Autonomous Agents and Multi-agent Systems (AAMAS 2022). Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS . NZL: ACM.
Abstract
Ineffective traffic signal control is one of the major causes of congestion in urban road networks. Dynamically changing traffic conditions and live traffic state estimation are fundamental challenges that limit the ability of the existing signal infrastructure in rendering individualized signal control in real-time. We use deep reinforcement learning (DRL) to address these challenges. Due to economic and safety constraints associated training such agents in the real world, a practical approach is to do so in simulation before deployment. Domain randomisation is an effective technique for bridging the reality gap and ensuring effective transfer of simulation-trained agents to the real world. In this paper, we develop a fully-autonomous, vision-based DRL agent that achieve adaptive signal control in the face of complex, imprecise, and dynamic traffic environments. Our agent uses live visual data (i.e. a stream of real-time RGB footage) from an intersection to extensively perceive and subsequently act upon the traffic environment. Employing domain randomisation, we examine our agent’s generalisation capabilities under varying traffic conditions in both the simulation and the real-world environments. In a diverse validation set independent of training data, our traffic control agent reliably adapted to novel traffic situations and demonstrated a positive transfer to previously unseen real intersections despite being trained entirely in simulation.
Divisions: | College of Engineering & Physical Sciences > Aston Institute of Urban Technology and the Environment (ASTUTE) College of Engineering & Physical Sciences College of Engineering & Physical Sciences > Systems analytics research institute (SARI) ?? 50811700Jl ?? |
---|---|
Additional Information: | (c) 2022, International Foundation for Autonomous Agents and Multiagent Systems (www.ifaamas.org). All rights reserved. |
Event Title: | 21st International Conference on Autonomous Agents and Multiagent Systems |
Event Type: | Other |
Event Dates: | 2022-05-09 - 2022-05-13 |
Uncontrolled Keywords: | Intelligent Transportation Systems,Autonomous Signal Control,Deep Reinforcement Learning,Artificial Intelligence,Software,Control and Systems Engineering |
ISBN: | 9781713854333 |
Last Modified: | 02 Dec 2024 09:15 |
Date Deposited: | 22 Feb 2022 11:59 |
Full Text Link: | |
Related URLs: |
http://www.scop ... tnerID=8YFLogxK
(Scopus URL) |
PURE Output Type: | Conference contribution |
Published Date: | 2022-05-09 |
Accepted Date: | 2021-12-20 |
Authors: |
Garg, Deepeka
Chli, Maria ( 0000-0002-2840-4475) Vogiatzis, George ( 0000-0002-3226-0603) |