Deep reinforcement learning (DRL) offers a sophisticated approach to developing intelligent traffic light controllers, with various DRL methods having been proposed in recent years. However, much of the research is limited to laboratory, simulation settings, and simple network structures, leaving their effectiveness in real-world scenarios largely unproven. In this work, we construct a large traffic network based on real-world conditions, in Birmingham, UK, and assess its performance in a wide variety of simulated realistic traffic scenarios. We assess performance improvements both locally (on a per junction basis) and globally (across the network) when applying DRL-trained controllers to key junctions. Our findings highlight the substantially positive impact our DRL-trained controller has under imbalanced traffic conditions (e.g., high traffic volume on certain routes and not on others, during peak hours), where it outperforms traditional pressure-based controllers in improving local traffic performance. However, they do not consistently enhance global performance and indicate the need for more research to achieve this aim.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Deep Reinforcement Learning Traffic Signal Controller for Large, Real-World Traffic Networks

  • Yingyi Kuang,
  • Maria Chli,
  • George Vogiatzis

摘要

Deep reinforcement learning (DRL) offers a sophisticated approach to developing intelligent traffic light controllers, with various DRL methods having been proposed in recent years. However, much of the research is limited to laboratory, simulation settings, and simple network structures, leaving their effectiveness in real-world scenarios largely unproven. In this work, we construct a large traffic network based on real-world conditions, in Birmingham, UK, and assess its performance in a wide variety of simulated realistic traffic scenarios. We assess performance improvements both locally (on a per junction basis) and globally (across the network) when applying DRL-trained controllers to key junctions. Our findings highlight the substantially positive impact our DRL-trained controller has under imbalanced traffic conditions (e.g., high traffic volume on certain routes and not on others, during peak hours), where it outperforms traditional pressure-based controllers in improving local traffic performance. However, they do not consistently enhance global performance and indicate the need for more research to achieve this aim.