Explainable Deep-Reinforcement Learning Framework for Autonomous Traffic Signal Control Integrating V2X Data and Smart Infrastructure

Authors

  • Jarot Dian Susatyono Universitas Sains dan Teknologi Komputer Semarang
  • Sofiansyah Fadli STMIK Lombok
  • G Thippanna Dr K V Subbareddy Institute of Technology Andhra Pradesh

DOI:

https://doi.org/10.70062/globalscience.v1i2.172

Keywords:

Autonomous traffic, Deep reinforcement, Real-Time Data, Smart Infrastructure, Vehicle-to-Everything

Abstract

The integration of autonomous systems in traffic management has become increasingly important as urban populations and vehicle numbers continue to rise, leading to significant congestion. Traditional traffic signal control systems, which rely on fixed timing, are no longer sufficient to handle the dynamic and complex nature of urban traffic. To address these challenges, the proposed explainable Deep Reinforcement Learning (DRL) framework aims to optimize traffic signal control by dynamically adjusting traffic signals based on real-time data. This approach enhances traffic flow efficiency, reduces congestion, and improves overall system performance. The framework leverages Vehicle-to-Everything (V2X) communication, which enables real-time data exchange between vehicles, infrastructure, and other road users, extending the perception range of autonomous vehicles and providing valuable insights for traffic signal optimization. Additionally, the integration of smart infrastructure, such as smart intersections, plays a crucial role in enabling adaptive traffic management and facilitating better coordination across multiple intersections. One of the key advantages of the proposed system is its transparency, achieved through the implementation of explainable AI (XAI) techniques. These mechanisms provide clear insights into the decision-making processes, ensuring that traffic management authorities and system users can understand the rationale behind the system’s decisions. Although challenges such as data accuracy, scalability, and cybersecurity risks remain, the proposed DRL framework shows great promise in revolutionizing traffic management systems. Future research directions include enhancing data collection methods, improving the scalability of the system for larger cities, and further developing explainability features to improve trust and adoption in real-world applications.

References

Abboud, K., Omar, H. A., & Zhuang, W. (2016). Interworking of DSRC and Cellular Network Technologies for V2X Communications: A Survey. IEEE Transactions on Vehicular Technology, 65(12), 9457 - 9470. https://doi.org/10.1109/TVT.2016.2591558

https://doi.org/10.1109/TVT.2016.2591558

Agrawal, S., Song, R., Kohli, A., Korb, A., Andre, M., Holzinger, E., & Elger, G. (2022). Concept of Smart Infrastructure for Connected Vehicle Assist and Traffic Flow Optimization. International Conference on Vehicle Technology and Intelligent Transport Systems, VEHITS - Proceedings, 360 - 367. https://doi.org/10.5220/0011068800003191

https://doi.org/10.5220/0011068800003191

Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017). Deep reinforcement learning: A brief survey. IEEE Signal Processing Magazine, 34(6), 26 - 38. https://doi.org/10.1109/MSP.2017.2743240

https://doi.org/10.1109/MSP.2017.2743240

Beg, A., Qureshi, A. R., Sheltami, T., & Yasar, A. (2021). UAV-enabled intelligent traffic policing and emergency response handling system for the smart city. Personal and Ubiquitous Computing, 25(1), 33 - 50. https://doi.org/10.1007/s00779-019-01297-y

https://doi.org/10.1007/s00779-019-01297-y

Bıyık, C., Abareshi, A., Paz, A., Ruiz, R. A., Battarra, R., Rogers, C. D. F., & Lizarraga, C. (2021). Smart mobility adoption: A review of the literature. Journal of Open Innovation: Technology, Market, and Complexity, 7(2). https://doi.org/10.3390/joitmc7020146

https://doi.org/10.3390/joitmc7020146

Cao, M., Li, V. O. K., & Shuai, Q. (2022). Book Your Green Wave: Exploiting Navigation Information for Intelligent Traffic Signal Control. IEEE Transactions on Vehicular Technology, 71(8), 8225 - 8236. https://doi.org/10.1109/TVT.2022.3176620

https://doi.org/10.1109/TVT.2022.3176620

Chehri, A., Quadar, N., & Saadane, R. (2020). Communication and Localization Techniques in VANET Network for Intelligent Traffic System in Smart Cities: A Review. Smart Innovation, Systems and Technologies, 185, 167 - 177. https://doi.org/10.1007/978-981-15-5270-0_15

https://doi.org/10.1007/978-981-15-5270-0_15

Chou, S.-K., Hribarl, J., Dusparic, I., & Fortuna, C. (2024). Towards 6G for Connected Autonomous Vehicles: A Trial Facility Analysis. IEEE International Workshop on Computer Aided Modeling and Design of Communication Links and Networks, CAMAD. https://doi.org/10.1109/CAMAD62243.2024.10943054

https://doi.org/10.1109/CAMAD62243.2024.10943054

Costandoiu, A., & Leba, M. (2019). Convergence of V2X communication systems and next generation networks. IOP Conference Series: Materials Science and Engineering, 477(1). https://doi.org/10.1088/1757-899X/477/1/012052

https://doi.org/10.1088/1757-899X/477/1/012052

Dai, X., Vallati, M., Guo, R., Wang, Y., Han, S., & Lin, Y. (2023). The Road Ahead: DAO-Secured V2X Infrastructures for Safe and Smart Vehicular Management. IEEE Transactions on Intelligent Vehicles, 8(12), 4674 - 4677. https://doi.org/10.1109/TIV.2023.3337993

https://doi.org/10.1109/TIV.2023.3337993

Darqaoui, M., Coulibaly, M., & Errami, A. (2024). Cellular-V2X and VANET(DSRC) Based End-to-End Guidance for Smart Parking. Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, 527 LNICST, 3 - 13. https://doi.org/10.1007/978-3-031-58053-6_1

https://doi.org/10.1007/978-3-031-58053-6_1

Djahel, S., Doolan, R., Muntean, G.-M., & Murphy, J. (2015). A Communications-Oriented Perspective on Traffic Management Systems for Smart Cities: Challenges and Innovative Approaches. IEEE Communications Surveys and Tutorials, 17(1), 125 - 151. https://doi.org/10.1109/COMST.2014.2339817

https://doi.org/10.1109/COMST.2014.2339817

El Sallab, A., Abdou, M., Perot, E., & Yogamani, S. (2017). Deep reinforcement learning framework for autonomous driving. IS and T International Symposium on Electronic Imaging Science and Technology, 70-76. https://doi.org/10.2352/ISSN.2470-1173.2017.19.AVM-023

https://doi.org/10.2352/ISSN.2470-1173.2017.19.AVM-023

Fitzgerald, M. (2023). The Challenges and Opportunities With Implementing V2X. Microwave Journal, 66(11), 72-74 and 76 78 80. https://www.scopus.com/inward/record.uri?eid=2-s2.0-105018188856&partnerID=40&md5=554e7ddca668f89593d98efe47a1bd99

Garg, D., Chli, M., & Vogiatzis, G. (2019). A Deep Reinforcement Learning Agent for Traffic Intersection Control Optimization. 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019, 4222 - 4229. https://doi.org/10.1109/ITSC.2019.8917361

https://doi.org/10.1109/ITSC.2019.8917361

Gaur, L., & Sahoo, B. M. (2022). Explainable Artificial Intelligence for Intelligent Transportation Systems: Ethics and Applications. In Explainable Artificial Intelligence for Intelligent Transportation Systems: Ethics and Applications. https://doi.org/10.1007/978-3-031-09644-0

https://doi.org/10.1007/978-3-031-09644-0

Guo, J., & Wang, S. (2021). Poster: Can Traffic Lights and CAV Work Together using Deep Reinforcement Learning? IEEE Vehicular Networking Conference, VNC, 2021-November, 127 - 128. https://doi.org/10.1109/VNC52810.2021.9644681

https://doi.org/10.1109/VNC52810.2021.9644681

Hudon, A., Demazure, T., Karran, A., Léger, P.-M., & Sénécal, S. (2021). Explainable Artificial Intelligence (XAI): How the Visualization of AI Predictions Affects User Cognitive Load and Confidence. Lecture Notes in Information Systems and Organisation, 52 LNISO, 237 - 246. https://doi.org/10.1007/978-3-030-88900-5_27

https://doi.org/10.1007/978-3-030-88900-5_27

Kabalci, Y., & Mutlu, U. (2023). Emerging Communication Technologies for V2X: Standards and Protocols. Power Systems, Part F1423, 301 - 329. https://doi.org/10.1007/978-3-031-38506-3_12

https://doi.org/10.1007/978-3-031-38506-3_12

Kansal, V., Shnain, A. H., Deepak, A., Rana, A., Manjunatha, Dixit, K. K., & Rajkumar, K. V. (2024). Deep Reinforcement Learning for IoT-Based Smart Traffic Management Systems. Proceedings of International Conference on Contemporary Computing and Informatics, IC3I 2024, 1707 - 1713. https://doi.org/10.1109/IC3I61595.2024.10829291

https://doi.org/10.1109/IC3I61595.2024.10829291

Karran, A. J., Demazure, T., Hudon, A., Senecal, S., & Léger, P.-M. (2022). Designing for Confidence: The Impact of Visualizing Artificial Intelligence Decisions. Frontiers in Neuroscience, 16. https://doi.org/10.3389/fnins.2022.883385

https://doi.org/10.3389/fnins.2022.883385

Khare, R., Naik, A., Raj, S., Srivastava, A., & Khandare, S. (2022). Green Corridor Implementation and Real Time Adaptive Traffic Regulation using Machine Learning and Image Processing. 2022 IEEE Industrial Electronics and Applications Conference, IEACon 2022, 235 - 239. https://doi.org/10.1109/IEACon55029.2022.9951734

https://doi.org/10.1109/IEACon55029.2022.9951734

Lin, W., Hu, X., & Wang, J. (2023). Multi-Level Objective Control of AVs at a Saturated Signalized Intersection with Multi-Agent Deep Reinforcement Learning Approach. Journal of Intelligent and Connected Vehicles, 6(4), 250 - 263. https://doi.org/10.26599/JICV.2023.9210021

https://doi.org/10.26599/JICV.2023.9210021

Luthra, A., & Chugh, N. (2024). A Review of Traffic Management: Real-Time Monitoring and Dynamic Control. 2024 2nd International Conference on Advancements and Key Challenges in Green Energy and Computing, AKGEC 2024. https://doi.org/10.1109/AKGEC62572.2024.10867948

https://doi.org/10.1109/AKGEC62572.2024.10867948

Moumen, I., Abouchabaka, J., & Rafalia, N. (2023). Enhancing urban mobility: integration of IoT road traffic data and artificial intelligence in smart city environment. Indonesian Journal of Electrical Engineering and Computer Science, 32(2), 985 - 993. https://doi.org/10.11591/ijeecs.v32.i2.pp985-993

https://doi.org/10.11591/ijeecs.v32.i2.pp985-993

Muriuki, K. P., Okello, J. O., & Chepkoech, J. (2024). Advanced Intelligent Traffic Management System(AITMS): A Generative AI-Enhanced Model. 2024 IEEE PES/IAS PowerAfrica, PowerAfrica 2024. https://doi.org/10.1109/PowerAfrica61624.2024.10759478

https://doi.org/10.1109/PowerAfrica61624.2024.10759478

Narayana, S., Mani, G. A., Sundaresan, P., & Nagarajan, K. (2024). V2V communication for electric vehicles using Lora. AIP Conference Proceedings, 3044(1). https://doi.org/10.1063/5.0209533

https://doi.org/10.1063/5.0209533

Naser, Z. S., Belguith, H. M., & Fakhfakh, A. (2024). Traffic Management Based on Cloud and MEC Architecture with Evolutionary Approaches towards AI: A Review. International Journal of Online and Biomedical Engineering, 20(12), 19 - 36. https://doi.org/10.3991/ijoe.v20i12.49787

https://doi.org/10.3991/ijoe.v20i12.49787

Ramanathan, R. A., BalaMurugan, R., Bama Krishna, R. S., & Selvan, M. P. (2023). A Review of Intelligent Traffic Management Systems. 7th International Conference on Trends in Electronics and Informatics, ICOEI 2023 - Proceedings, 1652 - 1657. https://doi.org/10.1109/ICOEI56765.2023.10126024

https://doi.org/10.1109/ICOEI56765.2023.10126024

Rath, M., Pati, B., Panigrahi, C. R., & Peng, S.-L. (2020). Control of congestion and traffic light using intelligent approaches in smart city. International Journal of Wireless and Mobile Computing, 18(4), 371 - 380. https://doi.org/10.1504/IJWMC.2020.108537

https://doi.org/10.1504/IJWMC.2020.108537

Rawat, B., Pandey, N., Bist, A., & Joshi, Y. (2024). Towards Transparent Intelligence: A Comprehensive Review of Explainable AI Methods and Applications. Proceeding of 2024 International Conference on Communication, Computing and Energy Efficient Technologies, I3CEET 2024, 953 - 958. https://doi.org/10.1109/I3CEET61722.2024.10993679

https://doi.org/10.1109/I3CEET61722.2024.10993679

Rocha, D., Silva, B., Vieira, E., Almeida, J., Bartolomeu, P., & Ferreira, J. (2024). Unlocking the Potential of C-ITS Data for the Deployment of Traffic Management Systems. IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, 1322 - 1329. https://doi.org/10.1109/ITSC58415.2024.10919959

https://doi.org/10.1109/ITSC58415.2024.10919959

Saksham, & Rana, C. (2024). Deep Reinforcement Learning: A Key to Unlocking the Potential of Robotics and Autonomous Systems. In Deep Reinforcement Learning and Its Industrial Use Cases: AI for Real-World Applications. https://doi.org/10.1002/9781394272587.ch2

https://doi.org/10.1002/9781394272587.ch2

Sattarzadeh, A. R., & Pathirana, P. N. (2024). Unification of probabilistic graph model and deep reinforcement learning (UPGMDRL) for multi-intersection traffic signal control. Knowledge-Based Systems, 305. https://doi.org/10.1016/j.knosys.2024.112663

https://doi.org/10.1016/j.knosys.2024.112663

Sedar, R., Vázquez-Gallego, F., Casellas, R., Vilalta, R., Muñoz, R., Silva, R., Dizambourg, L., Barciela, A. E. F., Vilajosana, X., Datta, S. K., Härri, J., & Alonso-Zarate, J. (2021). Standards-compliant multi-protocol on-board unit for the evaluation of connected and automated mobility services in multi-vendor environments†. Sensors, 21(6), 1 - 20. https://doi.org/10.3390/s21062090

https://doi.org/10.3390/s21062090

Shoab, M., & Alotaibi, A. S. (2022). Deep Q-learning based optimal query routing approach for unstructured P2P network. Computers, Materials and Continua, 70(3), 5765 - 5781. https://doi.org/10.32604/cmc.2022.021941

https://doi.org/10.32604/cmc.2022.021941

Singh, D. (2023). Deep Reinforcement Learning (DRL) for Real-Time Traffic Management in Smart Cities. 2023 International Conference on Communication, Security and Artificial Intelligence, ICCSAI 2023, 1001 - 1004. https://doi.org/10.1109/ICCSAI59793.2023.10421359

https://doi.org/10.1109/ICCSAI59793.2023.10421359

Thangam, S., & Sibi Chakkaravarthy, S. (2024). An Edge Enabled Region-oriented DAG-based Distributed Ledger System for Secure V2X Communication. KSII Transactions on Internet and Information Systems, 18(8), 2253 - 2280. https://doi.org/10.3837/tiis.2024.08.011

https://doi.org/10.3837/tiis.2024.08.011

Touko Tcheumadjeu, L. C., Stuerz-Mutalibow, K., Hoeing, J., Harmann, D., Glaab, J., & Kaul, R. (2022). New concepts to improve mobility by digitization and virtualization: An analysis and evaluation of the technical feasibility. In Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST (Vol. 426, pp. 26-43). https://doi.org/10.1007/

Wang, Y., Yang, X., Liang, H., & Liu, Y. (2018). A review of the self-adaptive traffic signal control system based on future traffic environment. Journal of Advanced Transportation, 2018. https://doi.org/10.1155/2018/1096123

https://doi.org/10.1155/2018/1096123

Zhang, G., Chang, F., Jin, J., Yang, F., & Huang, H. (2024). Multi-objective deep reinforcement learning approach for adaptive traffic signal control system with concurrent optimization of safety, efficiency, and decarbonization at intersections. Accident Analysis and Prevention, 199. https://doi.org/10.1016/j.aap.2023.107451

https://doi.org/10.1016/j.aap.2023.107451

Zhao, J., & Gao, H. (2024). Learning-Based Hybrid Exploration Method for Adaptive Traffic Signal Control. International Journal of Image and Graphics. https://doi.org/10.1142/S0219467827500112

https://doi.org/10.1142/S0219467827500112

Zheng, H., Zang, Z., Yang, S., & Mangharam, R. (2023). Towards Explainability in Modular Autonomous System Software. IEEE Intelligent Vehicles Symposium, Proceedings, 2023-June. https://doi.org/10.1109/IV55152.2023.10186720

https://doi.org/10.1109/IV55152.2023.10186720

Downloads

Published

2025-06-30

How to Cite

Jarot Dian Susatyono, Sofiansyah Fadli, & G Thippanna. (2025). Explainable Deep-Reinforcement Learning Framework for Autonomous Traffic Signal Control Integrating V2X Data and Smart Infrastructure. Global Science: Journal of Information Technology and Computer Science, 1(2), 01–15. https://doi.org/10.70062/globalscience.v1i2.172

Similar Articles

1 2 > >> 

You may also start an advanced similarity search for this article.