Explainable Deep-Reinforcement Learning Framework for Autonomous Traffic Signal Control Integrating V2X Data and Smart Infrastructure
DOI:
https://doi.org/10.70062/globalscience.v1i2.172Keywords:
Autonomous traffic, Deep reinforcement, Real-Time Data, Smart Infrastructure, Vehicle-to-EverythingAbstract
The integration of autonomous systems in traffic management has become increasingly important as urban populations and vehicle numbers continue to rise, leading to significant congestion. Traditional traffic signal control systems, which rely on fixed timing, are no longer sufficient to handle the dynamic and complex nature of urban traffic. To address these challenges, the proposed explainable Deep Reinforcement Learning (DRL) framework aims to optimize traffic signal control by dynamically adjusting traffic signals based on real-time data. This approach enhances traffic flow efficiency, reduces congestion, and improves overall system performance. The framework leverages Vehicle-to-Everything (V2X) communication, which enables real-time data exchange between vehicles, infrastructure, and other road users, extending the perception range of autonomous vehicles and providing valuable insights for traffic signal optimization. Additionally, the integration of smart infrastructure, such as smart intersections, plays a crucial role in enabling adaptive traffic management and facilitating better coordination across multiple intersections. One of the key advantages of the proposed system is its transparency, achieved through the implementation of explainable AI (XAI) techniques. These mechanisms provide clear insights into the decision-making processes, ensuring that traffic management authorities and system users can understand the rationale behind the system’s decisions. Although challenges such as data accuracy, scalability, and cybersecurity risks remain, the proposed DRL framework shows great promise in revolutionizing traffic management systems. Future research directions include enhancing data collection methods, improving the scalability of the system for larger cities, and further developing explainability features to improve trust and adoption in real-world applications.
References
Abboud, K., Omar, H. A., & Zhuang, W. (2016). Interworking of DSRC and Cellular Network Technologies for V2X Communications: A Survey. IEEE Transactions on Vehicular Technology, 65(12), 9457 - 9470. https://doi.org/10.1109/TVT.2016.2591558
https://doi.org/10.1109/TVT.2016.2591558
Agrawal, S., Song, R., Kohli, A., Korb, A., Andre, M., Holzinger, E., & Elger, G. (2022). Concept of Smart Infrastructure for Connected Vehicle Assist and Traffic Flow Optimization. International Conference on Vehicle Technology and Intelligent Transport Systems, VEHITS - Proceedings, 360 - 367. https://doi.org/10.5220/0011068800003191
https://doi.org/10.5220/0011068800003191
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017). Deep reinforcement learning: A brief survey. IEEE Signal Processing Magazine, 34(6), 26 - 38. https://doi.org/10.1109/MSP.2017.2743240
https://doi.org/10.1109/MSP.2017.2743240
Beg, A., Qureshi, A. R., Sheltami, T., & Yasar, A. (2021). UAV-enabled intelligent traffic policing and emergency response handling system for the smart city. Personal and Ubiquitous Computing, 25(1), 33 - 50. https://doi.org/10.1007/s00779-019-01297-y
https://doi.org/10.1007/s00779-019-01297-y
Bıyık, C., Abareshi, A., Paz, A., Ruiz, R. A., Battarra, R., Rogers, C. D. F., & Lizarraga, C. (2021). Smart mobility adoption: A review of the literature. Journal of Open Innovation: Technology, Market, and Complexity, 7(2). https://doi.org/10.3390/joitmc7020146
https://doi.org/10.3390/joitmc7020146
Cao, M., Li, V. O. K., & Shuai, Q. (2022). Book Your Green Wave: Exploiting Navigation Information for Intelligent Traffic Signal Control. IEEE Transactions on Vehicular Technology, 71(8), 8225 - 8236. https://doi.org/10.1109/TVT.2022.3176620
https://doi.org/10.1109/TVT.2022.3176620
Chehri, A., Quadar, N., & Saadane, R. (2020). Communication and Localization Techniques in VANET Network for Intelligent Traffic System in Smart Cities: A Review. Smart Innovation, Systems and Technologies, 185, 167 - 177. https://doi.org/10.1007/978-981-15-5270-0_15
https://doi.org/10.1007/978-981-15-5270-0_15
Chou, S.-K., Hribarl, J., Dusparic, I., & Fortuna, C. (2024). Towards 6G for Connected Autonomous Vehicles: A Trial Facility Analysis. IEEE International Workshop on Computer Aided Modeling and Design of Communication Links and Networks, CAMAD. https://doi.org/10.1109/CAMAD62243.2024.10943054
https://doi.org/10.1109/CAMAD62243.2024.10943054
Costandoiu, A., & Leba, M. (2019). Convergence of V2X communication systems and next generation networks. IOP Conference Series: Materials Science and Engineering, 477(1). https://doi.org/10.1088/1757-899X/477/1/012052
https://doi.org/10.1088/1757-899X/477/1/012052
Dai, X., Vallati, M., Guo, R., Wang, Y., Han, S., & Lin, Y. (2023). The Road Ahead: DAO-Secured V2X Infrastructures for Safe and Smart Vehicular Management. IEEE Transactions on Intelligent Vehicles, 8(12), 4674 - 4677. https://doi.org/10.1109/TIV.2023.3337993
https://doi.org/10.1109/TIV.2023.3337993
Darqaoui, M., Coulibaly, M., & Errami, A. (2024). Cellular-V2X and VANET(DSRC) Based End-to-End Guidance for Smart Parking. Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, 527 LNICST, 3 - 13. https://doi.org/10.1007/978-3-031-58053-6_1
https://doi.org/10.1007/978-3-031-58053-6_1
Djahel, S., Doolan, R., Muntean, G.-M., & Murphy, J. (2015). A Communications-Oriented Perspective on Traffic Management Systems for Smart Cities: Challenges and Innovative Approaches. IEEE Communications Surveys and Tutorials, 17(1), 125 - 151. https://doi.org/10.1109/COMST.2014.2339817
https://doi.org/10.1109/COMST.2014.2339817
El Sallab, A., Abdou, M., Perot, E., & Yogamani, S. (2017). Deep reinforcement learning framework for autonomous driving. IS and T International Symposium on Electronic Imaging Science and Technology, 70-76. https://doi.org/10.2352/ISSN.2470-1173.2017.19.AVM-023
https://doi.org/10.2352/ISSN.2470-1173.2017.19.AVM-023
Fitzgerald, M. (2023). The Challenges and Opportunities With Implementing V2X. Microwave Journal, 66(11), 72-74 and 76 78 80. https://www.scopus.com/inward/record.uri?eid=2-s2.0-105018188856&partnerID=40&md5=554e7ddca668f89593d98efe47a1bd99
Garg, D., Chli, M., & Vogiatzis, G. (2019). A Deep Reinforcement Learning Agent for Traffic Intersection Control Optimization. 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019, 4222 - 4229. https://doi.org/10.1109/ITSC.2019.8917361
https://doi.org/10.1109/ITSC.2019.8917361
Gaur, L., & Sahoo, B. M. (2022). Explainable Artificial Intelligence for Intelligent Transportation Systems: Ethics and Applications. In Explainable Artificial Intelligence for Intelligent Transportation Systems: Ethics and Applications. https://doi.org/10.1007/978-3-031-09644-0
https://doi.org/10.1007/978-3-031-09644-0
Guo, J., & Wang, S. (2021). Poster: Can Traffic Lights and CAV Work Together using Deep Reinforcement Learning? IEEE Vehicular Networking Conference, VNC, 2021-November, 127 - 128. https://doi.org/10.1109/VNC52810.2021.9644681
https://doi.org/10.1109/VNC52810.2021.9644681
Hudon, A., Demazure, T., Karran, A., Léger, P.-M., & Sénécal, S. (2021). Explainable Artificial Intelligence (XAI): How the Visualization of AI Predictions Affects User Cognitive Load and Confidence. Lecture Notes in Information Systems and Organisation, 52 LNISO, 237 - 246. https://doi.org/10.1007/978-3-030-88900-5_27
https://doi.org/10.1007/978-3-030-88900-5_27
Kabalci, Y., & Mutlu, U. (2023). Emerging Communication Technologies for V2X: Standards and Protocols. Power Systems, Part F1423, 301 - 329. https://doi.org/10.1007/978-3-031-38506-3_12
https://doi.org/10.1007/978-3-031-38506-3_12
Kansal, V., Shnain, A. H., Deepak, A., Rana, A., Manjunatha, Dixit, K. K., & Rajkumar, K. V. (2024). Deep Reinforcement Learning for IoT-Based Smart Traffic Management Systems. Proceedings of International Conference on Contemporary Computing and Informatics, IC3I 2024, 1707 - 1713. https://doi.org/10.1109/IC3I61595.2024.10829291
https://doi.org/10.1109/IC3I61595.2024.10829291
Karran, A. J., Demazure, T., Hudon, A., Senecal, S., & Léger, P.-M. (2022). Designing for Confidence: The Impact of Visualizing Artificial Intelligence Decisions. Frontiers in Neuroscience, 16. https://doi.org/10.3389/fnins.2022.883385
https://doi.org/10.3389/fnins.2022.883385
Khare, R., Naik, A., Raj, S., Srivastava, A., & Khandare, S. (2022). Green Corridor Implementation and Real Time Adaptive Traffic Regulation using Machine Learning and Image Processing. 2022 IEEE Industrial Electronics and Applications Conference, IEACon 2022, 235 - 239. https://doi.org/10.1109/IEACon55029.2022.9951734
https://doi.org/10.1109/IEACon55029.2022.9951734
Lin, W., Hu, X., & Wang, J. (2023). Multi-Level Objective Control of AVs at a Saturated Signalized Intersection with Multi-Agent Deep Reinforcement Learning Approach. Journal of Intelligent and Connected Vehicles, 6(4), 250 - 263. https://doi.org/10.26599/JICV.2023.9210021
https://doi.org/10.26599/JICV.2023.9210021
Luthra, A., & Chugh, N. (2024). A Review of Traffic Management: Real-Time Monitoring and Dynamic Control. 2024 2nd International Conference on Advancements and Key Challenges in Green Energy and Computing, AKGEC 2024. https://doi.org/10.1109/AKGEC62572.2024.10867948
https://doi.org/10.1109/AKGEC62572.2024.10867948
Moumen, I., Abouchabaka, J., & Rafalia, N. (2023). Enhancing urban mobility: integration of IoT road traffic data and artificial intelligence in smart city environment. Indonesian Journal of Electrical Engineering and Computer Science, 32(2), 985 - 993. https://doi.org/10.11591/ijeecs.v32.i2.pp985-993
https://doi.org/10.11591/ijeecs.v32.i2.pp985-993
Muriuki, K. P., Okello, J. O., & Chepkoech, J. (2024). Advanced Intelligent Traffic Management System(AITMS): A Generative AI-Enhanced Model. 2024 IEEE PES/IAS PowerAfrica, PowerAfrica 2024. https://doi.org/10.1109/PowerAfrica61624.2024.10759478
https://doi.org/10.1109/PowerAfrica61624.2024.10759478
Narayana, S., Mani, G. A., Sundaresan, P., & Nagarajan, K. (2024). V2V communication for electric vehicles using Lora. AIP Conference Proceedings, 3044(1). https://doi.org/10.1063/5.0209533
https://doi.org/10.1063/5.0209533
Naser, Z. S., Belguith, H. M., & Fakhfakh, A. (2024). Traffic Management Based on Cloud and MEC Architecture with Evolutionary Approaches towards AI: A Review. International Journal of Online and Biomedical Engineering, 20(12), 19 - 36. https://doi.org/10.3991/ijoe.v20i12.49787
https://doi.org/10.3991/ijoe.v20i12.49787
Ramanathan, R. A., BalaMurugan, R., Bama Krishna, R. S., & Selvan, M. P. (2023). A Review of Intelligent Traffic Management Systems. 7th International Conference on Trends in Electronics and Informatics, ICOEI 2023 - Proceedings, 1652 - 1657. https://doi.org/10.1109/ICOEI56765.2023.10126024
https://doi.org/10.1109/ICOEI56765.2023.10126024
Rath, M., Pati, B., Panigrahi, C. R., & Peng, S.-L. (2020). Control of congestion and traffic light using intelligent approaches in smart city. International Journal of Wireless and Mobile Computing, 18(4), 371 - 380. https://doi.org/10.1504/IJWMC.2020.108537
https://doi.org/10.1504/IJWMC.2020.108537
Rawat, B., Pandey, N., Bist, A., & Joshi, Y. (2024). Towards Transparent Intelligence: A Comprehensive Review of Explainable AI Methods and Applications. Proceeding of 2024 International Conference on Communication, Computing and Energy Efficient Technologies, I3CEET 2024, 953 - 958. https://doi.org/10.1109/I3CEET61722.2024.10993679
https://doi.org/10.1109/I3CEET61722.2024.10993679
Rocha, D., Silva, B., Vieira, E., Almeida, J., Bartolomeu, P., & Ferreira, J. (2024). Unlocking the Potential of C-ITS Data for the Deployment of Traffic Management Systems. IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, 1322 - 1329. https://doi.org/10.1109/ITSC58415.2024.10919959
https://doi.org/10.1109/ITSC58415.2024.10919959
Saksham, & Rana, C. (2024). Deep Reinforcement Learning: A Key to Unlocking the Potential of Robotics and Autonomous Systems. In Deep Reinforcement Learning and Its Industrial Use Cases: AI for Real-World Applications. https://doi.org/10.1002/9781394272587.ch2
https://doi.org/10.1002/9781394272587.ch2
Sattarzadeh, A. R., & Pathirana, P. N. (2024). Unification of probabilistic graph model and deep reinforcement learning (UPGMDRL) for multi-intersection traffic signal control. Knowledge-Based Systems, 305. https://doi.org/10.1016/j.knosys.2024.112663
https://doi.org/10.1016/j.knosys.2024.112663
Sedar, R., Vázquez-Gallego, F., Casellas, R., Vilalta, R., Muñoz, R., Silva, R., Dizambourg, L., Barciela, A. E. F., Vilajosana, X., Datta, S. K., Härri, J., & Alonso-Zarate, J. (2021). Standards-compliant multi-protocol on-board unit for the evaluation of connected and automated mobility services in multi-vendor environments†. Sensors, 21(6), 1 - 20. https://doi.org/10.3390/s21062090
https://doi.org/10.3390/s21062090
Shoab, M., & Alotaibi, A. S. (2022). Deep Q-learning based optimal query routing approach for unstructured P2P network. Computers, Materials and Continua, 70(3), 5765 - 5781. https://doi.org/10.32604/cmc.2022.021941
https://doi.org/10.32604/cmc.2022.021941
Singh, D. (2023). Deep Reinforcement Learning (DRL) for Real-Time Traffic Management in Smart Cities. 2023 International Conference on Communication, Security and Artificial Intelligence, ICCSAI 2023, 1001 - 1004. https://doi.org/10.1109/ICCSAI59793.2023.10421359
https://doi.org/10.1109/ICCSAI59793.2023.10421359
Thangam, S., & Sibi Chakkaravarthy, S. (2024). An Edge Enabled Region-oriented DAG-based Distributed Ledger System for Secure V2X Communication. KSII Transactions on Internet and Information Systems, 18(8), 2253 - 2280. https://doi.org/10.3837/tiis.2024.08.011
https://doi.org/10.3837/tiis.2024.08.011
Touko Tcheumadjeu, L. C., Stuerz-Mutalibow, K., Hoeing, J., Harmann, D., Glaab, J., & Kaul, R. (2022). New concepts to improve mobility by digitization and virtualization: An analysis and evaluation of the technical feasibility. In Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST (Vol. 426, pp. 26-43). https://doi.org/10.1007/
Wang, Y., Yang, X., Liang, H., & Liu, Y. (2018). A review of the self-adaptive traffic signal control system based on future traffic environment. Journal of Advanced Transportation, 2018. https://doi.org/10.1155/2018/1096123
https://doi.org/10.1155/2018/1096123
Zhang, G., Chang, F., Jin, J., Yang, F., & Huang, H. (2024). Multi-objective deep reinforcement learning approach for adaptive traffic signal control system with concurrent optimization of safety, efficiency, and decarbonization at intersections. Accident Analysis and Prevention, 199. https://doi.org/10.1016/j.aap.2023.107451
https://doi.org/10.1016/j.aap.2023.107451
Zhao, J., & Gao, H. (2024). Learning-Based Hybrid Exploration Method for Adaptive Traffic Signal Control. International Journal of Image and Graphics. https://doi.org/10.1142/S0219467827500112
https://doi.org/10.1142/S0219467827500112
Zheng, H., Zang, Z., Yang, S., & Mangharam, R. (2023). Towards Explainability in Modular Autonomous System Software. IEEE Intelligent Vehicles Symposium, Proceedings, 2023-June. https://doi.org/10.1109/IV55152.2023.10186720
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Global Science: Journal of Information Technology and Computer Science

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

