Blockchain-Enabled Multi-Agent Reinforcement Learning for Secure Decentralised Resource Allocation in 5G/6G Network Slicing
DOI:
https://doi.org/10.70062/globalscience.v1i3.174Keywords:
Blockchain Technology, Multi-Agent, Network Slicing, Reinforcement Learning, Resource AllocationAbstract
The integration of blockchain technology with Multi-Agent Reinforcement Learning (MARL) presents a promising solution for optimizing resource allocation and ensuring security in decentralized network environments, particularly in 5G and 6G network slicing. This research proposes a model that combines the security features of blockchain with the adaptive, decentralized decision-making capabilities of MARL. Blockchain ensures the integrity and transparency of resource allocation by providing a secure, tamper-proof ledger for transaction validation, while MARL allows agents to dynamically allocate resources based on real-time network conditions. The simulation results demonstrate significant improvements in resource allocation efficiency, fairness among users, and resilience to cyberattacks. By combining these two technologies, the proposed model overcomes many of the challenges posed by traditional centralized systems and offers an enhanced, secure, and fair solution for resource distribution in future mobile networks. However, scalability remains a challenge, especially in large-scale networks where transaction processing and consensus overhead can create bottlenecks. Additionally, training complexity in MARL models presents computational challenges, particularly in highly dynamic network environments. The model's performance trade-offs, including the balance between high security and system overhead, are also discussed. Future research should focus on optimizing blockchain consensus mechanisms to improve scalability and enhancing MARL model training techniques to reduce computational costs and improve real-time decision-making. This integration holds significant potential for revolutionizing resource allocation in 5G and 6G networks, enabling more efficient, secure, and fair management of network resources in the increasingly complex and decentralized digital ecosystem
References
Abbasi, M., Prieto, J., Plaza-Hernández, M., & Corchado, J. M. (2023). A Novel Aging-Based Proof of Stake Consensus Mechanism. Lecture Notes in Networks and Systems, 732 LNNS, 49 – 61. https://doi.org/10.1007/978-3-031-36957-5_5
Andrijasa, M. F., Ismail, S. A., Ahmad, N., & Yusop, O. M. (2024). Enhancing Smart Contract Security Through Multi-Agent Deep Reinforcement Learning Fuzzing: A Survey of Approaches and Techniques. International Journal of Advanced Computer Science and Applications, 15(5), 754 – 767. https://doi.org/10.14569/IJACSA.2024.0150576
Arali, N., Narayan, D. G., Altaf, H. M., & Hiremath, P. S. (2024). An Efficient and Secure Blockchain Consensus Algorithm Using Game Theory. International Journal of Computer Network and Information Security, 16(2), 92 – 102. https://doi.org/10.5815/ijcnis.2024.02.08
Awada, H., Berri, S., & Chorti, A. (2024). Learning-Based Resource Allocation for MBRLLC and Homogeneous Slices in 6G Networks. Proceedings of the 3rd International Conference on 6G Networking, 6GNet 2024, 127 – 134. https://doi.org/10.1109/6GNet63182.2024.10765787
Bandara, E., Foytik, P., Shetty, S., Mukkamala, R., Rahman, A., Liang, X., Keong, N. W., & Zoysa, K. De. (2024). SliceGPT - OpenAI GPT-3.5 LLM, Blockchain and Non-Fungible Token Enabled Intelligent 5G/6G Network Slice Broker and Marketplace. Proceedings - IEEE Consumer Communications and Networking Conference, CCNC, 439 – 445. https://doi.org/10.1109/CCNC51664.2024.10454701
Chen, X., Zhang, G., Han, G., & Peng, Z. (2024). Resource Management with Blockchain for Delay-Sensitive Transmission in UAV-assisted Vehicular Network. 2024 4th International Conference on Neural Networks, Information and Communication Engineering, NNICE 2024, 506 – 510. https://doi.org/10.1109/NNICE61279.2024.10498816
Chien, W.-C., Huang, S.-Y., Lai, C.-F., & Chao, H.-C. (2020). Resource management in 5g mobile networks: Survey and challenges. Journal of Information Processing Systems, 16(4), 896 – 914. https://doi.org/10.3745/JIPS.03.0143
Hasan, M., & Hossain, E. (2016). Distributed Resource Allocation in 5G Cellular Networks. In Towards 5G: Applications, Requirements and Candidate Technologies. https://doi.org/10.1002/9781118979846.ch8
He, Y., Du, S., Xia, S., Zhong, Y., Liu, Q., Tian, C., Fang, W., & Xiong, M. (2024). CT-PBFT: A Comprehensive Trust-Based Practical Byzantine Consensus Algorithm. Proceedings of the IEEE International Conference on Computer and Communications, ICCC, 2024, 995 – 999. https://doi.org/10.1109/ICCC62609.2024.10941849
Jain, A., Sridevi, J., Dabral, U., Malhotra, A., & Kapila, I. (2024). Multi-Agent Reinforcement Learning for Power System Operation and Control. E3S Web of Conferences, 511. https://doi.org/10.1051/e3sconf/202451101021
Kukliński, S., Tomaszewski, L., Kołakowski, R., & Chemouil, P. (2021). 6G-LEGO: A Framework for 6G Network Slices. Journal of Communications and Networks, 23(6), 442 – 453. https://doi.org/10.23919/JCN.2021.000025
Li, Y., Cheng, X., Wang, Y., Xu, L., Jin, Y., & Liu, G. (2021). Research on Wireless Resource Management and Scheduling for 5G Network Slice. 2021 International Wireless Communications and Mobile Computing, IWCMC 2021, 508 – 513. https://doi.org/10.1109/IWCMC51323.2021.9498806
Marinescu, A., Dusparic, I., Taylor, A., Canili, V., & Clarke, S. (2015). P-MARL: Prediction-based Multi-Agent Reinforcement Learning for non-stationary environments (extended abstract). Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS, 3, 1897 – 1898. https://www.scopus.com/inward/record.uri?eid=2-s2.0-84944687570&partnerID=40&md5=d158a3f32352504b5bd5f0334a89cd5f
Mohammed Seid, A., Erbad, A., Abishu, H. N., Albaseer, A., Abdallah, M., & Guizani, M. (2023). Blockchain-empowered resource allocation in multi-UAV-enabled 5G-RAN: A multi-agent deep reinforcement learning approach. IEEE Transactions on Cognitive Communications and Networking, 9(4), 991–1011. https://doi.org/10.1109/TCCN.2023.3262242
Mrabet, K., Bouanani, F. El, & Ben-Azza, H. (2023). Generalized Secure and Dynamic Decentralized Reputation System With a Dishonest Majority. IEEE Access, 11, 9368 – 9388. https://doi.org/10.1109/ACCESS.2023.3239394
Narayan, D. G., Arali, N., & Tejas, R. (2024). DPoSEB: Delegated Proof of Stake with Exponential Backoff Consensus Algorithm for Ethereum Blockchain. Computer Science Journal of Moldova, 32(2), 262 – 288. https://doi.org/10.56415/csjm.v32.14
Ndajah, P., Matine, A. O., & Hounkonnou, M. N. (2019). Black Hole Attack Prevention in Wireless Peer-to-Peer Networks: A New Strategy. International Journal of Wireless Information Networks, 26(1), 48 – 60. https://doi.org/10.1007/s10776-018-0418-z
Ouyang, Z., Shao, J., & Zeng, Y. (2021). PoW and PoS and Related Applications. 2021 International Conference on Electronic Information Engineering and Computer Science, EIECS 2021, 59 – 62. https://doi.org/10.1109/EIECS53707.2021.9588080
Pan, Q., Wu, J., Li, J., Yang, W., & Guizani, M. (2024). Blockchain and Multi-Agent Learning Empowered Incentive IRS Resource Scheduling for Intelligent Reconfigurable Networks. IEEE/ACM Transactions on Networking, 32(2), 943 – 958. https://doi.org/10.1109/TNET.2023.3309729
Park, K., Sung, S., Kim, H., & Jung, J. (2023). Technology trends and challenges in SDN and service assurance for end-to-end network slicing. Computer Networks, 234. https://doi.org/10.1016/j.comnet.2023.109908
Ricart-Sanchez, R., Malagon, P., Alcaraz-Calero, J. M., & Wang, Q. (2019). P4-NetFPGA-based network slicing solution for 5G MEC architectures. 2019 ACM/IEEE Symposium on Architectures for Networking and Communications Systems, ANCS 2019. https://doi.org/10.1109/ANCS.2019.8901889
Salhab, N., Langar, R., Rahim, R., Cherrier, S., & Outtagarts, A. (2021). Autonomous Network Slicing Prototype Using Machine-Learning-Based Forecasting for Radio Resources. IEEE Communications Magazine, 59(6), 73 – 79. https://doi.org/10.1109/MCOM.001.2000922
Sami, H., Mizouni, R., Otrok, H., Singh, S., Bentahar, J., & Mourad, A. (2024). LearnChain: Transparent and cooperative reinforcement learning on Blockchain. Future Generation Computer Systems, 150, 255 – 271. https://doi.org/10.1016/j.future.2023.09.012
Shurman, M., Taqieddin, E., Oudat, O., Al-Qurran, R., & Nounou, A. A. Al. (2019). Performance Enhancement in 5G Cellular Networks Using Priorities in Network Slicing. 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology, JEEIT 2019 - Proceedings, 822 – 826. https://doi.org/10.1109/JEEIT.2019.8717469
Subedi, P., Alsadoon, A., Prasad, P. W. C., Rehman, S., Giweli, N., Imran, M., & Arif, S. (2021). Network slicing: a next generation 5G perspective. Eurasip Journal on Wireless Communications and Networking, 2021(1). https://doi.org/10.1186/s13638-021-01983-7
Sun, Z., Hao, R., Lu, T., & Wang, M. (2023). Optimization of Multi-microgrid Operation Based on Blockchain Technology and Multi-agent Reinforcement Learning. 2023 International Conference on Power Energy Systems and Applications, ICoPESA 2023, 549 – 553. https://doi.org/10.1109/ICoPESA56898.2023.10140894
Wang, H., Qi, W., Kadoch, M., & Hong, T. (2024). Low-Carbon Federated Multiagent-DRL Enhanced Network Slicing for Satellite Direct-to-Device Communications. IEEE Internet of Things Journal, 11(24), 39158 – 39169. https://doi.org/10.1109/JIOT.2024.3479779
Wu, M., Xiao, Y., Gao, Y., & Lei, X. (2022). Design of Quality-of-Experience Criteria for Resource Allocation Toward 6G Wireless Networks: A Review and New Directions. IEEE Vehicular Technology Conference, 2022-September. https://doi.org/10.1109/VTC2022-Fall57202.2022.10013024
Yadav, R., Kamran, R., Jha, P., & Karandikar, A. (2024). An architecture for control plane slicing in beyond 5G networks. Computer Networks, 249. https://doi.org/10.1016/j.comnet.2024.110511
Yang, F., Zhou, W., Wu, Q., Long, R., Xiong, N. N., & Zhou, M. (2019). Delegated proof of stake with downgrade: A secure and efficient blockchain consensus algorithm with downgrade mechanism. IEEE Access, 7, 118541 – 118555. https://doi.org/10.1109/ACCESS.2019.2935149
Yang, H., So, T., & Xu, Y. (2021). 5G network slicing. In 5G NR and Enhancements: From R15 to R16. https://doi.org/10.1016/B978-0-323-91060-6.00012-X
Yin, Z., Bai, B., Liu, Y., & Cheng, T. (2024). Research on Distributed Node Resource Optimization Mechanism for Multi-Agent Systems Combined with Blockchain Technology. Proceedings - 2024 IEEE International Conference on Blockchain, Blockchain 2024, 536 – 541. https://doi.org/10.1109/Blockchain62396.2024.00079
Zhang, H., & Han, Z. (2019). Distributed resource allocation for network virtualization. In Handbook of Cognitive Radio (Vols. 2–3). https://doi.org/10.1007/978-981-10-1394-2_39
Zhang, P., Xu, C., Xia, C., & Jin, X. (2023). Blockchain-based Dependable Task Offloading and Resource Allocation for IIoT via Multi-Agent Deep Reinforcement Learning. IEEE Vehicular Technology Conference. https://doi.org/10.1109/VTC2023-Fall60731.2023.10333859
Zhou, L., Gu, K., Kang, Y., & Chen, Q. (2024). Blockchain-Based Transformer-Assisted Multi-Agent Reinforcement Learning for Resource Allocation and Computation Offloading in 5G Private Networks. 2024 4th International Conference on Electronic Information Engineering and Computer Communication, EIECC 2024, 1265 – 1271. https://doi.org/10.1109/EIECC64539.2024.10929530
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Global Science: Journal of Information Technology and Computer Science
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
