Quantum-Inspired Meta-Heuristic Algorithm for Large-Scale Graph Neural Network Training in Distributed Cloud-Edge Environments
DOI:
https://doi.org/10.70062/globalscience.v1i2.171Keywords:
Distributed Systems, Graph Neural Networks, Hybrid Cloud-Edge, Quantum-Inspired Algorithms, Resource OptimizationAbstract
This paper explores the application of quantum-inspired optimization algorithms in the training of large-scale Graph Neural Networks (GNNs) within distributed cloud-edge environments. GNNs have gained significant attention due to their ability to model complex relationships in graph-structured data, yet their training presents challenges such as high computational demand, inefficient resource allocation, and slow convergence, especially for large datasets. Traditional meta-heuristic algorithms, while useful, often face scalability and performance issues when applied to such large-scale tasks. To address these challenges, we propose a quantum-inspired meta-heuristic algorithm that leverages quantum principles, such as superposition and entanglement, to enhance optimization processes. The algorithm was integrated into a hybrid cloud-edge system, where computational tasks are dynamically distributed between edge nodes and the cloud, optimizing resource utilization and reducing latency. Our experimental results demonstrate significant improvements in training speed, resource efficiency, and convergence rate when compared to traditional optimization methods such as Genetic Algorithms and Simulated Annealing. The quantum-inspired algorithm not only accelerates the training process but also reduces memory usage, making it well-suited for large-scale GNN applications. Furthermore, the system's scalability was enhanced by the hybrid cloud-edge architecture, which balances computational load and enables real-time data processing. The findings suggest that quantum-inspired optimization algorithms can significantly improve the training of GNNs in distributed systems, opening new avenues for real-time applications in areas such as social network analysis, anomaly detection, and recommendation systems. Future work will focus on refining these algorithms to handle even larger datasets and more complex GNN architectures, with potential integration into edge devices for enhanced real-time decision-making.
References
Bencheikh, G. (2024). Metaheuristics and machine learning convergence: A comprehensive survey and future prospects. In Metaheuristic and machine learning optimization strategies for complex systems. https://doi.org/10.4018/979-8-3693-7842-7.ch015
Chang, Y.-J., Nien, C.-F., Huang, K.-P., Zhang, Y.-T., Cho, C.-H., & Chang, C.-R. (2024). Quantum computing for optimization with Ising machine. IEEE Nanotechnology Magazine, 18(3), 15–22. https://doi.org/10.1109/MNANO.2024.3378485
Fankhauser, T., Solèr, M. E., Füchslin, R. M., & Stockinger, K. (2023). Multiple query optimization using a gate-based quantum computer. IEEE Access, 11, 114031–114043. https://doi.org/10.1109/ACCESS.2023.3324253
Fidelis, S. A., Castro, M., & Siqueira, F. (2022). Distributed learning using consensus on edge AI. In Proceedings of the Brazilian Symposium on Computing System Engineering (SBESC). https://doi.org/10.1109/SBESC56799.2022.9965153
Gilboa, D., Michaeli, H., Soudry, D., & McClean, J. R. (2024). Exponential quantum communication advantage in distributed inference and learning. Advances in Neural Information Processing Systems, 37.
Gupta, V., Chen, X., Huang, R., Meng, F., Chen, J., & Yan, Y. (2024). GraphScale: A framework to enable machine learning over billion-node graphs. In Proceedings of the ACM International Conference on Information and Knowledge Management (pp. 4514–4521). https://doi.org/10.1145/3627673.3680021
He, H. (2024). Quantum annealing and GNN for solving TSP with QUBO. In Lecture notes in computer science (Vol. 15180, pp. 134–145). https://doi.org/10.1007/978-981-97-7801-0_12
Jeure, V., & Veena, K. (2024). Quantum-powered insights: Unravelling the nexus of quantum computing, machine learning, and quantum machine learning. In Proceedings of the 15th International Conference on Advances in Computing, Control, and Telecommunication Technologies (Vol. 2, pp. 1849–1855).
Jiang, Y., Zhang, K., Qian, Y., & Hu, R. Q. (2021). Efficient and privacy-preserving distributed learning in cloud-edge computing systems. In Proceedings of the 3rd ACM Workshop on Wireless Security and Machine Learning (pp. 25–30). https://doi.org/10.1145/3468218.3469044
Liang, Z., Liu, G., Liu, Z., Cheng, J., Hao, T., Liu, K., Ren, H., Song, Z., Liu, J., Ye, F., & Shi, Y. (2024). Graph learning for parameter prediction of quantum approximate optimization algorithm. In Proceedings of the Design Automation Conference. https://doi.org/10.1145/3649329.3663523
Lin, Y.-C., Xu, Z., & Prasanna, V. (2024). XBS-GNN: Accelerating billion-scale GNN training on FPGA. In Proceedings of SC 2024 Workshops (pp. 659–666). https://doi.org/10.1109/SCW63240.2024.00091
Liu, T., Chen, Y., Li, D., Wu, C., Zhu, Y., He, J., Peng, Y., Chen, H., Chen, H., & Guo, C. (2023). BGL: GPU-efficient GNN training by optimizing graph data I/O and preprocessing. In Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation (pp. 103–118).
Luo, Z., Bao, Y., & Wu, C. (2024). Optimizing task placement and online scheduling for distributed GNN training acceleration in heterogeneous systems. IEEE/ACM Transactions on Networking, 32(5), 3715–3729. https://doi.org/10.1109/TNET.2024.3415089
MacCormack, I., Delaney, C., Galda, A., Aggarwal, N., & Narang, P. (2022). Branching quantum convolutional neural networks. Physical Review Research, 4(1). https://doi.org/10.1103/PhysRevResearch.4.013117
Mohammed, A. M., Elhefnawy, N. A., El-Sherbiny, M. M., & Hadhoud, M. M. (2015). Quantum-behaved genetic algorithm: Constraints-handling and GPU computing. In Studies in computational intelligence (Vol. 591, pp. 243–259). https://doi.org/10.1007/978-3-319-14654-6_15
Owusu-Antwi, D., & Gokhale, P. (2023). Low-level circuit optimization for the quantum approximate optimization algorithm. In IET Conference Proceedings (Vol. 2023, No. 25, pp. 40–43). https://doi.org/10.1049/icp.2023.3269
Raj, A., Kumar, A., Sharma, V., Rani, S., Shanu, A. K., & Singh, T. (2023). Applications of genetic algorithm with integrated machine learning. In Proceedings of the 3rd International Conference on Innovative Practices in Technology and Management. https://doi.org/10.1109/ICIPTM57143.2023.10118328
Rodrigues, D., Papa, J. P., & Adeli, H. (2017). Meta-heuristic multi- and many-objective optimization techniques for solution of machine learning problems. Expert Systems, 34(6). https://doi.org/10.1111/exsy.12255
Rubio, Y., Olvera, C., & Montiel, O. (2021). Quantum-inspired evolutionary algorithms on IBM quantum experience. Engineering Letters, 29(4), 1573–1584.
Shao, Y., Li, H., Gu, X., Yin, H., Li, Y., Miao, X., Zhang, W., Cui, B., & Chen, L. (2024). Distributed graph neural network training: A survey. ACM Computing Surveys, 56(8). https://doi.org/10.1145/3648358
Sharma, D., & Sarkar, S. (2022). Enabling inference and training of deep learning models for AI applications on IoT edge devices. In Internet of things (pp. 267–283). https://doi.org/10.1007/978-3-030-87059-1_10
Shrivastava, P., Soni, K. K., & Rasool, A. (2019). Evolution of quantum computing based on Grover’s search algorithm. In Proceedings of the 10th International Conference on Computing, Communication and Networking Technologies. https://doi.org/10.1109/ICCCNT45670.2019.8944676
Stefanidis, V.-A., Verginadis, Y., & Mentzas, G. (2024). Federated learning in multiclouds and resource-constrained edge devices. In Proceedings of the 15th International Conference on Information, Intelligence, Systems and Applications. https://doi.org/10.1109/IISA62523.2024.10786719
Ud Din, A., & Qureshi, S. (2023). A review of challenges and solutions in the design and implementation of deep graph neural networks. International Journal of Computers and Applications, 45(3), 221–230. https://doi.org/10.1080/1206212X.2022.2133805
Wen, Z., Gong, S., Li, W., & Xiao, B. (2024). Research on efficient algorithms for large-scale graph neural network models. In Proceedings of the 7th International Conference on Computer Information Science and Application Technology (pp. 98–102). https://doi.org/10.1109/CISAT62382.2024.10695332
Xiao, G.-Q., Li, X.-Q., Chen, Y.-D., Tang, Z., Jiang, W.-J., & Li, K.-L. (2024). A survey of large-scale graph neural networks. Chinese Journal of Computers, 47(1), 148–171. https://doi.org/10.11897/SP.J.1016.2024.00148
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Global Science: Journal of Information Technology and Computer Science
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
