Augmented Reality-Assisted Explainable AI Platform for Collaborative Design of Cyber-Physical Systems in Industrial Automation
DOI:
https://doi.org/10.70062/globalscience.v1i3.177Keywords:
Augmented Reality, Explainable AI, Cyber-Physical Systems, Industrial Automation, Collaborative DesignAbstract
The integration of Augmented Reality (AR) and Explainable AI (XAI) within Cyber-Physical Systems (CPS) design is transforming the industrial automation landscape. This study explores how combining AR’s immersive visualization with XAI’s decision transparency enhances collaborative design processes in CPS. The AR-XAI platform developed in this research improves team collaboration by offering real-time visual feedback and enabling interactive decision-making. The platform provides interpretable insights into AI-driven decisions, fostering trust among engineers and decision-makers. Key features of the platform include the ability to visualize complex CPS models, facilitating faster iterations, reducing design errors, and improving design accuracy. The integration of XAI ensures transparency in decision-making by offering clear explanations of AI predictions, which is essential for ensuring accountability and building trust in automated systems. Testing with industrial engineers confirmed that the AR-XAI platform significantly improved design outcomes, with a reduction in errors and enhanced team performance compared to traditional design methods. Moreover, the platform enabled faster decision-making and improved collaboration across diverse teams, demonstrating its potential to optimize CPS design workflows. This research provides valuable insights into the role of AR and XAI in advancing Industry 4.0 and paves the way for more advanced integrations of these technologies in industrial settings. Future research should focus on developing scalable solutions for various industrial applications and exploring more sophisticated AR-XAI integrations for emerging fields like smart cities and autonomous manufacturing.
References
Aleksy, M., Vartiainen, E., Domova, V., & Naedele, M. (2014). Augmented reality for improved service delivery. Proceedings of the International Conference on Advanced Information Networking and Applications (AINA), 382–389. https://doi.org/10.1109/AINA.2014.146
Barbieri, L., & Marino, E. (2019). An augmented reality tool to detect design discrepancies: A comparison test with traditional methods. Lecture Notes in Computer Science, 11614, 99–110. https://doi.org/10.1007/978-3-030-25999-0_9
Bellalouna, F., & Langebach, R. (2023). Application of augmented reality for training in the field of refrigeration and air-conditioning. Lecture Notes in Production Engineering, Part F1162, 387–399. https://doi.org/10.1007/978-3-031-15602-1_29
Bhanu, A., Sharma, H., Piratla, K., & Madathil, K. C. (2022). Application of augmented reality for remote collaborative work in architecture, engineering, and construction: A systematic review. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 66(1), 1829–1833. https://doi.org/10.1177/1071181322661167
Bhatia, S., Mittal, V., & Sabharwal, S. (2024). Building trust and transparency in AI: A review of explainable AI and its ethical implications. Proceedings of the International Conference on Emerging Technologies and Innovation for Sustainability (EmergIN 2024), 650–655. https://doi.org/10.1109/EmergIN63207.2024.10961081
Burns, M., Manganelli, J., & Woliman, D. (2018). Elaborating the human aspect of the NIST framework for cyber-physical systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 62(1), 450–454.
Chan, W. P., Hanks, G., Sakr, M., Zuo, T., Van Der Loos, H. F. M., & Croft, E. (2020). An augmented reality human–robot physical collaboration interface design for shared, large-scale, labour-intensive manufacturing tasks. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 11308–11313. https://doi.org/10.1109/IROS45743.2020.9341119
Chen, C., Liang, R., Pan, Y., Li, D., Zhao, Z., Guo, Y., & Zhang, Q. (2022). A quick development toolkit for augmented reality visualization (QDARV) of a factory. Applied Sciences, 12(16), Article 8338. https://doi.org/10.3390/app12168338
da Silva Oliveira, B., Ferry, N., & Deantoni, J. (2024). Towards leveraging the concept of influence to enhance collaborative cyber-physical systems development. Proceedings of the ACM/IEEE 27th International Conference on Model Driven Engineering Languages and Systems (MODELS Companion), 935–944. https://doi.org/10.1145/3652620.3688568
Dai, W., Huang, W., & Vyatkin, V. (2016). Knowledge-driven service orchestration engine for flexible information acquisition in industrial cyber-physical systems. Proceedings of the IEEE International Symposium on Industrial Electronics (ISIE), 1055–1060. https://doi.org/10.1109/ISIE.2016.7745038
Fitzgerald, J., Pierce, K., & Larsen, P. G. (2014). Co-modelling and co-simulation in the engineering of systems of cyber-physical systems. Proceedings of the 9th International Conference on System of Systems Engineering (SoSE), 67–72. https://doi.org/10.1109/SYSOSE.2014.6892465
Foley, S. N., Grunenwald, S., Autrel, F., Hernan, J. R., Bourget, E., Kabil, A., Clédel, T., Larsen, R., Rooney, V. M., & Vanhulst, K. (2018). Science hackathons for cyber-physical system security research: Putting CPS testbed platforms to good use. Proceedings of the ACM Conference on Computer and Communications Security, 102–107. https://doi.org/10.1145/3264888.3264897
Gomes, D., Reis, P., Paiva, A., Silva, A., Braz, G., Gattass, M., & Araújo, A. (2017). An approach for construction of augmented reality systems using natural markers and mobile sensors in industrial fields. International Journal of Computers, Communications & Control, 12(4), 507–518. https://doi.org/10.15837/ijccc.2017.4.2658
Hayward, A., Rappl, M., & Fay, A. (2022). A SysML-based function-centered approach for the modeling of system groups for collaborative cyber-physical systems. Proceedings of the IEEE International Systems Conference (SysCon). https://doi.org/10.1109/SysCon53536.2022.9773806
Jin, K., Wu, L., & Shen, X. (2023). Description method of cyber-physical system fusion model. Proceedings of the IEEE 3rd International Conference on Electronic Technology, Communication and Information (ICETCI), 307–313. https://doi.org/10.1109/ICETCI57876.2023.10177039
Le, T.-T.-H., Prihatno, A. T., Oktian, Y. E., Kang, H., & Kim, H. (2023). Exploring local explanation of practical industrial AI applications: A systematic literature review. Applied Sciences, 13(9), Article 5809. https://doi.org/10.3390/app13095809
Leitão, P., Colombo, A. W., & Karnouskos, S. (2016). Industrial automation based on cyber-physical systems technologies: Prototype implementations and challenges. Computers in Industry, 81, 11–25. https://doi.org/10.1016/j.compind.2015.08.004
Lukosch, S., Billinghurst, M., Alem, L., & Kiyokawa, K. (2015). Collaboration in augmented reality. Computer Supported Cooperative Work, 24(6), 515–525. https://doi.org/10.1007/s10606-015-9239-0
Ma, J., Wang, Q., Jiang, Z., & Zhao, Z. (2021). A hybrid modeling methodology for cyber-physical production systems: Framework and key techniques. Production Engineering, 15(6), 773–790. https://doi.org/10.1007/s11740-021-01062-2
Maio, R., Araújo, T., Marques, B., Santos, A., Ramalho, P., Almeida, D., Dias, P., & Santos, B. S. (2024). Pervasive augmented reality to support real-time data monitoring in industrial scenarios: Shop floor visualization evaluation and user study. Computers & Graphics, 118, 11–22. https://doi.org/10.1016/j.cag.2023.10.025
Makris, S., Karagiannis, P., Koukas, S., & Matthaiakis, A.-S. (2016). Augmented reality system for operator support in human–robot collaborative assembly. CIRP Annals, 65(1), 61–64. https://doi.org/10.1016/j.cirp.2016.04.038
Mishra, A., Jha, A. V., Appasani, B., Ray, A. K., Gupta, D. K., & Ghazali, A. N. (2023). Emerging technologies and design aspects of next generation cyber physical system with a smart city application perspective. International Journal of System Assurance Engineering and Management, 14, 699–721. https://doi.org/10.1007/s13198-021-01523-y
Müller, J., Butscher, S., Feyer, S. P., & Reiterer, H. (2017). Studying collaborative object positioning in distributed augmented realities. Proceedings of the ACM Conference on Interactive Surfaces and Spaces, 123–132. https://doi.org/10.1145/3152832.3152856
Nazarenko, A. A., & Camarinha-Matos, L. M. (2017). Towards collaborative cyber-physical systems. Proceedings of the International Young Engineers Forum (YEF-ECE), 12–17. https://doi.org/10.1109/YEF-ECE.2017.7935633
O’Donovan, P., Gallagher, C., Bruton, K., & O’Sullivan, D. T. J. (2018). A fog computing industrial cyber-physical system for embedded low-latency machine learning Industry 4.0 applications. Manufacturing Letters, 15, 139–142. https://doi.org/10.1016/j.mfglet.2018.01.005
Palumbo, F., et al. (2019). CERBERO: Cross-layer model-based framework for multi-objective design of reconfigurable systems in uncertain hybrid environments. Proceedings of the ACM Conference on Computing Frontiers, 320–325. https://doi.org/10.1145/3310273.3323436
Pérez, J. B., Arrieta, A. G., Encinas, A. H., & Queiruga-Dios, A. (2017). Industrial cyber-physical systems in textile engineering. Advances in Intelligent Systems and Computing, 527, 126–135. https://doi.org/10.1007/978-3-319-47364-2_13
Ramanathan, L., & Nandhini, R. S. (2022). Cyber-physical system: An architectural review. Lecture Notes in Networks and Systems, 191, 133–142. https://doi.org/10.1007/978-981-16-0739-4_13
Segovia, D., Mendoza, M., Mendoza, E., & González, E. (2015). Augmented reality as a tool for production and quality monitoring. Procedia Computer Science, 75, 291–300. https://doi.org/10.1016/j.procs.2015.12.250
Seo, J. (2024). Motives and role of psychological ownership in AR workspaces for remote collaboration. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI). https://doi.org/10.1145/3613905.3638174
Shangguan, D., Chen, L., & Ding, J. (2019). A hierarchical digital twin model framework for dynamic cyber-physical system design. Proceedings of the ACM International Conference on Cyber-Physical Systems, 123–129. https://doi.org/10.1145/3314493.3314504
Soon, R.-J., Sang, D. V., Chng, C.-B., & Chui, C.-K. (2023). Explainable AI for CPS-based manufacturing workcell. Proceedings of the International Conference on System Science and Engineering (ICSSE), 332–337. https://doi.org/10.1109/ICSSE58758.2023.10227195
Wei, R., Kelly, T. P., Hawkins, R., & Armengaud, E. (2018). DEIS: Dependability engineering innovation for cyber-physical systems. Lecture Notes in Computer Science, 10748, 409–416. https://doi.org/10.1007/978-3-319-74730-9_37
Xie, J., Liu, Y., Wang, X., Fang, S., & Liu, S. (2024). A new XR-based human–robot collaboration assembly system based on industrial metaverse. Journal of Manufacturing Systems, 74, 949–964. https://doi.org/10.1016/j.jmsy.2024.05.001
Yin, Y., Zheng, P., Li, C., & Wang, L. (2023). A state-of-the-art survey on augmented reality-assisted digital twin for futuristic human-centric industry transformation. Robotics and Computer-Integrated Manufacturing, 81, Article 102515. https://doi.org/10.1016/j.rcim.2022.102515
Zamfirescu, C.-B., & Neghinǎ, M. (2019). Collaborative development of a CPS-based production system. Procedia Computer Science, 162, 579–586. https://doi.org/10.1016/j.procs.2019.12.026
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Global Science: Journal of Information Technology and Computer Science
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
