Non-Fungible Token based Smart Manufacturing to scale Industry 4.0 by using Augmented Reality, Deep Learning and Industrial Internet of Things
DOI:
https://doi.org/10.31436/ijpcc.v9i2.407Keywords:
Blockchain, Non-Fungible Token, Industrial Internet of Things, Industry 4.0.Abstract
The recent revolution in Industry 4.0 (IR 4.0) has characterized the integration of advance technologies to bring the fourth industrial revolution to scale the manufacturing landscape. There are different key drivers for this revolution, in this research we have explored the following among them such as, Industrial Internet of Things (IIoT), Deep Learning, Blockchain and Augmented Reality. The emerging concept from blockchain namely “Non-Fungible Token” (NFT) relating to the uniqueness of digital assets has vast potential to be considered for physical assets identification and authentication in the IR 4.0 scenario. Similarly, the data acquired through the deployment of IIoT devices and sensors into smart industry spectrum can be transformed to generated robust analytics for different industry use-cases. The predictive maintenance is a major scenario in which early equipment failure detection using deep learning model on acquired data from IIoT devices has major potential for it. Similarly, the augmented reality can be able to provide real-time visualization within the factory environment to gather real-time insight and analytics from the physical equipment for different purposes. This research initially conducted a survey to analyse the existing developments in these domains of technologies to further widen its horizon for this research. This research developed and deployed a smart contract into an ethereum blockchain environment to simulate the use-case for NFT for physical assets and processes synchronization. The next phase was deploying deep learning algorithms on a dataset having data generated from IIoT devices and sensors. The Feedforward and Convolutional Neural Network were used to classify the target variables in relation with predictive maintenance failure analysis. Lastly, the research also proposed an AR based framework for the visualization ecosystem within the industry environment to effectively visualize and monitory IIoT based equipment’s for different industrial use-cases i.e., monitoring, inspection, quality assurance.
References
D. Mourtzis, V. Zogopoulos and E. Vlachou, “Augmented Reality supported Product Design towards Industry 4.0: a Teaching Factory paradigm,” Procedia Manufacturing, vol. 23, pp. 207-212, 2018.
P. Zheng, H. Wang, Z. Sang, R. Y. Zhong, Y. Liu, C. Liu, K. Mubarok and X. X. Shiqiang Yu, “Smart manufacturing systems for Industry 4.0: Conceptual framework, scenarios, and future perspectives,” Frontiers of Mechanical Engineering, vol. 13, pp. 137-150, 2018.
K. R. Jothi and S. O. Manoj, “A Comprehensive Survey on Blockchain and Cryptocurrency Technologies: Approaches, Challenges, and Opportunities,” in EAI/Springer Innovations in Communication and Computing, 2022.
L. Ante, “Non-fungible Token (NFT) Markets on the Ethereum Blockchain: Temporal Development, Cointegration and Interrelations,” SSRN, 2021.
“Digital Twin and Virtual Reality and Augmented Reality/Mixed Reality,” Digital Twin Driven Smart Manufacturing, pp. 219-241, 2019.
A. Mohammed and R. Kora, “A comprehensive review on ensemble deep learning: Opportunities and challenges,” Journal of King Saud University - Computer and Information Sciences, vol. 35, pp. 757-774, 2023.
S. K. Das, F. Benkhelifa, Y. Sun, H. Abumarshoud, Q. H. Abbasi, M. A. Imran and L. Mohjazi, “Comprehensive review on ML-based RIS-enhanced IoT systems: basics, research progress and future challenges,” Computer Networks, vol. 224, p. 109581, 2023.
M. L. Nunes, A. Pereira and A. Alves, “Smart products development approaches for Industry 4.0,” Procedia Manufacturing, vol. 13, pp. 1215-1222, 2017.
R. Andersen, T. D. Brunoe and K. Nielsen, “Platform-based product development in the process industry: a systematic literature review,” International Journal of Production Research, vol. 61, no. 5, pp. 1696-1719, 2023.
E. Borgia, “The Internet of Things vision: Key features, applications and open issues,” Computer Communications, vol. 54, pp. 1-31, 2014.
J. Cardoso, K. Voigt and M. Winkler, “Service Engineering for the Internet of Services,” in International Conference on Enterprise Information Systems, 2008.
A. Musamih, I. Yaqoob, K. Salah, R. Jayaraman, M. Omar and S. Ellahham, “Using NFTs for Product Management, Digital Certification, Trading, and Delivery in the Healthcare Supply Chain,” IEEE Transactions on Engineering Management, pp. 1-22, 2022.
P. Strauß, M. Schmitz, R. Wöstmann and J. Deuse, “Enabling of Predictive Maintenance in the Brownfield through Low-Cost Sensors, an IIoT-Architecture and Machine Learning,” in 2018 IEEE International Conference on Big Data (Big Data), 2018.
T. Hafeez, L. Xu and G. Mcardle, “Edge Intelligence for Data Handling and Predictive Maintenance in IIOT,” IEEE Access, pp. 49355-49371, 2021.
J. Rosales, S. Deshpande and S. Anand, “IIoT based Augmented Reality for Factory Data Collection and Visualization,” Procedia Manufacturing, vol. 53, pp. 618-627, 2021.
M. Khalil, C. Bergs, T. Papadopoulos, R. Wüchner, K.-U. Bletzinger and M. Heizmann, “IIoT-based Fatigue Life Indication using Augmented Reality,” in 2019 IEEE 17th International Conference on Industrial Informatics (INDIN), 2019.
A. Pereira and F. Romero, “A review of the meanings and the implications of the Industry 4.0 concept,” Procedia Manufacturing, vol. 13, pp. 1206-1214, 2017.
J. Leng, S. Ye, M. Zhou, J. L. Zhao, Q. Liu, W. Guo, W. Cao and L. Fu, “Blockchain-Secured Smart Manufacturing in Industry 4.0: A Survey,” IEEE Transactions on Systems Man Cybernetics-Systems, vol. 51, no. 1, pp. 237-252, 2021.
J. Leng, G. Ruan, P. Jiang, K. Xu, Q. Liu, X. Zhou and C. Liu, “Blockchain-empowered sustainable manufacturing and product lifecycle management in industry 4.0: A survey,” Renewable and Sustainable Energy Reviews, vol. 132, p. 110112, 2020.
A. Behl, V. Pereira, A. Nigam, S. Wamba and R. Sindhwani, “Knowledge development in non-fungible tokens (NFT): a scoping review,” Journal of Knowledge Management, 2023.
A. K. Singh, V. P. Kumar, G. Dehdasht, S. R. Mohandes, P. Manu and F. P. Rahimian, “Investigating the barriers to the adoption of blockchain technology in sustainable construction projects,” Journal of Cleaner Production, vol. 403, p. 136840, 2023.
I. H. Sarker, “Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions,” SN Computer Science, vol. 2, 2021.
M. Abdel-Basset, V. Chang, H. Hawash, R. K. Chakrabortty and M. Ryan, “Deep learning approaches for human-centered IoT applications in smart indoor environments: a contemporary survey,” Annals of Operations Research, 2021.
M. AL-QATF, Y. LASHENG, M. AL-HABIB and K. AL-SABAHI, “[20] M. Al-Qatf, Y. Lasheng, M. Al-Habib, and K. Al-Sabahi, “Deep learning approach combining sparse Autoencoder with SVM for network intrusion detection,” IEEE Access, vol. 6, pp. 52843–52856, 2018. doi:10.1109/access.2018.2869577,” IEEE Access, vol. 6, 2018.
A. K. K, T. Y. Satheesha, B. B. L. Salvador, S. Mithileysh and S. T. Ahmed, “Augmented Intelligence enabled Deep Neural Networking (AuDNN) framework for skin cancer classification and prediction using multi-dimensional datasets on industrial IoT standards,” Microprocessors & Microsystems, vol. 97, 2023.
N. Vasilevski and J. Birt, “Human-Centered Design Science Research Evaluation for Gamified Augmented Reality,” Frontier in Virtual Reality, vol. 2, p. 713718, 2021.
V. Narayan, P. K. Mall, A. Alkhayyat, K. Abhishek, S. Kumar and P. Pandey, “Enhance-Net: An Approach to Boost the Performance of Deep Learning Model Based on Real-Time Medical Images,” Journal of Sensors, 2023.
C.-A. Cruz-Carrizales, L.-E. Bautista-Rojas and G.-R. Pedraza-Ferreira, “Evaluation of User Interfaces Description Languages to Augmented Reality,” Revista Facultad de Ingeniería, vol. 30, no. 57, p. 13304, 2021.
Z. Lv, A. Halawani, S. Feng, H. Li and S. U. Réhman, “Multimodal Hand and Foot Gesture Interaction for Handheld Devices,” ACM Transactions on Multimedia Computing, Communications, and Applications, vol. 11, no. 1, pp. 1-19, 2014.
D. Cheng, Y. Wang and H. Hua, “Design of a wide-angle, lightweight head-mounted display using free-form optics tiling,” Optics Letters, vol. 36, no. 11, pp. 2098-2100, 2011.
G. P. Jr, J. Bryan, M. Kline, E. Sheets and J. S. Miguel, “Towards Firmware Analysis of Industrial Internet of Things (IIoT) - Applying Symbolic Analysis to IIoT Firmware Vetting,” in Special Session on Innovative CyberSecurity and Privacy for Internet of Things: Strategies, Technologies, and Implementations, 2017.
E. T. Michailidis, S. M. Potirakis and A. G. Kanatas, “AI-Inspired Non-Terrestrial Networks for IIoT: Review on Enabling Technologies and Applications,” IoT, vol. 1, no. 1, pp. 21-48, 2020.
S. Pal and Z. Jadidi, “Analysis of Security Issues and Countermeasures for the Industrial Internet of Things,” Applied Sciences, vol. 11, no. 20, p. 9393, 2021.
G. S. S. Chalapathi, V. Chamola, A. Vaish and R. Buyya, “Industrial Internet of Things (IIoT) Applications of Edge and Fog Computing: A Review and Future Directions,” Fog/Edge Computing For Security, Privacy, and Applications. Advances in Information Security, vol. 83, 2021.
F. Psarommatis, G. May and V. Azamfirei, “Envisioning maintenance 5.0: Insights from a systematic literature review of Industry 4.0 and a proposed framework,” Journal of Manufacturing Systems, vol. 68, pp. 376-399, 2023.
