Real-Time Automated Road Damages Inspection Using Deep Convolutional Neural Networks

Authors

  • Mohamad Faiq Mohd Shahrul Munir Department of Computer Science, International Islamic University Malaysia, Kuala Lumpur, Malaysia
  • Muhammad Amiruddin Bustamam Department of Computer Science, International Islamic University Malaysia, Kuala Lumpur, Malaysia
  • Amelia Ritahani Ismail Department of Computer Science, International Islamic University Malaysia, Kuala Lumpur, Malaysia
  • Norlia Md-Yusof Department of Computer Science, International Islamic University Malaysia, Kuala Lumpur, Malaysia
  • Amir Aatieff Amir Hussin Department of Computer Science, International Islamic University Malaysia, Kuala Lumpur, Malaysia

Keywords:

pothole detection, car maintenance, YOLO, CNN, road damages

Abstract

This paperfocused on developing a real time automated road damage inspection using deep neural networks. The performance of the build image detection model is evaluated to get the best overall result. Thousands of images from selected dataset are trained using YOLO (You Only Look Once) v4 algorithm which based on CNN (Convolutional Neural Network). The model is deployed into smartphones to take advantage of the smartphone camera due to its availability. The road damage inspection app can help the road users and municipalities in inspecting the road surface thus can prevent heavy damages to the vehicle and help in providing a better road damage maintenance management.

References

Road traffic injuries. (n.d.). Retrieved August 13, 2020,from https://www.who.int/news-room/fact-sheets/detail/road-traffic-injuries.

Global status report on road safety 2018. (2020, June 19). Retrieved August 13, 2020, from https://www.who.int/violence_injury_prevention/road_safety_status/2018

Nguyen, S.D., Tran, T.S., Tran, V.P. et al. Deep Learning-Based Crack Detection: A Survey. Int. J. Pavement Res. Technol. (2022). Retrieved August 28,2022 from https://doi.org/10.1007/s42947-022-00172-z

Ma, N., Fan, J., Wang, W., Wu, J., Jiang, Y., Xie, L., & Fan, R. (2022). Computer vision for road imaging and pothole detection: A state-of-the-art review of systems and algorithms. arXiv preprint arXiv:2204.13590. Transportation Safety and Environment, 2022, pp. 1-16.

Ali, L.; Alnajjar, F.; Khan, W.; Serhani, M.A.; Al Jassmi, H. (2022). Bibliometric Analysis and Review of Deep Learning-Based Crack`Detection Literature Published between 2010 and 2022. Buildings 2022, 12, 432. Retrieved August 28,2022 from https://doi.org/10.3390/buildings12040432

Maeda, H., Sekimoto, Y., Seto, T., Kashiyama, T., & Omata, H. (2018). Road damage detection

using deep neural networks with images captured through a smartphone. arXivpreprint arXiv:1801.09454.

Zhang, A., Wang, K. C., Li, B., Yang, E., Dai, X., Peng, Y., ... & Chen, C. (2017). Automated pixel?level pavement crack detection on 3D asphalt surfaces using a deep?learning network. Computer?Aided Civil and Infrastructure Engineering, 32(10), 805-819.

M. Akarsu, B., Karaköse, M., Parlak, K., Akin, E., & Sarimaden, A. (2016). A Fast and Adaptive Road Defect Detection Approach Using Computer Vision with Real Time Implementation. International Journal of Applied Mathematics, Electronics and Computers, 290-290. doi:10.18100/ijamec.270546

Bochkovskiy, A., Wang, C. Y., & Liao, H. Y. M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv preprint arXiv:2004.10934.

Redmon, J. (2013). Darknet: Open source neural networks in c.

Tzutalin. LabelImg. Git code (2015). https://github.com/tzutalin/labelImg.

J. Padhye, Everingham, M., Eslami, S. A., Van Gool, L., Williams, C. K., Winn, J., & Zisserman, A. (2015). The pascal visual object classes challenge: A retrospective. International journal of computer vision, 111(1), 98-136.

Ali, R., Kang, D., Suh, G., & Cha, Y. J. (2021). Real-time multiple damage mapping using autonomous UAV and deep faster region-based neural networks for GPS-denied structures. Automation in Construction, 130, 103831.

Naddaf-Sh, M., Hosseini, S., Zhang, J., Brake, N. A., & Zargarzadeh, H. (2019). Real-time road crack mapping using an optimized convolutional neural network. Complexity, 2019.

Fan, J., Bocus, M. J., Wang, L., & Fan, R. (2021, August). Deep convolutional neural networks for road crack detection: Qualitative and quantitative comparisons. In 2021 IEEE International Conference on Imaging Systems and Techniques (IST) (pp. 1-6). IEEE.

Dung, C. V. (2019). Autonomous concrete crack detection using deep fully convolutional neural network. Automation in Construction, 99, 52-58.

Mandal, V., Uong, L., & Adu-Gyamfi, Y. (2018, December). Automated road crack detection using deep convolutional neural networks. In 2018 IEEE International Conference on Big Data (Big Data) (pp. 5212-5215). IEEE.

Ale, L., Zhang, N., & Li, L. (2018, December). Road damage detection using RetinaNet. In 2018 IEEE International Conference on Big Data (Big Data) (pp. 5197-5200). IEEE.

Downloads

Published

2023-01-28

How to Cite

Mohd Shahrul Munir, M. F., Bustamam, M. A. ., Ismail, A. R., Md-Yusof, N., & Amir Hussin, A. A. . (2023). Real-Time Automated Road Damages Inspection Using Deep Convolutional Neural Networks. International Journal on Perceptive and Cognitive Computing, 9(1), 122–127. Retrieved from https://journals.iium.edu.my/kict/index.php/IJPCC/article/view/372