Enhancing Steel Manufacturing Quality Control: A Deep Learning Approach for Rapid and Accurate Surface Defect Detection Using Pre-Trained Convolutional Neural Network Features and Supervised Classifiers

Main Article Content

Hanumesh Vaidya
K V Prasad
Renuka S
Kumar Swamy K
Shobha Y

Abstract

The importance of perfect surface quality in flat steel manufacturing has grown; however, traditional computer vision approaches for automatic fault spotting are inaccurate and slow, lagging behind assembly line needs. This research investigates using pre-trained Convolutional Neural Networks (CNNs) as feature extractors to reliably categorize steel surface flaws. Sample images containing defects in hot-rolled steel strips were obtained from JSW Steel Ltd’s Vijayanagara Works, Ballari, Karnataka, India. Features were extracted from the penultimate layers of VGG16 and DenseNet-201 models before feeding the data to supervised classifiers (Support Vector Machine, Multilayer Perceptron, Random Forest) to categorize defects. We examined performance across model configurations based on combining the pre-trained CNNs and classifiers. The DenseNet-201+MLP model achieved maximum accuracy of 98.31%, outperforming VGG16 combinations and highlighting the promise of this approach. Thorough statistical evaluation via F-1 scores, precision, recall, etc. further demonstrates the value of using pre-trained CNNs with classifiers for manufacturing quality control, significantly improving steel surface defect detection speed and accuracy over traditional computer vision. This strategy shows promise for enabling reliable, large-scale automated inspection critical for industrial steel production.

Article Details

How to Cite
1.
Hanumesh Vaidya, Prasad KV, Renuka S, Kumar Swamy K, Shobha Y. Enhancing Steel Manufacturing Quality Control: A Deep Learning Approach for Rapid and Accurate Surface Defect Detection Using Pre-Trained Convolutional Neural Network Features and Supervised Classifiers. J. Int. Acad. Phys. Sci. [Internet]. 2024 Mar. 15 [cited 2024 May 3];28(1):1-18. Available from: https://www.iaps.org.in/journal/index.php/journaliaps/article/view/955
Section
Articles

References

N. Jin, S. Zhou and T-S. Chang; Identification of impacting factors of surface defects in hot rolling processes using multi-level regression analysis, Society of Manufacturing Engineers, Southfield, MI, USA, 2000.

G. Wu, H. Zhang, X. Sun, J. Xu, K. Xu; A bran-new feature extraction method and its application to surface defect recognition of hot rolled strips, IEEE International Conference on Automation and Logistics, (2007), 2069-2074.

A. Kumar; Computer-vision-based fabric defect detection: A survey, IEEE Transactions on Industrial Electronics, 55-1 (2008), 348-363.

S. Ghorai, A. Mukherjee, M. Gangadaran, P. K. Dutta; Automatic defect detection on hot-rolled flat steel products, IEEE Transactions on Instrumentation and Measurement, 62-3 (2012), 612-621.

R. Usamentiaga, D. F. Garcia, J. Molleda, F.G. Bulnes, G. Bonet; Vibrations in steel strips: Effects on flatness measurement and filtering, 2013 IEEE Industry Applications Society Annual Meeting, (2013), 1-10.

K. Song and Y. Yan; A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects, Applied Surface Science, 285 (2013), 858-864.

P. Muñoz-Escalona, A. Shokrani, S. T. Newman; Influence of cutting environments on surface integrity and power consumption of austenitic stainless steel, Robotics and Computer-Integrated Manufacturing, 36 (2015), 60-69.

J. Gan, J. Wang, H. Yu, Q. Li, Z. Shi; Online rail surface inspection utilizing spatial consistency and continuity, IEEE Transactions on Systems, Man, and Cybernetics: Systems, 50-7 (2018), L2741-2751.

N. Neogi, D. K. Mohanta, P. K. Dutta; Review of vision-based steel surface inspection systems, EURASIP Journal on Image and Video Processing, 1 (2014), 1-19.

R. Wei, Y. Song, Y. Zhang; Enhanced faster region convolutional neural networks for steel surface defect detection, ISIJ International, 60-3 (2020), 539-545.

Y. Liu, K. Xu, J. Xu; Periodic surface defect detection in steel plates based on deep learning, Applied Sciences, 9(15), (2019), 3127.

V. F. Fadli and I. O. Herlistiono; Steel surface defect detection using deep learning, International Journal of Innovative Science Research and Technology, 5 (2020) 244-250.

S. Qi, J. Yang and Z. Zhong; A review on industrial surface defect detection based on deep learning technology, Proceedings of the 2020 3rd International Conference on Machine Learning and Machine Intelligence, (2020), 24-30.

P. M. Bhatt, R. K. Malhan, P. Rajendran, B. C. Shah, S. Thakar, Y. J. Yoon, S. K. Gupta; Image-based surface defect detection using deep learning: A review, Journal of Computing and Information Science in Engineering,21-4 (2021), 040801.

S. Zhang, Q. Zhang, J. Gu, L. Su, K. Li, M. Pecht; Visual inspection of steel surface defects based on domain adaptation and adaptive convolutional neural network, Mechanical Systems and Signal Processing,153 (2021), 107541.

X. Wen, J. Shan, Y. He, K. Song; Steel surface defect recognition: A survey, Coatings,13-1 (2022), 17.

K. Demir, M. Ay, M. Cavas, F. Demir; Automated steel surface defect detection and classification using a new deep learning-based approach, Neural Computing and Applications, 35-11 (2023), 8389-8406.

P. M. Prakash; Enhancing business performance through quantum electronic analysis of optical data, Optical and Quantum Electronics, 55-12 (2023), 1056.

G. Uganya, C.S. Devi, A. Chaturvedi, B.B. Shankar, J.V.N. Ramesh, A. Kiran; Sub-network modelling and integration for low-light enhancement of aerial images, Optical and Quantum Electronics, 55-11 (2023), 984.

A. S. Alqahtani, A.N. Madheswari, A. Mubarakali, P. Parthasarathy; Secure communication and implementation of handwritten digit recognition using deep neural network, Optical and Quantum Electronics, 55-1 (2023), 27.

B. Sangamithra, B. M. Swamy, M. S. Kumar; Evaluating the effectiveness of RNN and its variants for personalized web search, Optical and Quantum Electronics, 55-13 (2023), 1202.

A. Kiran, V. Kalpana, M. Madanan, J. V. N. Ramesh, B. S. Alfurhood, S. Mubeen; Anticipating network failures and congestion in optical networks a data analytics approach using genetic algorithm optimization, Optical and Quantum Electronics, 55-13 (2023), 1193.

K. V. Prasad, Hanumesh Vaidya, Kumar Swamy K, Renuka S; Pumpkin Seeds Classification: Artificial Neural Network and Machine Learning Methods, Journal of International Academy of Physical Sciences, 27-1 (2023), 23-33.

Kerehalli Vinayaka Prasad, Hanumesh Vaidya, Rajashekhar Choudhari, Kumar Swamy Karekal, Renuka Sali; Automated neural network forecast of PM2:5 concentration, International Journal of Mathematics and Computer in Engineering, 1-1 (2023), 1-12.

K. V. Prasad, Hanumesh Vaidya, Y. Shobha; Multi-class Brain Tumour Classification using Convolutional Neural Network, Journal of International Academy of Physical Sciences, 27-2 (2023), 125-137.

Hanumesh. Vaidya, K.V. Prasad, S. Renuka, K. Kumar Swamy; Multiclass Classification of Dry Beans using Artificial Neural Network, Journal of International Academy of Physical Sciences, 27-2 (2023), 109-124.

M. Zhou, W. Lu, J. Xia and Y. Wang; Defect Detection in Steel Using a Hybrid Attention Network, Sensors, 23-15 (2023), 6982.

X. Xiang, Z. Wang, J. Zhang, Y. Xia, P. Chen and B. Wang; AGCA: An Adaptive Graph Channel Attention Module for Steel Surface Defect Detection, IEEE Transactions on Instrumentation and Measurement, 72 (2023), 1-12.

G. Huang, Z. Liu, L. Van Der Maaten, K. Q. Weinberger; Densely connected convolutional networks, Proceedings of the IEEE conference on computer vision and pattern recognition, (2017), 4700-4708.

K. Simonyan and A. Zisserman; Very deep convolutional networks for large-scale image recognition, arXiv preprint arXiv:1409.1556, (2014).