Abstract

Steel defect diagnostics is important for industry task as it is tied to the product quality and production efficiency. The aim of this paper is evaluating the application of residual neural networks for recognition of industrial steel defects of three classes. Developed and investigated models based on deep residual neural networks for the recognition and classification of surface defects of rolled steel. Investigated the influence of various loss functions, optimizers and hyperparameters on the obtained result and selected optimal model parameters. Based on an ensemble of two deep residual neural networks ResNet50 and ResNet152, a classifier was constructed to detect defects of three classes on flat metal surfaces. The proposed technique allows classifying images with high accuracy. The average binary accuracy of classifying the test data is 96.7% for all images (including defect-free ones). The fields of neuron activation in the convolutional layers of the model were investigated. Feature maps formed in the process were found to reflect the position, size, and shape of the objects of interest very well. The proposed ensemble model has proven to be robust and able to accurately recognize steel surface defects. Erroneous recognition cases of the classifier application are investigated. It was shown that errors most often occur in ambiguous situations, where surface artifacts of different types are similar.

References

1.
Zhao
,
Y. J.
,
Yan
,
Y. H.
, and
Song
,
K. C.
,
2017
, “
Vision-Based Automatic Detection of Steel Surface Defects in the Cold Rolling Process: Considering the Influence of Industrial Liquids and Surface Textures
,”
Int. J. Adv. Manuf. Technol.
,
90
(
5–8
), pp.
1665
1678
.
2.
Song
,
G.
,
Song
,
K.
, and
Yan
,
Y.
,
2020
, “
EDRNet: Encoder-Decoder Residual Network for Salient Object Detection of Strip Steel Surface Defects
,”
IEEE Trans. Instrum. Meas.
,
69
(
12
), pp.
9709
9719
.
3.
Li
,
K.
,
Wang
,
X.
, and
Ji
,
L.
,
2019
, “
Application of Multi-Scale Feature Fusion
,”
Proceedings of the International Conference on Artificial Intelligence and Advanced Manufacturing (AIAM)
,
Dublin, Ireland
,
Oct. 17–19
, pp.
656
661
.
4.
Luo
,
Q.
, and
He
,
Y.
,
2016
, “
A Cost-Effective and Automatic Surface Defect Inspection System for Hot-Rolled Flat Steel
,”
Rob. Comput. Integr. Manuf.
,
38
, pp.
16
30
.
5.
Fang
,
X.
,
Luo
,
Q.
,
Zhou
,
B.
,
Li
,
C.
, and
Tian
,
L.
,
2020
, “
Research Progress of Automated Visual Surface Defect Detection for Industrial Metal Planar Materials
,”
Sensors
,
20
(
18
), p.
5136
.
6.
Bhatt
,
P. M.
,
Malhan
,
R. K.
,
Rajendran
,
P.
,
Shah
,
B. C.
,
Thakar
,
S.
,
Yoon
,
Y. J.
, and
Gupta
,
S. K.
,
2021
, “
Image-Based Surface Defect Detection Using Deep Learning: A Review
,”
ASME J. Comput. Inf. Sci. Eng.
,
21
(
4
), p.
040801
.
7.
Kostenetskiy
,
P.
,
Alkapov
,
R.
,
Vetoshkin
,
N.
,
Chulkevich
,
R.
,
Napolskikh
,
I.
, and
Poponin
,
O.
,
2019
, “
Real-Time System for Automatic Cold Strip Surface Defect Detection
,”
FME Trans.
,
47
(
4
), pp.
765
774
.
8.
Wang
,
S.
,
Xia
,
X.
,
Ye
,
L.
, and
Yang
,
B.
,
2021
, “
Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural Networks
,”
Metals
,
11
(
3
), p.
388
.
9.
Konovalenko
,
I.
,
Maruschak
,
P.
,
Brezinová
,
J.
,
Viňáš
,
J.
, and
Brezina
,
J.
,
2020
, “
Steel Surface Defect Classification Using Deep Residual Neural Network
,”
Metals
,
10
(
6
), p.
846
.
10.
GOST 21014-88
,
1989
, “
Rolled Products of Ferrous Metals. Surface Defects. Terms and Definitions
,”
Izd. Stand.: Moscow, USSR
, p.
61
(in Russian).
11.
Kaggle Severstal
,
2019
, “
Steel Defect Detection. Can You Detect and Classify Defects in Steel?
,” https://www.kaggle.com/c/severstal-steel-defect-detection, Accessed June 25, 2020.
12.
Xu
,
Y.
,
Jia
,
R.
,
Mou
,
L.
,
Li
,
G.
,
Chen
,
Y.
,
Lu
,
Y.
, and
Jin
,
Z.
,
2016
, “
Improved Relation Classification by Deep Recurrent Neural Networks with Data Augmentation
,”
arXiv:1601.03651 [cs.CL]
.
13.
Zhong
,
Z.
,
Zheng
,
L.
,
Kang
,
G.
,
Li
,
S.
, and
Yang
,
Y.
,
2017
, “
Random Erasing Data Augmentation
,”
arXiv Prepr. arXiv:170804896
.
14.
He
,
K.
,
Zhang
,
X.
,
Ren
,
S.
, and
Sun
,
J.
,
2015
, “
Deep Residual Learning for Image Recognition
,”
arXiv:1512.03385v1
.
15.
Lin
,
T.-Y.
,
Goyal
,
P.
,
Girshick
,
R.
,
He
,
K.
, and
Dollár
,
P.
,
2017
, “
Focal Loss for Dense Object Detection
,”
arXiv:1708.02002v2
.
16.
Chollet
,
F.
,
2017
,
Deep Learning With Python
,
Manning Publications
,
Shelter Island, NY
, p.
313
.
17.
Xie
,
J.
,
Xu
,
B.
, and
Chuang
,
Z.
,
2013
, “
Horizontal and Vertical Ensemble With Deep Representation for Classification
,”
arXiv:1306.2759v1 [cs.LG]
.
18.
Huang
,
G.
,
Li
,
Y.
,
Pleiss
,
G.
,
Liu
,
Z.
,
Hopcroft
,
J. E.
, and
Weinberger
,
K. Q.
,
2017
, “
Snapshot Ensembles: Train 1, get M for Free
,”
arXiv:1704.00109v1 [cs.LG]
.
You do not currently have access to this content.