Detection of dress code violations based on improved YOLOv5s

doi:10.11996/JG.j.2095-302X.2024030433

Abstract

Abstract:

Addressing the issue of non-compliance in the attire of culinary staff in the complex background of the catering kitchen, where existing algorithms tend to have low detection accuracy and are prone to false detections and omissions, this paper proposed an improved attire compliance detection algorithm, YOLOv5s-ESW, based on YOLOv5s. Firstly, a novel multi-scale attention mechanism was introduced into the main network to enhance the network’s feature extraction capability. Secondly, within the neck network, the spatial and channel reconstruction convolution module (SCConv) replaced the original convolution module (Conv) to reduce model parameter redundancy and simultaneously enhanced model accuracy. Lastly, the WIoU loss function was introduced in the prediction part to accelerate convergence and enhance the model’s generalization capability. The improved algorithm was applied to a self-compiled dataset of catering kitchen staff attire for experimentation. The results validated that the improved model has elevated its mean detection accuracy by 4.1% and reduced its parameter quantity by 11.4%. While enhancing detection accuracy, the model also reduced network complexity, thereby satisfying the requirements for attire compliance detection among catering kitchen staff.

Key words: dress code detection, attention mechanism, convolution, loss function, YOLOv5s-ESW algorithm

CLC Number:

TP391

LI Yuehua, ZHONG Xin, YAO Zhangyan, HU Bin. Detection of dress code violations based on improved YOLOv5s[J]. Journal of Graphics, 2024, 45(3): 433-445.

Figures/Tables 22

References 35

[1]	章温慧. 餐饮行业地方政府智慧监管的优化研究: 以苍南县为例[D]. 上海: 上海师范大学, 2021.
	ZHANG W H. Optimization of local government’s intelligent supervision of catering industry[D]. Shanghai: Shanghai Normal University, 2021 (in Chinese).
[2]	夏追平, 张志斌, 关堂敏. “阳光厨房” 项目对规范餐饮从业人员操作行为的影响[J]. 上海预防医学, 2021, 33(4): 340-344.
	XIA Z P, ZHANG Z B, GUAN T M. Influence of the “Sunshine Kitchen Project” on the standardized operation of catering industry[J]. Shanghai Journal of Preventive Medicine, 2021, 33(4): 340-344 (in Chinese).
[3]	蔚宏奎. 提升食品安全监管, 护航盛夏“烟火气”[J]. 食品安全导刊, 2023(24): 9.
	WEI H K. Improve food safety supervision and escort “fireworks” in midsummer[J]. China Food Safety Magazine, 2023(24): 9 (in Chinese).
[4]	FAN H L. Theoretical basis and system establishment of China food safety intelligent supervision in the perspective of Internet of Things[J]. IEEE Access, 2019, 7: 71686-71695.
[5]	许德刚, 王露, 李凡. 深度学习的典型目标检测算法研究综述[J]. 计算机工程与应用, 2021, 57(8): 10-25. DOI
	XU D G, WANG L, LI F. Review of typical object detection algorithms for deep learning[J]. Computer Engineering and Applications, 2021, 57(8): 10-25 (in Chinese). DOI
[6]	GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]// 2014 IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE Press, 2014: 580-587.
[7]	REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149. DOI PMID
[8]	LIU W, ANGUELOV D, ERHAN D, et al. SSD: single shot MultiBox detector[C]// European Conference on Computer Vision. Cham: Springer, 2016: 21-37.
[9]	REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: unified, real-time object detection[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE Press, 2016: 779-788.
[10]	陈刚, 张培基, 龚冬冬, 等. 火电厂监控视频安全服检测方法研究[J]. 图学学报, 2023, 44(2): 291-297. DOI
	CHEN G, ZHANG P J, GONG D D, et al. Research on safety clothing detection method for surveillance video of thermal power plant[J]. Journal of Graphics, 2023, 44(2): 291-297 (in Chinese). DOI
[11]	刘欣宜, 张宝峰, 符烨, 等. 基于深度学习的污染场地作业人员着装规范性检测[J]. 中国安全生产科学技术, 2020, 16(7): 169-175.
	LIU X Y, ZHANG B F, FU Y, et al. Detection on normalization of operating personnel dressing at contaminated sites based on deep learning[J]. Journal of Safety Science and Technology, 2020, 16(7): 169-175 (in Chinese).
[12]	CHEN Z H, ZHANG F, LIU H B, et al. Real-time detection algorithm of helmet and reflective vest based on improved YOLOv5[J]. Journal of Real-Time Image Processing, 2023, 20(1): 4.
[13]	林其雄, 陈畅, 闫云凤, 等. 一种基于特征引导的电力施工场景工装合规穿戴二阶段检测算法[J]. 浙江电力, 2022, 41(4): 44-50.
	LIN Q X, CHEN C, YAN Y F, et al. A two-stage detection algorithm for workwear compliance in power construction scenarios based on feature guidance[J]. Zhejiang Electric Power, 2022, 41(4): 44-50 (in Chinese).
[14]	OUYANG D L, HE S, ZHANG G Z, et al. Efficient multi-scale attention module with cross-spatial learning[C]// ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing. New York: IEEE Press, 2023: 1-5.
[15]	HU J, SHEN L, SUN G. Squeeze-and-excitation networks[C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE Press, 2018: 7132-7141.
[16]	HOU Q B, ZHOU D Q, FENG J S. Coordinate attention for efficient mobile network design[C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE Press, 2021: 13708-13717.
[17]	WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C]// European Conference on Computer Vision. Cham: Springer, 2018: 3-19.
[18]	DONGYOON H, YOUNGJOON Y, BEOMYOUNGE K, et al. Learning features with parameter-free layers[EB/OL]. [2023-05-08]. https://doi.org/10.48550/arXiv.2202.02777.
[19]	HAN S, MAO H Z, DALLY WILLIAM J. Deep compression: compressing deep neural networks with pruning. traincd quantization and huffman coding[EB/OL]. [2023-04-04]. https://arxiv.org/abs/1510.00149.
[20]	DENTON E, ZAREMBA W, BRUNA J, et al. Exploiting linear structure within convolutional networks for efficient evaluation[J]. Advances in Neural Information Processing Systems, 2014, 2(January): 1269-1277.
[21]	HINTON G, VINYALS O, DEAN J, et al. Distilling the knowledge in a neural network[EB/OL]. [2023-03-04]. https://arxiv.org/abs/1503.02531.
[22]	LI J F, WEN Y, HE L H. SCConv: spatial and channel reconstruction convolution for feature redundancy[C]// 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE Press, 2023: 6153-6162.
[23]	WU Y, HE K. Group normalization[C]// European Conference on Computer Vision. Cham: Springer. 2018: 3-19.
[24]	LI X, WANG W H, HU X L, et al. Selective kernel networks[C]// 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE Press, 2019: 510-519.
[25]	ZHANG Y F, REN W Q, ZHANG Z, et al. Focal and efficient IOU loss for accurate bounding box regression[J]. Neurocomputing, 2022, 506: 146-157.
[26]	TONG Z, CHEN Y, XU Z, et al. Wise-IoU: bounding box regression loss with dynamic gocusing mechanism[EB/OL]. (2023-08-08) [2023-08-12]. https://arxiv.org/abs/2301.10051.
[27]	SHETRY S. Application of convolutional neural network for image classification on Pascal VOC challenge 2012 dataset[EB/OL]. (2016-01-01) [2023-01-13]. https://arXiv.org/abs/:1607.03785.
[28]	WANG Q L, WU B G, ZHU P F, et al. ECA-Net: efficient channel attention for deep convolutional neural networks[EB/OL]. (2019-10-08) [2023-01-11]. https://arxiv.org/abs/1910.03151vl.
[29]	孙建诚, 杨舒涵, 龚芳媛, 等. 基于改进YOLOv5的复杂背景下路面裂缝检测[J]. 中国科技论文, 2023, 18(7): 779-785.
	SUN J C, YANG S H, GONG F Y, et al. Pavement crack detection in complex background based on improved YOLOv5[J]. China Sciencepaper, 2023, 18(7): 779-785 (in Chinese).
[30]	祁泽政, 徐银霞. 改进YOLOv5s算法的安全帽佩戴检测研究[J]. 计算机工程与应用, 2023, 59(14): 176-183. DOI
	QI Z Z, XU Y X. Research on helmet wearing detection of improved YOLOv5s algorithm[J]. Computer Engineering and Applications, 2023, 59(14): 176-183 (in Chinese). DOI
[31]	TAN M X, PANG R M, LE Q V. EfficientDet: scalable and efficient object detection[C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE Press, 2020: 10778-10787.
[32]	张秀花, 静茂凯, 袁永伟, 等. 基于改进YOLOv3-Tiny的番茄苗分级检测[J]. 农业工程学报, 2022, 38(1): 221-229.
	ZHANG X H, JING M K, YUAN Y W, et al. Tomato seedling classification detection using improved YOLOv3-Tiny[J]. Transactions of the Chinese Society of Agricultural Engineering, 2022, 38(1): 221-229 (in Chinese).
[33]	BOCHKOVSKIY A, WANG C Y, LIAO H M. Yolov4: optimal speed and accuracy of object detection[EB/OL]. [2023-01-23]. https://doi.org/10.48550/arXiv.2004.10934.
[34]	孟彩霞, 王兆楠, 石磊, 等. 改进YOLOv5s的铁路异物入侵检测算法[J/OL]. 小型微型计算机系统, 1-10. [2023-08-28]. http://kns.cnki.net/kcms/detail/21.1106.TP.20230217.1616.007.html.
	WENG C X, WANG Z N, SHI L, et al. Improved railroad foreign object intrusion detection algorithm for YOLOv5s[J/OL]. Journal of Chinese Computer Systems. 1-10. [2023-08-28]. http://kns.cnki.net/kcms/detail/21.1106.TP.20230217.1616.007.html (in Chinese).
[35]	殷智伟, 邵家玉, 张宁. YOLO-DAW: 基于窗口内部双重注意力机制的目标检测模型[J]. 东南大学学报: 自然科学版, 2023, 53(4): 718-724.
	YIN Z W, SHAO J Y, ZHANG N. YOLO-DAW: object detection model based on dual attention mechanism within windows[J]. Journal of Southeast University: Natural Science Edition, 2023, 53(4): 718-724 (in Chinese).

项目	版本环境
Operating System	Windows 11
CPU	Intel i7-10870H
GPU	NVIDIA RTX 2080
Python	3.7.12
Pytorch	1.9.0
CUDA	12.0
cuDNN	8.5.0

项目	版本环境
Operating System	Windows 11
CPU	Intel i7-10870H
GPU	NVIDIA RTX 2080
Python	3.7.12
Pytorch	1.9.0
CUDA	12.0
cuDNN	8.5.0

类别	数量
Hat	4 361
No hat	6 451
Mask	5 711
No mask	6 674
Cloth	5 436
No cloth	7 583

类别	数量
Hat	4 361
No hat	6 451
Mask	5 711
No mask	6 674
Cloth	5 436
No cloth	7 583

检测目标	样式
厨师服	厨师服(不区分长短袖)：白色、蓝色
厨师帽	厨师帽(高)、厨工帽(低)：白色
口罩	一次性无纺布口罩：蓝色、白色