Journal of Graphics ›› 2023, Vol. 44 ›› Issue (4): 667-676.DOI: 10.11996/JG.j.2095-302X.2023040667
Previous Articles Next Articles
					
													HAO Shuai(
), ZHAO Xin-sheng, MA Xu(
), ZHANG Xu, HE Tian, HOU Li-xiang
												  
						
						
						
					
				
Received:2023-01-31
															
							
															
							
																	Accepted:2023-03-16
															
							
																	Online:2023-08-31
															
							
																	Published:2023-08-16
															
						Contact:
								MA Xu (1985-), lecturer, Ph.D. Her main research interests cover image processing, object detection, etc. E-mail:About author:HAO Shuai (1986-), associate professor, Ph.D. His main research interests cover electrical equipment fault diagnosis, target detection, etc. E-mail:haoxust@163.com
Supported by:CLC Number:
HAO Shuai, ZHAO Xin-sheng, MA Xu, ZHANG Xu, HE Tian, HOU Li-xiang. Multi-class defect target detection method for transmission lines based on TR-YOLOv5[J]. Journal of Graphics, 2023, 44(4): 667-676.
Add to citation manager EndNote|Ris|BibTeX
URL: http://www.txxb.com.cn/EN/10.11996/JG.j.2095-302X.2023040667
| 缺陷类型 | 自定义名称 | 数量(张) | 
|---|---|---|
| 销钉脱落 | XT | 342 | 
| 螺母松动 | LSS | 316 | 
| 螺母脱落 | LST | 347 | 
| 放电间隙过大 | FDG | 310 | 
| 绝缘子脱落 | JYT | 212 | 
| 鸟巢 | NC | 235 | 
| 放电间隙设计问题 | FDSJ | 262 | 
| 防鸟刺损坏 | NS | 231 | 
| 放电间隙短接 | FDG | 310 | 
| 垫片缺失 | DP | 323 | 
| 间隔棒断开 | JGB | 364 | 
| 杂物 | ZW | 248 | 
Table 1 Defect name and quantity
| 缺陷类型 | 自定义名称 | 数量(张) | 
|---|---|---|
| 销钉脱落 | XT | 342 | 
| 螺母松动 | LSS | 316 | 
| 螺母脱落 | LST | 347 | 
| 放电间隙过大 | FDG | 310 | 
| 绝缘子脱落 | JYT | 212 | 
| 鸟巢 | NC | 235 | 
| 放电间隙设计问题 | FDSJ | 262 | 
| 防鸟刺损坏 | NS | 231 | 
| 放电间隙短接 | FDG | 310 | 
| 垫片缺失 | DP | 323 | 
| 间隔棒断开 | JGB | 364 | 
| 杂物 | ZW | 248 | 
| 缺陷类型 | Precision | Recall | 
|---|---|---|
| XT | 96.2 | 99.6 | 
| LSS | 78.2 | 95.7 | 
| LST | 97.5 | 98.9 | 
| FDG | 96.1 | 97.3 | 
| JYT | 99.3 | 97.1 | 
| NC | 99.8 | 99.0 | 
| FDSJ | 99.6 | 99.5 | 
| NS | 96.3 | 96.8 | 
| FDD | 98.0 | 98.6 | 
| DP | 88.4 | 86.1 | 
| JGB | 99.1 | 99.4 | 
| ZW | 98.5 | 97.4 | 
| ALL | 95.6 | 97.3 | 
Table 2 Detection result of TR-YOLOv5 model on various targets (%)
| 缺陷类型 | Precision | Recall | 
|---|---|---|
| XT | 96.2 | 99.6 | 
| LSS | 78.2 | 95.7 | 
| LST | 97.5 | 98.9 | 
| FDG | 96.1 | 97.3 | 
| JYT | 99.3 | 97.1 | 
| NC | 99.8 | 99.0 | 
| FDSJ | 99.6 | 99.5 | 
| NS | 96.3 | 96.8 | 
| FDD | 98.0 | 98.6 | 
| DP | 88.4 | 86.1 | 
| JGB | 99.1 | 99.4 | 
| ZW | 98.5 | 97.4 | 
| ALL | 95.6 | 97.3 | 
| C3Trans | RFB | CIOU | mAP (%) | FPS | 参数量 | 
|---|---|---|---|---|---|
| - | - | - | 95.0 | 131.0 | 7 042 489 | 
| √ | - | - | 95.3(↑0.3) | 130.8 | 7 043 257 | 
| √ | √ | - | 95.5(↑0.2) | 125.0 | 7 704 057 | 
| √ | √ | √ | 95.6(↑0.1) | 125.0 | 7 704 057 | 
Table 3 Ablation experiment
| C3Trans | RFB | CIOU | mAP (%) | FPS | 参数量 | 
|---|---|---|---|---|---|
| - | - | - | 95.0 | 131.0 | 7 042 489 | 
| √ | - | - | 95.3(↑0.3) | 130.8 | 7 043 257 | 
| √ | √ | - | 95.5(↑0.2) | 125.0 | 7 704 057 | 
| √ | √ | √ | 95.6(↑0.1) | 125.0 | 7 704 057 | 
																													Fig. 9 The detection results of different algorithm ((a) Original images; (b) Faster RCNN; (c) SSD; (d) YOLOv3; (e) YOLOv4; (f) YOLOv5; (g) YOLOX-s; (h) YOLOv7; (i) TR-YOLOv5)
| 检测算法 | FPS | mAP@0.5(%) | Weights(M) | 
|---|---|---|---|
| Faster RCNN | 2 | 94.9 | 113.8 | 
| SSD | 29 | 91.7 | 96.0 | 
| YOLOv3 | 7 | 93.7 | 123.5 | 
| YOLOv4 | 14 | 94.3 | 256.2 | 
| YOLOv5 | 131 | 95.0 | 15.2 | 
| YOLOX-s | 42 | 94.5 | 34.4 | 
| YOLOv7 | 36 | 95.3 | 74.8 | 
| TR-YOLOv5 | 125 | 95.6 | 15.8 | 
Table 4 Performance comparison of different algorithms
| 检测算法 | FPS | mAP@0.5(%) | Weights(M) | 
|---|---|---|---|
| Faster RCNN | 2 | 94.9 | 113.8 | 
| SSD | 29 | 91.7 | 96.0 | 
| YOLOv3 | 7 | 93.7 | 123.5 | 
| YOLOv4 | 14 | 94.3 | 256.2 | 
| YOLOv5 | 131 | 95.0 | 15.2 | 
| YOLOX-s | 42 | 94.5 | 34.4 | 
| YOLOv7 | 36 | 95.3 | 74.8 | 
| TR-YOLOv5 | 125 | 95.6 | 15.8 | 
| [1] | 赵振兵, 齐鸿雨, 聂礼强. 基于深度学习的输电线路视觉检测研究综述[J]. 广东电力, 2019, 32(9): 11-23. | 
| ZHAO Z B, QI H Y, NIE L Q. Research overview on visual detection of transmission lines based on deep learning[J]. Guangdong Electric Power, 2019, 32(9): 11-23 (in Chinese). | |
| [2] | 蒲天骄, 乔骥, 韩笑, 等. 人工智能技术在电力设备运维检修中的研究及应用[J]. 高电压技术, 2020, 46(2): 369-383. | 
| PU T J, QIAO J, HAN X, et al. Research and application of artificial intelligence in operation and maintenance for power equipment[J]. High Voltage Engineering, 2020, 46(2): 369-383 (in Chinese). | |
| [3] |  
											 WONG S Y, CHOE C W C, GOH H H, et al.  Power transmission line fault detection and diagnosis based on artificial intelligence approach and its development in UAV: a review[J]. Arabian Journal for Science and Engineering, 2021, 46(10): 9305-9331. 
																							 DOI  | 
										
| [4] | 郝帅, 马瑞泽, 赵新生, 等. 基于卷积块注意模型的YOLOv3输电线路故障检测方法[J]. 电网技术, 2021, 45(8): 2979-2987. | 
| HAO S, MA R Z, ZHAO X S, et al. Fault detection of YOLOv3 transmission line based on convolutional block attention model[J]. Power System Technology, 2021, 45(8): 2979-2987 (in Chinese). | |
| [5] | 高文婷, 刘越. 面向移动增强现实的实时深度学习目标检测方法综述[J]. 图学学报, 2021, 42(4): 525-534. | 
| GAO W T, LIU Y. Review of real-time deep learning-based object detection for mobile augmented reality[J]. Journal of Graphics, 2021, 42(4): 525-534 (in Chinese). | |
| [6] | 李洪安, 郑峭雪, 陶若霖, 等. 基于深度学习的图像超分辨率研究综述[J]. 图学学报, 2023, 44(1): 1-15. | 
| LI H A, ZHENG Q X, TAO R L, et al. Review of image super-resolution based on deep learning[J]. Journal of Graphics, 2023, 44(1): 1-15 (in Chinese). | |
| [7] |  
											 LIANG H G, ZUO C, WEI W M. Detection and evaluation method of transmission line defects based on deep learning[J]. IEEE Access, 2020, 8: 38448-38458. 
																							 DOI URL  | 
										
| [8] | 李辉, 董燕, 刘祥, 等. 基于两阶段深度网络的输电线路异常目标检测方法[J]. 控制与决策, 2022, 37(7): 1873-1882. | 
| LI H, DONG Y, LIU X, et al. Transmission line abnormal object detection method based on deep network of two-stage[J]. Control and Decision, 2022, 37(7): 1873-1882 (in Chinese). | |
| [9] |  
											 REN S Q, HE K M, GIRSHICK R, et al.  Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149. 
																							 DOI PMID  | 
										
| [10] | 戚银城, 武学良, 赵振兵, 等. 嵌入双注意力机制的Faster R-CNN航拍输电线路螺栓缺陷检测[J]. 中国图象图形学报, 2021, 26(11): 2594-2604. | 
| QI Y C, WU X L, ZHAO Z B, et al. Bolt defect detection for aerial transmission lines using Faster R-CNN with an embedded dual attention mechanism[J]. Journal of Image and Graphics, 2021, 26(11): 2594-2604 (in Chinese). | |
| [11] | 顾超越, 李喆, 史晋涛, 等. 基于改进Faster-RCNN的无人机巡检架空线路销钉缺陷检测[J]. 高电压技术, 2020, 46(9): 3089-3096. | 
| GU C Y, LI Z, SHI J T, et al. Detection for pin defects of overhead lines by UAV patrol image based on improved Faster-RCNN[J]. High Voltage Engineering, 2020, 46(9): 3089-3096 (in Chinese). | |
| [12] | LIU W, ANGUELOV D, ERHAN D, et al. SSD: single shot multibox detector[C]// European Conference on Computer Vision. Cham: Springer International Publishing, 2016: 21-37. | 
| [13] | REDMON J, FARHADI A. YOLOv3:an incremental improvement[EB/OL]. (2018-05-25) [2022-06-14]. https://arxiv.org/abs/1804.02767. | 
| [14] | BOCHKOVSKIY A, WANG C Y, LIAO H Y. YOLOv4: optimal speed and accuracy of object detection[EB/OL]. (2020-06-23) [2022-01-04]. https://arxiv.org/abs/2004.10934. | 
| [15] | 翁智, 程曦, 郑志强. 基于改进YOLOv3的高压输电线路关键部件检测方法[J]. 计算机应用, 2020, 40(S2): 183-187. | 
| WENG Z, CHENG X, ZHENG Z Q. Detection method of key components of high-voltage transmission lines based on improved YOLOv3[J]. Journal of Computer Applications, 2020, 40(S2): 183-187 (in Chinese). | |
| [16] | 郝帅, 杨磊, 马旭, 等. 基于注意力机制与跨尺度特征融合的YOLOv5输电线路故障检测[J]. 中国电机工程学报, 2023, 43(6): 2319-2331. | 
| HAO S, YANG L, MA X, et al. Fault detection of YOLOv5 transmission lines based on attention mechanism and cross-scale feature fusion[J]. Proceedings of the CSEE, 2023, 43(6): 2319-2331 (in Chinese). | |
| [17] | 祝星馗, 蒋球伟. 基于CNN与Transformer的无人机图像目标检测研究[J]. 武汉理工大学学报: 信息与管理工程版, 2022, 44(2): 323-331. | 
| ZHU X K, JIANG Q W. Research on object detection for UAV images based on CNN and Transformer[J]. Journal of Wuhan University of Technology: Information & Management Engineering, 2022, 44(2): 323-331 (in Chinese). | |
| [18] | 郑伟, 赵金芳, 张奕婧, 等. 基于感受野扩增和注意力机制的U-Net脑肿瘤MR图像分割[J]. 河北大学学报: 自然科学版, 2022, 42(5): 542-551. | 
| ZHENG W, ZHAO J F, ZHANG Y J, et al. Segmentation algorithm of brain tumor MR images based on receptor field amplification and attentional mechanism[J]. Journal of Hebei University: Natural Science Edition, 2022, 42(5): 542-551 (in Chinese). | |
| [19] | DU S J, ZHANG B F, ZHANG P, et al. An improved bounding box regression loss function based on CIOU loss for multi-scale object detection[C]// 2021 IEEE 2nd International Conference on Pattern Recognition and Machine Learning. New York: IEEE Press, 2021: 92-98. | 
| [20] | GE Z, LIU S, WANG F, et al. YOLOX: exceeding YOLO series in 2021[EB/OL]. (2021-08-06) [2022-06-12]. https://doi.org/10.48550/arXiv.2107.08430. | 
| [21] | WANG C, BOCHKOVSKIY A, LIAO H Y M. YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[EB/OL]. (2022-07-06) [2022-06-12]. https://doi.org/10.48550/arXiv.2207.02696. | 
| [1] | 
														YANG Chen-cheng, DONG Xiu-cheng, HOU Bing, ZHANG Dang-cheng, XIANG Xian-ming, FENG Qi-ming. 
														
															 
	Reference based transformer texture migrates depth imagessuper resolution reconstruction
 
														[J]. Journal of Graphics, 2023, 44(5): 861-867.
													 | 
												
| [2] | 
														PI Jun, NIU Hou-xing, GAO Zhi-yun. 
														
															 
	Lightweight human pose estimation algorithm byintegrating CA and BiFPN 
 
														[J]. Journal of Graphics, 2023, 44(5): 868-878.
													 | 
												
| [3] | 
														YANG Hong-ju, GAO Min, ZHANG Chang-you, BO Wen, WU Wen-jia, CAO Fu-yuan. 
														
															 
	A local optimization generation model for image inpainting
 
														[J]. Journal of Graphics, 2023, 44(5): 955-965.
													 | 
												
| [4] | LI Li-xia, WANG Xin, WANG Jun, ZHANG You-yuan. Small object detection algorithm in UAV image based on feature fusion and attention mechanism [J]. Journal of Graphics, 2023, 44(4): 658-666. | 
| [5] | HU Xin, ZHOU Yun-qiang, XIAO Jian, YANG Jie. Surface defect detection of threaded steel based on improved YOLOv5 [J]. Journal of Graphics, 2023, 44(3): 427-437. | 
| [6] | LI Gang, ZHANG Yun-tao, WANG Wen-kai, ZHANG Dong-yang. Defect detection method of transmission line bolts based on DETR and prior knowledge fusion [J]. Journal of Graphics, 2023, 44(3): 438-447. | 
| [7] | MAO Ai-kun, LIU Xin-ming, CHEN Wen-zhuang, SONG Shao-lou. Improved substation instrument target detection method for YOLOv5 algorithm [J]. Journal of Graphics, 2023, 44(3): 448-455. | 
| [8] | SUN Long-fei, LIU Hui, YANG Feng-chang, LI Pan. Research on cyclic generative network oriented to inter-layer interpolation of medical images [J]. Journal of Graphics, 2023, 44(3): 502-512. | 
| [9] | XIONG Ju-ju, XU Yang, FAN Run-ze, SUN Shao-cong. Flowers recognition based on lightweight visual transformer [J]. Journal of Graphics, 2023, 44(2): 271-279. | 
| [10] | CHEN Gang, ZHANG Pei-ji, GONG Dong-dong, YU Jun-qing. Research on safety clothing detection method for surveillance video of thermal power plant [J]. Journal of Graphics, 2023, 44(2): 291-297. | 
| [11] | CAO Yi-qin, WU Ming-lin, XU Lu. Steel surface defect detection based on improved YOLOv5 algorithm [J]. Journal of Graphics, 2023, 44(2): 335-345. | 
| [12] | ZHANG Wei-kang, SUN Hao, CHEN Xin-kai, LI Xu-bing, YAO Li-gang, DONG Hui. Research on weed detection in vegetable seedling fields based on the improved YOLOv5 intelligent weeding robot [J]. Journal of Graphics, 2023, 44(2): 346-356. | 
| [13] | LI Xiao-bo, LI Yang-gui, GUO Ning, FAN Zhen. Mask detection algorithm based on YOLOv5 integrating attention mechanism [J]. Journal of Graphics, 2023, 44(1): 16-25. | 
| [14] | PI Jun, LIU Yu-heng, LI Jiu-hao. Research on lightweight forest fire detection algorithm based on YOLOv5s [J]. Journal of Graphics, 2023, 44(1): 26-32. | 
| [15] | HUANG Zhi-yong, HAN Sha-sha, CHEN Zhi-jun, YAO Yu, XIONG Biao, MA Kai. An imitation U-shaped network for video object segmentation [J]. Journal of Graphics, 2023, 44(1): 104-111. | 
| Viewed | ||||||
| 
										Full text | 
									
										 | 
								|||||
| 
										Abstract | 
									
										 | 
								|||||