Journal of Graphics ›› 2023, Vol. 44 ›› Issue (4): 667-676.DOI: 10.11996/JG.j.2095-302X.2023040667
Previous Articles Next Articles
HAO Shuai(), ZHAO Xin-sheng, MA Xu(
), ZHANG Xu, HE Tian, HOU Li-xiang
Received:
2023-01-31
Accepted:
2023-03-16
Online:
2023-08-31
Published:
2023-08-16
Contact:
MA Xu (1985-), lecturer, Ph.D. Her main research interests cover image processing, object detection, etc. E-mail:About author:
HAO Shuai (1986-), associate professor, Ph.D. His main research interests cover electrical equipment fault diagnosis, target detection, etc. E-mail:haoxust@163.com
Supported by:
CLC Number:
HAO Shuai, ZHAO Xin-sheng, MA Xu, ZHANG Xu, HE Tian, HOU Li-xiang. Multi-class defect target detection method for transmission lines based on TR-YOLOv5[J]. Journal of Graphics, 2023, 44(4): 667-676.
Add to citation manager EndNote|Ris|BibTeX
URL: http://www.txxb.com.cn/EN/10.11996/JG.j.2095-302X.2023040667
缺陷类型 | 自定义名称 | 数量(张) |
---|---|---|
销钉脱落 | XT | 342 |
螺母松动 | LSS | 316 |
螺母脱落 | LST | 347 |
放电间隙过大 | FDG | 310 |
绝缘子脱落 | JYT | 212 |
鸟巢 | NC | 235 |
放电间隙设计问题 | FDSJ | 262 |
防鸟刺损坏 | NS | 231 |
放电间隙短接 | FDG | 310 |
垫片缺失 | DP | 323 |
间隔棒断开 | JGB | 364 |
杂物 | ZW | 248 |
Table 1 Defect name and quantity
缺陷类型 | 自定义名称 | 数量(张) |
---|---|---|
销钉脱落 | XT | 342 |
螺母松动 | LSS | 316 |
螺母脱落 | LST | 347 |
放电间隙过大 | FDG | 310 |
绝缘子脱落 | JYT | 212 |
鸟巢 | NC | 235 |
放电间隙设计问题 | FDSJ | 262 |
防鸟刺损坏 | NS | 231 |
放电间隙短接 | FDG | 310 |
垫片缺失 | DP | 323 |
间隔棒断开 | JGB | 364 |
杂物 | ZW | 248 |
缺陷类型 | Precision | Recall |
---|---|---|
XT | 96.2 | 99.6 |
LSS | 78.2 | 95.7 |
LST | 97.5 | 98.9 |
FDG | 96.1 | 97.3 |
JYT | 99.3 | 97.1 |
NC | 99.8 | 99.0 |
FDSJ | 99.6 | 99.5 |
NS | 96.3 | 96.8 |
FDD | 98.0 | 98.6 |
DP | 88.4 | 86.1 |
JGB | 99.1 | 99.4 |
ZW | 98.5 | 97.4 |
ALL | 95.6 | 97.3 |
Table 2 Detection result of TR-YOLOv5 model on various targets (%)
缺陷类型 | Precision | Recall |
---|---|---|
XT | 96.2 | 99.6 |
LSS | 78.2 | 95.7 |
LST | 97.5 | 98.9 |
FDG | 96.1 | 97.3 |
JYT | 99.3 | 97.1 |
NC | 99.8 | 99.0 |
FDSJ | 99.6 | 99.5 |
NS | 96.3 | 96.8 |
FDD | 98.0 | 98.6 |
DP | 88.4 | 86.1 |
JGB | 99.1 | 99.4 |
ZW | 98.5 | 97.4 |
ALL | 95.6 | 97.3 |
C3Trans | RFB | CIOU | mAP (%) | FPS | 参数量 |
---|---|---|---|---|---|
- | - | - | 95.0 | 131.0 | 7 042 489 |
√ | - | - | 95.3(↑0.3) | 130.8 | 7 043 257 |
√ | √ | - | 95.5(↑0.2) | 125.0 | 7 704 057 |
√ | √ | √ | 95.6(↑0.1) | 125.0 | 7 704 057 |
Table 3 Ablation experiment
C3Trans | RFB | CIOU | mAP (%) | FPS | 参数量 |
---|---|---|---|---|---|
- | - | - | 95.0 | 131.0 | 7 042 489 |
√ | - | - | 95.3(↑0.3) | 130.8 | 7 043 257 |
√ | √ | - | 95.5(↑0.2) | 125.0 | 7 704 057 |
√ | √ | √ | 95.6(↑0.1) | 125.0 | 7 704 057 |
Fig. 9 The detection results of different algorithm ((a) Original images; (b) Faster RCNN; (c) SSD; (d) YOLOv3; (e) YOLOv4; (f) YOLOv5; (g) YOLOX-s; (h) YOLOv7; (i) TR-YOLOv5)
检测算法 | FPS | mAP@0.5(%) | Weights(M) |
---|---|---|---|
Faster RCNN | 2 | 94.9 | 113.8 |
SSD | 29 | 91.7 | 96.0 |
YOLOv3 | 7 | 93.7 | 123.5 |
YOLOv4 | 14 | 94.3 | 256.2 |
YOLOv5 | 131 | 95.0 | 15.2 |
YOLOX-s | 42 | 94.5 | 34.4 |
YOLOv7 | 36 | 95.3 | 74.8 |
TR-YOLOv5 | 125 | 95.6 | 15.8 |
Table 4 Performance comparison of different algorithms
检测算法 | FPS | mAP@0.5(%) | Weights(M) |
---|---|---|---|
Faster RCNN | 2 | 94.9 | 113.8 |
SSD | 29 | 91.7 | 96.0 |
YOLOv3 | 7 | 93.7 | 123.5 |
YOLOv4 | 14 | 94.3 | 256.2 |
YOLOv5 | 131 | 95.0 | 15.2 |
YOLOX-s | 42 | 94.5 | 34.4 |
YOLOv7 | 36 | 95.3 | 74.8 |
TR-YOLOv5 | 125 | 95.6 | 15.8 |
[1] | 赵振兵, 齐鸿雨, 聂礼强. 基于深度学习的输电线路视觉检测研究综述[J]. 广东电力, 2019, 32(9): 11-23. |
ZHAO Z B, QI H Y, NIE L Q. Research overview on visual detection of transmission lines based on deep learning[J]. Guangdong Electric Power, 2019, 32(9): 11-23 (in Chinese). | |
[2] | 蒲天骄, 乔骥, 韩笑, 等. 人工智能技术在电力设备运维检修中的研究及应用[J]. 高电压技术, 2020, 46(2): 369-383. |
PU T J, QIAO J, HAN X, et al. Research and application of artificial intelligence in operation and maintenance for power equipment[J]. High Voltage Engineering, 2020, 46(2): 369-383 (in Chinese). | |
[3] |
WONG S Y, CHOE C W C, GOH H H, et al. Power transmission line fault detection and diagnosis based on artificial intelligence approach and its development in UAV: a review[J]. Arabian Journal for Science and Engineering, 2021, 46(10): 9305-9331.
DOI |
[4] | 郝帅, 马瑞泽, 赵新生, 等. 基于卷积块注意模型的YOLOv3输电线路故障检测方法[J]. 电网技术, 2021, 45(8): 2979-2987. |
HAO S, MA R Z, ZHAO X S, et al. Fault detection of YOLOv3 transmission line based on convolutional block attention model[J]. Power System Technology, 2021, 45(8): 2979-2987 (in Chinese). | |
[5] | 高文婷, 刘越. 面向移动增强现实的实时深度学习目标检测方法综述[J]. 图学学报, 2021, 42(4): 525-534. |
GAO W T, LIU Y. Review of real-time deep learning-based object detection for mobile augmented reality[J]. Journal of Graphics, 2021, 42(4): 525-534 (in Chinese). | |
[6] | 李洪安, 郑峭雪, 陶若霖, 等. 基于深度学习的图像超分辨率研究综述[J]. 图学学报, 2023, 44(1): 1-15. |
LI H A, ZHENG Q X, TAO R L, et al. Review of image super-resolution based on deep learning[J]. Journal of Graphics, 2023, 44(1): 1-15 (in Chinese). | |
[7] |
LIANG H G, ZUO C, WEI W M. Detection and evaluation method of transmission line defects based on deep learning[J]. IEEE Access, 2020, 8: 38448-38458.
DOI URL |
[8] | 李辉, 董燕, 刘祥, 等. 基于两阶段深度网络的输电线路异常目标检测方法[J]. 控制与决策, 2022, 37(7): 1873-1882. |
LI H, DONG Y, LIU X, et al. Transmission line abnormal object detection method based on deep network of two-stage[J]. Control and Decision, 2022, 37(7): 1873-1882 (in Chinese). | |
[9] |
REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149.
DOI PMID |
[10] | 戚银城, 武学良, 赵振兵, 等. 嵌入双注意力机制的Faster R-CNN航拍输电线路螺栓缺陷检测[J]. 中国图象图形学报, 2021, 26(11): 2594-2604. |
QI Y C, WU X L, ZHAO Z B, et al. Bolt defect detection for aerial transmission lines using Faster R-CNN with an embedded dual attention mechanism[J]. Journal of Image and Graphics, 2021, 26(11): 2594-2604 (in Chinese). | |
[11] | 顾超越, 李喆, 史晋涛, 等. 基于改进Faster-RCNN的无人机巡检架空线路销钉缺陷检测[J]. 高电压技术, 2020, 46(9): 3089-3096. |
GU C Y, LI Z, SHI J T, et al. Detection for pin defects of overhead lines by UAV patrol image based on improved Faster-RCNN[J]. High Voltage Engineering, 2020, 46(9): 3089-3096 (in Chinese). | |
[12] | LIU W, ANGUELOV D, ERHAN D, et al. SSD: single shot multibox detector[C]// European Conference on Computer Vision. Cham: Springer International Publishing, 2016: 21-37. |
[13] | REDMON J, FARHADI A. YOLOv3:an incremental improvement[EB/OL]. (2018-05-25) [2022-06-14]. https://arxiv.org/abs/1804.02767. |
[14] | BOCHKOVSKIY A, WANG C Y, LIAO H Y. YOLOv4: optimal speed and accuracy of object detection[EB/OL]. (2020-06-23) [2022-01-04]. https://arxiv.org/abs/2004.10934. |
[15] | 翁智, 程曦, 郑志强. 基于改进YOLOv3的高压输电线路关键部件检测方法[J]. 计算机应用, 2020, 40(S2): 183-187. |
WENG Z, CHENG X, ZHENG Z Q. Detection method of key components of high-voltage transmission lines based on improved YOLOv3[J]. Journal of Computer Applications, 2020, 40(S2): 183-187 (in Chinese). | |
[16] | 郝帅, 杨磊, 马旭, 等. 基于注意力机制与跨尺度特征融合的YOLOv5输电线路故障检测[J]. 中国电机工程学报, 2023, 43(6): 2319-2331. |
HAO S, YANG L, MA X, et al. Fault detection of YOLOv5 transmission lines based on attention mechanism and cross-scale feature fusion[J]. Proceedings of the CSEE, 2023, 43(6): 2319-2331 (in Chinese). | |
[17] | 祝星馗, 蒋球伟. 基于CNN与Transformer的无人机图像目标检测研究[J]. 武汉理工大学学报: 信息与管理工程版, 2022, 44(2): 323-331. |
ZHU X K, JIANG Q W. Research on object detection for UAV images based on CNN and Transformer[J]. Journal of Wuhan University of Technology: Information & Management Engineering, 2022, 44(2): 323-331 (in Chinese). | |
[18] | 郑伟, 赵金芳, 张奕婧, 等. 基于感受野扩增和注意力机制的U-Net脑肿瘤MR图像分割[J]. 河北大学学报: 自然科学版, 2022, 42(5): 542-551. |
ZHENG W, ZHAO J F, ZHANG Y J, et al. Segmentation algorithm of brain tumor MR images based on receptor field amplification and attentional mechanism[J]. Journal of Hebei University: Natural Science Edition, 2022, 42(5): 542-551 (in Chinese). | |
[19] | DU S J, ZHANG B F, ZHANG P, et al. An improved bounding box regression loss function based on CIOU loss for multi-scale object detection[C]// 2021 IEEE 2nd International Conference on Pattern Recognition and Machine Learning. New York: IEEE Press, 2021: 92-98. |
[20] | GE Z, LIU S, WANG F, et al. YOLOX: exceeding YOLO series in 2021[EB/OL]. (2021-08-06) [2022-06-12]. https://doi.org/10.48550/arXiv.2107.08430. |
[21] | WANG C, BOCHKOVSKIY A, LIAO H Y M. YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[EB/OL]. (2022-07-06) [2022-06-12]. https://doi.org/10.48550/arXiv.2207.02696. |
[1] |
YANG Chen-cheng, DONG Xiu-cheng, HOU Bing, ZHANG Dang-cheng, XIANG Xian-ming, FENG Qi-ming.
Reference based transformer texture migrates depth imagessuper resolution reconstruction
[J]. Journal of Graphics, 2023, 44(5): 861-867.
|
[2] |
PI Jun, NIU Hou-xing, GAO Zhi-yun.
Lightweight human pose estimation algorithm byintegrating CA and BiFPN
[J]. Journal of Graphics, 2023, 44(5): 868-878.
|
[3] |
YANG Hong-ju, GAO Min, ZHANG Chang-you, BO Wen, WU Wen-jia, CAO Fu-yuan.
A local optimization generation model for image inpainting
[J]. Journal of Graphics, 2023, 44(5): 955-965.
|
[4] | LI Li-xia, WANG Xin, WANG Jun, ZHANG You-yuan. Small object detection algorithm in UAV image based on feature fusion and attention mechanism [J]. Journal of Graphics, 2023, 44(4): 658-666. |
[5] | HU Xin, ZHOU Yun-qiang, XIAO Jian, YANG Jie. Surface defect detection of threaded steel based on improved YOLOv5 [J]. Journal of Graphics, 2023, 44(3): 427-437. |
[6] | LI Gang, ZHANG Yun-tao, WANG Wen-kai, ZHANG Dong-yang. Defect detection method of transmission line bolts based on DETR and prior knowledge fusion [J]. Journal of Graphics, 2023, 44(3): 438-447. |
[7] | MAO Ai-kun, LIU Xin-ming, CHEN Wen-zhuang, SONG Shao-lou. Improved substation instrument target detection method for YOLOv5 algorithm [J]. Journal of Graphics, 2023, 44(3): 448-455. |
[8] | SUN Long-fei, LIU Hui, YANG Feng-chang, LI Pan. Research on cyclic generative network oriented to inter-layer interpolation of medical images [J]. Journal of Graphics, 2023, 44(3): 502-512. |
[9] | XIONG Ju-ju, XU Yang, FAN Run-ze, SUN Shao-cong. Flowers recognition based on lightweight visual transformer [J]. Journal of Graphics, 2023, 44(2): 271-279. |
[10] | CHEN Gang, ZHANG Pei-ji, GONG Dong-dong, YU Jun-qing. Research on safety clothing detection method for surveillance video of thermal power plant [J]. Journal of Graphics, 2023, 44(2): 291-297. |
[11] | CAO Yi-qin, WU Ming-lin, XU Lu. Steel surface defect detection based on improved YOLOv5 algorithm [J]. Journal of Graphics, 2023, 44(2): 335-345. |
[12] | ZHANG Wei-kang, SUN Hao, CHEN Xin-kai, LI Xu-bing, YAO Li-gang, DONG Hui. Research on weed detection in vegetable seedling fields based on the improved YOLOv5 intelligent weeding robot [J]. Journal of Graphics, 2023, 44(2): 346-356. |
[13] | LI Xiao-bo, LI Yang-gui, GUO Ning, FAN Zhen. Mask detection algorithm based on YOLOv5 integrating attention mechanism [J]. Journal of Graphics, 2023, 44(1): 16-25. |
[14] | PI Jun, LIU Yu-heng, LI Jiu-hao. Research on lightweight forest fire detection algorithm based on YOLOv5s [J]. Journal of Graphics, 2023, 44(1): 26-32. |
[15] | HUANG Zhi-yong, HAN Sha-sha, CHEN Zhi-jun, YAO Yu, XIONG Biao, MA Kai. An imitation U-shaped network for video object segmentation [J]. Journal of Graphics, 2023, 44(1): 104-111. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||