Welcome to Journal of Graphics share: 

Journal of Graphics ›› 2023, Vol. 44 ›› Issue (4): 667-676.DOI: 10.11996/JG.j.2095-302X.2023040667

Previous Articles     Next Articles

Multi-class defect target detection method for transmission lines based on TR-YOLOv5

HAO Shuai(), ZHAO Xin-sheng, MA Xu(), ZHANG Xu, HE Tian, HOU Li-xiang   

  1. School of Electrical and Control Engineering, Xi’an University of Science and Technology, Xi’an Shaanxi 710054, China
  • Received:2023-01-31 Accepted:2023-03-16 Online:2023-08-31 Published:2023-08-16
  • Contact: MA Xu (1985-), lecturer, Ph.D. Her main research interests cover image processing, object detection, etc. E-mail:414548542@qq.com
  • About author:

    HAO Shuai (1986-), associate professor, Ph.D. His main research interests cover electrical equipment fault diagnosis, target detection, etc. E-mail:haoxust@163.com

  • Supported by:
    National Natural Science Foundation of China(51804250);China Postdoctoral Science Foundation(2019M653874);China Postdoctoral Science Foundation(2020M683522);Shaanxi Provincial Science and Technology Plan Project(2021JQ-572);Shaanxi Provincial Science and Technology Plan Project(2020JQ-757);Shaanxi Provincial Education Department Scientific Research Program(18JK0512);Shaanxi Provincial Education Department Scientific Research Program(17JK0503);Xi’an Beilin District Science and Technology Plan Project(GX2116)

Abstract:

To address the problem of multi-scale detection of multi-class defect targets in transmission lines in complex environments, a YOLOv5 transmission line multi-class defect target detection algorithm was proposed based on Transformer and perceptual field modules, abbreviated as TR-YOLOv5. First, a YOLOv5 network was built to address the problem of low saliency of defect targets caused by complex backgrounds, which hindered accurate detection. The Transformer module was introduced in the Backbone part. By utilizing a multi-head attention structure to capture the correlations and global information between the pixels of feature maps, the feature expression capability of the defect targets was enhanced, thereby improving the detection accuracy of the model. Secondly, since the target being detected is impacted by multiple scales, a perceptual field module was introduced in the Neck part to extract features of different scales of the target. Null convolution was also employed to increase the perceptual field, while more detailed features were reserved for the subsequent PANet structure. Furthermore, the Neck feature fusion capability was bolstered to enhance the detection accuracy of the model for multi-scale defective targets. In addition, to enhance the precision of predicted border regression, the CIOU function was introduced to further boost the detection accuracy of the algorithm. Finally, the proposed algorithm was validated using the data of a power inspection department for the past three years. The experimental results demonstrated that the proposed algorithm could surpass seven comparative algorithms in terms of detection accuracy and real-time performance, with an average detection accuracy of 95.6% and the inspection image detection speed for 1280×720 resolution reaching 125 frames/second.

Key words: YOLOv5, transmission line defect detection, dilation convolution, Transformer, receptive field block, loss function

CLC Number: