Journal of Graphics ›› 2022, Vol. 43 ›› Issue (1): 141-148.DOI: 10.11996/JG.j.2095-302X.2022010141
• Computer Graphics and Virtual Reality • Previous Articles Next Articles
Online:
Published:
Supported by:
Abstract: This paper examined the basic structure and training method of Faster R-CNN (convolutional neural networks) target detection network. The state data set of mechanical and electrical equipment was established, and the target detection network was trained. In a single step, the region of pointer instrument could be extracted, and the reading of digital instrument and the state of switch and plug could be recognized. The target detection network was tested under different viewing angles and illumination intensities. The results show that the model can maintain the accuracy of more than 90% in different environments. Finally, based on the reasoning results, the intelligent maintenance assistant system for mechanical and electrical equipment developed based on Unity 3D software and HoloLens 2 hardware was applied to the retrieval of the mixed reality (MR) holographic induction maintenance information, thus guiding the operation of the support personnel. In order to verify the availability of the system, the experimental verification process was added, and the experimental results show that the experimenter could complete the maintenance task quickly and efficiently using MR. In addition, test and evaluation were conducted based on the operation time and questionnaire survey, and qualitative analysis was carried out regarding the advantages of the system.
Key words: mixed reality, faster R-CNN, intelligent fault diagnosis, maintenance assistance, experimental verification
CLC Number:
TP 391 
WANG Wei, HONG Xue-feng, LEI Song-gui. Intelligent inspection and maintenance of mechanical and electrical equipment based on MR [J]. Journal of Graphics, 2022, 43(1): 141-148.
0 / / Recommend
Add to citation manager EndNote|Ris|BibTeX
URL: http://www.txxb.com.cn/EN/10.11996/JG.j.2095-302X.2022010141
http://www.txxb.com.cn/EN/Y2022/V43/I1/141