Welcome to Journal of Graphics share: 

Journal of Graphics

Previous Articles     Next Articles

Contour recognition and information extraction of human bodies in complex scenes

  

  1. (1. College of Computer Science and Technology, Zhejiang University, Hangzhou Zhejiang 310027, China; 2. School of Mechanical Engineering, Zhejiang University, Hangzhou Zhejiang 310027, China; 3. School of Art and Design, Sanming University, Sanming Fujiang 365004, China)
  • Online:2020-10-31 Published:2020-11-05
  • Contact: ZHANG Dong-liang (1971–), male, professor, Ph.D. His main research interests cover computer-aided design, computer graphics, interactive design, etc. E-mail:dzhang@zju.edu.cn
  • About author:WU Ze-bin (1995–), male, master student. His main research interests cover image processing, computer vision, etc. E-mail:wuzb1995@zju.edu.cn
  • Supported by:
    National Natural Science Foundation of China (61732015, 61972340);Key R&D Program Projects in Zhejiang Province (2018C01090)

Abstract: Due to the complexity of background, it is difficult to accurately recognize the contour of human body by traditional image-processing methods based on color space or energy gradient. Neural network can improve the accuracy of recognition. However, due to the large scale of computations and parameters, it is difficult to deploy the general neural network methods in mobile devices. Therefore, we proposed a lightweight neural network to extract human body contours. This network utilized MobileNet V2 and U-Net framework to recognize the contours of human bodies by building a human-body dataset with specific poses for training. The contours of human bodies can be used to measure the sizes of human bodies after the subsequent processes, such as the extraction of key points and analysis of fitting regression. This method can be applied to mobile terminals to measure the body sizes by taking pictures. Experiments show that this method can accurately extract the contours of human bodies in photos with complex backgrounds and measure the body sizes, and that it possesses some advantages over the general neural network in terms of speed and storage.

Key words: image processing, contour extraction, body measurement, lightweight neural network; deep learning