欢迎访问《图学学报》 分享到:

图学学报

• 图像处理与计算机视觉 • 上一篇    下一篇

复杂场景下的人体轮廓提取及尺寸测量

  

  1. (1. 浙江大学计算机科学与技术学院,浙江 杭州 310027; 2. 浙江大学机械工程学院,浙江 杭州 310027; 3. 三明学院艺术与设计学院,福建 三明 365004)
  • 出版日期:2020-10-31 发布日期:2020-11-05
  • 通讯作者: 张东亮(1971–),男,浙江温州人,教授,博士,博士生导师。主要研究方向为计算机辅助设计、计算机图形学、交互设计等。 E-mail:dzhang@zju.edu.cn
  • 作者简介:吴泽斌(1995?),男,浙江杭州人,硕士研究生。主要研究方向为图形图像处理、计算机视觉等。E-mail:wuzb1995@zju.edu.cn
  • 基金资助:
    国家自然科学基金项目(61732015,61972340);浙江省重点研发计划项目(2018C01090)

Contour recognition and information extraction of human bodies in complex scenes

  1. (1. College of Computer Science and Technology, Zhejiang University, Hangzhou Zhejiang 310027, China; 2. School of Mechanical Engineering, Zhejiang University, Hangzhou Zhejiang 310027, China; 3. School of Art and Design, Sanming University, Sanming Fujiang 365004, China)
  • Online:2020-10-31 Published:2020-11-05
  • Contact: ZHANG Dong-liang (1971–), male, professor, Ph.D. His main research interests cover computer-aided design, computer graphics, interactive design, etc. E-mail:dzhang@zju.edu.cn
  • About author:WU Ze-bin (1995–), male, master student. His main research interests cover image processing, computer vision, etc. E-mail:wuzb1995@zju.edu.cn
  • Supported by:
    National Natural Science Foundation of China (61732015, 61972340);Key R&D Program Projects in Zhejiang Province (2018C01090)

摘要: 自然拍摄的人体照片由于背景图案较为复杂,采用传统基于图片色彩空间或能量 梯度的图像处理方法难以准确地识别人体的轮廓。采用神经网络的方法,可以提高识别的精度。 但是,一般的神经网络方法由于计算量与参数规模较大,难以在移动终端部署。因此,提出了 一种轻量级的神经网络策略以提取人体轮廓。该网络采用 MobileNet V2 与 U-Net 框架,通过构 建特定姿态的人体数据集进行训练,识别相应的人体轮廓形状。人体轮廓经过提取关键点、拟 合回归分析等后续处理,可估算人体的尺寸。该方法可应用在移动终端上,通过拍摄的人体照 片的方法测量人体的尺寸。实验表明,该方法能准确地提取复杂背景照片中的人体轮廓并测量 尺寸,在速度与存储占用方面较一般神经网络有一定优势。

关键词: 图像处理, 轮廓提取, 人体尺寸测量, 轻量级神经网络, 深度学习

Abstract: Due to the complexity of background, it is difficult to accurately recognize the contour of human body by traditional image-processing methods based on color space or energy gradient. Neural network can improve the accuracy of recognition. However, due to the large scale of computations and parameters, it is difficult to deploy the general neural network methods in mobile devices. Therefore, we proposed a lightweight neural network to extract human body contours. This network utilized MobileNet V2 and U-Net framework to recognize the contours of human bodies by building a human-body dataset with specific poses for training. The contours of human bodies can be used to measure the sizes of human bodies after the subsequent processes, such as the extraction of key points and analysis of fitting regression. This method can be applied to mobile terminals to measure the body sizes by taking pictures. Experiments show that this method can accurately extract the contours of human bodies in photos with complex backgrounds and measure the body sizes, and that it possesses some advantages over the general neural network in terms of speed and storage.

Key words: image processing, contour extraction, body measurement, lightweight neural network; deep learning