欢迎访问《图学学报》 分享到:

图学学报

• 图像处理与计算机视觉 • 上一篇    下一篇

基于改进分段铰链变换的人体重建技术

  

  1. 安徽大学计算机科学与技术学院媒体计算研究所,安徽 合肥 230601
  • 出版日期:2020-02-29 发布日期:2020-03-11
  • 基金资助:
    国家自然科学基金项目(61502005);安徽省科技攻关计划项目(1604d0802004);安徽省自然科学基金项目(1608085QF129)

Human body reconstruction based on improved piecewise hinge transformation

  1. Institute of Media Computing, School of Computer Science and Technology, Anhui University, Hefei Anhui 230601, China
  • Online:2020-02-29 Published:2020-03-11

摘要: 目前,基于单帧图像的人体建模还不能有效地处理手臂、衣服等对身体部位的遮
挡,以及因视角带来的自我身体遮挡等复杂的遮挡问题。为此,利用SMPL 模型骨骼关节分布
特点,提出改进传统分段铰链变换模型的人体重建方法。该方法运用骨骼关节的精确标注确定
模型变换的节点,结合图像轮廓边界约束图,提出前向分段回归概率期望最小化(FPR-PEM)的
柔性配准方法。通过迭代模型对变形关节处结合薄板样条进行线性插值,保证模型表面点云形
状的独立性,有效地注册各种姿势下的非刚性变形模型,较好地解决了复杂遮挡带来的重建挑
战,并进行模型姿态回归调整,实现准确的人体建模。实验结果表明,方法可以有效实现精细
和平滑模型的人体表面重建。

关键词: 人体重建, 分段铰链, 柔性配准, 概率模型, SMPL

Abstract: At present, existing single-image-based human body modeling methods still cannot
effectively deal with the complex occlusions of body parts either due to the arms or clothes or to the
changes of viewpoints. To solve this problem, using the distribution characteristics of skeletal joints
in the SMPL model, we designed a human body reconstruction method by improving the traditional
segmented hinge transformation model. The method uses the accurate annotation of the skeletal joints
to identify the node of the model transformation and combines the image contour boundary constraint
map to propose the non-rigid registration method of forward piecewise regression and probability
expectation minimization (FPR-PEM). The iterative model was used to linearly interpolate the thin
plate splines at the deformed joint to ensure the independence of the point cloud shape on the model
surface, which effectively registered non-rigid deformation models under various postures and better
solved the reconstruction challenges brought by complex occlusion. Then regression adjustments
were performed with regard to the model posture so as made to achieve accurate human body
modeling. Experimental results show that the proposed method works effectively to build a fine and
smooth model of human body reconstruction.

Key words: human body reconstruction, piecewise hinge, non-rigid registration, probability model;
SMPL