欢迎访问《图学学报》 分享到：
图学学报

图学学报

• 专论：第18届中国虚拟现实大会暨第8届国际虚拟现实与可视化会议(ChinaVR & ICVRV 2018 青岛 ) • 上一篇    下一篇

面向虚拟化身的人脸表情模拟技术

  

  1. (1. 南京理工大学自动化学院，江苏 南京 210094； 
    2. 南京理工大学计算机科学与工程学院，江苏 南京 210094)
  • 出版日期:2019-06-30 发布日期:2019-08-02
  • 基金资助:
    “十三五”装备预研项目(315100104，41401010203)；上海航天科技创新基金项目(SAST2018009)

Facial Expression Simulation Technology for Virtual Avatar

  1. (1. School of Automation, Nanjing University of Science and Technology, Nanjing Jiangsu 210094, China;  
    2. School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing Jiangsu 210094, China)
  • Online:2019-06-30 Published:2019-08-02

PDF (PC)

128

摘要： 为了实现基于增强现实的电子沙盘环境中的异地可视化交互功能，提出了一种面 向虚拟化身的三维表情模拟技术。首先，使用 RGB 摄像头跟踪异地作业人员的表情，基于约 束局部模型(CLM)提取人脸特征点数据后传输到本地；然后，采用基于径向基函数的插值算法 计算虚拟化身面部网格点的坐标，驱动模型模拟出与异地作业人员相同的表情；最后，为了提 高变形算法的精度和效率，提出一种基于贪心算法与人脸肌群分布的插值控制点选取和分区域 插值方法。实验结果表明，该算法能够满足实际应用对实时性和真实感的需求。

关键词: 表情模拟, 径向基函数, 形变模型, 肌肉模型

Abstract: In order to realize the offsite visualization interaction function in the electronic sand table environment based on Augmented Reality, a 3D expression simulation technology for virtual avatar is proposed. First, the expressions of remote worker is tracked using a RGB camera, the face feature point data is extracted based on constrained local models (CLM) and the data is sent to local. The interpolation algorithm based on Radial Basis Function is used to calculate the coordinates of vertices of the virtual avatar face mesh, the model is driven to simulate the same facial expression with the other offsite worker; Finally, in order to improve the accuracy and efficiency of the deformation algorithm, a selection method of interpolation control points and a sub-region interpolation method based on the distribution of the human muscle group and the greedy algorithm are proposed, The experimental results show that the algorithm can meet the real-time and realistic requirements of applications.

Key words: expression simulation, radial basis function, deformation model, muscle mode