Welcome to Journal of Graphics share: 

Journal of Graphics

Previous Articles     Next Articles

Facial Expression Simulation Technology for Virtual Avatar

  

  1. (1. School of Automation, Nanjing University of Science and Technology, Nanjing Jiangsu 210094, China;  
    2. School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing Jiangsu 210094, China)
  • Online:2019-06-30 Published:2019-08-02

Abstract: In order to realize the offsite visualization interaction function in the electronic sand table environment based on Augmented Reality, a 3D expression simulation technology for virtual avatar is proposed. First, the expressions of remote worker is tracked using a RGB camera, the face feature point data is extracted based on constrained local models (CLM) and the data is sent to local. The interpolation algorithm based on Radial Basis Function is used to calculate the coordinates of vertices of the virtual avatar face mesh, the model is driven to simulate the same facial expression with the other offsite worker; Finally, in order to improve the accuracy and efficiency of the deformation algorithm, a selection method of interpolation control points and a sub-region interpolation method based on the distribution of the human muscle group and the greedy algorithm are proposed, The experimental results show that the algorithm can meet the real-time and realistic requirements of applications.

Key words: expression simulation, radial basis function, deformation model, muscle mode