Welcome to Journal of Graphics share: 

Journal of Graphics ›› 2021, Vol. 42 ›› Issue (3): 462-469.DOI: 10.11996/JG.j.2095-302X.2021030462

• Computer Graphics and Virtual Reality • Previous Articles     Next Articles

Research on adaptive grasping of virtual hands based on deep reinforcement learning 

  

  1. 1. School of Automation, Nanjing University of Science and Technology, Nanjing Jiangsu 210094, China;  2. School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing Jiangsu 210094, China
  • Online:2021-06-30 Published:2021-06-29
  • Supported by:
    Thirteenth Five-Year Plan Equipment Pre-research Project (61409230104, 1017, 315100104); Fundamental Research Fund for Central Universities (30918012203); Shanghai Aerospace Science and Technology Innovation Fund (SAST2019009)

Abstract: For the grasping of computer character animation, it is difficult to guarantee the naturalness, stability and adaptability of the generated action sequence at the same time. In other words, the natural and stable grasping controller are often limited in generalization and cannot be applied to other types of grabbing tasks. A virtual hand adaptive grasping controller was constructed based on deep reinforcement learning by introducing hand teaching data corresponding to the grasping types and by designing the reward function. Experimental results show that the designed controller can generate a grasping motion sequence with both naturalness and stability, and are also highly adaptive for different sizes and types of primitive objects in the material library. 

Key words: deep reinforcement learning, demonstration learning, motion generation, virtual hands, mocap data 

CLC Number: