Welcome to Journal of Graphics share: 

Journal of Graphics

Previous Articles     Next Articles

Towards Human-Computer Interface Design for Virtual Micro Cataract Surgical System

  

  1. (1. School of Mechanical and Electrical Engineering, Wuhan University of Technology, Wuhan Hubei 430070, China;
    2. Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen Guangdong 518055, China; 
    3. Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong 999077 China; 
    4. School of Information Science and Engineering, Shandong University of Science and Technology, Qingdao Shandong 266590, China)
  • Online:2019-06-30 Published:2019-08-02

Abstract: Virtual reality based micro cataract surgical simulator is of great significance for the training of ophthalmic surgery in the microscope vision environment. We have presented a hardware/software environment for a highly immersive virtual micro surgical training system. The hardware part of the system is based on HTC Vive and Geomagic Touch X, and the surgical instrument conversion interfaces are used to build a high-fidelity surgical operating environment. In addition, position-based dynamics in the software part is used to simulate the deformation, puncturing and suturing of corneal soft tissue during surgery, while GPU parallel computing is employed to accelerate the computing for interactive environment. Finally, tests show that this system achieves a more natural human-computer interface for micro cataract surgery, which enables young physicians to obtain a highly immersive real surgical training experience to achieve an effective training effect.

Key words: micro cataract surgery, virtual training system, interactive simulation, human-computer interaction interface