欢迎访问《图学学报》 分享到：
图学学报

图学学报

• 人机交互 • 上一篇    下一篇

虚拟显微白内障手术系统人机交互接口设计

  

  1. (1. 武汉理工大学机电工程学院，湖北 武汉 430070； 
    2. 中国科学院深圳先进技术研究院深圳市虚拟现实与人机交互技术重点实验室，广东 深圳 518055； 
    3. 香港中文大学计算机科学与工程系，香港 999077；
    4. 山东科技大学信息科学与工程学院，山东 青岛 266590)
  • 出版日期:2019-06-30 发布日期:2019-08-02
  • 基金资助:
    深圳市虚拟现实与人机交互技术重点实验室项目(ZDSYS201605101739178)；国家自然科学基金青年项目(61802385)；深圳市科技计划基 础研究项目(JCYJ20170413162617606)

Towards Human-Computer Interface Design for Virtual Micro Cataract Surgical System

  1. (1. School of Mechanical and Electrical Engineering, Wuhan University of Technology, Wuhan Hubei 430070, China;
    2. Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen Guangdong 518055, China; 
    3. Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong 999077 China; 
    4. School of Information Science and Engineering, Shandong University of Science and Technology, Qingdao Shandong 266590, China)
  • Online:2019-06-30 Published:2019-08-02

PDF (PC)

66

摘要：

基于虚拟现实技术的显微白内障手术仿真训练系统对显微环境下眼科手术操作培 训具有重要的意义。为此，设计并搭建了一套具有高度沉浸感的虚拟显微白内障手术训练系统 的软硬件环境。硬件部分系统以 HTC Vive，Geomagic Touch X 为硬件基础，设计手术器械转换 接口以搭建高保真手术操作环境；软件部分采用基于位置动力学方法(position-based dynamics) 模拟手术过程中眼角膜软组织的变形、穿刺及缝合操作，并采用 GPU 并行计算对手术仿真过程 进行加速。最后，实验结果表明该系统可以实现自然的显微眼科手术人机交互环境，使年轻医 师获得高沉浸感的真实手术训练体验，从而达到一定的培训效果。

关键词: 显微白内障手术, 虚拟训练系统, 交互式仿真, 人机交互接口

Abstract: Virtual reality based micro cataract surgical simulator is of great significance for the training of ophthalmic surgery in the microscope vision environment. We have presented a hardware/software environment for a highly immersive virtual micro surgical training system. The hardware part of the system is based on HTC Vive and Geomagic Touch X, and the surgical instrument conversion interfaces are used to build a high-fidelity surgical operating environment. In addition, position-based dynamics in the software part is used to simulate the deformation, puncturing and suturing of corneal soft tissue during surgery, while GPU parallel computing is employed to accelerate the computing for interactive environment. Finally, tests show that this system achieves a more natural human-computer interface for micro cataract surgery, which enables young physicians to obtain a highly immersive real surgical training experience to achieve an effective training effect.

Key words: micro cataract surgery, virtual training system, interactive simulation, human-computer interaction interface