欢迎访问《图学学报》 分享到：
图学学报

图学学报 ›› 2021, Vol. 42 ›› Issue (2): 216-221.DOI: 10.11996/JG.j.2095-302X.2021020216

• 计算机图形学与虚拟现实 • 上一篇    下一篇

基于混合现实的远程协同式装配维修引导

  

  1. 1. 长安大学信息工程学院，陕西 西安 710064；2. 西北工业大学航天学院，陕西 西安 710072
  • 出版日期:2021-04-30 发布日期:2021-04-30
  • 基金资助:
    航天预研项目(030101) 

Mixed reality based remote collaborative assembly guidance 

  1. 1. School of Information Engineering, Chang’an University, Xi’an Shaanxi 710064, China; 2. School of Astronautics, Northwestern Polytechnical University, Xi’an Shaanxi 710072, China
  • Online:2021-04-30 Published:2021-04-30
  • Supported by:
    Advance Research Program of Space (030101) 

PDF (PC)

99

摘要： 提出一种基于混合现实设备 HoloLens 头盔的一种远程协同装配维修系统。利用 HoloLens 的深 度摄像头和摄像头对空间的感知能力，通过改进手势识别算法将专家端的二维手势操作转换为用户端的三维动 画标识。这种简洁生动的三维动画标识通过空间锚点固定在相应的空间位置上，为操作人员开展下一步操作提 供清晰的指引，且无需放下手头工作与计算机进行手势交互，实现了专家-用户模式的远程协同工作。相对于 传统的协同式系统，实验验证了该文开发的协同式装配维修引导系统的友好性和实用性。

关键词: 远程协同, 混合现实, 人机交互, 装配维修, HoloLens 

Abstract: A remote collaborative assembly and maintenance system was proposed based on mixed reality technology. HoloLens’s spatial perception capability of the depth camera and RGB camera was employed to map the interaction from the 2D gestures on the expert side to the 3D animation markers on the operator side, where the gestures were recognized using an improved method. These simple and vivid 3D markers were located with spatial anchors to provide the operator with clear directions about the next steps for expert-operator-mode collaborative tasks, freeing the operator’s hands from interacting with the computer by gestures. The experiments verify the feasibility of such user-friendly guide interfaces for remote collaboration of assembly and maintenance tasks. 

Key words: remote collaboration, mixed reality, human-computer interaction, assembly and maintenance, HoloLens 

中图分类号: