欢迎访问《图学学报》 分享到:

图学学报

• 交互技术与虚拟现实 • 上一篇    下一篇

基于Leap Motion 的三维模型草图检索

  

  1. 1. 虚拟现实应用教育部工程研究中心,北京 100875;
    2. 北京师范大学信息科学与技术学院,北京 100875
  • 出版日期:2017-04-30 发布日期:2017-04-28
  • 基金资助:
    国家自然科学基金项目(61001168,61402041);中央高校基本科研基金项目(2013YB67)

Sketch-Based Three-Dimensional Model Retrieval Based on Leap Motion

  1. 1. Engineering Research Center of Virtual Reality and Applications, Ministry of Education (MOE), Beijing 100875, China;
    2. College of Information Science and Technology, Beijing Normal University, Beijing 100875, China
  • Online:2017-04-30 Published:2017-04-28

摘要: 对三维模型检索的需求在搜索领域日益增长,而基于草图的三维模型检索也已然成
为最为有效且易用的检索方式。为了更好地提升草图检索的体验,着眼于人机交互的方式并对其
加以改进是必由之路。其中,Leap Motion 系统可高精度实时检测并跟踪手指的位置和手势信息
等,为大屏幕、远距离交互提供了有效途径。文中提出了一种基于Leap Motion 的三维模型草图
检索系统用于三维模型检索。通过Leap Motion 获得的数据将手的运动模拟信息实时地反映到浏
览器上,实现草图的绘制和模型的检索。在草图检索部分,提出了一种改进的流形排序方法用于
对模型间的相似度进行排序,结合模型语义分类信息的排序约束方法,提高了同类模型的排名分
数。实验显示,该方法使得草图检索更加贴近和方便用户,进一步提高了草图检索的易用性以及
三维模型检索的准确性。

关键词: 草图检索, 三维模型, Leap Motion, 流形排序, 线画图

Abstract: The demand of 3D model retrieval is increasing, and the sketch-based method has been
proved to be the most effective and efficient approach to retrieve 3D models. In order to get better
experience on sketch retrieval, it’s necessary to focus on the way of human-computer interaction as
well as improve it. The Leap Motion sensor can detect the position information of fingers and
gestures with high precision in real-time, which makes volume interaction with large screen at
long-distance more effective. In this paper, an extended manifold ranking method based on Leap
Motion is presented as a new retrieval framework. The sketch drawing and model retrieval processes
are realized by obtaining data of hands from Leap Motion to the browser. In the process of sketch
retrieval, manifold ranking is proposed to rank on similarities between models combining with
semantic classification as a constraint, thus improving the ranking score of models belong to the same
classification. Experiments have demonstrated that the proposed method makes the sketch retrieval
more closable and convenient to the user as well as improves the accuracy of 3D model retrieval.