欢迎访问《图学学报》 分享到:

图学学报

• 图像处理与计算机视觉 • 上一篇    下一篇

基于模板替换的室内场景建模方法研究

  

  1. (1. 大连理工大学计算机科学与技术学院,辽宁 大连 116024; 
    2. 鹏城实验室,广东 深圳 518055; 
    3. 大连民族大学计算机科学与工程学院,辽宁 大连 116600)
  • 出版日期:2020-04-30 发布日期:2020-05-15
  • 基金资助:
    国家自然科学基金项目(91748104,61972067,61632006,U1811463,U1908214,61751203);国家重点研发计划项目(2018AAA0102003)

Indoor scene modeling method based on template replacement

  1. (1. School of Computer Science and Technology, Dalian University of Technology, Dalian Liaoning 116024, China; 
    2. Peng Cheng Laboratory, Shenzhen Guangdong 518055, China; 
    3. School of Computer Science and Engineering, Dalian Nationalities University, Dalian Liaoning 116600, China)
  • Online:2020-04-30 Published:2020-05-15

摘要: 当前,室内场景建模相关研究已经取得很多进展,特别是基于多视角融合的建模 框架与基于单视角的建模框架的提出,增强了机器人的环境感知能力。但仍然存在以下不足: ①基于多视角融合的建模方式预处理时间长,建模完成后需线下优化过程,不能满足特定条件 下的建模需求;②基于单视角的建模算法输出一般为体素,建模质量较低,信息缺失严重,对 于场景细节无法精确刻画,难以满足机器人交互的要求。特提出一种基于模板替换的室内场景 建模方法研究。首先,预处理由设备采集到的三维点云场景,分割出存在点云缺失的单个对象, 并利用虚拟扫描技术采样对象表面点并计算法向量与曲率。采用八叉树网格结构,将点云的法 向量与曲率信息分别存入网格中,再利用卷积神经网络(CNN)提取高维特征向量,将其与数据 库中三维对象特征进行欧氏距离比较,得到检索序列。从序列中挑选出最相似的对象,利用迭 代就近点(ICP)配准方法,与扫描场景进行配准,完成场景优化。对提出的网络模型在 2 个基准 数据集上进行测试并表现出良好的性能。

关键词: 机器人, 室内场景建模, 卷积神经网络, 迭代就近点配准, 点云

Abstract:

Nowadays, much progress has been made in the research of indoor scene modeling, especially the modeling frameworks based on multiple perspectives and single perspective, which has enhanced the robot’s environment perception. However, the following shortcomings still exist: The modeling method based on multiple perspectives requires a long pre-processing time, and the offline optimization process is required after the modeling is completed, which cannot meet the modeling requirements under specific conditions. The modeling algorithm based on single perspective is mainly output with voxels, so the modeling quality is low, and the information is missing seriously. The details of the scene cannot be accurately characterised, and it is difficult to meet the requirements of robot interaction. In view of the above deficiencies, this paper puts forward a method of indoor scene modeling based on template replacement. First, the three-dimensional point cloud scene is preprocessed to segment a single object with missing point cloud, and then the virtual scanning technology is used to sample the surface points of the object and calculate the corresponding normal vector and curvature. Next, the octree mesh is used to store the normal vector and the curvature information respectively. Furthermore, the high-dimensional feature vectors are extracted by the convolutional neural network (CNN), and the Euclidean distance is compared with the features of three-dimensional object in the database, so as to obtain the retrieval sequence. Finally, the most similar objects are selected from the sequence, and the iterative closest point (ICP) registration method is used to register with the scanning scene to complete the scene optimization. In this paper, the proposed network model is tested on two benchmark data sets and shows good performance.

Key words: font-family: "Times New Roman",serif, letter-spacing: 0.1pt, line-height: 107%, mso-fareast-font-family: 宋体, mso-font-kerning: 1.0pt, mso-ansi-language: EN-US, mso-fareast-language: ZH-CN, mso-bidi-language: AR-SA">robot, indoor scene modeling, convolutional neural network, iterative closest point registration, point cloud