Welcome to Journal of Graphics share: 

Journal of Graphics ›› 2021, Vol. 42 ›› Issue (4): 525-534.DOI: 10.11996/JG.j.2095-302X.2021040525

• Review • Previous Articles     Next Articles

Review of real-time deep learning-based object detection for mobile augmented reality

  

  1. 1. School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China;
    2. Advanced Innovation Center for Future Visual Entertainment, Beijing Film Academy, Beijing 100088, China
  • Online:2021-08-31 Published:2021-08-05
  • Supported by:
    National Natural Science Foundation of China (61960206007); R & D Projects in Key Areas of Guangdong (2019B010149001);
    Programme of Introducing Talents of Discipline to Universities (B18005)

Abstract: Mobile augmented reality (AR) is a technology that integrates virtual information with the real world on the
mobile intelligent terminal, therefore the ability to accurately detect the to-be-enhanced objects in the environment
directly determines the performance of mobile AR systems. With the rapid advancement of deep learning, a large
number of deep learning-based methods have been proposed for better detection. However, such problems as limited
computing power, high energy consumption, large model size, and offloading latency make it difficult to combine
deep learning-based object detection with mobile AR. This paper first summarized previous studies on deep
learning-based object detection from both aspects of two stages and one stage, then categorized the object detection
systems for mobile AR, and analyzed the approaches based on local, cloud, or edge ends, as well as collaboration.
Finally, both the advantages and limitations of these methods were summarized, and predictions were made on the problems to be solved and the future development of object detection in mobile AR.

Key words: object detection, mobile augmented reality, deep learning, computer vision, mobile edge computing

CLC Number: