欢迎访问《图学学报》 分享到：
图学学报

图学学报

• 计算机图形学与虚拟现实 • 上一篇    下一篇

基于 BCI 的虚拟现实模拟驾驶教学系统设计

  

  1. (岭南师范学院机电工程学院，广东 湛江 524048)
  • 出版日期:2020-04-30 发布日期:2020-05-15
  • 基金资助:
    广东省普通高校青年创新人才类项目(2017WQNCX097)；岭南师范学院校级项目(L1821)

Design of virtual reality simulated driving teaching system based on BCI

  1. (College of Mechanical and Electrical Engineering, Lingnan Normal University, Zhanjing Guangdong 524048, China)
  • Online:2020-04-30 Published:2020-05-15

PDF (PC)

104

摘要： 为解决传统模拟驾驶过于强调正常场景的训练，缺少对意外场景下学员心理状态 的监测与协助，且无法反馈和评价驾驶心理状态等问题。以脑机交互(BCI)技术与虚拟现实(VR) 为基础开发 VR 模拟驾驶教学演示系统，利用三维动力学引擎开发了驾驶模拟操作系统，在硬 件上设计可穿戴式脑电波信号检测头盔，基于 BCI 技术实现对学员模拟驾驶大脑状态的监控与 数据评估；有突发模拟事件发生时，系统通过脑机接口技术自动制动或辅助驾驶。在完成模拟 驾驶训练的同时可以根据脑波(EEG)反馈在意外事件中给出紧急解救措施，根据 EEG 情况评估 学员的发挥以及心理素质，为虚拟驾驶等认知负荷较高的教学训练提供了更为丰富与直观沉浸 式交互操作方式，提高了该领域教学训练系统的实用性与可用性。

关键词: 脑机交互, 虚拟现实, 模拟驾驶, 教学演示

Abstract: In the traditional simulated driving, the training of normal scenes has received too much attention, the monitoring and assistance of the trainees’ psychological state in the accident scenes has been overlooked, and the driving psychological state has obtained no feedback and evaluation. In order to solve these problems, based on brain-computer interaction (BCI) and virtual reality (VR), a virtual reality simulated driving teaching demonstration system was developed. The simulated driving operating system was developed by using three-dimensional dynamics engine. And the wearable electroencephalogram (EEG) signal detection helmet was designed on hardware. The monitoring and data evaluation of the trainees’ brain state during simulated driving was realized based on BCI technology. When a sudden simulated event occurs, the system will automatically brake or assist driving through brain-computer interface technology. After completing the simulated driving training, emergency rescue measures can be given according to EEG feedback in the accident. In addition the students’ performance and psychological quality can be assessed based on EEG. The method proposed in this article provides a richer and more immersive interactive operation mode for the teaching and training with higher cognitive load, such as virtual driving, and improves the practicality and usability of the teaching and training system in this field.

Key words: brain-computer interaction, virtual reality, teaching demonstration, driving simulation