The regularity of cognitive response to image perception based on EEG information and its quantitative analysis method

doi:10.11996/JG.j.2095-302X.2024030624

Abstract

Abstract:

“Images” serve as an important medium for human perception of the world, and image perception is a key channel for the effective conversion between planar elements and three-dimensional forms in cognitive thinking. However, the process of human brain accepting image input, completing cognitive processing, and realizing knowledge output is an interdisciplinary discipline between cognitive psychology and brain science, which lacks sufficient research methods and theoretical basis at present. Therefore, in view of the unclear cognitive process of image perception and the lack of cognitive analysis methods, the EEG cognitive test experiment were designed. These experiments analyzed the changes in P300 potential based on the theory of brain potential correlation of cognitive events, and two-dimensional projection map and three-dimensional model as the cognitive objects of image perception. The results demonstrated that the relevant parts of image perception were mainly in the left frontal lobe of the brain. The P300 potential value could be employed to reflect the cognitive degree of the brain’s image perception. The stronger the brain’s ability to accept the image content, the lower the P300 potential peak value. By comparing the P300 potential changes of different samples, the cognitive process of image perception could be analyzed to form a quantitative analysis method for the cognitive ability of image perception, improve the input efficiency of the cognitive content of image perception to the brain, and shed light on the input and cognitive mechanism of image perception, providing an effective basis for the application of feedback optimization in the depth of image interaction.

Key words: image perception, brain waves, P300 potential, brain electrical activity mapping, EEG experiment

CLC Number:

TN98

YI Peng, TIAN Xinghui, LIU Guangdou, WEI Qingbing, WANG Shuai, LIU Yancong. The regularity of cognitive response to image perception based on EEG information and its quantitative analysis method[J]. Journal of Graphics, 2024, 45(3): 624-630.

Figures/Tables 13

Fig. 1 The framework for experimental analysis of EEG interaction

Fig. 2 Experiment process of image perception cognitive

Fig. 3 Wireless EEG cap wearing ((a) EEG cap equipment; (b) Experimental wearing)

Fig. 4 10-20 International standard lead system

Fig. 5 Raw EEG data

Fig. 6 Brain topographic maps ((a) 250 ms; (b) 300 ms; (c) 350 ms)

Fig. 7 Single EEG

Fig. 8 Average EEG

Fig. 9 EEG of group A and B

Table 1 A and B group of subjects reflect the situation (correct rate/%) comparison statistics

任务状态	A组	B组	P值
简单任务	96±3	95±3	P=0.24>0.05
一般任务	91±2	78±1	P=0.0059<0.05
困难任务	66±3	34±1	P=0.0001<0.05
P值	P=0.0034<0.05	P=0.00026<0.05

Table 2 A and B group of subjects reflect the situation (reaction time/s) comparison statistics

任务状态	A组	B组	P值
简单任务	2.227±1.064	2.296±1.578	P=0.37>0.05
一般任务	3.0006±2.34	2.553±2.372	P=0.0034<0.05
困难任务	3.2056±0.945	3.9971±1.25	P=0.00046<0.05
P值	P=0.0002<0.05	P=0.0057<0.05

Fig. 10 P300 potential comparison between subjects A and B during the difficult group graph perception cognitive experiment

Fig. 11 The peak value of P300 potential in group B after receiving the pattern perception cognitive teaching mode

References 19

[1]	张海生. “新工科”建设的背景、价值向度与预期效果[J]. 湖北社会科学, 2017, (9): 167-173.
	ZHANG H S. The background, value orientation and expected effect of the construction of “new engineering”[J]. Hubei Social Sciences, 2017(9): 167-173 (in Chinese).
[2]	韩明秀, 王盛, 王煜文, 等. 基于EEG的飞行员脑力疲劳评估研究进展[J]. 载人航天, 2021, 27(5): 639-645.
	HAN M X, WANG S, WANG Y W, et al. Research progress of pilots’ mental fatigue evaluation based on EEG[J]. Manned Spaceflight, 2021, 27(5): 639-645 (in Chinese).
[3]	于海燕, 刘衍聪, 何援军. 计算时代工程图学之定位与建设思考[J]. 图学学报, 2023, 44(1): 194-198. DOI
	YU H Y, LIU Y C, HE Y J. Reflections on the orientation and development of engineering graphics in the era of computing[J]. Journal of Graphics, 2023, 44(1): 194-198 (in Chinese).
[4]	刘衍聪, 马晓丽, 伊鹏. 现代图学教学中的图感因素探析[J]. 图学学报, 2013, 34(6): 110-113.
	LIU Y C, MA X L, YI P. Analysis of sense of drawing factors in modern graphics teaching[J]. Journal of Graphics, 2013, 34(6): 110-113 (in Chinese).
[5]	伊鹏, 刘衍聪, 石永军, 等. 基于增强现实技术的工程图学移动端教学系统设计与开发[J]. 图学学报, 2018, 39(6): 1207-1213. DOI
	YI P, LIU Y C, SHI Y J, et al. Design and development of engineering graphics teaching system on mobile devices based on the augmented reality technology[J]. Journal of Graphics, 2018, 39(6): 1207-1213 (in Chinese). DOI
[6]	BACEVICIUTE S, TERKILDSEN T, MAKRANSKY G. Remediating learning from non-immersive to immersive media: using EEG to investigate the effects of environmental embeddedness on reading in virtual reality[J]. Computers & Education, 2021, 164: 104122.
[7]	赵静, 刘小菠, 李涓, 等. 事件相关电位应用于认知功能研究的可视化分析[J]. 中国康复理论与实践, 2022, 28(1): 69-78. DOI
	ZHAO J, LIU X B, LI J, et al. Event-related potential for cognitive function research: a visual analysis[J]. Chinese Journal of Rehabilitation Theory and Practice, 2022, 28(1): 69-78 (in Chinese). DOI
[8]	COHEN M X. Where does EEG come from and what does it mean?[J]. Trends in Neurosciences, 2017, 40(4): 208-218. DOI PMID
[9]	疏德明. 事件相关电位技术实验操作及注意事项[J]. 实验技术与管理, 2017, 34(1): 198-202, 224.
	SHU D M. Experimental operations and notes of event-related potentials technology[J]. Experimental Technology and Management, 2017, 34(1): 198-202, 224 (in Chinese).
[10]	王国华, 聂胜欣, 薛瑞鑫. 多媒体学习中的认知负荷:测量方法与技术纵览[J]. 电化教育研究, 2022, 43(4): 19-25, 54.
	WANG G H, NIE S X, XUE R X. Cognitive load in multimedia learning: an overview of measurement methods and technologies[J]. e-Education Research, 2022, 43(4): 19-25, 54 (in Chinese).
[11]	皮忠玲, 章仪, 杨九民. 教师手势对视频学习的影响及其认知神经机制[J]. 中国电化教育, 2019(4): 103-110, 129.
	PI Z L, ZHANG Y, YANG J M. The influence of instructor’s gestures on video learning and its cognitive neural mechanism[J]. China Educational Technology, 2019(4): 103-110, 129 (in Chinese).
[12]	邓勇, 唐祯, 周炫余, 等. 教育神经科学视域下数学学习困难儿童早期干预虚拟仿真实验设计[J]. 实验技术与管理, 2020, 37(6): 146-150, 156.
	DENG Y, TANG Z, ZHOU X Y, et al. Design on virtual simulation experiment of early intervention for children with mathematics learning disability from educational neuroscience perspective[J]. Experimental Technology and Management, 2020, 37(6): 146-150, 156 (in Chinese).
[13]	NEGI S, MITRA R. Native language subtitling of educational videos: a multimodal analysis with eye tracking, EEG and self-reports[J]. British Journal of Educational Technology, 2022, 53(6): 1793-1816.
[14]	韩文民, 葛倩, 高龙龙. 基于脑电的轻装作业操作者脑力负荷与绩效的分析[J]. 科学技术与工程, 2019, 19(14): 110-117.
	HAN W M, GE Q, GAO L L. Analysis of the relationship between mental workload and performance of light-loading operators based on electro-encephalo-graphy[J]. Science Technology and Engineering, 2019, 19(14): 110-117 (in Chinese).
[15]	许子明, 牛一帆, 温旭云, 等. 基于脑电信号的认知负荷评估综述[J]. 航天医学与医学工程, 2021, 34(4): 339-348.
	XU Z M, NIU Y F, WEN X Y, et al. A review of cognitive workload assessment based on EEG[J]. Space Medicine & Medical Engineering, 2021, 34(4): 339-348 (in Chinese).
[16]	陈旭东, 钟恒, 皇甫洁, 等. 脑电信号情绪识别综述[J]. 计算机应用, 2023, 43(S1): 323-332.
	CHEN X D, ZHONG H, HUANGFU J, et al. A summary of emotional recognition of EEG signals[J]. Journal of Computer Applications, 2023, 43(S1): 323-332 (in Chinese).
[17]	陈万, 蔡艳平, 李爱华, 等. 多通道脑电信号眼电伪迹自适应去除方法[J]. 科学技术与工程, 2023, 23(18): 7694-7700.
	CHEN W, CAI Y P, LI A H, et al. Automatic removal method of electrooculogram artifacts for multi-channel EEG[J]. Science Technology and Engineering, 2023, 23(18): 7694-7700 (in Chinese).
[18]	BADRE D, NEE D E. Frontal cortex and the hierarchical control of behavior[J]. Trends in Cognitive Sciences, 2018, 22(2): 170-188. DOI PMID
[19]	LIN F R, KAO C M. Mental effort detection using EEG data in E-learning contexts[J]. Computers & Education, 2018, 122: 63-79.