Effects of map symbols and emotional valence on AR map users′ spatial memory

doi:10.11996/JG.j.2095-302X.2023020399

Abstract

Abstract:

This paper delved into the effects of map symbols′ abstraction level and emotional valence on the spatial memory of mobile augmented reality (AR) map users, and offered suggestions for design optimization. A total of 35 subjects were assessed by the Mental Cutting Test, and then the emotions were induced by the combination of Chinese Affective Picture System and Chinese Affective Music System. The data of 30 subjects′ Profile of Mood States (POMS), Brief Mood Introspection Scale (BMIS), and Egocentric Pointing Judgments were collected and analyzed according to the scale scores and experimental results. The results indicated that the abstraction level of map symbols had a significant impact on spatial memory, with icons having the shortest learning times. However, emotional valence had no significant impact on spatial memory. Furthermore, the abstraction level of map symbols and emotional valence were found to have interactive effects on the learning time and task error rate of spatial memory. The research findings will aid in the design and assessment of comparable systems.

Key words: map symbol, emotional valence, augmented reality, spatial memory, emotional induction

CLC Number:

P289

CHEN Yan, ZHANG Qiong-wen, WANG Jia-qi, SHUAI Mei-qiong, HU Jun. Effects of map symbols and emotional valence on AR map users′ spatial memory[J]. Journal of Graphics, 2023, 44(2): 399-407.

Figures/Tables 12

References 48

[1]	陶岚, 何华贵. 基于AR互动等新技术的《广州城市地图集》设计特点[J]. 测绘地理信息, 2021, 46(1): 118-122.
	TAO L, HE H G. The design characteristics of Guangzhou city atlas based on AR interaction and other new technologies[J]. Journal of Geomatics, 2021, 46(1): 118-122. (in Chinese)
[2]	AMINOFF M J, DAROFF R B. Encyclopedia of the neurological sciences[M]. 2nd ed. Waltham: Academic Press, 2014: 86-90.
[3]	DONG W H, WU Y L, QIN T, et al. What is the difference between augmented reality and 2D navigation electronic maps in pedestrian wayfinding?[J]. Cartography and Geographic Information Science, 2021, 48(3): 225-240. DOI URL
[4]	邵将, 颜克彤, 姚君, 等. 头戴式AR界面目标符号的视觉搜索实验研究[J]. 东南大学学报: 自然科学版, 2020, 50(1): 20-25.
	SHAO J, YAN K T, YAO J, et al. Experimental study on visual search for aiming symbols in head-mounted AR system interface[J]. Journal of Southeast University: Natural Science Edition, 2020, 50(1): 20-25. (in Chinese)
[5]	HALIK Ł, MEDYŃSKA-GULIJ B. The differentiation of point symbols using selected visual variables in the mobile augmented reality system[J]. The Cartographic Journal, 2017, 54(2): 147-156. DOI URL
[6]	郭健, 陈辉, 徐旺, 等. 应用模式的增强现实地图内容表达研究[J]. 测绘科学技术学报, 2020, 37(5): 516-524, 530.
	GUO J, CHEN H, XU W, et al. Research on content expression of augmented reality maps application model[J]. Journal of Geomatics Science and Technology, 2020, 37(5): 516-524, 530. (in Chinese)
[7]	KEIL J, KORTE A, RATMER A, et al. Augmented reality (AR) and spatial cognition: effects of holographic grids on distance estimation and location memory in a 3D indoor scenario[J]. Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 2020, 88(2): 165-172.
[8]	RUOTOLO F, CLAESSEN M H G, VAN DER HAM I J M. Putting emotions in routes: the influence of emotionally laden landmarks on spatial memory[J]. Psychological Research, 2019, 83(5): 1083-1095. DOI PMID
[9]	欧阳峥峥, 孙世月, 李雪冰, 等. 音乐诱发负性情绪对语音工作记忆和空间工作记忆不同影响的事件相关电位研究[J]. 中华行为医学与脑科学杂志, 2010, 19(9): 813-816.
	OUYANG Z Z, SUN S Y, LI X B, et al. The different effect of negative emotion induced by background music on verbal and spatial working memory: evidence from ERP study[J]. Chinese Journal of Behavioral Medicine and Brain Science, 2010, 19(9): 813-816. (in Chinese)
[10]	BEDNARCZUK N F, BRADSHAW J M, MIAN S Y, et al. Pathophysiological dissociation of the interaction between time pressure and trait anxiety during spatial orientation judgments[J]. The European Journal of Neuroscience, 2020, 52(4): 3215-3222. DOI URL
[11]	王君怡, 林岚, 高华, 等. 大学生旅游地图空间符号认知的群体差异研究: 基于眼动实验数据分析[J]. 旅游学刊, 2016, 31(3): 97-105.
	WANG J Y, LIN L, GAO H, et al. Differences in college students' spatial symbol cognition of tourism map: based on experimental data from an eye-movement tracking system[J]. Tourism Tribune, 2016, 31(3): 97-105. (in Chinese)
[12]	MAIDENBAUM S, PATEL A, GARLIN I C, et al. Studying spatial memory in augmented and virtual reality[EB/OL]. (2019-09-23) [2022-04-24]. https://www.biorxiv.org/content/10.1101/777946v1.full.
[13]	ELIAS B, PAELKE V. User-centered design of landmark visualizations[M]// Lecture Notes in Geoinformation and Cartography. Heidelberg: Springer, 2008: 33-56.
[14]	YOVCHEVA Z, BUHALIS D, GATZIDIS C, et al. Empirical evaluation of smartphone augmented reality browsers in an urban tourism destination context[J]. International Journal of Mobile Human Computer Interaction, 2014, 6(2): 10-31. DOI URL
[15]	LOKKA I E, ÇÖLTEKIN A. Toward optimizing the design of virtual environments for route learning: empirically assessing the effects of changing levels of realism on memory[J]. International Journal of Digital Earth, 2019, 12(2): 137-155. DOI URL
[16]	STEVENS J, ROBINSON A, MACEACHREN A. Designing map symbols for mobile devices: challenges, best practices, and the utilization of skeuomorphism[J]. International Cartograhic Conference, ICC 2013, 2013: 1-9.
[17]	FRANKE C, SCHWEIKART J. Mental representation of landmarks on maps: investigating cartographic visualization methods with eye tracking technology[J]. Spatial Cognition & Computation, 2017, 17(1-2): 20-38.
[18]	KEIL J. The salience of landmark representations in maps and its effects on spatial memory[D]. Bochum: Ruhr University Bochum, 2021.
[19]	TYNG C M, AMIN H U, SAAD M N M, et al. The influences of emotion on learning and memory[J]. Frontiers in Psychology, 2017, 8: 1454. DOI PMID
[20]	PANKSEPP J. Affective neuroscience: the foundations of human and animal emotions[M]. Oxford: Oxford University Press, 2004.
[21]	RIENER C R, STEFANUCCI J K, PROFFITT D R, et al. An effect of mood on the perception of geographical slant[J]. Cognition & Emotion, 2011, 25(1): 174-182.
[22]	傅小兰. 情绪心理学[M]. 上海: 华东师范大学出版社, 2016: 2-6.
	FU X L. Psychology of emotion[M]. Shanghai: East China Normal University Press, 2016: 2-6. (in Chinese)
[23]	RUSSELL J A. A circumplex model of affect[J]. Journal of personality and social psychology, 1980, 39(6): 1161-1178. DOI URL
[24]	SCHMIDT K, PATNAIK P, KENSINGER E A. Emotion's influence on memory for spatial and temporal context[J]. Cognition & Emotion, 2011, 25(2): 229-243.
[25]	PALMIERO M, NORI R, ROGOLINO C, et al. Situated navigational working memory: the role of positive mood[J]. Cognitive Processing, 2015, 16(1): 327-330. DOI URL
[26]	BALABAN C Z, KARIMPUR H, RÖSER F, et al. Turn left where you felt unhappy: how affect influences landmark-based wayfinding[J]. Cognitive Processing, 2017, 18(2): 135-144. DOI PMID
[27]	SCHWARZ N. Feelings-as-information theory[M]// Handbook of Theories of Social Psychology: Volume 1.1. London: SAGE Publications Ltd, 2012: 289-308.
[28]	MUNOZ-MONTOYA F, FIDALGO C, JUAN M C, et al. Memory for object location in augmented reality: the role of gender and the relationship among spatial and anxiety outcomes[J]. Frontiers in Human Neuroscience, 2019, 13: 113. DOI URL
[29]	SCHULTHEIS H. Spatial memory of immediate environments[C]// The 41st Annual Conference of the Cognitive Science Society. Montreal: Cognitive Science Society Press, 2019: 1022-1028.
[30]	MOU W M, BIOCCA F, OWEN C B, et al. Frames of reference in mobile augmented reality displays[J]. Journal of Experimental Psychology Applied, 2004, 10(4): 238-244. DOI URL
[31]	AVRAAM S, HATZIPANAYIOTI A, AVRAAMIDES M N. Orientation-dependent spatial memories for scenes viewed on mobile devices[J]. Psychological Research, 2020, 84(3): 643-649. DOI PMID
[32]	LEÓN I, TASCÓN L, CIMADEVILLA J M. Age and gender-related differences in a spatial memory task in humans[J]. Behavioural Brain Research, 2016, 306: 8-12. DOI PMID
[33]	袁加锦, 汪宇, 鞠恩霞, 等. 情绪加工的性别差异及神经机制[J]. 心理科学进展, 2010, 18(12): 1899-1908.
	YUAN J J, WANG Y, JU E X, et al. Gender differences in emotional processing and its neural mechanisms[J]. Advances in Psychological Science, 2010, 18(12): 1899-1908. (in Chinese)
[34]	LAURA T, IRENE L, RUBÉN F, et al. Reversal training discloses gender differences in a spatial memory task in humans[J]. International Journal of Cognition and Behaviour, 2021, 4(1): 11.
[35]	JONES C M, HEALY S D. Differences in cue use and spatial memory in men and women[J]. Proceedings Biological Sciences, 2006, 273(1598): 2241-2247.
[36]	TSUTSUMI E. Evaluation of students' spatial abilities using mental cutting test[J]. International Journal of Technology and Engineering Education, 2005, 2(2): 77-82.
[37]	方浩, 宋章通, 杨流, 等. VR移动城市导航地图设计中的空间认知要素[J]. 武汉大学学报·信息科学版, 2019, 44(8): 1124-1130.
	FANG H, SONG Z T, YANG L, et al. Spatial cognitive elements of VR mobile city navigation map[J]. Geomatics and Information Science of Wuhan University, 2019, 44(8): 1124-1130. (in Chinese)
[38]	GARDONY A, TAYLOR H A. Affective states influence spatial cue utilization during navigation[J]. Presence, 2011, 20(3): 223-240. DOI URL
[39]	白露, 马慧, 黄宇霞, 等. 中国情绪图片系统的编制: 在46名中国大学生中的试用[J]. 中国心理卫生杂志, 2005, 19(11): 719-722.
	BAI L, MA H, HUANG Y X, et al. The development of native Chinese affective picture system-a pretest in 46 college students[J]. Chinese Mental Health Journal, 2005, 19(11): 719-722. (in Chinese)
[40]	GROVE R, PRAPAVESSIS H. Preliminary evidence for the reliability and validity of an abbreviated Profile of Mood States[J]. International Journal of Sport Psychology, 1992, 23(2): 93-109.
[41]	祝蓓里. POMS量表及简式中国常模简介[J]. 天津体育学院学报, 1995, 10(1): 35-37.
	ZHU B L. Brief introduction of poms scale and its model for China[J]. Journal of Tianjin Institute of Physical Education, 1995, 10(1): 35-37. (in Chinese)
[42]	MAYER J D, GASCHKE Y N. The experience and meta-experience of mood[J]. Journal of Personality and Social Psychology, 1988, 55(1): 102-111. PMID
[43]	HUFFMAN D J, EKSTROM A D. Which way is the bookstore? A closer look at the judgments of relative directions task[J]. Spatial Cognition and Computation, 2019, 19(2): 93-129. DOI PMID
[44]	SCHNEIDER L F, TAYLOR H A. How do you get there from here? Mental representations of route descriptions[J]. Applied Cognitive Psychology, 1999, 13(5): 415-441. DOI URL
[45]	RYAN T A, SCHWARTZ C B. Speed of perception as a function of 3mode of representation[J]. The American Journal of Psychology, 1956, 69(1): 60. DOI URL
[46]	LOOMIS J M, LIPPA Y, GOLLEDGE R G, et al. Spatial updating of locations specified by 3-d sound and spatial language[J]. Journal of Experimental Psychology Learning, Memory, and Cognition, 2002, 28(2): 335-345. DOI URL
[47]	REPPA I, MCDOUGALL S, SONDEREGGER A, et al. Mood moderates the effect of aesthetic appeal on performance[J]. Cognition and Emotion, 2021, 35(1): 15-29. DOI URL
[48]	MCDOUGALL S J P, REPPA I. Why do I like It? The relationships between icon characteristics, user performance and aesthetic appeal[J]. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2008, 52(18): 1257-1261. DOI URL

任务	指标	具体解释
自我为中心的方位判断任务	学习时间	从记忆指令结束到被试报告完成记忆所用时长
	方位判断任务反应时	从方位判断指令结束到被试按下按钮所用时长
	方位判断任务错误率	出错次数与任务总数之比，被试所指方向偏离正确方向超过22.5°被视为错误

任务	指标	具体解释
自我为中心的方位判断任务	学习时间	从记忆指令结束到被试报告完成记忆所用时长
	方位判断任务反应时	从方位判断指令结束到被试按下按钮所用时长
	方位判断任务错误率	出错次数与任务总数之比，被试所指方向偏离正确方向超过22.5°被视为错误

类型	符号名称(正确认识率 %)
图像
	冷饮店 (94)	动物园 (90)	游乐场 (94)	教堂 (92)

	碑林 (53)	湿地景区 (71)	树屋 (67)	纪念品店 (94)
草图
	园林 (63)	帆船基地 (71)	观鸟平台 (67)	商贸中心 (90)

	咖啡厅 (86)	山峰 (92)	海洋馆 (78)	遗址 (67)
图标
	公园 (59)	酒吧 (84)	唱吧 (84)	桥 (90)

	寺庙 (63)	码头 (75)	餐厅 (94)	超市 (71)

类型	符号名称(正确认识率 %)
图像
	冷饮店 (94)	动物园 (90)	游乐场 (94)	教堂 (92)

	碑林 (53)	湿地景区 (71)	树屋 (67)	纪念品店 (94)
草图
	园林 (63)	帆船基地 (71)	观鸟平台 (67)	商贸中心 (90)

	咖啡厅 (86)	山峰 (92)	海洋馆 (78)	遗址 (67)
图标
	公园 (59)	酒吧 (84)	唱吧 (84)	桥 (90)

	寺庙 (63)	码头 (75)	餐厅 (94)	超市 (71)

POMS量表	情绪组	前测值		后测值		差值		BMIS量表	情绪组	所有时间点的平均值
POMS量表	情绪组	均值	标准差	均值	标准差	均值	标准差	BMIS量表	情绪组	均值	标准差
抑郁	正性	1.400	2.823	1.733	2.658	0.333	1.799	效价	正性	56.550	11.257
抑郁	负性	0.733	1.033	4.067	3.693	3.333	3.498	效价	负性	42.800	7.404
精力	正性	9.933	3.918	10.000	6.268	0.067	6.318	唤醒	正性	32.200	3.298
精力	负性	9.400	5.193	5.193	5.467	-3.933	-3.933	唤醒	负性	29.583	3.041