Journal of Graphics ›› 2025, Vol. 46 ›› Issue (4): 775-782.DOI: 10.11996/JG.j.2095-302X.2025040775
• Computer Graphics and Virtual Reality • Previous Articles Next Articles
ZHANG Yufei(), DING Ding, LI Zhuying
Received:
2024-10-05
Revised:
2025-01-16
Online:
2025-08-30
Published:
2025-08-11
Contact:
DING Ding
About author:
First author contact:ZHANG Yufei (2002-), master student. Her main research interests cover virtual reality and human-computer interaction. E-mail:220242397@seu.edu.cn
Supported by:
CLC Number:
ZHANG Yufei, DING Ding, LI Zhuying. A virtual reality experience for artistic re-creation based on emotion capture[J]. Journal of Graphics, 2025, 46(4): 775-782.
Add to citation manager EndNote|Ris|BibTeX
URL: http://www.txxb.com.cn/EN/10.11996/JG.j.2095-302X.2025040775
Fig. 2 Re-creation of the Mona Lisa painting ((a) Mona Lisa’s initial state; (b) Mona Lisa’s feedback states to different emotions: from left to right, top to bottom are happy, surprised, sad and angry)
Fig. 4 Sculpture re-creation ((a) Initial state; (b) Painted state with different moods: from left to right, top to bottom are happy, surprised, sad and angry)
情绪 | 体验前 | 体验后 | t | df | Sig (2-tailed) |
---|---|---|---|---|---|
Joy | 60.2±14.18 | 76.8±9.95 | -7.105 | 21 | 0.000** |
Happy | 54.5±17.11 | 70.5±17.92 | -5.636 | 21 | 0.000** |
Calm | 48.9±20.06 | 62.3±19.92 | -2.512 | 21 | 0.020* |
Relax | 50.7±18.98 | 68.4±18.99 | -5.098 | 21 | 0.000** |
Disgust | 18.6±16.20 | 7.3±12.03 | 5.743 | 21 | 0.000** |
Sad | 27.5±16.39 | 9.8±10.41 | 5.266 | 21 | 0.000** |
Angry | 14.8±12.95 | 7.7±10.43 | 4.830 | 21 | 0.000** |
Fear | 14.1±12.50 | 9.1±15.17 | 1.229 | 21 | 0.233 |
Dizzy | 5.6±7.91 | 21.6±19.42 | -4.021 | 21 | 0.001** |
Table 1 Paired t-test for mood before and after VR experience (M±SD)
情绪 | 体验前 | 体验后 | t | df | Sig (2-tailed) |
---|---|---|---|---|---|
Joy | 60.2±14.18 | 76.8±9.95 | -7.105 | 21 | 0.000** |
Happy | 54.5±17.11 | 70.5±17.92 | -5.636 | 21 | 0.000** |
Calm | 48.9±20.06 | 62.3±19.92 | -2.512 | 21 | 0.020* |
Relax | 50.7±18.98 | 68.4±18.99 | -5.098 | 21 | 0.000** |
Disgust | 18.6±16.20 | 7.3±12.03 | 5.743 | 21 | 0.000** |
Sad | 27.5±16.39 | 9.8±10.41 | 5.266 | 21 | 0.000** |
Angry | 14.8±12.95 | 7.7±10.43 | 4.830 | 21 | 0.000** |
Fear | 14.1±12.50 | 9.1±15.17 | 1.229 | 21 | 0.233 |
Dizzy | 5.6±7.91 | 21.6±19.42 | -4.021 | 21 | 0.001** |
子量表 | M | SD | t | df | Sig(2-tailed) |
---|---|---|---|---|---|
SP | 5.60 | 0.714 | 10.504 | 21 | 0.000** |
INV | 4.44 | 1.104 | 1.882 | 21 | 0.074 |
REAL | 4.52 | 1.343 | 1.826 | 21 | 0.082 |
GP | 5.78 | 1.152 | 7.218 | 21 | 0.000** |
Table 2 Sample t-test results for the IPQ subscale form (test value=4)
子量表 | M | SD | t | df | Sig(2-tailed) |
---|---|---|---|---|---|
SP | 5.60 | 0.714 | 10.504 | 21 | 0.000** |
INV | 4.44 | 1.104 | 1.882 | 21 | 0.074 |
REAL | 4.52 | 1.343 | 1.826 | 21 | 0.082 |
GP | 5.78 | 1.152 | 7.218 | 21 | 0.000** |
情绪识别 | M | SD | t | df | Sig(2-tailed) |
---|---|---|---|---|---|
准确性 | 4.43 | 1.434 | 1.369 | 21 | 0.186 |
合理性 | 5.71 | 1.102 | 7.129 | 21 | 0.000** |
Table 3 Sample t-test results for the Emotion Recognition scale form (test value=4)
情绪识别 | M | SD | t | df | Sig(2-tailed) |
---|---|---|---|---|---|
准确性 | 4.43 | 1.434 | 1.369 | 21 | 0.186 |
合理性 | 5.71 | 1.102 | 7.129 | 21 | 0.000** |
得分 | M | SD | t | df | Sig(2-tailed) |
---|---|---|---|---|---|
总分 | 117.14 | 9.342 | 8.604 | 21 | 0.000** |
Table 4 Sample t-test results for VRNQ total score (test value=100)
得分 | M | SD | t | df | Sig(2-tailed) |
---|---|---|---|---|---|
总分 | 117.14 | 9.342 | 8.604 | 21 | 0.000** |
子量表 | M | SD | t | df | Sig(2-tailed) |
---|---|---|---|---|---|
用户体验 | 28.41 | 3.418 | 4.678 | 21 | 0.000** |
系统机制 | 30.36 | 3.048 | 8.254 | 21 | 0.000** |
辅助机制 | 29.55 | 2.132 | 10.000 | 21 | 0.000** |
引起的 症状及影响 | 28.82 | 3.390 | 5.284 | 21 | 0.000** |
Table 5 Sample t-test result for the total score of the VRNQ section (test value=25)
子量表 | M | SD | t | df | Sig(2-tailed) |
---|---|---|---|---|---|
用户体验 | 28.41 | 3.418 | 4.678 | 21 | 0.000** |
系统机制 | 30.36 | 3.048 | 8.254 | 21 | 0.000** |
辅助机制 | 29.55 | 2.132 | 10.000 | 21 | 0.000** |
引起的 症状及影响 | 28.82 | 3.390 | 5.284 | 21 | 0.000** |
[1] | 中共中央办公厅, 国务院办公厅. 《关于推进实施国家文化数字化战略的意见》[EB/OL]. (2022-05-22) [2024-05-19]. https://www.gov.cn/xinwen/2022-05/22/content_5691759.htm. |
General Office of the CPC Central Committee, General Office of the State Council. Opinions of the State Council Office on promoting the implementation of digital culture[EB/OL]. (2022-05-22) [2024-05-19]. https://www.gov.cn/xinwen/2022-05/22/content_5691759.htm (in Chinese). | |
[2] | CECOTTI H. Cultural heritage in fully immersive virtual reality[J]. Virtual Worlds, 2022, 1(1): 82-102. |
[3] | EVANS C, HUSTON P, BUNN W, et al. IL DIVINO: Michelangelo’s Sistine ceiling in VR[EB/OL]. (2019-11-18) [2024-05-19]. https://store.steampowered.com/app/1165850/IL_DIVINO_Michelangelos_Sistine_Ceiling_in_VR/. |
[4] | Borrowed Light Studios. The night cafe: a VR tribute to Vincent van Gogh[EB/OL]. (2016-06-03) [2024-05-19]. https://store.steampowered.com/app/482390/The_Night_Cafe_A_VR_Tribute_to_Vincent_Van_Gogh/. |
[5] | YUAN C, YUN Z,. Tunable a VR reconstruction of “Listening to a Guqin” from emperor Zhao Ji[C]// SIGGRAPH ASIA 2016 VR Showcase. New York: ACM, 2016: 6. |
[6] | JIN S, FAN M, WANG Y C, et al. Reconstructing traditional Chinese paintings with immersive virtual reality[C]// 2020 CHI Conference on Human Factors in Computing Systems. New York: ACM, 2020: 1-8. |
[7] | Cinétévé Experience, BackLight TAPE. The Scream[EB/OL]. (2019-06-19) [2024-05-19]. https://store.steampowered.com/app/1097120/The_Scream/?curator_clanid=32244664. |
[8] |
林莹莹, 蔡睿凡, 朱雨真, 等. 基于Leap Motion 的虚拟现实陶艺体验系统[J]. 图学学报, 2020, 41(1): 57-65.
DOI |
LIN Y Y, CAI R F, ZHU Y Z, et al. Virtual reality pottery modeling system based on leap motion[J]. Journal of Graphics, 2020, 41(1): 57-65 (in Chinese). | |
[9] | MEHRABIAN A, RUSSELL J A. An approach to environmental psychology[M/OL]. Cambridge: The MIT Press, 1974 [2024-05-14]. https://psycnet.apa.org/record/1974-22049-000. |
[10] |
EKMAN P, FRIESEN WV. Constants across cultures in the face and emotion[J]. Journal of personality and social psychology, 1971, 17(2):124.
DOI PMID |
[11] | WALLER B M, PASQUALINI M S. Analysing facial expression using the facial action coding system (FACS)[M]// MÜLLER C, CIENKI A, FRICKE E, et al. Body- Language-Communication. Berlin: De Gruyter Mouton, 2013: 917-931. |
[12] |
ZHANG K H, HUANG Y Z, DU Y, et al. Facial expression recognition based on deep evolutional spatial-temporal networks[J]. IEEE Transactions on Image Processing, 2017, 26(9): 4193-4203.
DOI PMID |
[13] | CHEN S, CHENG H C, SITU J, et al. Mirror hearts: exploring the (Mis-)alignment between AI-recognized and self-reported emotions[C]// 2023 CHI Conference on Human Factors in Computing Systems. New York: ACM, 2023: 206. |
[14] | BRUNO P, MELNYK V, VÖLCKNER F. Temperature and emotions: Effects of physical temperature on responses to emotional advertising[J]. International Journal of Research in Marketing, 2017, 34(1): 302-320. |
[15] | GOSHVARPOUR A, ABBASI A, GOSHVARPOUR A,. An emotion recognition approach based on wavelet transform and second-order difference plot of ECG[J]. Journal of AI and Data Mining, 2017, 5(2): 211-221. |
[16] | GRECO A, LANATA A, CITI L, et al. Skin admittance measurement for emotion recognition: a study over frequency sweep[J]. Electronics, 2016, 5(3): 46. |
[17] | HUI T K L, SHERRATT R S. Coverage of emotion recognition for common wearable biosensors[J]. Biosensors, 2018, 8(2): 30. |
[18] | TABBAA L, SEARLE R, BAFTI S M, et al. VREED: virtual reality emotion recognition dataset using eye tracking & physiological measures[J]. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2021, 5(4): 178. |
[19] | MARÍN-MORALES J, HIGUERA-TRUJILLO J L, GRECO A, et al. Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors[J]. Scientific Reports, 2018, 8(1): 13657. |
[20] | DUBOVI I. Cognitive and emotional engagement while learning with VR: the perspective of multimodal methodology[J]. Computers & Education, 2022, 183: 104495. |
[21] | KOOLE S L. The psychology of emotion regulation: an integrative review[J]. Cognition and Emotion, 2008, 23(1): 4-41. |
[22] | KRAMER E. Art therapy in a children’s community: a study of the function of art therapy in the treatment program of Wiltwyck School for Boys[M]. Springfield, IL: Charles C Thomas Publisher, Ltd., 1958: 5-23. |
[23] | RAJCIC N, MCCORMACK J. Mirror ritual: an affective interface for emotional self-reflection[C]// 2020 CHI Conference on Human Factors in Computing Systems. New York: ACM, 2020: 1-13. |
[24] | WATERWORTH J, WATERWORTH E L. Relaxation island: a virtual tropical paradise[EB/OL]. [2024-06-05]. https://www.diva-portal.org/smash/record.jsf?pid=diva2%3A154544&dswid=7041. |
[25] | SEAY A F, GROMALA D, HODGES L, et al. The Meditation Chamber: a bio-interactive therapeutic virtual environment[EB/OL]. [2024-06-05]. http://physiologicalcomputing.net/chi2002/chi_papers/Fleming_Seay_Meditation_chamber.pdf. |
[26] | PATIBANDA R, MUELLER F F, LESKOVSEK M, et al. Life tree: understanding the design of breathing exercise games[C]// Annual Symposium on Computer-Human Interaction in Play. New York: ACM, 2017: 19-31. |
[27] | JÓŹWIK S, CIEŚLIK B, GAJDA R, et al. Evaluation of the impact of virtual reality-enhanced cardiac rehabilitation on depressive and anxiety symptoms in patients with coronary artery disease: a randomised controlled trial[J]. Journal of Clinical Medicine, 2021, 10(10): 2148. |
[28] | STERN R A, ARRUDA J E, HOOPER C R, et al. Visual analogue mood scales to measure internal mood state in neurologically impaired patients: description and initial validity evidence[J]. Aphasiology, 1997, 11(1): 59-71. |
[29] | SCHUBERT T W. The sense of presence in virtual environments: a three-component scale measuring spatial presence, involvement, and realness[J]. Zeitschrift für Medienpsychologie, 2003, 15(2): 69-71. |
[30] |
KOURTESIS P, COLLINA S, DOUMAS L A A, et al. Validation of the virtual reality neuroscience questionnaire: maximum duration of immersive virtual reality sessions without the presence of pertinent adverse symptomatology[J]. Frontiers in Human Neuroscience, 2019, 13: 417.
DOI PMID |
[31] | RUSSELL J A. A circumplex model of affect[J]. Journal of Personality and Social Psychology, 1980, 39(6): 1161-1178. |
[1] | DU Xin, REN Yangfu, XU Senzhe, WANG Juhong, ZHENG Yufei, ZHANG Songhai. Investigation of scene scaling gains in redirected walking within virtual reality [J]. Journal of Graphics, 2025, 46(4): 793-806. |
[2] | ZHU Xiaoqiang, YANG Yifei. Free sculpting system in virtual reality environment [J]. Journal of Graphics, 2025, 46(2): 345-357. |
[3] | YANG Haozhong, KONG Xiaoyu, GU Ruikun, WANG Miao. Research progress and trends in large model technologies for virtual reality [J]. Journal of Graphics, 2024, 45(6): 1117-1131. |
[4] | LUAN Shuai, WU Jian, FAN Runze, WANG Lili. Observation quality field based collaborative object manipulation in VR [J]. Journal of Graphics, 2024, 45(6): 1338-1348. |
[5] | REN Yangfu, YU Ge, FU Yueyao, XU Senzhe, HE Yu, WANG Juhong, ZHANG Songhai. The impact of scenery and time on spatial orientation cognition in virtual reality [J]. Journal of Graphics, 2024, 45(6): 1349-1363. |
[6] | LI Xiangdong, XIA Hanfei, SHAN Yifei, YIN Kailin, GENG Weidong. Opportunities and challenges: automatic generation technologies for graphical user interfaces [J]. Journal of Graphics, 2024, 45(3): 409-421. |
[7] | YAN Jiahao, LV Jian, HOU Yukang, MO Xinzhu. Research on the influence of eye movement interaction frequency on visual fatigue in virtual reality [J]. Journal of Graphics, 2024, 45(3): 528-538. |
[8] | WANG Haomiao, SANG Shengju, DUAN Xiaodong, ZHANG Weihua, TAO Tiwei, MA Ting. Collaborative 3D modeling technique in virtual reality [J]. Journal of Graphics, 2024, 45(1): 169-182. |
[9] | XIE Hong-xia, HU Yu-ning, ZHANG Yun, WANG Ya-qi, DU Hui, QIN Ai-hong. Survey of methods for scene analysis and content processing in panoramic images and videos [J]. Journal of Graphics, 2023, 44(4): 640-657. |
[10] | GAO Yue, HAN Hong-lei. Audience screen display system based on light-emitting devices [J]. Journal of Graphics, 2023, 44(4): 784-793. |
[11] | TANG Peng, SA Guo-dong, LIU Zhen-yu, TAN Jian-rong. Design of digital twin system for forging hydraulic press [J]. Journal of Graphics, 2023, 44(3): 609-615. |
[12] | ZHU Yong-ning , GE Ting , DU Sheng-yu , LOU Ze-ru , WANG Jian-min. A usability study of panoramic fluid painting system in immersive virtual environments [J]. Journal of Graphics, 2021, 42(5): 833-840. |
[13] | LIU You-quan , WANG Yuan-chao , XU Kun , LIU Zheng-xiong , HUANG Pan-feng. Mixed reality based remote collaborative assembly guidance [J]. Journal of Graphics, 2021, 42(2): 216-221. |
[14] | ZHAO Jian-jun, HUANG Jun-peng, CHEN Jun-liang . Human-computer interaction method in previz based on Leap Motion [J]. Journal of Graphics, 2021, 42(1): 71-78. |
[15] | ZHENG Ming-yu, LI Jia-he, ZHANG Han, LUO Yan-lin, SHEN Jia-li, ZHU Xiao-ming . Immersive physics learning environment with force feedback [J]. Journal of Graphics, 2021, 42(1): 79-86. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||