Observation quality field based collaborative object manipulation in VR

doi:10.11996/JG.j.2095-302X.2024061338

Abstract

Abstract:

In virtual reality (VR), interacting with objects serves as a crucial form of interaction, especially in collaborative VR applications where efficient and accurate operations are extremely important. However, traditional collaborative operation techniques have failed to adequately consider the interactions among objects, targets, and environmental dynamics, nor have they provided effective guidance to assist users in selecting the best viewpoint during operations. To address this issue, a new collaborative operation technique based on the Observation Quality Field (OQF) was introduced, aimed at enhancing operational accuracy and efficiency. This technique guided users to choose the most appropriate viewpoint based on their observation quality score, facilitating more efficient and coordinated object operation. Initially, the concept and construction method of the Observation Quality Field were introduced, followed by two strategies to accelerate the OQF update process. Subsequently, a collaborative operation method using OQF guidance for object operation was presented. Through a user study involving 36 participants conducted in three different virtual environments—living room, warehouse, and pipeline—the efficiency and accuracy of this technique were evaluated. The results showed that compared to traditional methods, the OQF technique significantly reduced task completion time, positional errors, rotational errors, and overall task load.

Key words: virtual reality, collaboration, object manipulation, observation quality field, human-computer interaction

CLC Number:

TP391.4

LUAN Shuai, WU Jian, FAN Runze, WANG Lili. Observation quality field based collaborative object manipulation in VR[J]. Journal of Graphics, 2024, 45(6): 1338-1348.

Figures/Tables 16

References 23

[1]	BOWMAN D A, KRUIJFF E, LAVIOLA J J, et al. 3D user interfaces: theory and practice[M]. Boston: Addison-Wesley, 2005: 117-118.
[2]	BOWMAN D A, HODGES L F. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments[C]// 1997 Symposium on Interactive 3D Graphics. New York: ACM, 1997: 35-38.
[3]	GLOUMEAU P C, STUERZLINGER W, HAN J. PinNPivot: object manipulation using pins in immersive virtual environments[J]. IEEE Transactions on Visualization and Computer Graphics, 2021, 27(4): 2488-2494.
[4]	NGUYEN T T H, DUVAL T, PONTONNIER C. A new direct manipulation technique for immersive 3D virtual environments[C]// The 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual Environments. Goslar: Eurographics Association, 2014: 67-74.
[5]	WANG R, PARIS S, POPOVIĆ J. 6D hands: markerless hand-tracking for computer aided design[C]// The 24th Annual ACM Symposium on User Interface Software and Technology. New York: ACM, 2011: 549-558.
[6]	GRUDIN J, RUDDLE R A, SAVAGE J C D, et al. Symmetric and asymmetric action integration during cooperative object manipulation in virtual environments[J]. ACM Transactions on Computer-Human Interaction, 2002, 9(4): 285-308.
[7]	GRANDI J G, DEBARBA H G, MACIEL A. Characterizing asymmetric collaborative interactions in virtual and augmented realities[C]// 2019 IEEE Conference on Virtual Reality and 3D User Interfaces. New York: IEEE Press, 2019: 127-135.
[8]	DUVAL T, LECUYER A, THOMAS S. SkeweR: a 3D interaction technique for 2-user collaborative manipulation of objects in virtual environments[C]// 3D User Interfaces. New York: IEEE Press, 2006: 69-72.
[9]	BARON N. CollaborativeConstraint: UI for collaborative 3D manipulation operations[C]// 2016 IEEE Symposium on 3D User Interfaces. New York: IEEE Press, 2016: 273-274.
[10]	WANG L L, LIU X L, LI X Y. VR collaborative object manipulation based on viewpoint quality[C]// 2021 IEEE International Symposium on Mixed and Augmented Reality. New York: IEEE Press, 2021: 60-68.
[11]	LE CHENECHAL M, LACOCHE J, ROYAN J, et al. When the giant meets the ant an asymmetric approach for collaborative and concurrent object manipulation in a multi-scale environment[C]// 2016 IEEE Third VR International Workshop on Collaborative Virtual Environments. New York: IEEE Press, 2016: 18-22.
[12]	SOARES L P, KOPPER R, PINHO M S. EGO-EXO: a cooperative manipulation technique with automatic viewpoint control[C]// 2018 20th Symposium on Virtual and Augmented Reality. New York: IEEE Press, 2018: 82-88.
[13]	LAGES W. Ray, camera, action! A technique for collaborative 3D manipulation[C]// 2016 IEEE Symposium on 3D User Interfaces. New York: IEEE Press, 2016: 281-282.
[14]	BACHMANN E R, HODGSON E, HOFFBAUER C, et al. Multi-user redirected walking and resetting using artificial potential fields[J]. IEEE Transactions on Visualization and Computer Graphics, 2019, 25(5): 2022-2031.
[15]	DONG T Y, CHEN X W, SONG Y F, et al. Dynamic artificial potential fields for multi-user redirected walking[C]// 2020 IEEE Conference on Virtual Reality and 3D User Interfaces. New York: IEEE Press, 2020: 146-154.
[16]	BOZGEYIKLI E, RAIJ A, KATKOORI S, et al. Point & teleport locomotion technique for virtual reality[C]// 2016 Annual Symposium on Computer-Human Interaction in Play. New York: ACM, 2016: 205-216.
[17]	FREES S, KESSLER G D, KAY E. PRISM interaction for enhancing control in immersive virtual environments[J]. ACM Transactions on Computer-Human Interaction, 2007, 14(1): 2:1-2:31.
[18]	ZAGATA K, GULIJ J, HALIK Ł, et al. Mini-map for gamers who walk and teleport in a virtual stronghold[J]. ISPRS International Journal of Geo-Information, 2021, 10(2): 96:1-96:17.
[19]	HART S G. NASA-task load index (NASA-TLX); 20 years later[J]. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2006, 50(9): 904-908.
[20]	HART S G, STAVELAND L E. Development of NASA-TLX (Task Load Index): results of empirical and theoretical research[J]. Advances in Psychology, 1988, 52: 139-183.
[21]	SHAPIRO S S, WILK M B. An analysis of variance test for normality (complete samples)[J]. Biometrika, 1965, 52(3/4): 591-611.
[22]	MAUCHLY J W. Significance test for sphericity of a normal n-variate distribution[J]. The Annals of Mathematical Statistics, 1940, 11(2): 204-209.
[23]	LIU X S. Statistical power analysis for the social and behavioral sciences[M]. New York: Routledge, 2013.

任务	条件	时间/s	[(CC_i-EC)/CC_i]/%	p	d	效果
S1	CC	144.25±47.36
	EC₁	84.78±16.82	70.2	<0.001*	1.67	非常大
	EC₂	130.90±31.12	10.2	0.311	0.33	小
	EC₃	72.23±22.16	99.7	<0.001*	1.95	非常大
	EC₄	88.70±22.16	62.6	<0.001*	1.48	非常大
	EC₅	74.05±17.54	94.8	<0.001*	1.97	非常大
S2	CC	114.90±32.51
	EC₁	95.30±24.49	20.6	0.042*	0.68	中等
	EC₂	102.90±23.77	11.7	0.202	0.42	小
	EC₃	84.75±24.82	35.6	0.002*	1.04	大
	EC₄	89.30±36.13	28.7	0.027*	0.74	中等
	EC₅	74.85±27.47	53.5	<0.001*	1.33	非常大
S3	CC	135.75±50.75
	EC₁	106.65±29.51	27.3	0.037*	0.70	中等
	EC₂	154.70±42.13	-12.2	0.218	0.41	小
	EC₃	93.70±23.30	44.9	0.002*	1.06	大
	EC₄	98.15±28.36	38.3	0.007*	0.91	大
	EC₅	86.50±22.66	56.9	0.007*	1.25	非常大

任务	条件	时间/s	[(CC_i-EC)/CC_i]/%	p	d	效果
S1	CC	144.25±47.36
	EC₁	84.78±16.82	70.2	<0.001*	1.67	非常大
	EC₂	130.90±31.12	10.2	0.311	0.33	小
	EC₃	72.23±22.16	99.7	<0.001*	1.95	非常大
	EC₄	88.70±22.16	62.6	<0.001*	1.48	非常大
	EC₅	74.05±17.54	94.8	<0.001*	1.97	非常大
S2	CC	114.90±32.51
	EC₁	95.30±24.49	20.6	0.042*	0.68	中等
	EC₂	102.90±23.77	11.7	0.202	0.42	小
	EC₃	84.75±24.82	35.6	0.002*	1.04	大
	EC₄	89.30±36.13	28.7	0.027*	0.74	中等
	EC₅	74.85±27.47	53.5	<0.001*	1.33	非常大
S3	CC	135.75±50.75
	EC₁	106.65±29.51	27.3	0.037*	0.70	中等
	EC₂	154.70±42.13	-12.2	0.218	0.41	小
	EC₃	93.70±23.30	44.9	0.002*	1.06	大
	EC₄	98.15±28.36	38.3	0.007*	0.91	大
	EC₅	86.50±22.66	56.9	0.007*	1.25	非常大

任务	条件	位置误差/mm	[(CC_i-EC)/CC_i]/%	p	d	效果
S1	CC	5.4±2.0
	EC1	3.0±1.4	80.4	0.001 6*	1.36	非常大
	EC2	4.5±1.9	19.7	0.167 8	0.46	小
	EC3	3.7±1.2	47.2	0.002 7*	1.04	大
	EC4	3.2±0.7	67.5	<0.001 0*	1.45	非常大
	EC5	3.1±0.7	75.9	0.001 6*	1.36	非常大
S2	CC	3.8±2.2
	EC1	2.2±0.9	74.6	0.003 5*	0.98	大
	EC2	3.8±2.7	1.3	0.952 0	0.02	非常小
	EC3	2.5±1.4	52.6	0.031 0*	0.73	中等
	EC4	2.5±1.3	49.6	0.036 7*	0.70	中等
	EC5	2.1±1.1	82.9	0.003 6*	1.01	大
S3	CC	3.6±1.2
	EC1	2.9±1.5	22.8	0.141 0	0.49	小
	EC2	3.2±1.7	11.3	0.460 0	0.24	小
	EC3	2.2±1.0	62.6	0.000 6*	1.21	非常大
	EC4	3.1±1.5	26.9	0.0714	0.60	中等
	EC5	2.3±1.0	57.9	0.0007*	1.19	大

任务	条件	位置误差/mm	[(CC_i-EC)/CC_i]/%	p	d	效果
S1	CC	5.4±2.0
	EC1	3.0±1.4	80.4	0.001 6*	1.36	非常大
	EC2	4.5±1.9	19.7	0.167 8	0.46	小
	EC3	3.7±1.2	47.2	0.002 7*	1.04	大
	EC4	3.2±0.7	67.5	<0.001 0*	1.45	非常大
	EC5	3.1±0.7	75.9	0.001 6*	1.36	非常大
S2	CC	3.8±2.2
	EC1	2.2±0.9	74.6	0.003 5*	0.98	大
	EC2	3.8±2.7	1.3	0.952 0	0.02	非常小
	EC3	2.5±1.4	52.6	0.031 0*	0.73	中等
	EC4	2.5±1.3	49.6	0.036 7*	0.70	中等
	EC5	2.1±1.1	82.9	0.003 6*	1.01	大
S3	CC	3.6±1.2
	EC1	2.9±1.5	22.8	0.141 0	0.49	小
	EC2	3.2±1.7	11.3	0.460 0	0.24	小
	EC3	2.2±1.0	62.6	0.000 6*	1.21	非常大
	EC4	3.1±1.5	26.9	0.0714	0.60	中等
	EC5	2.3±1.0	57.9	0.0007*	1.19	大

任务	条件	旋转误差/mm	[(CC_i-EC)/CC_i]/%	p	d	效果
S1	CC	5.52±3.48
	EC1	3.62±0.67	52.6	0.024 6*	0.76	大
	EC2	4.19±0.97	31.9	0.115 0	0.52	中等
	EC3	3.22±1.42	71.4	0.011 1*	0.87	大
	EC4	3.29±1.11	68.0	0.011 2*	0.86	大
	EC5	3.15±1.34	75.3	0.008 0*	0.90	大
S2	CC	6.12±2.56
	EC1	3.79±0.75	61.6	0.000 4*	1.24	非常大
	EC2	3.84±0.90	59.2	0.070 0	0.39	小
	EC3	3.18±1.11	92.3	<0.000 1*	1.49	非常大
	EC4	3.69±1.48	66.0	0.000 9*	1.16	大
	EC5	3.02±1.25	102.8	<0.000 1*	1.54	非常大
S3	CC	4.20±1.92
	EC1	2.50±0.97	68.4	0.001 3*	1.12	大
	EC2	3.26±0.98	29.4	0.062 0	0.62	中等
	EC3	2.32±1.14	80.8	0.000 7*	1.19	大
	EC4	2.54±1.39	80.0	0.003 9*	0.86	大
	EC5	2.12±1.30	97.9	0.000 3*	1.29	非常大