The combination of visual communication cues in mixed reality remote collaboration

Kim, S; Lee, G; Billinghurst, M; Huang, W

The combination of visual communication cues in mixed reality remote collaboration

Kim, S Lee, G Billinghurst, M Huang, W

Permalink

Publisher:: Springer Science and Business Media LLC
Publication Type:: Journal Article
Citation:: Journal on Multimodal User Interfaces, 2020, 14, (4), pp. 321-335
Issue Date:: 2020-12-01

Open Access

Copyright Clearance Process

Recently Added
In Progress
Open Access

This item is open access.

Adobe PDF

Download Accepted versionAdobe PDF (3.27 MB)

View on publisher's site

View statistics

Full metadata record

Field	Value	Language
dc.contributor.author	Kim, S
dc.contributor.author	Lee, G
dc.contributor.author	Billinghurst, M
dc.contributor.author	Huang, W https://orcid.org/0000-0002-5190-7839
dc.date.accessioned	2020-12-12T03:34:38Z
dc.date.available	2020-12-12T03:34:38Z
dc.date.issued	2020-12-01
dc.identifier.citation	Journal on Multimodal User Interfaces, 2020, 14, (4), pp. 321-335
dc.identifier.issn	1783-7677
dc.identifier.issn	1783-8738
dc.identifier.uri	http://hdl.handle.net/10453/144637
dc.description.abstract	© 2020, Springer Nature Switzerland AG. Many researchers have studied various visual communication cues (e.g. pointer, sketch, and hand gesture) in Mixed Reality remote collaboration systems for real-world tasks. However, the effect of combining them has not been so well explored. We studied the effect of these cues in four combinations: hand only, hand + pointer, hand + sketch, and hand + pointer + sketch, within the two user studies when a dependent view and independent view are supported respectively. In the first user study with the dependent view, the results showed that the hand gesture cue was the main visual communication cue and adding sketch cue to the hand gesture cue helped participants complete the task faster. In the second study with the independent view, the results showed that the hand gesture had an issue of local worker understanding remote expert’s hand gesture cue and the main visual communication cue was the pointer cue with fast completion time and high level of co-presence.
dc.language	en
dc.publisher	Springer Science and Business Media LLC
dc.relation.ispartof	Journal on Multimodal User Interfaces
dc.relation.isbasedon	10.1007/s12193-020-00335-x
dc.rights	info:eu-repo/semantics/openAccess
dc.rights	info:eu-repo/semantics/openAccess
dc.rights	This is a post-peer-review, pre-copyedit version of an article published in Journal on Multimodal User Interfaces. The final authenticated version is available online at: https://dx.doi.org/10.1007/s12193-020-00335-x.	en_US
dc.subject	0801 Artificial Intelligence and Image Processing, 0806 Information Systems, 1203 Design Practice and Management
dc.title	The combination of visual communication cues in mixed reality remote collaboration
dc.type	Journal Article
utslib.citation.volume	14
utslib.for	0801 Artificial Intelligence and Image Processing
utslib.for	0806 Information Systems
utslib.for	1203 Design Practice and Management
pubs.organisational-group	/University of Technology Sydney/Faculty of Transdisciplinary Innovation
pubs.organisational-group	/University of Technology Sydney
utslib.copyright.status	open_access	*
dc.date.updated	2020-12-12T03:34:07Z
pubs.issue	4
pubs.publication-status	Accepted
pubs.volume	14
utslib.citation.issue	4

Abstract:

© 2020, Springer Nature Switzerland AG. Many researchers have studied various visual communication cues (e.g. pointer, sketch, and hand gesture) in Mixed Reality remote collaboration systems for real-world tasks. However, the effect of combining them has not been so well explored. We studied the effect of these cues in four combinations: hand only, hand + pointer, hand + sketch, and hand + pointer + sketch, within the two user studies when a dependent view and independent view are supported respectively. In the first user study with the dependent view, the results showed that the hand gesture cue was the main visual communication cue and adding sketch cue to the hand gesture cue helped participants complete the task faster. In the second study with the independent view, the results showed that the hand gesture had an issue of local worker understanding remote expert’s hand gesture cue and the main visual communication cue was the pointer cue with fast completion time and high level of co-presence.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/144637