Hand-in-Air (HiA) and Hand-on-Target (HoT) Style Gesture Cues for Mixed Reality Collaboration

Kim, S; Jing, A; Park, H; Lee, GA; Huang, W; Billinghurst, M

Hand-in-Air (HiA) and Hand-on-Target (HoT) Style Gesture Cues for Mixed Reality Collaboration

Kim, S Jing, A Park, H Lee, GA Huang, W

Billinghurst, M

Permalink

Publisher:: IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Publication Type:: Journal Article
Citation:: IEEE Access, 2020, 8, (99), pp. 224145-224161
Issue Date:: 2020-01-01

Open Access

Copyright Clearance Process

Recently Added
In Progress
Open Access

This item is open access.

Adobe PDF

Download Published versionAdobe PDF (2.64 MB)

View on publisher's site

View statistics

Full metadata record

Field	Value	Language
dc.contributor.author	Kim, S
dc.contributor.author	Jing, A
dc.contributor.author	Park, H
dc.contributor.author	Lee, GA
dc.contributor.author	Huang, W https://orcid.org/0000-0002-5190-7839
dc.contributor.author	Billinghurst, M
dc.date.accessioned	2021-02-07T00:15:42Z
dc.date.available	2021-02-07T00:15:42Z
dc.date.issued	2020-01-01
dc.identifier.citation	IEEE Access, 2020, 8, (99), pp. 224145-224161
dc.identifier.issn	2169-3536
dc.identifier.issn	2169-3536
dc.identifier.uri	http://hdl.handle.net/10453/145891
dc.description.abstract	© 2013 IEEE. In collaboration systems, collaborators often use hand gestures for showing information relating to a distant object. However, in viewer's perspective, it is sometimes difficult to know where the conventional gesture cue (Hands-in-Air style: HiA) refers to because the conventional HiA gesture appears away from the distant object. In this paper, we investigate how two factors, distance to the object and view angle difference between collaborators, influence the understanding of HiA gesture by comparing the use of it at 25 positions with 5 distances and 5 view angles. In a user study, we found that the distance to the target object and view angle difference negatively influenced HiA gesture communication. The influence of the distance and view angle was more serious between smaller angles (030 degree) than larger angles (3060 degree), and between shorter distances (1m ∼ 1.5m ) than between longer distance (1.5m ∼ 2m ). As a solution, we propose the Hands-on-Target (HoT) style which positions the hand gesture cue on the surface of the target object. The HoT style gesture cue dramatically reduces the negative effect of the distance and view angle difference. Participants completed the task 29.3 percent faster, selected the correct object 2.75 times more, and felt 63.1 percent less mental effort. For further investigation, we discuss on the extensibility of the HoT interface that it can be used not only for object selection but also for diverse type of gesture communication including gesture for object manipulation because the HoT interface can support all possible real world hand gestures.
dc.language	English
dc.publisher	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
dc.relation	http://purl.org/au-research/grants/arc/DP170102885
dc.relation.ispartof	IEEE Access
dc.relation.isbasedon	10.1109/ACCESS.2020.3043783
dc.rights	info:eu-repo/semantics/openAccess
dc.rights	© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.	en_US
dc.subject	08 Information and Computing Sciences, 09 Engineering, 10 Technology
dc.title	Hand-in-Air (HiA) and Hand-on-Target (HoT) Style Gesture Cues for Mixed Reality Collaboration
dc.type	Journal Article
utslib.citation.volume	8
utslib.for	08 Information and Computing Sciences
utslib.for	09 Engineering
utslib.for	10 Technology
pubs.organisational-group	/University of Technology Sydney/Faculty of Transdisciplinary Innovation
pubs.organisational-group	/University of Technology Sydney
utslib.copyright.status	open_access	*
dc.date.updated	2021-02-07T00:15:17Z
pubs.issue	99
pubs.publication-status	Published
pubs.volume	8
utslib.citation.issue	99

Abstract:

© 2013 IEEE. In collaboration systems, collaborators often use hand gestures for showing information relating to a distant object. However, in viewer's perspective, it is sometimes difficult to know where the conventional gesture cue (Hands-in-Air style: HiA) refers to because the conventional HiA gesture appears away from the distant object. In this paper, we investigate how two factors, distance to the object and view angle difference between collaborators, influence the understanding of HiA gesture by comparing the use of it at 25 positions with 5 distances and 5 view angles. In a user study, we found that the distance to the target object and view angle difference negatively influenced HiA gesture communication. The influence of the distance and view angle was more serious between smaller angles (030 degree) than larger angles (3060 degree), and between shorter distances (1m ∼ 1.5m ) than between longer distance (1.5m ∼ 2m ). As a solution, we propose the Hands-on-Target (HoT) style which positions the hand gesture cue on the surface of the target object. The HoT style gesture cue dramatically reduces the negative effect of the distance and view angle difference. Participants completed the task 29.3 percent faster, selected the correct object 2.75 times more, and felt 63.1 percent less mental effort. For further investigation, we discuss on the extensibility of the HoT interface that it can be used not only for object selection but also for diverse type of gesture communication including gesture for object manipulation because the HoT interface can support all possible real world hand gestures.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/145891