Comparing Mixed Reality Hand Gestures to Artificial Instruction Means for Small Target Objects

Abstract

Hand gestures are a valuable means for the instruction of complex handling processes. They are used and perceived in an intuitive way and outperform artificial representations such as arrows or symbols. On the other hand, referring finger gestures require a certain object size to avoid ambiguities, and often they are replaced by artificial means. However, this comes to the cost of reduced intuition due to the change of a hand gesture to an artificial gesture, which consequently makes it more difficult to learn long instruction sequences and keep them in mind. This paper thus introduces study results showing that hand pointing gestures perform well even for small objects, so that unnecessary switches to artificial representations can be avoided in the future.