Indicators of Training Success in Virtual Reality Using Head and Eye Movements
OPEN ACCESS
Loading...
Author / Producer
Date
2021-10-04
Publication Type
Conference Paper
ETH Bibliography
yes
Citations
Altmetric
OPEN ACCESS
Data
Rights / License
Abstract
An essential aspect in the evaluation of Virtual Training Environments (VTEs) is the assessment of users’ training success, preferably in real-time, e.g. to continuously adapt the training or to provide feedback. To achieve this, leveraging users’ behavioral data has been shown to be a valid option. Behavioral data include sensor data from eye trackers, head-mounted displays, and hand-held controllers, as well as semantic data like a trainee’s focus on objects of interest within a VTE. While prior works investigated the relevance of mostly one and in rare cases two behavioral data sources at a time, we investigate the benefits of the combination of three data sources. We conduct a user study with 48 participants in an industrial training task to find correlations between training success and measures extracted from different behavioral data sources. We show that all individual data sources, i.e. eye gaze position and head movement, as well as duration of objects in focus are related to training success. Moreover, we find that simultaneously considering multiple behavioral data sources allows to better explain training success. Further, we show that training outcomes can already be predicted significantly better than chance by only recording trainees for parts of their training. This could be used for dynamically adapting a VTE’s difficulty. Finally, our work further contributes to reaching the long-term goal of substituting traditional evaluation of training success (e.g. through pen-and-paper tests) with an automated approach.
Permanent link
Publication status
published
Editor
Book title
2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
Journal / series
Volume
Pages / Article No.
285 - 280
Publisher
IEEE
Event
IEEE International Symposium on Mixed and Augmented Reality
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Virtual Reality (VR); Attention Guidance
Organisational unit
08844 - Kunz, Andreas (Tit.-Prof.) / Kunz, Andreas (Tit.-Prof.)
Notes
Conference lecture held on October 6, 2021