Facial expressions play an important role in human communication since they enrich spoken information and help convey additional sentiments e.g. mood. Among others, they non-verbally express a partner’s agreement or disagreement to spoken information. Further, together with the audio signal, humans can even detect nuances of changes in a person’s mood. However, facial expressions remain inaccessible to the blind and visually impaired, and ...

In this study, we introduce an authoring toolkit enabling both experts and trainees to record their actions in a virtual environment, streamlining the creation of training procedures and the evaluation of trainee actions. The toolkit was developed using two distinct methods: a state-based and an input-based approach. Within a virtual testing environment, we compared these methods across a range of interactions, focusing on three performance ...