Evaluation of Human-Robot Interfaces Based on 2D/3D Visual and Haptic Feedback for Aerial Manipulation
OPEN ACCESS
Loading...
Author / Producer
Date
2025-09
Publication Type
Journal Article
ETH Bibliography
yes
OPEN ACCESS
Data
Rights / License
Abstract
Most telemanipulation systems for aerial robots provide the operator with only 2D screen visual information. The lack of richer information about the robot’s status and environment can limit human awareness and, in turn, task performance. While the pilot’s experience can often compensate for this reduced flow of information, providing richer feedback is expected to reduce the cognitive workload and offer a more intuitive experience overall. This work aims to understand the significance of providing additional pieces of information during aerial telemanipulation, namely (i) 3D immersive visual feedback about the robot’s surroundings through mixed reality (MR) and (ii) 3D haptic feedback about the robot interaction with the environment. To do so, we developed a human-robot interface able to provide this information. First, we demonstrate its potential in a real-world manipulation task requiring sub-centimeter-level accuracy. Then, we evaluate the individual effect of MR vision and haptic feedback on both dexterity and workload through a human subjects study involving a virtual block transportation task. Results show that both 3D MR vision and haptic feedback improve the operator’s dexterity in the considered teleoperated aerial interaction tasks. Nevertheless, pilot experience remains the most significant factor.
Permanent link
Publication status
published
External links
Editor
Book title
Journal / series
Volume
111 (3)
Pages / Article No.
104
Publisher
Springer
Event
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Aerial physical interaction; Aerial manipulation; Teleoperation; Haptic; Mixed reality; Multimodal
Organisational unit
Notes
Funding
953454 - AErial RObotic TRAINing for developing the next generation of European infrastructure and asset maintenance technologies (EC)