Where Should I Walk? Predicting Terrain Properties from Images via Self-Supervised Learning
Abstract
Legged robots have the potential to traverse diverse and rugged terrain. To find a safe and efficient navigation path and to carefully select individual footholds, it is useful to be able to predict properties of the terrain ahead of the robot. In this work, we propose a method to collect data from robot-terrain interaction and associate it to images. Using sparse data acquired in teleoperation experiments with a quadrupedal robot,we train a neural network to generate a dense prediction of the terrain properties in front of the robot. To generate training data, we project the foothold positions from the robot trajectory into on-board camera images. We then attach labels to these footholds by identifying the dominant features of the force-torque signal measured with sensorized feet. We show that data collected in this fashion can be used to train a convolutional network for terrain property prediction as well as weakly supervised semantic segmentation. Finally, we show that the predicted terrain properties can be used for autonomous navigation of the ANYmal quadruped robot. Mehr anzeigen
Persistenter Link
https://doi.org/10.3929/ethz-b-000323783Publikationsstatus
publishedExterne Links
Zeitschrift / Serie
IEEE Robotics and Automation LettersBand
Seiten / Artikelnummer
Verlag
IEEEOrganisationseinheit
09570 - Hutter, Marco / Hutter, Marco