Deep Sandscapes: Design Tool for Robotic Sand-Shaping with GAN-Based Heightmap Predictions
METADATA ONLY
Loading...
Author / Producer
Date
2022
Publication Type
Conference Paper
ETH Bibliography
yes
Citations
Altmetric
METADATA ONLY
Data
Rights / License
Abstract
The aim of this research is to develop an adaptive and interactive design workflow for robotic sand-shaping. One of the challenges of working with natural materials is the increased level of complexity due to uncertain material behaviour. In this work, a generative adversarial network (GAN) is used to expedite material simulations. We train an image-to-image GAN to learn the relationship between planned excavation trajectories in existing sand states (input) and the modified sand states after excavation (ground truth). Data is collected prior to learning by an autonomous excavation routine. This routine (1) generates random trajectories that are executed by a robotic-arm; (2) uses an RGB-D camera to capture sand states as heightmaps before and after robotic interaction. Our GAN-assisted design tool predicts rearranged sandscapes by providing robotic excavation trajectories. Integrated into CAD software, an interactive and iterative design environment is realised for robotic sand-shaping.
Permanent link
Publication status
published
Editor
Book title
2022 Annual Modeling and Simulation Conference (ANNSIM)
Journal / series
Volume
Pages / Article No.
730 - 741
Publisher
IEEE
Event
70th Annual Modeling and Simulation Conference (ANNSIM 2022)
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
digital fabrication; sand; GAN; image-to-image; design tool
Organisational unit
09566 - Dillenburger, Benjamin / Dillenburger, Benjamin