Towards Automating Construction Tasks: Large-Scale Object Mapping, Segmentation and Manipulation
OPEN ACCESS
Loading...
Author / Producer
Date
2020-08
Publication Type
Journal Article
ETH Bibliography
yes
Citations
Altmetric
OPEN ACCESS
Data
Rights / License
Abstract
Automating building processes through robotic systems has the potential to address the need for safer, more efficient, and sustainable construction operations. While ongoing research effort often targets the use of prefabricated materials in controlled environments, here we focus on utilizing objects found on‐site, such as irregularly shaped rocks and rubble, as a way of enabling novel types of construction in remote and extreme environments, where standard building materials might not be easily accessible. In this article, we present a perception and grasp pose planning pipeline for autonomous manipulation of objects of interest with a robotic walking excavator. The system incrementally builds a LiDAR‐based map of the robot's surroundings and provides the ability to register externally reconstructed point clouds of the scene, for example, from images captured by a drone‐borne camera, which helps increasing map coverage. In addition, object‐like instances, such as stones, are segmented out of this map. Based on this information, collision‐free grasping poses for the robotic manipulator are planned to enable picking and placing of these objects, while keeping track of them during the manipulation. The approach is validated in a real setting on an architectural relevant scale by segmenting and manipulating boulders of several hundred kilograms, which is a first step towards the full automation of dry‐stack wall building processes.
Permanent link
Publication status
published
External links
Editor
Book title
Journal / series
Volume
38 (5)
Pages / Article No.
684 - 699
Publisher
Wiley
Event
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
On site robotics; Mapping; Object segmentation; Mobile manipulation
Organisational unit
09559 - Chli, Margarita (ehemalig) / Chli, Margarita (former)
09570 - Hutter, Marco / Hutter, Marco
02284 - NFS Digitale Fabrikation / NCCR Digital Fabrication
Notes
Funding
Related publications and datasets
Is part of: