Convolutional Autoencoders for Human Motion Infilling
OPEN ACCESS
Author / Producer
Date
2020
Publication Type
Conference Paper
ETH Bibliography
yes
Citations
Altmetric
OPEN ACCESS
Data
Rights / License
Abstract
In this paper we propose a convolutional autoencoder to address the problem of motion infilling for 3D human motion data. Given a start and end sequence, motion infilling aims to complete the missing gap in between, such that the filled in poses plausibly forecast the start sequence and naturally transition into the end sequence. To this end, we propose a single, end-to-end trainable convolutional autoencoder. We show that a single model can be used to create natural transitions between different types of activities. Furthermore, our method is not only able to fill in entire missing frames, but it can also be used to complete gaps where partial poses are available (e.g. from end effectors), or to clean up other forms of noise (e.g. Gaussian). Also, the model can fill in an arbitrary number of gaps that potentially vary in length. In addition, no further post-processing on the model’s outputs is necessary such as smoothing or closing discontinuities at the end of the gap. At the heart of our approach lies the idea to cast motion infilling as an inpainting problem and to train a convolutional de-noising autoencoder on image-like representations of motion sequences. At training time, blocks of columns are removed from such images and we ask the model to fill in the gaps. We demonstrate the versatility of the approach via a number of complex motion sequences and report on thorough evaluations performed to better understand the capabilities and limitations of the proposed approach.
Permanent link
Publication status
published
External links
Editor
Book title
2020 International Conference on 3D Vision (3DV)
Journal / series
Volume
Pages / Article No.
918 - 927
Publisher
IEEE
Event
8th International Conference on 3D Vision (3DV 2020) (virtual)
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
COMPUTER SCIENCE; Computer Vision; Motion Modelling
Organisational unit
03979 - Hilliges, Otmar (ehemalig) / Hilliges, Otmar (former)
Notes
Due to the Coronavirus (COVID-19) the conference was conducted virtually.
Funding
717054 - Optimization-based End-User Design of Interactive Technologies (EC)