Single-Image Deblurring, Trajectory and Shape Recovery of Fast Moving Objects with Denoising Diffusion Probabilistic Models


METADATA ONLY
Loading...

Date

2024

Publication Type

Conference Paper

ETH Bibliography

yes

Citations

Altmetric
METADATA ONLY

Data

Rights / License

Abstract

Blurry appearance of fast moving objects in video frames was successfully used to reconstruct the object appearance and motion in both 2D and 3D domains. The proposed method addresses the novel, severely ill-posed, task of single-image fast moving object deblurring, shape, and trajectory recovery - previous approaches require at least three consecutive video frames. Given a single image, the method outputs the object 2D appearance and position in a series of sub-frames as if captured by a high-speed camera (i.e. temporal super-resolution). The proposed SI-DDPM-FMO method is trained end-to-end on a synthetic dataset with various moving objects, yet it generalizes well to real-world data from several publicly available datasets. SI-DDPM-FMO performs similarly to or better than recent multi-frame methods and a carefully designed baseline method.

Permanent link

Publication status

published

Editor

Book title

2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)

Journal / series

Volume

Pages / Article No.

6843 - 6852

Publisher

IEEE

Event

IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2024)

Edition / version

Methods

Software

Geographic location

Date collected

Date created

Subject

Algorithms; Video recognition and understanding; Low-level and physics-based vision

Organisational unit

Notes

Funding

Related publications and datasets