Adaptive Convolutions for Structure-Aware Style Transfer
OPEN ACCESS
Loading...
Author / Producer
Date
2021-06
Publication Type
Conference Paper
ETH Bibliography
yes
Citations
Altmetric
OPEN ACCESS
Data
Rights / License
Abstract
Style transfer between images is an artistic application of CNNs, where the 'style' of one image is transferred onto another image while preserving the latter's content. The state of the art in neural style transfer is based on Adaptive Instance Normalization (AdaIN), a technique that transfers the statistical properties of style features to a content image, and can transfer a large number of styles in real time. However, AdaIN is a global operation; thus local geometric structures in the style image are often ignored during the transfer. We propose Adaptive Convolutions (AdaConv), a generic extension of AdaIN, to allow for the simultaneous transfer of both statistical and structural styles in real time. Apart from style transfer, our method can also be readily extended to style-based image generation, and other tasks where AdaIN has already been adopted.
Permanent link
Publication status
published
Editor
Book title
2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Journal / series
Volume
Pages / Article No.
7968 - 7977
Publisher
IEEE
Event
2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021)
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Style transfer; Deep learning; Normalization; GAN; Neural style transfer
Organisational unit
03420 - Gross, Markus / Gross, Markus