Characterizing and Improving Stability in Neural Style TransferReport as inadecuate

Characterizing and Improving Stability in Neural Style Transfer - Download this document for free, or read online. Document in PDF available to download.

Presented at: International Conference on Computer Vision (ICCV), Venice, Italy, October 22-29, 2017 Publication date: 2017

Recent progress in style transfer on images has focused on improving the quality of stylized images and speed of methods. However, real-time methods are highly unstable resulting in visible flickering when applied to videos. In this work we characterize the instability of these methods by examining the solution set of the style transfer objective. We show that the trace of the Gram matrix representing style is inversely related to the stability of the method. Then, we present a recurrent convolutional network for real-time video style transfer which incorporates a temporal consistency loss and overcomes the instability of prior methods. Our networks can be applied at any resolution, do not re- quire optical flow at test time, and produce high quality, temporally consistent stylized videos in real-time.

Reference EPFL-CONF-230217

Author: Gupta, Agrim; Johnson, Justin; Alahi, Alexandre; Fei-Fei, Li



Related documents