Characterizing and Improving Stability in Neural Style TransferReportar como inadecuado

Characterizing and Improving Stability in Neural Style Transfer - Descarga este documento en PDF. Documentación en PDF para descargar gratis. Disponible también para leer online.

Presented at: International Conference on Computer Vision (ICCV), Venice, Italy, October 22-29, 2017 Publication date: 2017

Recent progress in style transfer on images has focused on improving the quality of stylized images and speed of methods. However, real-time methods are highly unstable resulting in visible flickering when applied to videos. In this work we characterize the instability of these methods by examining the solution set of the style transfer objective. We show that the trace of the Gram matrix representing style is inversely related to the stability of the method. Then, we present a recurrent convolutional network for real-time video style transfer which incorporates a temporal consistency loss and overcomes the instability of prior methods. Our networks can be applied at any resolution, do not re- quire optical flow at test time, and produce high quality, temporally consistent stylized videos in real-time.

Reference EPFL-CONF-230217

Autor: Gupta, Agrim; Johnson, Justin; Alahi, Alexandre; Fei-Fei, Li


Documentos relacionados