Informed source separation through spectrogram coding and data embeddingReportar como inadecuado

Informed source separation through spectrogram coding and data embedding - Descarga este documento en PDF. Documentación en PDF para descargar gratis. Disponible también para leer online.

1 LTCI - Laboratoire Traitement et Communication de l-Information 2 GIPSA-CICS - CICS GIPSA-DIS - Département Images et Signal 3 GIPSA-MAGIC - MAGIC GIPSA-DPC - Département Parole et Cognition 4 TSI - Département Traitement du Signal et des Images

Abstract : We address the issue of underdetermined source separation in a particular informed configuration where both the sources and the mixtures are known during a so-called encoding stage. This knowledge enables the computation of a side-information which is small enough to be inaudibly embedded into the mixtures. At the decoding stage, the sources are no longer assumed to be known, only the mixtures and the extracted side-information are processed for source separation. The proposed system models the sources as independent and locally stationary Gaussian processes GP and the mixing process as a linear filtering. This model allows reliable estimation of the sources through generalized Wiener filtering, provided their spectrograms are known. As these spectrograms are too large to be embedded in the mixtures, we show how they can be efficiently approximated using either Nonnegative Tensor Factorization NTF or image compression. A high-capacity embedding method is used by the system to inaudibly embed the separation side-information into the mixtures. This method is an application of the Quantization Index Modulation technique applied to the time-frequency coefficients of the mixtures and permits to reach embedding rates of about 250 kbps. Finally, a study of the performance of the full system is presented.

Keywords : NTF Audio source separation Wiener filtering Data embedding

Autor: Antoine Liutkus - Jonathan Pinel - Roland Badeau - Laurent Girin - Gaël Richard -



Documentos relacionados