Direct Optimization of the dictionary learning problemReportar como inadecuado

Direct Optimization of the dictionary learning problem - Descarga este documento en PDF. Documentación en PDF para descargar gratis. Disponible también para leer online.

1 LITIS - Laboratoire d-Informatique, de Traitement de l-Information et des Systèmes

Abstract : A novel way of solving the dictionary learning problem is proposed in this paper. It is based on a so-called direct optimization as it avoids the usual technique which consists in alternatively optimizing the coefficients of a sparse decomposition and in optimizing dictionary atoms. The algorithm we advocate simply performs a joint proximal gradient descent step over the dictionary atoms and the coefficient matrix. After having derived the algorithm, we also provided in-depth discussions on how the stepsizes of the proximal gradient descent have been chosen. In addition, we uncover the connection between our direct approach and the alternating optimization method for dictionary learning. We have shown that it can be applied to a broader class of non-convex optimization problems than the dictionary learning one. As such, we have denoted the algorithm as a one-step blockcoordinate proximal gradient descent. The main advantage of our novel algorithm is that, as suggested by our simulation study, it is more efficient than alternating optimization algorithms.

Keywords : dictionary learning non convex proximal

Autor: Alain Rakotomamonjy -



Documentos relacionados