Improved Training of Sparse Coding Variational Autoencoder via Weight Normalization

no code implementations • 23 Jan 2021 • Linxing Preston Jiang, Luciano de la Iglesia

We propose a few heuristics to improve the training of SVAE and show that a unit $L_2$ norm constraint on the decoder is critical to produce sparse coding filters.

Decoder