Generative Models
k-Sparse Autoencoder
Introduced by Makhzani et al. in k-Sparse Autoencodersk-Sparse Autoencoders are autoencoders with linear activation function, where in hidden layers only the $k$ highest activities are kept. This achieves exact sparsity in the hidden representation. Backpropagation only goes through the the top $k$ activated units. This can be achieved with a ReLU layer with an adjustable threshold.
Source: k-Sparse Autoencoders
Papers
| Paper | Code | Results | Date | Stars |
|---|
ReLU
