Semi-tensor Product-based TensorDecomposition for Neural Network Compression

no code implementations • 30 Sep 2021 • Hengling Zhao, Yipeng Liu, Xiaolin Huang, Ce Zhu

Tucker decomposition, Tensor Train (TT) and Tensor Ring (TR) are common decomposition for low rank compression of deep neural networks.

Low-rank compression Neural Network Compression +1