no code implementations • 18 Jul 2023 • Shibo Yao, Dantong Yu, Ioannis Koutis
In this paper, we identify the close connection between matrix spectrum learning and neural network training for dense and convolutional layers and argue that weight pruning is essentially a matrix sparsification process to preserve the spectrum.
no code implementations • 7 Apr 2023 • Shibo Yao
In such cases, one seeks to fuse side information from a separate domain to mitigate the gap between good representation learning and the scarce knowledge in the domain of interest.
1 code implementation • 21 May 2019 • Shibo Yao, Dantong Yu, Keli Xiao
We present a novel method named Latent Semantic Imputation (LSI) to transfer external knowledge into semantic space for enhancing word embedding.