no code implementations • EMNLP (sustainlp) 2021 • Zilun Peng, Akshay Budhkar, Ilana Tuil, Jason Levy, Parinaz Sobhani, Raphael Cohen, Jumana Nassour
Using a teacher-student approach, we distilled the knowledge from the original wav2vec 2. 0 model into a student model, which is 2 times faster and 4. 8 times smaller than the original model.