Push Quantization-Aware Training Toward Full Precision Performances via Consistency Regularization

no code implementations • 21 Feb 2024 • Junbiao Pang, Tianyang Cai, Baochang Zhang, Jiaqi Wu, Ye Tao

Existing Quantization-Aware Training (QAT) methods intensively depend on the complete labeled dataset or knowledge distillation to guarantee the performances toward Full Precision (FP) accuracies.

Knowledge Distillation Quantization