ApproBiVT: Lead ASR Models to Generalize Better Using Approximated Bias-Variance Tradeoff Guided Early Stopping and Checkpoint Averaging

no code implementations • 5 Aug 2023 • Fangyuan Wang, Ming Hao, Yuhai Shi, Bo Xu

The conventional recipe for Automatic Speech Recognition (ASR) models is to 1) train multiple checkpoints on a training set while relying on a validation set to prevent overfitting using early stopping and 2) average several last checkpoints or that of the lowest validation losses to obtain the final model.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1