Search Results for author:
Found 2 papers, 1 papers with code
Position Prediction as an Effective Pretraining Strategy
This pretraining strategy which has been used in BERT models in NLP, Wav2Vec models in Speech and, recently, in MAE models in Vision, forces the model to learn about relationships between the content in different parts of the input using autoencoding related objectives.
Speech Emotion: Investigating Model Representations, Multi-Task Learning and Knowledge Distillation
We investigate the use of pre-trained model representations to improve valence estimation from acoustic speech signal.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
