no code implementations • 4 Apr 2023 • Kartik Bhatnagar, Sampath Lonka, Jammi Kunal, Mahabala Rao M G
In this work, we develop language models for the Sanskrit language, namely Bidirectional Encoder Representations from Transformers (BERT) and its variants: A Lite BERT (ALBERT), and Robustly Optimized BERT (RoBERTa) using Devanagari Sanskrit text corpus.