Texts
Edit

OSCAR

Introduced by Suárez et al. in A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages

OSCAR or Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture. The dataset used for training multilingual models such as BART incorporates 138 GB of text.

Homepage

Papers

Paper Code Results Date Stars

Dataset Loaders
Add Remove

Tasks

Similar Datasets

ParaShoot

ParaShoot
CoNLL 2017 Shared Task - Automatically Annotated Raw Texts and Word Embeddings

CoNLL 2017 Shared Task - Automatically Annotated Raw Texts and Word Embeddings
IndicGLUE

IndicGLUE
mC4

mC4

License

Modalities

Languages

Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy