1 code implementation • 11 Sep 2023 • Thibault Douzon, Stefan Duffner, Christophe Garcia, Jérémy Espinas
They are based on efficient implementations of Transformers for long sequences.
1 code implementation • 11 Sep 2023 • Thibault Douzon, Stefan Duffner, Christophe Garcia, Jérémy Espinas
These tasks force the model to learn better-contextualized representations of the scanned documents.