Pretraining the Vision Transformer using self-supervised methods for vision based Deep Reinforcement Learning

1 code implementation • 22 Sep 2022 • Manuel Goulão, Arlindo L. Oliveira

With this work, we hope to provide some insights into the representations learned by ViT during a self-supervised pretraining with observations from RL environments and which properties arise in the representations that lead to the best-performing agents.

Atari Games Atari Games 100k +3