1 code implementation • 4 Jun 2021 • Thorben Frank, Stefan Chmiela
Attention mechanisms are developing into a viable alternative to convolutional layers as elementary building block of NNs.