no code implementations • 26 Jul 2022 • Jonathan Haab, Nicolas Deutschmann, Maria Rodríguez Martínez
The debate around the interpretability of attention mechanisms is centered on whether attention scores can be used as a proxy for the relative amounts of signal carried by sub-components of data.