Search Results for author: Mikołaj Piórczyński

Found 1 papers, 0 papers with code

SADMoE: Exploiting Activation Sparsity with Dynamic-k Gating

no code implementations6 Oct 2023 Filip Szatkowski, Bartosz Wójcik, Mikołaj Piórczyński, Kamil Adamczewski

Transformer models, despite their impressive performance, often face practical limitations due to their high computational requirements.

Cannot find the paper you are looking for? You can Submit a new open access paper.