no code implementations • 1 Apr 2024 • Achintya Kundu, Fabian Lim, Aaron Chew, Laura Wynter, Penny Chong, Rhui Dih Lee
Supernet training of LLMs is of great interest in industrial applications as it confers the ability to produce a palette of smaller models at constant cost, regardless of the number of models (of different size / latency) produced.
1 code implementation • 14 Oct 2021 • Fabian Lim, Laura Wynter, Shiau Hong Lim
Optimal transport is a framework for comparing measures whereby a cost is incurred for transporting one measure to another.