no code implementations • 29 Aug 2023 • Coenraad Mouton, Marthinus W. Theunissen, Marelie H. Davel
While margins have been shown to be correlated with the generalization ability of a model when measured at its hidden representations (hidden margins), no such link between large margins and generalization has been established for input margins.
no code implementations • 14 Feb 2023 • Marthinus W. Theunissen, Coenraad Mouton, Marelie H. Davel
A global estimate of margin size is usually used in the literature.
no code implementations • 14 Mar 2021 • Arthur E. W. Venter, Marthinus W. Theunissen, Marelie H. Davel
When training neural networks as classifiers, it is common to observe an increase in average test loss while still maintaining or improving the overall classification accuracy on the same dataset.
no code implementations • 17 Jan 2020 • Marelie H. Davel, Marthinus W. Theunissen, Arnold M. Pretorius, Etienne Barnard
A robust theoretical framework that can describe and predict the generalization ability of deep neural networks (DNNs) in general circumstances remains elusive.