Search Results for author: Marelie H. Davel

Found 9 papers, 0 papers with code

Input margins can predict generalization too

no code implementations29 Aug 2023 Coenraad Mouton, Marthinus W. Theunissen, Marelie H. Davel

While margins have been shown to be correlated with the generalization ability of a model when measured at its hidden representations (hidden margins), no such link between large margins and generalization has been established for input margins.

Exploring layerwise decision making in DNNs

no code implementations1 Feb 2022 Coenraad Mouton, Marelie H. Davel

While deep neural networks (DNNs) have become a standard architecture for many machine learning tasks, their internal decision-making process and general interpretability is still poorly understood.

Decision Making

Tracking translation invariance in CNNs

no code implementations13 Apr 2021 Johannes C. Myburgh, Coenraad Mouton, Marelie H. Davel

Our main focus is to investigate the effect of different architectural components of a standard CNN on that network's sensitivity to translation.

Translation

Stride and Translation Invariance in CNNs

no code implementations18 Mar 2021 Coenraad Mouton, Johannes C. Myburgh, Marelie H. Davel

We also observe that this characteristic is dataset-specific and dictates the relationship between pooling kernel size and stride required for translation invariance.

Data Augmentation Image Classification +1

Pre-interpolation loss behaviour in neural networks

no code implementations14 Mar 2021 Arthur E. W. Venter, Marthinus W. Theunissen, Marelie H. Davel

When training neural networks as classifiers, it is common to observe an increase in average test loss while still maintaining or improving the overall classification accuracy on the same dataset.

DNNs as Layers of Cooperating Classifiers

no code implementations17 Jan 2020 Marelie H. Davel, Marthinus W. Theunissen, Arnold M. Pretorius, Etienne Barnard

A robust theoretical framework that can describe and predict the generalization ability of deep neural networks (DNNs) in general circumstances remains elusive.

Classification General Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.