no code implementations • 28 Oct 2023 • Saad Qadeer, Andrew Engel, Amanda Howard, Adam Tsou, Max Vargas, Panos Stinis, Tony Chiang
For the regression problem of smooth functions and logistic regression classification, we show that the CK performance is only marginally worse than that of the NTK and, in certain cases, is shown to be superior.
no code implementations • 21 Oct 2023 • Andy Lin, Cameron Torres, Errett C. Hobbs, Jaydeep Bardhan, Stephen B. Aley, Charles T. Spencer, Karen L. Taylor, Tony Chiang
Enumerated threat agent lists have long driven biodefense priorities.
no code implementations • 20 Oct 2023 • Max Vargas, Adam Tsou, Andrew Engel, Tony Chiang
Sampling biases can cause distribution shifts between train and test datasets for supervised learning tasks, obscuring our ability to understand the generalization capacity of a model.
no code implementations • 1 Oct 2023 • Sinjini Banerjee, Reilly Cannon, Tim Marrinan, Tony Chiang, Anand D. Sarwate
Training a deep neural network (DNN) often involves stochastic optimization, which means each run will produce a different model.
no code implementations • 27 Sep 2023 • Amit Harlev, Andrew Engel, Panos Stinis, Tony Chiang
Understanding feature representation for deep neural networks (DNNs) remains an open question within the general field of explainable AI.
no code implementations • 26 May 2023 • Eric Silk, Swarnita Chakraborty, Nairanjana Dasgupta, Anand D. Sarwate, Andrew Lumsdaine, Tony Chiang
Training deep neural networks (DNNs) used in modern machine learning is computationally expensive.
1 code implementation • 23 May 2023 • Andrew Engel, Zhichao Wang, Natalie S. Frank, Ioana Dumitriu, Sutanay Choudhury, Anand Sarwate, Tony Chiang
A second trend has been to utilize kernel functions in various explain-by-example or data attribution tasks.
no code implementations • 24 May 2022 • Andrew Engel, Zhichao Wang, Anand D. Sarwate, Sutanay Choudhury, Tony Chiang
We introduce torchNTK, a python library to calculate the empirical neural tangent kernel (NTK) of neural network models in the PyTorch framework.