no code implementations • 23 Jul 2023 • Tangjun Wang, Wenqi Tao, Chenglong Bao, Zuoqiang Shi
Based on the convection-diffusion equation, we design a new training method for ResNets.
no code implementations • 29 Sep 2021 • Wenqi Tao, Zuoqiang Shi
To show the effectiveness for general form of PDEs, we show that several effective networks can be interpreted by our general form of PDEs and design a training method motivated by PDEs theory to train DNN models for better robustness and less chance of overfitting.
no code implementations • 1 Jan 2021 • Wenqi Tao, Huaming Ling, Zuoqiang Shi, Bao Wang
Empirically, we show that residual perturbation outperforms the state-of-the-art DP stochastic gradient descent (DPSGD) in both membership privacy protection and maintaining the DL models' utility.