Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling

no code implementations • 23 May 2024 • Shuaipeng Li, Penghao Zhao, Hailin Zhang, Xingwu Sun, Hao Wu, Dian Jiao, Weiyan Wang, Chengjun Liu, Zheng Fang, Jinbao Xue, Yangyu Tao, Bin Cui, Di Wang

First, we raise the scaling law between batch sizes and optimal learning rates in the sign of gradient case, in which we prove that the optimal learning rate first rises and then falls as the batch size increases.

HAL: Improved Text-Image Matching by Mitigating Visual Semantic Hubs

1 code implementation • 22 Nov 2019 • Fangyu Liu, Rongtian Ye, Xun Wang, Shuaipeng Li

The hubness problem widely exists in high-dimensional embedding space and is a fundamental source of error for cross-modal matching tasks.

3DCNN-DQN-RNN: A Deep Reinforcement Learning Framework for Semantic Parsing of Large-scale 3D Point Clouds

no code implementations • ICCV 2017 • Fangyu Liu, Shuaipeng Li, Liqiang Zhang, Chenghu Zhou, Rongtian Ye, Yuebin Wang, Jiwen Lu

Our method provides an automatic process that maps the raw data to the classification results.

Classification General Classification +4