no code implementations • 4 Dec 2023 • Tianle Zhong, Jiechen Zhao, Xindi Guo, Qiang Su, Geoffrey Fox
However, loading shuffled data for large datasets incurs significant overhead in the deep learning pipeline and severely impacts the end-to-end training throughput.