Search Results for author:
Found 2 papers, 2 papers with code
Yuan 2.0-M32: Mixture of Experts with Attention Router
Yuan 2. 0-M32, with a similar base architecture as Yuan-2. 0 2B, uses a mixture-of-experts architecture with 32 experts of which 2 experts are active.
Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learning
With this method, Yuan 1. 0, the current largest singleton language model with 245B parameters, achieves excellent performance on thousands GPUs during training, and the state-of-the-art results on NLP tasks.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
