1 code implementation • 1 May 2024 • Zefang Liu, Jiahua Luo
We introduce AdaMoLE, a novel method for fine-tuning large language models (LLMs) through an Adaptive Mixture of Low-Rank Adaptation (LoRA) Experts.
no code implementations • 17 Jul 2021 • Jiahua Luo, Chi-Man Wong, Chi-Man Vong
Sparse Bayesian Learning (SBL) constructs an extremely sparse probabilistic model with very competitive generalization.