no code implementations • 13 Feb 2023 • Mimee Xu, Jiankai Sun, Xin Yang, Kevin Yao, Chong Wang
Without incurring the cost of re-training, and without degrading the model unnecessarily, we develop Unlearn-ALS by making a few key modifications to the fine-tuning procedure under Alternating Least Squares optimisation, thus applicable to any bi-linear models regardless of the training procedure.