Understanding the Effect of Model Compression on Social Bias in Large Language Models

1 code implementation • 9 Dec 2023 • Gustavo Gonçalves, Emma Strubell

Large Language Models (LLMs) trained with self-supervision on vast corpora of web text fit to the social biases of that text.

Knowledge Distillation Model Compression +1