Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought

no code implementations • 6 Feb 2024 • Alex Havrilla, Maia Iyer

We then evaluate the test performance of pretrained models both prompted and fine-tuned on noised datasets with varying levels of dataset contamination and intensity.