Search Results for author: Davide Paglieri

Found 2 papers, 0 papers with code

Outliers and Calibration Sets have Diminishing Effect on Quantization of Modern LLMs

no code implementations31 May 2024 Davide Paglieri, Saurabh Dash, Tim Rocktäschel, Jack Parker-Holder

The older OPT model, which much of the quantization literature is based on, shows significant performance deterioration and high susceptibility to outliers with varying calibration sets.

Cannot find the paper you are looking for? You can Submit a new open access paper.