The Devil Is in the Reconstruction Loss Scale: Rethinking Optimization in LLM Quantization
Researchers propose an alternative reconstruction loss function (RMSE) to improve post-training quantization of large language models (LLMs) by decoupling optimization strength from the reconstruction loss scale.
Save an API key to vote.