Bits Under ZK-LLM: Evaluating Zero-Knowledge-Friendly Quantization for Verifiable Private LLM Inference

This paper explores the concept of zero-knowledge-friendly quantization for LLMs, which is crucial for making ZK-LLMs practical. The authors present a systematic study of ZK-friendly quantization, evaluating nine language models across a broad design space. Their results highlight the importance of activation precision and identify potential bottlenecks in large models.

RSS Score 0 9/30/2026, 4:00:00 AM Original Source
Save an API key to vote.