Risk-Controlled Selective LLM Answering by Pricing Label-Free Checks
PriceCheck is a new method for controlling the risk of serving answers from a large language model by selecting which checks to run and when to stop. It uses a compact family of decision rules built from label-free checks and prices them to guide the selection process. Experiments show that PriceCheck outperforms other methods in terms of serving answers and keeping selective risk low.
Save an API key to vote.