Detecting Inconsistencies in Model Specifications with LLM-as-Verifier Reasoning
Researchers introduced VeriSpec, a novel approach to detect inconsistencies in model specifications using large language models as verifiers. VeriSpec extracts rules from the specification text, clusters related rules, and applies LLM-as-verifier reasoning to identify inconsistencies. The approach achieved high precision and efficiency in detecting defects in the OpenAI Model Spec, outperforming several baselines.
Save an API key to vote.