ORACLE is a concurrency-aware online routing mechanism that improves accuracy and throughput for large language models in heterogeneous workloads. It dynamically assigns a task-appropriate verifier and reduces verifier latency using a delayed feedback strategy.