DRelay: Global Draft Context for Prefix-Aware Parallel Speculative Decoding Repair
DRelay proposes a method for prefix-aware selective repair of candidate selections in parallel speculative decoding for large language models (LLMs), improving drafting efficiency and end-to-end decoding performance.
Save an API key to vote.