Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs
A new method, HeteroFold, allows for efficient cross-family key-value (KV) cache transfer between heterogeneous multi-agent large language models (LLMs) without requiring the receiver to prefilled shared context.
Save an API key to vote.