Audio Token Attention Is Predictable Before the Language Model Runs
Researchers propose a method called Triage that can predict and prune audio tokens in large audio language models (LALMs) before the language model runs, achieving significant compression and improving performance.
Save an API key to vote.