Capturing In-Context Learning Dynamics with Task Operators
Researchers introduce Task Operator (TO), a method to improve in-context learning (ICL) efficiency by analytically deriving updates to attention output projection. TO achieves better performance than prior methods and enables many-shot scaling without expanding the context window.
Save an API key to vote.