Researchers propose a memory authorization system for personal language agents that acts across private and shared conversations, ensuring that sensitive information is only accessed by authorized audiences.