A new access control mechanism, Locket, is proposed to prevent private data leakage in large language models (LLMs) by embedding fine-grained access control into LLM generation. Locket trains lightweight adapters with distinct access policies and a gating module to associate a learned keyed entry token with a specific adapter, ensuring compatibility with off-the-shelf LLMs and satisfying regulatory and privacy requirements.