Researchers propose a method to improve AI alignment by training models with an explicitly defined set of principles, called a constitution. They develop "constitutional adapters" that can be used to mitigate misalignment and misuse in AI deployments.