OpenAI, Google, Microsoft, and Anthropic to support new standard for opting out of AI training
Four major AI companies have announced support for a new "policy token" standard in robots.txt, letting publishers use a single signal to prohibit AI training on their content across all participating companies at once.
Operators of websites, blogs, or personal pages will be able to use a single entry in robots.txt to refuse the use of their content for training models from these four companies, instead of setting preferences separately for each one.