Major AI Companies Adopt Shared Robots.txt Protocol for Website Training Opt-Out
OpenAI announced its intention to honor a shared Robots.txt signal, allowing websites to express preferences regarding their content's use for AI training. This move aims to provide website operators with a standardized method to communicate their choices to AI providers. Multiple reports from third-party outlets indicate that other major AI companies, including Google, Microsoft, and Anthropic, are also backing this new protocol. While OpenAI's commitment is directly from the company, the broader industry support from other tech giants is reported by various news sources. This initiative establishes a common signal for data scraping preferences, though its full implementation and impact across the AI industry remain to be seen.
8 articles from 8 outlets covered this story. No difference in framing or figures was found between them. The underlying claim is sourced from a press release.
What do all outlets agree on?
8 outlets covered “Major AI Companies Adopt Shared Robots.txt Protocol for Website Training Opt-Out”. All of them report the following:
- OpenAI will honor a signal for AI training preferences
- The signal is related to Robots.txt
- It allows websites to opt out of AI training/scraping
- Google, Microsoft, and Anthropic are also backing this initiative
- The goal is a common/shared standard for AI training preferences
Did outlets disagree about this?
No. All 8 outlets covering “Major AI Companies Adopt Shared Robots.txt Protocol for Website Training Opt-Out” reported it the same way — no difference in framing or figures was found between them.
Which outlets covered this?
All 8 articles found on this story, grouped by the stance of the piece. Every link goes to the original publisher.