Policy/shipped/2026-10-30

OpenAI adopts Robots.txt standard for websites to manage AI training data preferences

OpenAI has announced it will begin honoring a common Robots.txt signal, enabling website operators to communicate their preferences regarding the use of their content for AI model training. This policy implementation, confirmed by OpenAI itself, aims to provide website owners with greater control over their data. The move was also reported by Unite.AI and TradingView, affirming the company's new approach to data sourcing.

3 articles from 3 outlets covered this story. The underlying claim is sourced from a shipped.

What do all outlets agree on?

3 outlets covered “OpenAI adopts Robots.txt standard for websites to manage AI training data preferences”. All of them report the following:

  • OpenAI is implementing a new policy
  • The policy allows websites to express preferences for AI training
  • The mechanism is a common or shared Robots.txt signal
  • This gives website operators control over their content's use in AI training

Which outlets covered this?

All 3 articles found on this story, grouped by the stance of the piece. Every link goes to the original publisher.

What related stories are there?

Which companies does this involve?

Get the week in AI in one email

What happened, which outlets reported it, and where their coverage differed. One issue a week.

The first issue hasn’t gone out yet. Subscribe and it’s the one you’ll get.

We’ll send the digest and nothing else. One-click unsubscribe. Privacy.