Support for the shared robots.txt AI training preference signal
OpenAI says it will honor a shared robots.txt signal that lets websites state their AI training preferences to several providers at once.
Website operators have had to name each provider's crawler and keep separate rules for each. The shared signal, drawn from the IETF AI Preferences working group's work, lets them state one preference for all participating providers. OpenAI aims to implement it in the coming months, and its existing crawler controls in robots.txt continue to apply.
- Date
- Friday 30 October 2026
- Lab
- OpenAI
- Kind
- feature
- Access
- open standard
Announcement of intent; OpenAI will share implementation details later, and the signal is a voluntary IETF draft (draft-kelley-aipref-training-preference-signal).
Sources
This record was partly confirmed: some claims could not be checked on 30 October 2026. How we check