Publishers who want to keep their work out of AI training currently have to block each company’s crawler separately. On 30 October, OpenAI, Google, Microsoft and Anthropic pledged to honour a single, standardised instruction instead, according to AFP reporting carried by The Hindu. [1]
The rollout is uneven. Microsoft says it will apply the signal from 1 February 2027 and Google “sometime in 2027”; OpenAI says “in the coming months”, while Anthropic says it has “already started”. Meta’s spokesperson expressed support on X but did not commit to a date in the report. [1]
The limits matter as much as the promise. Microsoft’s description says the setting covers only future model training, does not stop crawling, and leaves scraping allowed by default until a publisher changes it. Microsoft and Google also warn that opting out could make a publisher’s content less likely to surface in their AI products. [1]
The same story reached Brazilian readers through Núcleo, a reminder that the trade-off is not confined to large English-language outlets. [2] Our reading: a common signal lowers the technical burden, but it keeps the default on the AI companies’ side and links opting out to lower visibility. Whether it changes publisher bargaining power depends on adoption and on court cases such as The New York Times’ suit against OpenAI and Microsoft, which remains unresolved. [1]