79% of top news sites block at least one AI training bot, while 71% also block retrieval bots used for live AI search citations. Google-Extended is the least-blocked training bot at 46%, with US ...
“The Atlantic has built a scorecard for Al crawlers, identifying which bots actually send readers back and which just strip content. Only those with value get through. This approach led it to block a ...