reverse DNS
Verifying AI bots by IP range and reverse DNS: a 2026 reference
Verify AI bots by IP range and reverse DNS: the official IP lists and DNS checks for OpenAI, Anthropic, Google, Perplexity, Bing, Apple, Amazon and more.
robots.txt control token
Applebot-Extended is a secondary user agent token that gives publishers control over how Apple uses their content. Apple says it does not crawl webpages itself.
Apple says it only determines how data already crawled by Applebot may be used; disallowing it opts content out of training Apple's general-purpose foundation models.
User-agent: Applebot-Extended Allow: /
Applebot-Extended is only a rule name in robots.txt. It never visits, so a request that claims to be Applebot-Extended is not genuine.
Applebot-Extended is a robots.txt rule, not a visitor, so there is no website activity to show.
reverse DNS
Verify AI bots by IP range and reverse DNS: the official IP lists and DNS checks for OpenAI, Anthropic, Google, Perplexity, Bing, Apple, Amazon and more.
robots.txt
A plain guide to robots.txt for AI agents: which training, search and user-initiated bots to allow or block, with a starter file for online stores.
Apple says pages that disallow it can still appear in search results and its rules are not used in Search ranking.
No. Apple says it does not crawl webpages, so a request claiming to be Applebot-Extended has failed verification.