Glossary

What is a verified bot?

Definition

A verified bot is an automated visitor whose claimed identity has been checked and confirmed. Checks include reverse DNS lookups, matching against IP ranges the operator publishes, or a cryptographic signature on the request. A name in the User-Agent header alone is not verification.

Why it matters

Anyone can put "Googlebot" or "ChatGPT-User" in a User-Agent header. Verification is how you tell a real visit from a request that claims a name but fails the check. That matters when you decide who gets through your firewall, who you count in analytics and which agents may place orders.

How it works

There are three common methods.

  • Reverse DNS. You look up the hostname for the visitor's IP, then look up that hostname's IP and confirm it matches. Google documents this for Googlebot.
  • Published IP lists. The operator publishes its address ranges, and you match the visitor against them. Google recommends this for large-scale checks.
  • Signed requests. The bot signs each request with a private key, and you check it against a public key the operator hosts. This is called Web Bot Auth.

Cloudflare keeps a list of verified bots. It says a bot qualifies by identifying itself reliably and by not behaving abusively, for example by obeying robots.txt and keeping request rates reasonable.

Example

A request arrives claiming to be Googlebot. You run a reverse lookup on its IP and get a hostname under googlebot.com. A forward lookup on that name returns the same IP. The request is verified. If the lookup fails, treat it as unverified and apply your normal rules. As agentic commerce grows, signed requests are likely to matter more for agents acting for shoppers.

Also called: verified crawler, authenticated bot

Sources

  1. Cloudflare: Verified bots · checked 15 Nov 2026
  2. Cloudflare: Web Bot Auth · checked 15 Nov 2026
  3. Google Search Central: Verifying Googlebot and other Google crawlers · checked 15 Nov 2026

The Sill Signals Team · Updated 15 Nov 2026

See which AI agents visit your site, and decide what they may do.

Scan your site free