AI training crawler

Meta-ExternalAgent

Meta-ExternalAgent is a Meta crawler. Meta says it crawls the web for uses such as training foundation AI models or improving products by indexing content directly.

Sources: Meta's own documentation and the Sill agent registry · checked 15 Nov 2026

Company
Meta
Acts for
Meta, for AI training and indexing
Follows robots.txt
Yes
How to verify
No method published

robots.txt

Meta instructs site owners to add a robots.txt disallow for the relevant crawler to block it, with no caveat for this one.

User-agent: meta-externalagent
Allow: /

How to check it is really Meta-ExternalAgent

Meta does not publish a way to verify Meta-ExternalAgent. Treat the user agent alone as a claim, not proof.

How verification works →

Sill Agent Intelligence

What it does on websites

Live field data · through 8 Nov 2026 · refreshed weekly

Reach
Across the Sill network
First observed
October 2026
Status
Active now

Source: Sill Agent Intelligence, built from verified agent traffic across the Sill network. Figures are aggregated and anonymised; no website is ever identified.

Other Meta agents

Read more on Signals

Questions about Meta-ExternalAgent

Should I block Meta-ExternalAgent?

Block it if you do not want your content used to train Meta's AI models or indexed by Meta. Meta says a robots.txt disallow is how to do it.

Can I verify it by IP address?

Meta's crawler page does not publish IP ranges or a verification method for it, so we cannot point you to an official check.

Sources

  1. Meta: Web crawlers · checked 15 Nov 2026

Official documentation: https://developers.facebook.com/documentation/sharing/webmasters/web-crawlers · Spotted an error? Tell us

See which AI agents visit your site, and decide what they may do.

Scan your site free