# Meta-ExternalAgent

> Meta · training

_The AI Crawler Registry · /crawlers/meta-externalagent · [JSON](/api/crawlers/meta-externalagent) · [all The AI Crawler Registry](/crawlers)_

- **name:** Meta-ExternalAgent
- **operator:** Meta
- **purpose:** training
- **ua_substring:** meta-externalagent
- **robots_token:** meta-externalagent
- **respects_robots:** yes
- **verify:** Meta publishes crawler IP ranges; confirm against those
- **notes:** Crawls content to train Meta's Llama models and AI products.
- **canonical_name:** Meta-ExternalAgent
- **user_agent_token:** meta-externalagent
- **ua_full:** — (verify-against-primary-at-build)
- **bot_type:** training
- **bot_type_extension:** —
- **opt_out_mechanism:** robots.txt disallow (User-agent: meta-externalagent)
- **published_ip_range_url:** — (verify-against-primary-at-build)
- **asn:** — (verify-against-primary-at-build)
- **reverse_dns_suffix:** — (verify-against-primary-at-build)
- **supports_web_bot_auth:** — (verify-against-primary-at-build)
- **signature_agent_domain:** — (verify-against-primary-at-build)
- **jwks_url:** — (verify-against-primary-at-build)
- **verification_methods:** user-agent-match
- **crawl_traffic_share:** — (verify-against-primary-at-build)
- **targeted_content_type:** HTML, text
- **documentation_url:** https://developers.facebook.com/docs/sharing/webmasters/crawler
- **first_seen_date:** — (verify-against-primary-at-build)
- **last_verified_date:** 2026-06-15
- **block_vs_allow_recommendation:** conditional — training crawler for Llama/Meta AI; allow to be represented, block via robots.txt to opt out. No authoritative IP file makes strict verification harder; rate-limit at the edge if needed.
- **citation_referral_value:** low (training; does not itself cite or refer)
- **cloudflare_verified_category:** — (verify-against-primary-at-build)
- **status:** active
- **triples:** ["Meta-ExternalAgent","operated_by","Meta"], ["Meta-ExternalAgent","has_bot_type","training"], ["Meta-ExternalAgent","verified_via","user-agent-match"]
- **attribute_sources:** {"claims":["robots_token","documentation_url","respects_robots"],"source":"https://developers.facebook.com/docs/sharing/webmasters/crawler","last_verified":"2026-06-15"}