meta-externalfetcher
Meta · inference. Fetches individual links at a user's request to support Meta AI task completion. It is user-triggered, not bulk crawling.
- name
- meta-externalfetcher
- operator
- Meta
- purpose
- inference
- ua_substring
- meta-externalfetcher
- robots_token
- meta-externalfetcher
- respects_robots
- yes
- verify
- Meta documents its crawlers and honors robots.txt; match the UA and a Meta-owned IP (see documentation_url).
- notes
- Fetches individual links at a user's request to support Meta AI task completion. It is user-triggered, not bulk crawling.
- canonical_name
- meta-externalfetcher
- user_agent_token
- meta-externalfetcher
- ua_full
- — verify-against-primary-at-build ↗ https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
- bot_type
- user-action-fetcher
- bot_type_extension
- —
- opt_out_mechanism
- robots.txt disallow (User-agent: meta-externalfetcher)
- published_ip_range_url
- — verify-against-primary-at-build ↗ https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
- asn
- — verify-against-primary-at-build ↗ https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
- reverse_dns_suffix
- — verify-against-primary-at-build ↗ https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
- supports_web_bot_auth
- — verify-against-primary-at-build ↗ https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
- signature_agent_domain
- — verify-against-primary-at-build ↗ https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
- jwks_url
- — verify-against-primary-at-build ↗ https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
- verification_methods
user-agent-string- crawl_traffic_share
- — verify-against-primary-at-build ↗ https://radar.cloudflare.com/bots
- targeted_content_type
- HTML, text
- documentation_url
- https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
- first_seen_date
- — verify-against-primary-at-build ↗ https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/
- last_verified_date
- 2026-07-06
- block_vs_allow_recommendation
- conditional — user-triggered fetch for Meta AI; allow so Meta AI users can reach your pages.
- citation_referral_value
- medium (surfaces in user-facing Meta AI answers)
- cloudflare_verified_category
- — verify-against-primary-at-build ↗ https://radar.cloudflare.com/bots
- status
- active
- triples
["meta-externalfetcher","operated_by","Meta"]["meta-externalfetcher","has_bot_type","user-action-fetcher"]["meta-externalfetcher","verified_via","user-agent-string"]- attribute_sources
{"claims":["user_agent_token","robots_token"],"source":"https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/","last_verified":"2026-07-06"}{"claims":["operator","purpose","documentation_url","respects_robots"],"source":"https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/","last_verified":"2026-07-06"}
last verified · by Özden Erdinc