Claude-User
Anthropic · inference
- name
- Claude-User
- operator
- Anthropic
- purpose
- inference
- ua_substring
- Claude-User
- robots_token
- Claude-User
- respects_robots
- yes
- verify
- reverse DNS to an Anthropic host
- notes
- Fetches a page in real time when a Claude user's prompt references it. User-initiated, not bulk crawling.
- canonical_name
- Claude-User
- user_agent_token
- Claude-User
- ua_full
- — verify-against-primary-at-build ↗ https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- bot_type
- user-action-fetcher
- bot_type_extension
- —
- opt_out_mechanism
- robots.txt disallow (User-agent: Claude-User)
- published_ip_range_url
- https://claude.com/crawling/bots.json
- asn
- — verify-against-primary-at-build ↗ https://claude.com/crawling/bots.json
- reverse_dns_suffix
- — verify-against-primary-at-build ↗ https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- supports_web_bot_auth
- — verify-against-primary-at-build ↗ https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- signature_agent_domain
- — verify-against-primary-at-build ↗ https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- jwks_url
- — verify-against-primary-at-build ↗ https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- verification_methods
published-IP-rangereverse-DNS- crawl_traffic_share
- — verify-against-primary-at-build ↗ https://radar.cloudflare.com/bots
- targeted_content_type
- HTML, text
- documentation_url
- https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- first_seen_date
- — verify-against-primary-at-build ↗ https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- last_verified_date
- 2026-06-15
- block_vs_allow_recommendation
- allow (default) — user-initiated fetch on behalf of a real Claude user; blocking degrades that user's experience without protecting against training.
- citation_referral_value
- medium (fetches in response to a user; can surface your page to that user)
- cloudflare_verified_category
- — verify-against-primary-at-build ↗ https://radar.cloudflare.com/bots/directory/claude-user
- status
- active
- triples
["Claude-User","operated_by","Anthropic"]["Claude-User","has_bot_type","user-action-fetcher"]["Claude-User","verified_via","published-IP-range"]["Claude-User","verified_via","reverse-DNS"]- attribute_sources
{"claims":["user_agent_token","robots_token","published_ip_range_url","documentation_url","respects_robots"],"source":"https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","last_verified":"2026-06-15"}