# Claude-SearchBot

> Anthropic · search

_The AI Crawler Registry · /crawlers/claude-searchbot · [JSON](/api/crawlers/claude-searchbot) · [all The AI Crawler Registry](/crawlers)_

- **name:** Claude-SearchBot
- **operator:** Anthropic
- **purpose:** search
- **ua_substring:** Claude-SearchBot
- **robots_token:** Claude-SearchBot
- **respects_robots:** yes
- **verify:** reverse DNS to an Anthropic host
- **notes:** Indexes pages to power Claude's search results.
- **canonical_name:** Claude-SearchBot
- **user_agent_token:** Claude-SearchBot
- **ua_full:** — (verify-against-primary-at-build)
- **bot_type:** search-index
- **bot_type_extension:** —
- **opt_out_mechanism:** robots.txt disallow (User-agent: Claude-SearchBot)
- **published_ip_range_url:** https://claude.com/crawling/bots.json
- **asn:** — (verify-against-primary-at-build)
- **reverse_dns_suffix:** — (verify-against-primary-at-build)
- **supports_web_bot_auth:** — (verify-against-primary-at-build)
- **signature_agent_domain:** — (verify-against-primary-at-build)
- **jwks_url:** — (verify-against-primary-at-build)
- **verification_methods:** published-IP-range, reverse-DNS
- **crawl_traffic_share:** 2.22% (source: https://radar.cloudflare.com/bots)
- **targeted_content_type:** HTML, text
- **documentation_url:** https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- **first_seen_date:** — (verify-against-primary-at-build)
- **last_verified_date:** 2026-06-15
- **block_vs_allow_recommendation:** allow — search-index crawler that can cite and link your pages in Claude search; blocking forfeits that visibility.
- **citation_referral_value:** high (powers Claude search results; cites and links sources)
- **cloudflare_verified_category:** — (verify-against-primary-at-build)
- **status:** active
- **triples:** ["Claude-SearchBot","operated_by","Anthropic"], ["Claude-SearchBot","has_bot_type","search-index"], ["Claude-SearchBot","verified_via","published-IP-range"], ["Claude-SearchBot","has_crawl_share","2.22% (Radar 2026-05)"]
- **attribute_sources:** {"claims":["user_agent_token","robots_token","published_ip_range_url","documentation_url","respects_robots"],"source":"https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler","last_verified":"2026-06-15"}, {"claims":["crawl_traffic_share"],"source":"https://radar.cloudflare.com/bots","last_verified":"2026-06-15"}