# Crawler verification

> A user-agent string is trivially spoofed. Confirm a crawler is genuine by its published IP ranges, reverse DNS, or a Web Bot Auth signature.

_31 of 31 · [all The AI Crawler Registry](/crawlers)_

- [ClaudeBot](/crawlers/claudebot) — Anthropic · training
- [Claude-User](/crawlers/claude-user) — Anthropic · inference
- [Claude-SearchBot](/crawlers/claude-searchbot) — Anthropic · search
- [GPTBot](/crawlers/gptbot) — OpenAI · training
- [OAI-SearchBot](/crawlers/oai-searchbot) — OpenAI · search
- [ChatGPT-User](/crawlers/chatgpt-user) — OpenAI · inference
- [PerplexityBot](/crawlers/perplexitybot) — Perplexity · search
- [Perplexity-User](/crawlers/perplexity-user) — Perplexity · inference
- [Google-Extended](/crawlers/google-extended) — Google · training
- [GoogleOther](/crawlers/googleother) — Google · search
- [Google-CloudVertexBot / Gemini agents](/crawlers/gemini-deep-research) — Google · inference
- [Bingbot](/crawlers/bingbot) — Microsoft · search
- [Amazonbot](/crawlers/amazonbot) — Amazon · search
- [Applebot-Extended](/crawlers/applebot-extended) — Apple · training
- [Meta-ExternalAgent](/crawlers/meta-externalagent) — Meta · training
- [CCBot](/crawlers/ccbot) — Common Crawl · training
- [Bytespider](/crawlers/bytespider) — ByteDance · training
- [DuckAssistBot](/crawlers/duckassistbot) — DuckDuckGo · inference
- [OAI-AdsBot](/crawlers/oai-adsbot) — OpenAI · ad-verification
- [Google-Agent](/crawlers/google-agent) — Google · inference
- [MistralAI-User](/crawlers/mistralai-user) — Mistral AI · inference
- [Diffbot](/crawlers/diffbot) — Diffbot · data-aggregation
- [Diffbot-User](/crawlers/diffbot-user) — Diffbot · inference
- [ImagesiftBot](/crawlers/imagesiftbot) — ImageSift (Hive) · data-aggregation
- [ICC-Crawler](/crawlers/icc-crawler) — NICT (National Institute of Information and Communications Technology) · training
- [cohere-ai](/crawlers/cohere-ai) — Cohere · inference
- [Meta-WebIndexer](/crawlers/meta-webindexer) — Meta · search
- [ChatGPT Atlas (agent mode)](/crawlers/chatgpt-atlas) — OpenAI · agentic-browsing
- [Perplexity Comet (assistant/agent)](/crawlers/perplexity-comet) — Perplexity · agentic-browsing
- [OpenAI Operator (Computer-Using Agent)](/crawlers/openai-operator) — OpenAI · agentic-browsing
- [Project Mariner](/crawlers/project-mariner) — Google · agentic-browsing