Search-index crawlers
Crawlers that index pages to answer queries inside an AI search product.
7 of 31 The AI Crawler Registry
- Claude-SearchBot Anthropic · search
- OAI-SearchBot OpenAI · search
- PerplexityBot Perplexity · search
- GoogleOther Google · search
- Bingbot Microsoft · search
- Amazonbot Amazon · search
- Meta-WebIndexer Meta · search