User-triggered fetchers
Agents that fetch a page in real time because a user asked — not bulk crawling.
10 of 31 The AI Crawler Registry
- Claude-User Anthropic · inference
- ChatGPT-User OpenAI · inference
- Perplexity-User Perplexity · inference
- Google-CloudVertexBot / Gemini agents Google · inference
- DuckAssistBot DuckDuckGo · inference
- OAI-AdsBot OpenAI · ad-verification
- Google-Agent Google · inference
- MistralAI-User Mistral AI · inference
- Diffbot-User Diffbot · inference
- cohere-ai Cohere · inference