# Training crawlers

> Crawlers that gather web content to train AI models.

_6 of 31 · [all The AI Crawler Registry](/crawlers)_

- [ClaudeBot](/crawlers/claudebot) — Anthropic · training
- [GPTBot](/crawlers/gptbot) — OpenAI · training
- [Meta-ExternalAgent](/crawlers/meta-externalagent) — Meta · training
- [CCBot](/crawlers/ccbot) — Common Crawl · training
- [Bytespider](/crawlers/bytespider) — ByteDance · training
- [ICC-Crawler](/crawlers/icc-crawler) — NICT (National Institute of Information and Communications Technology) · training