# Agentic Web Adoption Report — what Cloudflare's network data shows

> A sourced snapshot of AI-crawler adoption from Cloudflare's public network analyses (2024-2025). Every figure is cited, not estimated.

## The crawl-to-click gap (crawls per referral, Jul 2025)

| AI company | Crawls per referral | Change since Jan 2025 |
|---|---|---|
| Anthropic | 38,065 : 1 | down 86.7% (from 286,930 : 1) |
| OpenAI | 1,091 : 1 | down 10.4% |
| Perplexity | 195 : 1 | up 256.7% |
| Microsoft | 41 : 1 | up 5.7% |

Source: Cloudflare, "The crawl-to-click gap" (https://blog.cloudflare.com/crawlers-click-ai-bots-training/), data Jan–Jul 2025.

## Who is crawling (share, Jul 2024 -> Jul 2025)

- GPTBot (OpenAI): 4.7% -> 11.7%
- ClaudeBot (Anthropic): 6% -> 9.9%
- Amazonbot: 10.2% -> 5.9%
- Bytespider (ByteDance): 14.1% -> 2.4%

Source: Cloudflare, "The crawl-to-click gap" (https://blog.cloudflare.com/crawlers-click-ai-bots-training/).

## Why they crawl

Training now drives nearly 80% of AI-bot crawling (up from 72% a year earlier); user-action and undeclared purposes together are under 5%.
Source: Cloudflare, "AI crawler traffic by purpose and industry" (https://blog.cloudflare.com/ai-crawler-traffic-by-purpose-and-industry/), 2025.

## By industry

News & Publications (early Aug 2025): GPTBot 17.4%, ChatGPT-User 14.9% of AI-bot traffic.
Source: Cloudflare, "AI crawler traffic by purpose and industry" (https://blog.cloudflare.com/ai-crawler-traffic-by-purpose-and-industry/).

## How to read this

Cloudflare's published network figures for 2024–2025 — a snapshot, not a live feed. Treat the direction (training up, crawl-to-click lopsided, GPTBot rising) as durable; exact decimals are as of their stated period. Our own reference-coverage measurement is at /state-of-the-agentic-web.

Compiled from primary Cloudflare sources. See also /state-of-the-agentic-web and /access-economics.