# State of the Agentic Web

> Adoption data for the agentic web (2026): AI-crawler traffic shares, standard adoption, protocol maturity and model trends. Each figure is tagged cited (primary source) or our-measurement (with method); unconfirmed third-party figures are flagged for build-time verification, never asserted as fact.
> Updated 2026-06-15. JSON: /api/state-of-the-agentic-web

## AI Crawler Traffic

- **11.48 % of observed AI-crawler requests** — AI crawler traffic share — GPTBot (2026-05; _cited_; measures /crawlers). Source: https://radar.cloudflare.com/bots
- **10.25 % of observed AI-crawler requests** — AI crawler traffic share — Bytespider (2026-05; _cited_; measures /crawlers). Source: https://radar.cloudflare.com/bots
- **7.01 % of observed AI-crawler requests** — AI crawler traffic share — Applebot (2026-05; _cited_; measures /crawlers). Source: https://radar.cloudflare.com/bots
- **2.22 % of observed AI-crawler requests** — AI crawler traffic share — Claude-SearchBot (2026-05; _cited_; measures /crawlers). Source: https://radar.cloudflare.com/bots

## Standard Adoption

- **3.8M+ domains carrying the policy** — Content Signals policy adoption (2025-09; _cited_; measures /protocols). Source: https://blog.cloudflare.com/content-signals-policy/
- **~3.9 % of sites serving agents markdown** — Markdown content-negotiation adoption (2026; _reported — verify at build_; measures /agent-readiness). Source: https://— third-party estimate; confirm at build
- **~0 % of top sites with a valid llms.txt** — llms.txt adoption among top sites (2026; _reported — verify at build_; measures /agent-readiness). Source: https://— third-party estimate; confirm at build
- **143 records (31 crawlers · 28 protocols · 30 models · 54 terms)** — Agentic-web reference coverage (this Almanac) (2026-06; _our measurement_; measures /). Source: direct count of data/almanac/*.json on 2026-06-15

## Protocol Maturity

- **2025-12-09 formation date; 8 platinum members** — Agentic AI Foundation formed (neutral governance) (2025-12; _cited_; measures /protocols). Source: https://www.linuxfoundation.org/press/linux-foundation-announces-the-formation-of-the-agentic-ai-foundation
- **2025-11-25 spec date (JSON-RPC 2.0)** — MCP current spec revision (2025-11; _cited_; measures /protocols). Source: https://modelcontextprotocol.io/specification/2025-11-25
- **v1.0 stable specification** — A2A reaches first stable spec (2026; _cited_; measures /protocols). Source: https://www.linuxfoundation.org/press/a2a-protocol-surpasses-150-organizations-lands-in-major-cloud-platforms-and-sees-enterprise-production-use-in-first-year
- **2025-09-10 launch date** — RSL (Really Simple Licensing) launched (2025-09; _cited_; measures /protocols). Source: https://rslstandard.org/press/rsl-standard
- **2026-06-15 draft date (navigator.modelContext)** — WebMCP W3C Community Group draft (2026-06; _cited_; measures /protocols). Source: https://webmachinelearning.github.io/webmcp/
- **Draft EIP status; created 2025-08-13** — ERC-8004 (trustless agents) status (2025-08; _cited_; measures /protocols). Source: https://eips.ethereum.org/EIPS/eip-8004
- **2025-09-16 launch date; 60+ partners** — AP2 (Agent Payments Protocol) announced (2025-09; _cited_; measures /protocols). Source: https://cloud.google.com/blog/products/ai-machine-learning/announcing-agents-to-payments-ap2-protocol
- **2025-10-14 launch date; 12 launch partners** — Visa Trusted Agent Protocol introduced (2025-10; _cited_; measures /protocols). Source: https://investor.visa.com/news/news-details/2025/Visa-Introduces-Trusted-Agent-Protocol-An-Ecosystem-Led-Framework-for-AI-Commerce/default.aspx
- **2026-03-18 announcement date** — Machine Payments Protocol announced (Stripe + Tempo) (2026-03; _cited_; measures /protocols). Source: https://stripe.com/blog/machine-payments-protocol
- **165M+ cumulative agent transactions (~69k agents, Apr 2026)** — x402 settled transaction volume (2026-04; _reported — verify at build_; measures /commerce). Source: https://www.coinbase.com/developer-platform/discover/launches/x402 — verify primary at build (Chainalysis primary supports only ~100M+ through Q1 2026)

## Frontier Model Trends

- **1M advertised context window** — Frontier models at 1M-token context (2026-06; _cited_; measures /models). Source: https://platform.claude.com/docs/en/about-claude/models/overview
- **2026-06-09 release date; 1M context, $10/$50 per Mtok** — Claude Fable 5 released (2026-06; _cited_; measures /models). Source: https://platform.claude.com/docs/en/about-claude/models/introducing-claude-fable-5-and-claude-mythos-5
- **30 API-accessible, tool-calling models tracked** — Tool-calling frontier models in this matrix (2026-06; _our measurement_; measures /models). Source: direct count of data/almanac/models.json (selection gate: API-accessible AND tool-calling)