GET /api/state-of-the-agentic-web · 21 metrics · updated 2026-06-15

State of the Agentic Web

How adopted is the agentic web, in numbers. Every figure is tagged cited (primary source) or our-measurement (with method); unconfirmed third-party figures are flagged for verification, never asserted as fact.

AI Crawler Traffic

  • 11.48 AI crawler traffic share — GPTBot % of observed AI-crawler requests 2026-05 · cited · measures /crawlers source: https://radar.cloudflare.com/bots
  • 10.25 AI crawler traffic share — Bytespider % of observed AI-crawler requests 2026-05 · cited · measures /crawlers source: https://radar.cloudflare.com/bots
  • 7.01 AI crawler traffic share — Applebot % of observed AI-crawler requests 2026-05 · cited · measures /crawlers source: https://radar.cloudflare.com/bots
  • 2.22 AI crawler traffic share — Claude-SearchBot % of observed AI-crawler requests 2026-05 · cited · measures /crawlers source: https://radar.cloudflare.com/bots

Standard Adoption

  • 3.8M+ Content Signals policy adoption domains carrying the policy 2025-09 · cited · measures /protocols source: https://blog.cloudflare.com/content-signals-policy/
  • ~3.9 Markdown content-negotiation adoption % of sites serving agents markdown 2026 · reported · verify at build · measures /agent-readiness source: https://— third-party estimate; confirm at build
  • ~0 llms.txt adoption among top sites % of top sites with a valid llms.txt 2026 · reported · verify at build · measures /agent-readiness source: https://— third-party estimate; confirm at build
  • 143 Agentic-web reference coverage (this Almanac) records (31 crawlers · 28 protocols · 30 models · 54 terms) 2026-06 · our measurement · measures / source: direct count of data/almanac/*.json on 2026-06-15

Protocol Maturity

  • 2025-12-09 Agentic AI Foundation formed (neutral governance) formation date; 8 platinum members 2025-12 · cited · measures /protocols source: https://www.linuxfoundation.org/press/linux-foundation-announces-the-formation-of-the-agentic-ai-foundation
  • 2025-11-25 MCP current spec revision spec date (JSON-RPC 2.0) 2025-11 · cited · measures /protocols source: https://modelcontextprotocol.io/specification/2025-11-25
  • v1.0 A2A reaches first stable spec stable specification 2026 · cited · measures /protocols source: https://www.linuxfoundation.org/press/a2a-protocol-surpasses-150-organizations-lands-in-major-cloud-platforms-and-sees-enterprise-production-use-in-first-year
  • 2025-09-10 RSL (Really Simple Licensing) launched launch date 2025-09 · cited · measures /protocols source: https://rslstandard.org/press/rsl-standard
  • 2026-06-15 WebMCP W3C Community Group draft draft date (navigator.modelContext) 2026-06 · cited · measures /protocols source: https://webmachinelearning.github.io/webmcp/
  • Draft ERC-8004 (trustless agents) status EIP status; created 2025-08-13 2025-08 · cited · measures /protocols source: https://eips.ethereum.org/EIPS/eip-8004
  • 2025-09-16 AP2 (Agent Payments Protocol) announced launch date; 60+ partners 2025-09 · cited · measures /protocols source: https://cloud.google.com/blog/products/ai-machine-learning/announcing-agents-to-payments-ap2-protocol
  • 2025-10-14 Visa Trusted Agent Protocol introduced launch date; 12 launch partners 2025-10 · cited · measures /protocols source: https://investor.visa.com/news/news-details/2025/Visa-Introduces-Trusted-Agent-Protocol-An-Ecosystem-Led-Framework-for-AI-Commerce/default.aspx
  • 2026-03-18 Machine Payments Protocol announced (Stripe + Tempo) announcement date 2026-03 · cited · measures /protocols source: https://stripe.com/blog/machine-payments-protocol
  • 165M+ x402 settled transaction volume cumulative agent transactions (~69k agents, Apr 2026) 2026-04 · reported · verify at build · measures /commerce source: https://www.coinbase.com/developer-platform/discover/launches/x402 — verify primary at build (Chainalysis primary supports only ~100M+ through Q1 2026)

Frontier Model Trends

  • 1M Frontier models at 1M-token context advertised context window 2026-06 · cited · measures /models source: https://platform.claude.com/docs/en/about-claude/models/overview
  • 2026-06-09 Claude Fable 5 released release date; 1M context, $10/$50 per Mtok 2026-06 · cited · measures /models source: https://platform.claude.com/docs/en/about-claude/models/introducing-claude-fable-5-and-claude-mythos-5
  • 30 Tool-calling frontier models in this matrix API-accessible, tool-calling models tracked 2026-06 · our measurement · measures /models source: direct count of data/almanac/models.json (selection gate: API-accessible AND tool-calling)