# Known Agents reviewed: AI-agent analytics and robots.txt, formerly Dark Visitors

> Known Agents (formerly Dark Visitors) tracks AI agent and bot traffic to your site in real time, generates a continuously-updated robots.txt to block misbehaving scrapers, and offers an agent-identification API plus a public agent directory.

## What Known Agents does

Known Agents (formerly Dark Visitors) gives site owners three capabilities: real-time analytics of AI agent/bot traffic, automatic (continuously-updated) robots.txt generation, and an agent-identification API for authenticating/controlling specific agents. It also runs a public agent directory and monitors AI shopping activity on product pages.

## Where it fits

A crawler-analytics tool: which bots fetch my pages, allow or block? Its catalogue overlaps /crawlers; its identification work is what /crawlers/verification and /protocols/web-bot-auth address.

## Our take

The specialist for identifying and gating individual crawlers; its live agent directory helps when writing robots.txt. It measures and lists traffic — it does not certify agent-readiness. Know who visits, then use /agent-readiness to decide what to expose.