bedrockbot

Amazon · inference. Fetches web pages for Amazon Bedrock knowledge bases and web-data connectors at a customer's request; retrieval, not bulk training.

name
bedrockbot
operator
Amazon
purpose
inference
ua_substring
bedrockbot
robots_token
bedrockbot
respects_robots
yes
verify
Amazon honors robots.txt and documents Bedrock's web crawling; match the UA and an AWS-owned IP (see documentation_url).
notes
Fetches web pages for Amazon Bedrock knowledge bases and web-data connectors at a customer's request; retrieval, not bulk training.
canonical_name
bedrockbot
user_agent_token
bedrockbot
ua_full
— verify-against-primary-at-build ↗ https://docs.aws.amazon.com/bedrock/
bot_type
user-action-fetcher
bot_type_extension
opt_out_mechanism
robots.txt disallow (User-agent: bedrockbot)
published_ip_range_url
— verify-against-primary-at-build ↗ https://docs.aws.amazon.com/bedrock/
asn
— verify-against-primary-at-build ↗ https://docs.aws.amazon.com/bedrock/
reverse_dns_suffix
— verify-against-primary-at-build ↗ https://docs.aws.amazon.com/bedrock/
supports_web_bot_auth
— verify-against-primary-at-build ↗ https://docs.aws.amazon.com/bedrock/
signature_agent_domain
— verify-against-primary-at-build ↗ https://docs.aws.amazon.com/bedrock/
jwks_url
— verify-against-primary-at-build ↗ https://docs.aws.amazon.com/bedrock/
verification_methods
user-agent-string
crawl_traffic_share
— verify-against-primary-at-build ↗ https://radar.cloudflare.com/bots
targeted_content_type
HTML, text
documentation_url
https://docs.aws.amazon.com/bedrock/
first_seen_date
— verify-against-primary-at-build ↗ https://docs.aws.amazon.com/bedrock/
last_verified_date
2026-07-06
block_vs_allow_recommendation
conditional — retrieval for Bedrock knowledge bases a customer configures; allow if your content should be reachable there.
citation_referral_value
low (retrieval for a customer's knowledge base)
cloudflare_verified_category
— verify-against-primary-at-build ↗ https://radar.cloudflare.com/bots
status
active
triples
["bedrockbot","operated_by","Amazon"] ["bedrockbot","has_bot_type","user-action-fetcher"] ["bedrockbot","verified_via","user-agent-string"]
attribute_sources
{"claims":["user_agent_token","robots_token"],"source":"https://github.com/ai-robots-txt/ai.robots.txt","last_verified":"2026-07-06"} {"claims":["operator","purpose","documentation_url","respects_robots"],"source":"https://docs.aws.amazon.com/bedrock/","last_verified":"2026-07-06"}

last verified · by

← all The AI Crawler Registry · .md · JSON