ClaudeBot (Anthropic)
Model training
What it is
ClaudeBot is Anthropic’s crawler that collects web content which could contribute to training its generative AI models. Anthropic says that restricting ClaudeBot signals that your site’s future materials should be excluded from its AI training datasets. Claude search and user-requested fetches use separate bots: Claude-SearchBot and Claude-User.
Official documentation: support.claude.com · checked 13 Nov 2026
ClaudeBot user agent
Anthropic does not publish a full user agent string for ClaudeBot, only the token. Look for “ClaudeBot” in your logs and in robots.txt.
Official documentation: support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler · checked 13 Nov 2026
Block or allow ClaudeBot in robots.txt
Put these lines at the top of the robots.txt file in your site’s root (example.com/robots.txt). Each subdomain needs its own file.
User-agent: ClaudeBot
Disallow: /
User-agent: ClaudeBot
Allow: /
# repeat here the Disallow lines of your User-agent: * group
If ClaudeBot is not named in robots.txt, it already follows your User-agent: * rules, so you don’t need anything. A group of its own replaces the * group for this bot entirely: if you add one, repeat your general Disallow lines in it.
- Anthropic asks you to add the rule for every subdomain you want to opt out.
- Anthropic says blocking its IP addresses may not work as an opt-out, because it stops its bots from reading your robots.txt.
ClaudeBot IP ranges
Official list: 14 ranges · published by the owner 20 Oct 2026 · we checked it 13 Nov 2026
Anthropic publishes one list for all its bots — ClaudeBot, Claude-User and Claude-SearchBot.
Check an IP from your logs
Show all 14
- 34.152.124.140/32
- 34.153.21.190/32
- 34.162.27.34/32
- 34.162.86.102/32
- 34.162.90.102/32
- 34.162.111.78/32
- 34.162.153.71/32
- 34.162.191.81/32
- 34.162.230.222/32
- 34.162.244.71/32
- 34.186.252.4/32
- 136.79.143.251/32
- 136.83.20.215/32
- 216.73.216.0/22
Does it respect robots.txt and Crawl-delay?
robots.txt: yes, ClaudeBot follows it according to its owner.
“Anthropic’s Bots respect “do not crawl” signals by honoring industry standard directives in robots.txt.” — Anthropic documentation
Crawl-delay: supported for ClaudeBot.
“we support the non-standard Crawl-delay extension to robots.txt” — Anthropic documentation
Should you block ClaudeBot?
It is a legitimate choice. Blocking ClaudeBot opts your content out of this kind of use, and search and AI answers that rely on other bots are not affected. If you want your content used by AI models, leave it open.
Check your site
See whether your robots.txt and firewall let ClaudeBot in — together with every other AI bot in this directory. Free, no sign-up.
Other Anthropic bots
Questions
What is the ClaudeBot user agent string?+
Anthropic does not publish a full user agent string for ClaudeBot. Match the token “ClaudeBot” instead.
How do I block ClaudeBot in robots.txt?+
Add a group for it to robots.txt in your site’s root: “User-agent: ClaudeBot” followed by “Disallow: /”.
What IP addresses does ClaudeBot use?+
Anthropic publishes 14 ranges at https://claude.com/crawling/bots.json. Requests that call themselves ClaudeBot from other addresses are most likely fake.
Does ClaudeBot respect robots.txt?+
robots.txt: yes, ClaudeBot follows it according to its owner.