ClaudeBot
Anthropic's training crawler. It collects public web content that may be used to train Claude models.
What happens if you block it
Your site's future content is excluded from Anthropic's model training datasets.
Our take
Block it to opt out of Anthropic training. Claude's search and user fetches use separate agents.
robots.txt
To block it:
User-agent: ClaudeBot Disallow: /
To allow it explicitly (useful when a wider rule blocks other bots):
User-agent: ClaudeBot Allow: /
The operator's own words
When a site restricts ClaudeBot access, it signals that the site's future materials should be excluded from our AI model training datasets.Anthropic documentation, checked 2026-10-31
Other Anthropic agents
Claude-SearchBot
Anthropic
Anthropic's search crawler.
Claude-User
Anthropic
Fetches made when a Claude user asks a question that needs your page.
Can ClaudeBot reach your site?
Free, no sign-up. We request your homepage as 13 different clients and show what each one gets.