Claude-User

Fetches made when a Claude user asks a question that needs your page.

What happens if you block it

Claude can't retrieve your content in response to user queries, which may reduce your visibility for user-directed search.

Our take

Leave it allowed if you want Claude to read your pages when users ask about them.

robots.txt

To block it:

User-agent: Claude-User
Disallow: /

To allow it explicitly (useful when a wider rule blocks other bots):

User-agent: Claude-User
Allow: /

The operator's own words

Disabling Claude-User on your site prevents our system from retrieving your content in response to a user query, which may reduce your site's visibility for user-directed web search.Anthropic documentation, checked 2026-10-31

robots.txt allows it, but is it really getting through?

A firewall or CDN rule can reject Claude-User even when robots.txt welcomes it, and nothing in your CMS shows it. Our check sends a live request as Claude-User alongside a normal browser and a Googlebot control, so a bot-verification rule isn't mistaken for a block.

Other Anthropic agents