Home / Fix guides / Shopify

Shopify and AI crawlers: robots.txt.liquid and what you can control

Updated 2026-11-01

Shopify gives you two layers of control over AI crawlers: the robots.txt file, which you can customize, and the network layer, which Shopify manages for you.

Selling through ChatGPT or Copilot? Shopify syndicates product data to agentic storefronts through Shopify Catalog, independently of robots.txt. Blocking crawlers affects only open-web discoverability, not those channels.

1. Customize robots.txt with robots.txt.liquid

  1. From your Shopify admin, go to Online Store.
  2. For your published theme, click ⋯ → Edit code.
  3. Click Add a new template, select robots, then Create template. This creates robots.txt.liquid containing Shopify's default rules.
  4. Add your own rule groups and keep the default ones, then save.

Shopify recommends adding directives with Liquid rather than replacing the template with plain text, so its default rules keep updating. A plain-text example of groups to add, which opts out of training while keeping AI search:

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

Shopify treats this as an unsupported customization: its support team can't help with edits, and it warns that incorrect use can result in loss of all traffic. Re-test after every change.

2. When the live request is blocked

Shopify handles bot management at the network layer for every store, and it doesn't recommend or support a proxy such as Cloudflare in front of Shopify. If robots.txt allows a crawler but our live request is blocked, remove any proxy you added, check apps that add bot protection or geo-blocking, and if it persists, raise it with Shopify using the report link.

3. Make product pages readable

Most AI crawlers don't run JavaScript. If the report shows little text without JavaScript, check that product titles, prices and descriptions are in the theme's HTML rather than injected by apps after the page loads.

Sources

Re-test your site

Free, no sign-up. We request your homepage as 13 different clients and show what each one gets.

Other guides: Cloudflare · CloudFront / AWS WAF · WordPress