UK supermarkets robots.txt records, read 10 November 2026.
Nine read through a web fetch tool, Ocado in Chrome. Full copies: Asda, Aldi, Morrisons, Lidl, Co-op (as returned by the fetch tool; Asda's header line breaks were inferred by the tool). Condensed records: Tesco, Sainsbury's, Waitrose, Iceland, Ocado.
Note: the fetch tool reported 'robots_disallowed' for https://www.ocado.com/robots.txt at about 09:40 UTC. The file read in Chrome at 09:41 UTC has no whole-site rule. Unexplained.

===== www.tesco.com/robots.txt =====
# CONDENSED RECORD, not a full copy. Full file: 35 non-blank lines (7 Sitemap, 1 User-agent, 26 Disallow, 1 Allow), counted in Chrome on 10 Nov 2026.
User-agent: *
Disallow: */userinteraction*
# (one real rule shown as an example; the rest are summarised in the next line)
# 26 Disallow rules and 1 Allow rule, all path or parameter patterns (e.g. Disallow: /shop/*-*/login?*). None is "/", "/*" or "*".

===== www.sainsburys.co.uk/robots.txt =====
# CONDENSED RECORD, not a full copy. As returned by the fetch tool on 10 Nov 2026: 1 User-agent line, 1 Sitemap line, Disallow rules only.
User-agent: *
Disallow: /shop/MyAccount
# (one real rule shown as an example; the rest are summarised in the next line)
# Disallow rules, all specific paths (e.g. Disallow: /shop/MyAccount, Disallow: /gol-ui/trolley). None is "/", "/*" or "*".

===== www.asda.com/robots.txt =====
# Last Updated Date : 28th Oct 2024
# This is an autogenerated file from asda-sitemap-generator
Sitemap: https://www.asda.com/sitemap-content-pages.xml

User-agent: *
Disallow: /clothing*
Disallow: /delivery-pass*
Disallow: /emails/*
Disallow: /account*
Disallow: /groceries*
Disallow: /registration*
Disallow: /terms*
Disallow: /privacy*
Disallow: /*onlineopinionV5
Disallow: /asda-estore*
Disallow: /reset-password*

===== www.aldi.co.uk/robots.txt =====
# For all robots
User-agent: *
Disallow: /results$
Disallow: /results?
Disallow: /*?page=
Disallow: /*&page=
Disallow: /*?utm_
Disallow: /*&utm_
Disallow: /*?cid=
Disallow: /*&cid=
Disallow: /*?bid=
Disallow: /*&bid=
Disallow: /tools/clp/*

# Sitemaps
Sitemap: https://www.aldi.co.uk/sitemap.xml
Sitemap: https://www.aldi.co.uk/sitemap_categories.xml
Sitemap: https://www.aldi.co.uk/sitemap_products.xml
Sitemap: https://www.aldi.co.uk/sitemap_stores.xml


# Block known low-value crawlers
User-agent: CazoodleBot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: dotbot
Disallow: /

User-agent: Gigabot
Disallow: /

User-Agent: GPTBot
Allow: /
User-Agent: ChatGPT-User
Allow: /
User-Agent: OAI-SearchBot
Allow: /
User-Agent: Google-Extended
Allow: /
User-Agent: Cohere-Ai
Allow: /
User-Agent: OmgiliBot
Allow: /
User-Agent: Omgili
Allow: /
User-Agent: Claude-Web
Allow: /
User-Agent: ClaudeBot
Allow: /
User-Agent: PerplexityBot
Allow: /
User-agent: CCBot
Allow: /
User-agent: anthropic-ai
Allow: /
User-agent: applebot-extended
Allow: /

===== www.morrisons.com/robots.txt =====
User-Agent: *
Allow: /
Disallow: /draft/
Disallow: /media-centre/christmas-2026

Sitemap: https://www.morrisons.com/sitemap.xml

===== www.lidl.co.uk/robots.txt =====
User-agent: *
Disallow: /q/search?id=*
Disallow: /cc.js*
Disallow: /1*
Disallow: /2*
Disallow: /3*
Disallow: /4*
Disallow: /5*
Disallow: /6*
Disallow: /7*
Disallow: /8*
Disallow: /9*
Disallow: /cdn/assets/cwv/

Sitemap: https://www.lidl.co.uk/static/sitemap.xml

===== www.coop.co.uk/robots.txt =====
User-agent: *
Allow: /
Disallow: /search?*
Disallow: /products/search?*
Disallow: /recipes/search?*
Disallow: /funeralcare/funeral-directors/*/email-us/
Disallow: /funeralcare/funeral-wishes$
Disallow: /funeralcare/funeral-wishes/
Sitemap: https://www.coop.co.uk/sitemap.xml
Sitemap: https://www.coop.co.uk/recipes/sitemap.xml
Sitemap: https://www.coop.co.uk/products/sitemap.xml
Sitemap: https://www.coop.co.uk/funeralcare/sitemap.xml
Sitemap: https://www.coop.co.uk/funeralcare/funeral-directors/sitemap.xml
Sitemap: https://www.coop.co.uk/store-finder/sitemap.xml
Sitemap: https://www.coop.co.uk/insurance/sitemap.xml
Sitemap: https://www.coop.co.uk/blog/sitemap.xml

===== www.waitrose.com/robots.txt =====
# CONDENSED RECORD, not a full copy. As returned by the fetch tool on 10 Nov 2026: 2 User-agent lines.
User-agent: *
Disallow: /shop/ViewTrolley
# (one real rule shown as an example; the rest are summarised in the next line)
# Path and parameter rules only (e.g. Disallow: /shop/ViewTrolley, Disallow: *search?*, Allow: /offers). None is "/", "/*" or "*". Crawl-delay: 1.
User-agent: ia_archiver
Disallow: /

===== www.iceland.co.uk/robots.txt =====
# CONDENSED RECORD, not a full copy. As returned by the fetch tool on 10 Nov 2026: 1 User-agent line.
User-agent: *
Disallow: /basket*
# (one real rule shown as an example; the rest are summarised in the next line)
# Path and parameter rules only (e.g. Disallow: /basket*, Disallow: *?pmin=*, Disallow: */account/*). None is "/", "/*" or "*".

===== www.ocado.com/robots.txt =====
# CONDENSED RECORD, not a full copy. Read in Chrome on 10 Nov 2026 09:41 UTC: 81 lines, 1,982 characters as rendered.
# SHA-256 of the rendered text: 39ce716d707112d8a0b6947fba05541f7f318f63bf7be0346b81a67ba3c2a22d
User-agent: *
Disallow: /api/
# (one real rule shown as an example; the rest are summarised in the next line)
# 2 Allow rules (/api/webproductpagews/v5/products/related and /similar) and path or parameter Disallow rules (e.g. Disallow: /api/, Disallow: /basket, Disallow: /*?filters=). None is "/", "/*" or "*".
User-agent: OneTrustBot
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:87.0) Gecko/20100101 Firefox/87.0;OneTrustBot;
Allow: /