User-agent: * # /sk on tyreto.cz stays out of the index: it duplicates tyreto.sk with Czech prices. # /en and /de are indexed language versions (frontend/lib/i18n/routes.js, # NEXT_PUBLIC_INDEX_TRANSLATIONS). Disallow: /sk/ Disallow: /_next/data/ # Nothing links with ?amount= any more (the quantity travels in a fragment or in # sessionStorage). These stay as a safety net for URLs already out in the wild. Disallow: /*?amount= Disallow: /*&amount= # SEO-tool crawlers, not search engines. AhrefsBot rendered ~90 000 pages and API calls # an hour on 4-5 Nov 2026 and took the backend to 87 % CPU. They honour Crawl-delay # (search engines are not listed here and are not slowed). A crawler that matches a # named group ignores the * group, so its rules are repeated here; /api/ is the JSON # the storefront fetches in the browser, which these crawlers have no use for. User-agent: AhrefsBot User-agent: SemrushBot User-agent: MJ12bot User-agent: DotBot Crawl-delay: 10 Disallow: /api/ Disallow: /sk/ Disallow: /_next/data/ Disallow: /*?amount= Disallow: /*&amount= Sitemap: https://www.tyreto.cz/sitemap.xml Sitemap: https://www.tyreto.cz/sitemapprod.xml # Written by the backend for the languages it serves (GenerateSitemapXML). Sitemap: https://www.tyreto.cz/sitemap-en.xml Sitemap: https://www.tyreto.cz/sitemapprod-en.xml Sitemap: https://www.tyreto.cz/sitemap-de.xml Sitemap: https://www.tyreto.cz/sitemapprod-de.xml