# Disallowed crawlers user-agent: Claude-Web user-agent: ClaudeBot user-agent: SemrushBot user-agent: BLEXBot user-agent: AhrefsBot user-agent: DotBot disallow: / # Pinterest user-agent: Pinterestbot Allow: / Disallow: /shop/category Crawl-delay: 1.0 # Amazon (Alexa), OpenAI GPTBot user-agent: GPTBot user-agent: Amazonbot allow: / disallow: /shop/category # All crawlers User-Agent: * Allow: / disallow: /cart Crawl-delay: 0.2