User-agent: * Sitemap: https://botbhidu.com/sitemap.xml Disallow: /web/login Disallow: /web/reset_password Disallow: /my/ Disallow: /shop/cart Disallow: /shop/checkout User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: PetalBot Disallow: /