User-Agent: * Allow: / Disallow: /admin Disallow: /api/ Disallow: /monitoring Disallow: /d/ User-Agent: Bytespider User-Agent: CCBot User-Agent: GPTBot User-Agent: ClaudeBot User-Agent: PerplexityBot User-Agent: Amazonbot User-Agent: Scrapy Disallow: / Sitemap: https://www.momdoc.com/sitemap.xml