# robots.txt — shhots.ai # Default rules apply to every bot we don't list a specific group for, # including Googlebot, Bingbot, and all AI/answer bots (ChatGPT, GPTBot, # PerplexityBot, ClaudeBot, Google-Extended, Applebot-Extended, CCBot, etc.). User-agent: * Disallow: /admin/ Disallow: /api/ Disallow: /internal/ Disallow: /checkout/ Disallow: /cart/ Disallow: /auth/ Disallow: /*?*sort= Disallow: /*?*filter= Disallow: /*?*query-0-page= Disallow: /*?*cst= Disallow: /*?*utm_ # Block aggressive scrapers and SEO crawlers User-agent: Bytespider User-agent: Diffbot User-agent: AhrefsBot User-agent: SemrushBot User-agent: MJ12bot User-agent: DotBot Disallow: / Sitemap: https://shhots.ai/sitemap-index.xml