# ============================================================ # robots.txt for hrdelivery.co # Optimized for SEO + GEO (AI Visibility) # Last updated: June 2026 # ============================================================ # --- Default: Allow all crawlers --- User-agent: * Allow: / Disallow: /assets/ Disallow: /*.json$ Sitemap: https://hrdelivery.co/sitemap.xml # --- OpenAI / ChatGPT --- User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / # --- Anthropic / Claude --- User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / # --- Perplexity AI --- User-agent: PerplexityBot Allow: / # --- Google Gemini + AI Overviews --- User-agent: Google-Extended Allow: / # --- Microsoft Copilot (via Bing) --- User-agent: bingbot Allow: / # --- Meta AI --- User-agent: meta-externalagent Allow: / # --- Apple Intelligence --- User-agent: Applebot-Extended Allow: / # --- Block known spam/junk bots --- User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: SemaltBot Disallow: / User-agent: MauiBot Disallow: /