# https://deviceshelf.app/robots.txt # Allow everything. We have nothing to hide and want every reachable # language variant indexed. User-agent: * Allow: / # Sitemap (per-language URLs + hreflang alternates listed inside) Sitemap: https://deviceshelf.app/sitemap.xml # Common AI crawlers — we welcome them too; the marketing copy is meant # to be read. To opt-out of AI training, change the matching block to # `Disallow: /`. User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / User-agent: anthropic-ai Allow: / User-agent: CCBot Allow: /