# infinihash.com — AI-crawler policy: Option A (owner decision 2026-09-22). # AI crawlers are ALLOWED on marketing pages on infinihash.com, kyt.infinihash.com # and kyc.infinihash.com. The subdomains additionally disallow the signed-in app # paths (/kyt/, /kyc/, /billing/, /api/). Keep the bot list identical to # retail-mvp app/robots.ts (AI_CRAWLERS) so the three files never drift again. User-agent: * Allow: / Disallow: /api/ User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: GoogleOther User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: FacebookBot User-agent: CCBot User-agent: Bytespider User-agent: Amazonbot User-agent: cohere-ai User-agent: YouBot User-agent: Diffbot User-agent: omgili User-agent: Timpibot User-agent: ImagesiftBot User-agent: AI2Bot User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: Firecrawl Allow: / Disallow: /api/ Sitemap: https://infinihash.com/sitemap.xml