User-agent: * Allow: / Disallow: /app Disallow: /admin Disallow: /billing Disallow: /api/v1/ Disallow: /embed/ # AI search crawlers - explicitly allowed User-agent: GPTBot Allow: / Disallow: /app Disallow: /admin Disallow: /billing Disallow: /api/v1/ Disallow: /embed/ User-agent: OAI-SearchBot Allow: / Disallow: /app Disallow: /admin Disallow: /billing Disallow: /api/v1/ Disallow: /embed/ User-agent: ChatGPT-User Allow: / Disallow: /app Disallow: /admin Disallow: /billing Disallow: /api/v1/ Disallow: /embed/ User-agent: PerplexityBot Allow: / Disallow: /app Disallow: /admin Disallow: /billing Disallow: /api/v1/ Disallow: /embed/ User-agent: Google-Extended Allow: / Disallow: /app Disallow: /admin Disallow: /billing Disallow: /api/v1/ Disallow: /embed/ User-agent: ClaudeBot Allow: / Disallow: /app Disallow: /admin Disallow: /billing Disallow: /api/v1/ Disallow: /embed/ Sitemap: https://metric37.com/sitemap.xml # AI crawler guidance # See https://metric37.com/llms.txt for AI-friendly site overview