User-agent: * Content-Signal: search=yes, ai-input=no, ai-train=no Allow: / Disallow: /admin Disallow: /billing Disallow: /dashboard Disallow: /login Disallow: /onboarding Disallow: /r/ # Search / retrieval — live citation surface and primary GEO target User-agent: Googlebot User-agent: Bingbot User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: PerplexityBot Content-Signal: search=yes, ai-input=no, ai-train=no Allow: / Disallow: /admin Disallow: /billing Disallow: /dashboard Disallow: /login Disallow: /onboarding Disallow: /r/ # User-triggered — a logged-in user asked the assistant to fetch this page User-agent: ChatGPT-User User-agent: Claude-User User-agent: Perplexity-User Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Disallow: /admin Disallow: /billing Disallow: /dashboard Disallow: /login Disallow: /onboarding Disallow: /r/ # Training — deliberate allow so Olwen content enters the training corpus User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Disallow: /admin Disallow: /billing Disallow: /dashboard Disallow: /login Disallow: /onboarding Disallow: /r/ Sitemap: https://www.olwen.io/sitemap.xml Host: https://www.olwen.io