# Allow all crawlers; block the public investor deck from indexing. # The /deck rules MUST live in this first User-agent: * group - robots.txt # uses only the FIRST matching group per crawler, so a second User-agent: * # block (as this file previously had) is ignored and /deck was never blocked. User-agent: * Allow: / Disallow: /deck Disallow: /deck.html Disallow: /whitepaper Disallow: /dataroom # AI search crawlers - allowed to read and cite User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / # Block training-only crawlers (optional - AI search crawlers above are allowed) User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: cohere-ai Disallow: / # Sitemap Sitemap: https://conversify.app/sitemap.xml