# Sightivo Robots.txt # AI crawlers welcome - see llms.txt for AI-optimized context User-agent: * Allow: / # OpenAI User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / # Anthropic User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / # Perplexity User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Google AI User-agent: Google-Extended Allow: / # Apple AI User-agent: Applebot-Extended Allow: / # Common Crawl (used by many AI models) User-agent: CCBot Allow: / # Cohere User-agent: cohere-ai Allow: / # Meta AI User-agent: FacebookBot Allow: / User-agent: meta-externalagent Allow: / Sitemap: https://sightivo.com/sitemap.xml # AI Context Files (llmstxt.org standard). Comments, not directives: robots.txt # has no llms field, and validators reject unknown ones. Crawlers find these at # the fixed paths, and every page links them with . # https://sightivo.com/llms.txt # https://sightivo.com/llms-full.txt