User-agent: * Allow: / Disallow: /admin Sitemap: https://www.ourkavach.com/sitemap.xml # AI Crawlers — welcome User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: ChatGPT-User Allow: / # OAI-SearchBot is the agent behind ChatGPT search citations. It is separate # from GPTBot (training) and ChatGPT-User (live browsing on a user's behalf). User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / # Claude-SearchBot is the agent behind Claude's search citations. User-agent: Claude-SearchBot Allow: / # Claude-Web and anthropic-ai are Anthropic's older agent names, kept for # any crawler still identifying with them. ClaudeBot above is the current one. User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / # Perplexity-User fetches a page live on a user's behalf. User-agent: Perplexity-User Allow: / User-agent: Amazonbot Allow: / User-agent: Bytespider Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Cohere-ai Allow: / User-agent: Meta-ExternalAgent Allow: / # IndexNow — real-time URL change notification # Key: https://www.ourkavach.com/b1ab9df7b08449f99ff5e58acdb6c0a3.txt # GEO — AI-readable product content # See /llms.txt for structured product information # See /.well-known/llms.txt (standard path) # See /llms-full.txt for the full text of every page in one file