User-agent: * Allow: / Disallow: /admin Disallow: /admin/ Disallow: /health Disallow: /webhook # AI search and assistant crawlers. These explicit groups make crawler access # clear even if a CDN/security layer later adds stricter defaults. User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Googlebot Allow: / Disallow: /admin Disallow: /admin/ Disallow: /health Disallow: /webhook User-agent: Google-Extended Allow: / Sitemap: https://pnralert.in/sitemap.xml Sitemap: https://pnralert.in/sitemap-core.xml Sitemap: https://pnralert.in/sitemap-keywords.xml Sitemap: https://pnralert.in/sitemap-blog.xml Sitemap: https://pnralert.in/sitemap-trains.xml Sitemap: https://pnralert.in/sitemap-stations.xml