republicworld.com · India · Republic · measured 8 Oct 2026
As read on 8 Oct 2026, 1,746 bytes. 10 rule groups name AI crawlers; shown first.
User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: CCBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: Google-Extended Allow: / User-agent: anthropic-ai Allow: / User-agent: FacebookBot Allow: / User-agent: YouBot Allow: / Disallow: *sitemap/* Disallow: *amp=* Disallow: *query=* Disallow: *?v=12rss* Disallow: /*-$ Disallow: *search?query=* Disallow: */rss/* Disallow: /*?$ Disallow: */sports-news/* Disallow: */entertainment-news/* Disallow: */technology-news/* Disallow: */sports-news/* Disallow: *.html* Disallow: */entertainment/entertainment/* Disallow: */entertainment/television/entertainment/television/* Disallow: */sports/cricket/sports/cricket/* Disallow: */tech/tech/tech/* Disallow: */business/business/business/* Disallow: */lifestyle/lifestyle/* Disallow: */economy/economy/* Disallow: */india/india/india/india/* Disallow: */_app/* Disallow: */tags/* Disallow: /amp/web-stories/ Disallow: /amp/web-stories/* Disallow: /amp/shorts/ Disallow: /amp/shorts/* Disallow: /amp/taboola-app/ Disallow: /amp/taboola-app Disallow: /amp/taboola-app/* Disallow: /policies-disclaimers-app/ Disallow: /policies-disclaimers-app/* Disallow: /privacy-policy-app/ Disallow: /mgid/ Disallow: /mgid/* Disallow: /amp/mgid-app/ Disallow: /amp/mgid-app/* Disallow: *.news* Disallow: *?jw_start=* Disallow: *utm_* Disallow: /*/*/$ Disallow: /*/$ Disallow: /world-news/world-news/ Disallow: /amp/amp/ Disallow: /anchors-and-authors/ Disallow: */assets/* Disallow: */assets/ Sitemap: https://www.republicworld.com/sitemaps/sitemaps-news.xml Sitemap: https://www.republicworld.com/sitemaps/index-sitemaps.xml User-agent: * Allow: / User-agent: Applebot Allow: /
Changes recorded since June 2026.
No change recorded.