CrawlerPulse
CrawlerPulse / Asia / India / patrika.com

Patrika

patrika.com · India · Rajasthan Patrika Private Limited · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,422 bytes. 8 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: anthropic-ai
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: CCBot
Allow: /
Sitemap: https://www.patrika.com/sitemap.xml
Sitemap: https://www.patrika.com/google-news-sitemap-v1.xml
Sitemap: https://www.patrika.com/newurlsitemapindex.xml

User-Agent: Googlebot
Allow: /
Disallow: /*.pdf$ # block all files ending with .pdf
Disallow: /*.aspx$ # block all files ending with .aspx pages
Disallow: /*.aspx?* # block all query strings for .aspx pages
Disallow: /*.ashx$ # block all files ending with .ashx
Disallow: /*.ashx?* # block all query strings for .ashx pages
Disallow: /.ashx/$ # block all query strings for .ashx pages
Disallow: /*.asmx$ # block all files ending with .asmx pages
Disallow: /*.asmx?* # block all query strings for .asmx pages
Disallow: /.asmx/$ # block all query strings for .asmx pages
Disallow: /*.swf$ # block all files ending with .swf
Disallow: /*?slide=*
Disallow: /*?fromNewsdog*
Disallow: /*?utm_*
Disallow: /search?q=
Disallow: *?infiniteStory*
Disallow: /*point_down*
Disallow: *?src*
Disallow: *?_rsc*
Disallow: *?cb*
Disallow: /ucnews/
Disallow: /newsdog/
Disallow: /search/
Disallow: /index-new.php
Disallow: /new/
Disallow: /test/
Disallow: /ajax/Advertisement.aspx
Disallow: /print/emailarticle.aspx
Disallow: /print/emailnews.aspx
Disallow: /print/article.aspx
Disallow: /print/news.aspx
Disallow: /errorpage.aspx
Disallow: /purge.php
Disallow: /advertisewithus.htm
Disallow: /advt/
Disallow: /gulabkothari/
Disallow: /mag/
Disallow: /rusu/
Disallow: /vision2025/
Disallow: /rajasthan-budget-2012-13/
Disallow: /rajasthan-budget-2013-14/
Disallow: /chhattisgarh-attack/
Disallow: /sarabjeet-singh/
Disallow: /kckaward/
Disallow: /indore-foundation-day/
Disallow: /union-budget-2012-13/
Disallow: /union-budget-2013-14/
Disallow: /swaraj-yatra/
Disallow: /anndata-ke-aansu/
Disallow: /special-coverage/
Disallow: /jaipur-literature-festival/
Disallow: /document/
Disallow: /shardhanjali/
Disallow: /mothers-day/
Disallow: /Atma-team-in-jaipur/
Disallow: /yearender-2013/
Disallow: /patrika-rss/
Disallow: /StateAndLocal/
Disallow: /PhotoGalleryStateSlider/
Disallow: /GalleryStateSlides/
Disallow: /#/
Disallow: /search;query=
Disallow: /special/

User-agent: Mediapartners-Google
Allow: /

History

Changes recorded since June 2026.

No change recorded.

In context

India
25.0% block at least one AI crawler
Behind Cloudflare
No