CrawlerPulse
CrawlerPulse / Asia / India / jagran.com

Jagran

jagran.com · India · Dainik Jagran · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,471 bytes. No rule names an AI crawler.

User-agent: *
Allow: /
Disallow: *-undefined-*
Disallow: /state/*
Disallow: /local/*
Disallow: /RelatedArticleDetail.html?*
Disallow: /assets/js/*
Disallow: /*-13276288.html
Disallow: /search/*
Disallow: /home.html
Disallow: /home-new.html
Disallow: /english/
Disallow: /error.html
Disallow: /JCOM_PREFIX
Disallow: /jagran/*.page
Disallow: /shayri/
Disallow: /iw-cc/
Disallow: /detail/
Disallow: /7176/
Disallow: /listing/interstitial_1x1
Disallow: /*300x250
Disallow: /*980x50
Disallow: /*728x90
Disallow: /*160x600
Disallow: /*980x50
Disallow: /*320x75
Disallow: /photogallery/
Disallow: /lite/shayri/
Disallow: /delhi/video/
Disallow: /*/video/
Disallow: /berger-paints.html
Disallow: /berger/*
Disallow: /article2/
Disallow: /article3/
Disallow: /article4/
Disallow: /article5/
Disallow: /article6/
Disallow: /article7/
Disallow: /*/wp-admin/
Disallow: /*/plt/
Disallow: /*-20848123.html
Disallow: /podcast/*
Disallow: /blogs/*
Disallow: /search/*
Disallow: /topics/
Disallow: /exam-results.html
Disallow: /berger-paints.html
Disallow: /berger/*
Disallow: /podcast/*
Disallow: */sports40/*
Disallow: */news-news-*
Disallow: *state-news-hindi-page*
Disallow: */CategoryLanding/*
Disallow: */-*
Disallow: *-page*
Disallow: */litetest/*
Disallow: /pfp.html
Disallow: /pfp.html/
Disallow: /pfp.html/*
Disallow: /13276288/
Sitemap: https://www.jagran.com/all-news-sitemap.xml
Sitemap: https://www.jagran.com/news-sitemap.xml
Sitemap: https://www.jagran.com/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

India
25.0% block at least one AI crawler
Behind Cloudflare
No
Same group