CrawlerPulse
CrawlerPulse / Asia / India / hindi.economictimes.com

Economic Times-Hindi

hindi.economictimes.com · India · Bennett Coleman & Co. Ltd. · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Blocked
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,423 bytes. 1 rule group name AI crawlers; shown first.

User-agent: meta-externalagent
Disallow:/
Sitemap: https://hindi.economictimes.com/staticsitemap/ethindi/news/sitemap-48hours.xml
Sitemap: https://hindi.economictimes.com/sitemap/sitemapxml.cms

User-agent: *
Allow: /
Allow: /staticsitemap/ethindi/news/sitemap-48hours.xml
Disallow: */hindi/*
Disallow: */chart.cms*
Disallow: *?back=1
Disallow: */xml/*
Disallow: */7176/*
Disallow: */23037861279/*
Disallow: */stockreports/*
Disallow: */infocompanybackground/*
Disallow: */infocompanylisting/*
Disallow: */quotecompare/*
Disallow: */shareholding/*
Disallow: */chairmanspeech/*
Disallow: */infocompanybonus/*
Disallow: */stocksupdate/*
Disallow: */infocompanydividends/*
Disallow: */infocompanyagm/*
Disallow: */ninemonthly/*
Disallow: */infocompanyrights/*
Disallow: */infocompanysplits/*
Disallow: */halfyearly/*
Disallow: */infocompanyhistory/*
Disallow: */infocompanyboardmeetings/*
Disallow: */directorsreport/*
Disallow: */profitandlose/*
Disallow: */infocompanylocations/*
Disallow: */finishedproducts/*
Disallow: */balancesheet/*
Disallow: */prices/*
Disallow: */cashflow/*
Disallow: */capitalstructure/*
Disallow: */yearly/*
Disallow: */quarterly/*
Disallow: */infocompanymanagement/*
Disallow: */videoplayer.cms?
Disallow: */pwafeeds/
Disallow: *?trc_source
Disallow: */login.cms?
Disallow: */feeds/vod_player.cms?
Disallow: */search?query=
Disallow: */mffundinfo/*

History

Changes recorded since June 2026.

No change recorded.

In context