Economic Times

economictimes.com · India · Bennett Coleman & Co. Ltd. · measured 8 Oct 2026
Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
robots.txt

As read on 8 Oct 2026, 6,944 bytes. 1 rule group name AI crawlers; shown first.
User-agent: meta-externalagent
Disallow: /

User-agent: *
Allow: /
Disallow: /PDAET/
Disallow: /7176/
Disallow: */notify.htm?*
Disallow: /default1.cms
Disallow: /default.cms
Disallow: /*rssarticleshow*
Disallow: /*cms.dll*
Disallow: /*/opinions/
Disallow: /pmcomment/
Disallow: /logtopickeywords.cms
Disallow: /logtopickeywords.cms?query=
Disallow: /researchview.cms?searchid=
Disallow: /researchviewcomm.cms?searchid=
Disallow: /articleshow_cmtofartac/
Disallow: /cmtofart/
Disallow: /cmtofartac_lp/
Disallow: /comments/
Disallow: /comment/
Disallow: /announcements.cms
Disallow: /analysis.cms
Disallow: /?adcode=
Disallow: /etvertical_articleshow/
Disallow: /articleshow1/
Disallow: */params/smecompany/entityid-*
Disallow: /smelistings*
Disallow: *primeshow*
Disallow: */login.cms*
Disallow: /topic/*/photos*
Disallow: /topic/*/ampphoto*
Disallow: */topics_amp/*
Disallow: /top-trending-products/*/primearticleshow/*
Disallow: /etvertical_taglist*
Disallow: */hindi/*
Disallow: *?language=HIN
Disallow: *,language-HIN.cms
Disallow: *?language=BEN
Disallow: *,language-BEN.cms
Disallow: *?language=GUJ
Disallow: *,language-GUJ.cms
Disallow: *?language=MAR
Disallow: *,language-MAR.cms
Disallow: *?language=TAM
Disallow: *,language-TAM.cms
Disallow: *?language=TEL
Disallow: *,language-TEL.cms
Disallow: *?language=MAL
Disallow: *,language-MAL.cms
Disallow: *?language=KAN
Disallow: *,language-KAN.cms
Disallow: */blogs/*
Disallow: */comments/*
Disallow: /topic/*(*
Disallow: /topic/*{*
Disallow: /topic/*[*
Disallow: /topic/*seo9*
Disallow: /topic/*1*
Disallow: /topic/*2*
Disallow: /topic/*3*
Disallow: /topic/*4*
Disallow: /topic/*5*
Disallow: /topic/*6*
Disallow: /topic/*7*
Disallow: /topic/*8*
Disallow: /topic/*9*
Disallow: /(
Disallow: /)
Disallow: /*?companyid=
Disallow: /?intenttarget=
Disallow: /?scode=
Disallow: /*?utm=
Disallow: /?save_layout=
Disallow: /?filter=
Disallow: /?articleno=
Disallow: /hindi/
Disallow: /marathi/
Disallow: /kannada/
Disallow: /tamil/
Disallow: /telugu/
Disallow: /malayalam/
Disallow: /gujarati/
Disallow: /bengali/
Disallow: */js_monetize/*
Disallow: */js_freetrial/*
Disallow: */js_subscriptioncontent/*
Disallow: */js_gift_subs_story/*
Disallow: */js_ibeat_ext.cms*
Disallow: */js_renderdfponscroll_en.cms*
Disallow: */etads_v2/*
Disallow: */feeds/etads_v2/*
Disallow: */js_onboarding_popup_sh/*
Disallow: */js_feed/jsso_crosswalk_legacy_min.cms*
Disallow: */trivia/*
Disallow: */feed_meta_all.cms?msid=*
Disallow: */etstatic/ads/ad-configs/desktop/*
Disallow: */commentsdata.cms?appkey=*
Disallow: */feeds/stock_data_feed.cms?companies=*
Disallow: */etstatic/breakingnews/*
Disallow: */nextpodcastlist/*
Disallow: */viewandrecofeed.cms?*
Disallow: */stockstooltip_feed.cms?feedtype=etjson*
Disallow: /etstatic/sitemaps/articleshow_state/
Sitemap: https://economictimes.indiatimes.com/companylisting.cms
Sitemap: https://economictimes.indiatimes.com/etstatic/sitemaps/et/news/sitemap-index.xml
Sitemap: https://economictimes.indiatimes.com/sitemapxml.cms
Sitemap: https://economictimes.indiatimes.com/etstatic/sitemaps/et/video/sitemap-index.xml
Sitemap: https://economictimes.indiatimes.com/etstatic/sitemaps/et/news/sitemap-today.xml
Sitemap: https://economictimes.indiatimes.com/etstatic/sitemaps/et/news/sitemap-yesterday.xml

User-agent: Googlebot-News
Allow: /
Disallow: /PDAET/
Disallow: /7176/
Disallow: */notify.htm?*
Disallow: /default1.cms
Disallow: /default.cms
Disallow: /*rssarticleshow*
Disallow: /*cms.dll*
Disallow: /*/opinions/
Disallow: /pmcomment/
Disallow: /logtopickeywords.cms
Disallow: /logtopickeywords.cms?query=
Disallow: /researchview.cms?searchid=
Disallow: /researchviewcomm.cms?searchid=
Disallow: /articleshow_cmtofartac/
Disallow: /cmtofart/
Disallow: /cmtofartac_lp/
Disallow: /comments/
Disallow: /comment/
Disallow: /announcements.cms
Disallow: /analysis.cms
Disallow: ?adcode=
Disallow: /etvertical_articleshow/
Disallow: /articleshow1/
Disallow: */params/smecompany/entityid-*
Disallow: /smelistings*
Disallow: *primeshow*
Disallow: */login.cms*
Disallow: /topic/*/photos*
Disallow: /topic/*/ampphoto*
Disallow: */topics_amp/*
Disallow: /top-trending-products/*/primearticleshow/*
Disallow: /etvertical_taglist*
Disallow: */hindi/*
Disallow: *?language=HIN
Disallow: *,language-HIN.cms
Disallow: *?language=BEN
Disallow: *,language-BEN.cms
Disallow: *?language=GUJ
Disallow: *,language-GUJ.cms
Disallow: *?language=MAR
Disallow: *,language-MAR.cms
Disallow: *?language=TAM
Disallow: *,language-TAM.cms
Disallow: *?language=TEL
Disallow: *,language-TEL.cms
Disallow: *?language=MAL
Disallow: *,language-MAL.cms
Disallow: *?language=KAN
Disallow: *,language-KAN.cms
Disallow: */blogs/*
Disallow: */comments/*
Disallow: /topic/(
Disallow: /topic/{
Disallow: /topic/[
Disallow: /topic/seo9
Disallow: /topic/1
Disallow: /topic/2
Disallow: /topic/3
Disallow: /topic/4
Disallow: /topic/5
Disallow: /topic/6
Disallow: /topic/7
Disallow: /topic/8
Disallow: /topic/9
Disallow: /(
Disallow: /)
Disallow: /*?companyid=
Disallow: /?intenttarget=
Disallow: /?scode=
Disallow: /*?utm=
Disallow: /?save_layout=
Disallow: /?filter=
Disallow: /?articleno=
Disallow: /hindi/
Disallow: /marathi/
Disallow: /kannada/
Disallow: /tamil/
Disallow: /telugu/
Disallow: /malayalam/
Disallow: /gujarati/
Disallow: /bengali/
Disallow: */js_monetize/*
Disallow: */js_freetrial/*
Disallow: */js_subscriptioncontent/*
Disallow: */js_gift_subs_story/*
Disallow: */js_ibeat_ext.cms*
Disallow: */js_renderdfponscroll_en.cms*
Disallow: */etads_v2/*
Disallow: */feeds/etads_v2/*
Disallow: */js_onboarding_popup_sh/*
Disallow: */js_feed/jsso_crosswalk_legacy_min.cms*
Disallow: */feed_meta_all.cms?msid=*
Disallow: */etstatic/ads/ad-configs/desktop/*
Disallow: */commentsdata.cms?appkey=*
Disallow: */feeds/stock_data_feed.cms?companies=*
Disallow: */etstatic/breakingnews/*
Disallow: */nextpodcastlist/*
Disallow: */viewandrecofeed.cms?*
Disallow: */stockstooltip_feed.cms?feedtype=etjson*
Disallow: /etstatic/sitemaps/articleshow_state/
Disallow: */trivia/*
Sitemap: https://economictimes.indiatimes.com/companylisting.cms
Sitemap: https://economictimes.indiatimes.com/etstatic/sitemaps/et/news/sitemap-index.xml
Sitemap: https://economictimes.indiatimes.com/sitemapxml.cms
Sitemap: https://economictimes.indiatimes.com/etstatic/sitemaps/et/video/sitemap-index.xml
Sitemap: https://economictimes.indiatimes.com/etstatic/sitemaps/et/news/sitemap-today.xml
Sitemap: https://economictimes.indiatimes.com/etstatic/sitemaps/et/news/sitemap-yesterday.xml

User-agent: AmazonAdBot
Allow: /

User-agent: AdsBot-Google
Allow: /trivia/

User-agent: Mediapartners-Google
Allow: /trivia/

User-agent: AmazonAdBot
Allow: /trivia/
History

Changes recorded since June 2026.
No change recorded.
In context

India
25.0% block at least one AI crawler
Behind Cloudflare
Same group
hindi.economictimes.com, eisamay.com, indiatimes.com, getm360.com, maharashtratimes.com, mensxp.com, navbharattimes.com, malayalam.samayam.com, telugu.samayam.com, tamil.samayam.com, timesnownews.com, timesofindia.com