cnbctv18.com · India · Network18 Media & Investments Limited · measured 8 Oct 2026
As read on 8 Oct 2026, 3,113 bytes. 14 rule groups name AI crawlers; shown first.
User-agent: CCBot Disallow: / User-agent: GPTBot Disallow: / User-Agent: omgili Disallow: / User-Agent: omgilibot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Google-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: ClaudeBot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Diffbot Disallow: / User-agent: Claude-Web Disallow: / User-agent: cohere-ai Disallow: / User-agent: Timpibot Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: * Allow: / Disallow: /advertise/amp?* Disallow: /*amp?/* Disallow: /crossword-* Disallow: /*?/amp Disallow: /*?/privacy/amp/ Disallow: /*privacy/?/amp Disallow: /*?/about/amp/ Disallow: /*balance-sheet/ Disallow: /*profit-and-loss/ Disallow: /*quaterly-results/ Disallow: /*half-yearly-results/ Disallow: /*nine-months-results/ Disallow: /*yearly-results/ Disallow: /*cash-flow/ Disallow: /*ratios/ Disallow: /*capital-structure/ Disallow: /*advertise?/amp Disallow: /*disclaimer?/amp Disallow: /*amp%2 Disallow: /*ampamp Disallow: /*/amp/amp Disallow: /*%2F Disallow: /*//* Disallow: /*?amp=1 Disallow: /*?amp=2 Disallow: /*classic=true Disallow: /travel/sports Disallow: /market/sports Disallow: /*?is_app=1 Disallow: /*.htmamp Disallow: /*.htmlamp Disallow: /comscore.txt Disallow: /*.htm/amp/amp Disallow: /lok-sabha-election-2019 Disallow: /*.htm/uncategorized/* Disallow: /crossword/ Disallow: /tags/*htm*.htm Disallow: /tags/*/?amp=* Disallow: /*/*.htm-* Disallow: /*/*.htm//ms/*/ Disallow: /contact/amp Disallow: /*//amp Disallow: /*?is_app=1 Disallow: /*amp// Disallow: /static.cnbctv18.com/* Disallow: /sitemap/image-sitemap-*.xml Disallow: /sitemaps/daily/*.xml Disallow: /wp-admin/ Disallow: /author/*/page-*/ Disallow: /tag/*/page-*/ Disallow: /quiz-list/ Disallow: /crossword-list/ Disallow: /expert-views/ Disallow: /wp-includes/ Disallow: /1039154/ Disallow: /services/ Disallow: /*-sitemap-2018-* Disallow: /*-sitemap-2019-* Disallow: /*-sitemap-2020-* Disallow: /*-sitemap-2021-* Disallow: /*?trk= Disallow: /*.json$ Disallow: /*_buildManifest.js$ Disallow: /*_middlewareManifest.js$ Disallow: /*_ssgManifest.js$ Disallow: /_next/static/*.js$ Disallow: /_next/static/*.json% Disallow: /api/*/article/ Disallow: /*?search_str Disallow: /tag/ Disallow: /quiz- Disallow: /iframe/access/become-member-widget Disallow: /impact-shorts/* Sitemap: https://www.cnbctv18.com/commonfeeds/v1/cne/sitemap/google-news.xml Sitemap: https://www.cnbctv18.com/commonfeeds/v1/cne/sitemap-image-index.xml Sitemap: https://www.cnbctv18.com/commonfeeds/v1/cne/sitemap-video.xml Sitemap: https://www.cnbctv18.com/commonfeeds/v1/cne/sitemap-index.xml Sitemap: https://www.cnbctv18.com/commonfeeds/v1/cne/sitemap/webstories-sitemap-index.xml User-agent: MAZBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: img2dataset Disallow: / User-agent: Scrapy Disallow: / User-agent: VelenPublicWebCrawler Disallow: /
Changes recorded since June 2026.
No change recorded.