telugu.news18.com · India · Network18 Media & Investments Limited · measured 4 Aug 2026
As read on 4 Aug 2026, 2,724 bytes. 14 rule groups name AI crawlers; shown first.
User-agent: CCBot Disallow: / User-agent: GPTBot Disallow: / User-Agent: omgili Disallow: / User-Agent: omgilibot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Google-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: ClaudeBot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Diffbot Disallow: / User-agent: Claude-Web Disallow: / User-agent: cohere-ai Disallow: / User-agent: Timpibot Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: * Allow: / Disallow: /*studio18/* Disallow: /login/ Disallow: /login?ref* Disallow: /events/general-election-2019/ Disallow: /uc/ Disallow: /.well-known/ Disallow: /uc-election-widget/ Disallow: /mutual-funds/ Disallow: /insurance/ Disallow: /auto/ Disallow: /tag/%* Disallow: /amp/tag/%* Disallow: /tag/*/page-*/ Disallow: /tag/*/photogallery/page-*/ Disallow: /tag/*/videos/page-*/ Disallow: /tag/*/news/page-*/ Disallow: /amp/tag/*/page-*/ Disallow: /amp/tag/*/photogallery/page-*/ Disallow: */ampnews/* Disallow: */category$ Disallow: /videopub/*a Disallow: /amp/agency/*/page-*/$ Disallow: /agency/*/page-*/$ Disallow: /*> Disallow: /*< Disallow: /*tag/*~ Disallow: /*tag/*. Disallow: /*tag/*: Disallow: /byline/*page-* Disallow: /byline/*--* Disallow: /*tag/*) Disallow: /*tag/*( Disallow: /scorecard/ Disallow: /vod/ Disallow: /embed/ Disallow: /tag/*.* Disallow: /amp/tag/*.* Disallow: /*/page-*/ Disallow: /amp/lok-sabha-election-2019/ Disallow: /amp/*.htmlpage-*/ Disallow: /videos/*.htmpage-*/ Disallow: /lok-sabha-election-2019/ Disallow: /amp/tag/*/videos/ Disallow: /videos/*/page-*/ Disallow: /tag/*/undefined/ Disallow: /*tag/*[ Disallow: /*tag/*] Disallow: /*tag/*+ Disallow: /*tag/*V Allow: /cricket/live-score/$ Disallow: /cricket/live-score/ Disallow: /elections/*constituency- Disallow: /elections/*candidate- Disallow: /elections/*-led20 Sitemap: https://telugu.news18.com/commonfeeds/v1/tel/sitemap/today Sitemap: https://telugu.news18.com/commonfeeds/v1/tel/sitemap-index.xml Sitemap: https://telugu.news18.com/commonfeeds/v1/tel/sitemap/google-news.xml Sitemap: https://telugu.news18.com/commonfeeds/v1/tel/sitemap-video-index.xml Sitemap: https://telugu.news18.com/commonfeeds/v1/tel/sitemap/webstories-sitemap-index.xml Sitemap: https://telugu.news18.com/commonfeeds/v1/tel/sitemap-image-index.xml User-agent: MAZBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: img2dataset Disallow: / User-agent: Scrapy Disallow: / User-agent: VelenPublicWebCrawler Disallow: /
Changes recorded since June 2026.
No change recorded.