malayalam.news18.com · India · Network18 Media & Investments Limited · measured 4 Aug 2026
As read on 4 Aug 2026, 3,541 bytes. 8 rule groups name AI crawlers; shown first.
User-agent: CCBot Disallow: / User-Agent: omgili Disallow: / User-Agent: omgilibot Disallow: / User-agent: Bytespider Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Diffbot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Timpibot Disallow: / User-agent: * Allow: / Disallow: /*studio18/* Disallow: /events/general-election-2019/ Disallow /login/ Disallow: /login?ref* Disallow: /uc/ Disallow: /uc-election-widget/ Disallow: /tag/*/page-*/ Disallow: /tag/*/photogallery/* Disallow: /tag/*/videos/* Disallow: /tag/*/news/* Disallow: /amp/tag/*/news/ Disallow: /amp/tag/*/photogallery/ Disallow: /amp/tag/*/videos/ Disallow: /amp/tag/*/buzz/ Disallow: /amp/tag/*/career/ Disallow: /amp/tag/*/india/ Disallow: /amp/tag/*/opinion/ Disallow: /amp/tag/*/kerala/ Disallow: /amp/tag/*/india-china/ Disallow: /amp/tag/*/crime/ Disallow: /amp/tag/*/gulf/ Disallow: /amp/tag/*/sports/ Disallow: /amp/tag/*/life/ Disallow: /amp/tag/*/money/ Disallow: /amp/tag/*/explained/ Disallow: /amp/tag/*/tag/*/ Disallow: /videos/*page-*page-*/page-*/tag/*/ Disallow: /assembly-elections-*/:state_slug:/* Disallow: /assembly-elections-*/*/*/* Disallow: */News18_Malayalam_WAP/* Disallow: */*.html/page-*/tag/*/ Disallow: /ampnews/*/*.html/page-*/ Disallow: */lok-sabha-election-2019/* Disallow: */page-*/tag/*/ Disallow: */*/*/page-*/page*/ Disallow: */assembly-election-2019/*.html/tag/*/ Disallow: /amp/*/assembly-election-2019/*.html Disallow: /amp/*/*/*/page-* Disallow: /ampvideos/*/*.html/page-*/ Disallow: /scorecard/ Disallow: /privacy_policy.html Disallow: /complaint-redressal.html Disallow: /cookie-policy.html Disallow: /feedback/ Disallow: /undefined/ Disallow: /embed/ Disallow: /notifications/ Disallow: /bypoll-2021/ Disallow: /byline/*/page-*/ Disallow: /kerala-assembly-elections-2021/ Disallow: /amp/kerala-assembly-election-2021/ Disallow: /ampvideos/ Disallow: /assembly-election-2019/ Disallow: /amp/tag/*/*/ Disallow: /home/ Disallow: /videos/*/page-*/ Disallow: /*/page-*/page-*/ Disallow: /cricketnext/ Disallow: /*/page-*/ Disallow: /vod/ Disallow: /*/*page-1page-1page-*/ Disallow: /category/ Disallow: /assembly-election-2021/ Disallow: /lallu-speak/ Disallow: /ampnews/ Disallow: /*==/tag/IPL 2022/ Disallow: /year-ender-2018/ Disallow: /ipl-2020/ Disallow: /assembly-election-2020/ Disallow: /amp/photogallery/*/tag/*/ Disallow: /1 Disallow: /2 Disallow: /3 Disallow: /4 Disallow: /5 Disallow: /6 Disallow: /7 Disallow: /8 Disallow: /9 Disallow: /0 Disallow: /zip/* Disallow: /*/zip/* Allow: /cricket/live-score/$ Disallow: /cricket/live-score/ Disallow: /elections/*constituency- Disallow: /elections/*candidate- Disallow: /elections/*-led20 Sitemap: https://malayalam.news18.com/commonfeeds/v1/mal/sitemap/today Sitemap: https://malayalam.news18.com/commonfeeds/v1/mal/sitemap-index.xml Sitemap: https://malayalam.news18.com/commonfeeds/v1/mal/sitemap/google-news.xml Sitemap: https://malayalam.news18.com/commonfeeds/v1/mal/sitemap-image-index.xml Sitemap: https://malayalam.news18.com/commonfeeds/v1/mal/sitemap-video-index.xml Sitemap: https://malayalam.news18.com/commonfeeds/v1/mal/sitemap/webstories-sitemap-index.xml User-agent: MAZBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: img2dataset Disallow: / User-agent: Scrapy Disallow: / User-agent: VelenPublicWebCrawler Disallow: /
Changes recorded since June 2026.
No change recorded.