CrawlerPulse
CrawlerPulse / Asia / India / manoramaonline.com

Manorama Online

manoramaonline.com · India · Malayala Manorama · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,476 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: CCBots
Disallow: /

User-agent: AmazonAdBot
Allow: /
Crawl-delay: 0

User-agent: *
Disallow: /.myModalPoll*
Disallow: /content/mm/ml/tool/
Disallow: /.currencyRating
Disallow: /.youAndYourVehiclePopup*
Disallow: /.natureAndYouPopup*
Disallow: /.momAndYouPopup*
Disallow: /.postYourCreativePopup*
Disallow: /.commonMsgPopup
Disallow: /.shareemailpopup
Disallow: /.greyedMsgPopup
Disallow: /cgi-bin/
Disallow: /advt/
Disallow: /rss/
Disallow: /mmfont/
Disallow: /.MM*
Disallow: /servlet/
Disallow: /ADVT/
Disallow: /Cgi-bin/
Disallow: /home.html/.myModalPoll*
Disallow: /analytics.html
Disallow: /analytics.html/*
Disallow: /ACP/
Disallow: /ACP/*
Disallow: /content/mm/tv
Disallow: /OnlinePortal/
Disallow: /content/mm/ml/mm-push-engage.html
Disallow: /mm-push-engage.html
Disallow: /*feed.feed.xml$
Disallow: /content/mm/ml/
Disallow: /content/mm/mo/indian-super-league-2019-20.html
Disallow: /indian-super-league-2019-20.html
Disallow: /search-results*
Disallow: /_jcr_content/root/*
Disallow: /jcr:content/root/*
Disallow: /content/experience-fragments/*
Disallow: /acd/api/3.0/authorize/*
Disallow: /content/mm/mo/*
Disallow: /etc/acs-commons/*
Disallow: /acd/api/3.0/widgets/*
Disallow: /searchresults*

User-agent: Mediapartners-Google
Disallow: /404.htm
Disallow: /health/sex.html
Disallow: /health/sex/
Disallow: /health/sexual-health.html
Disallow: /health/sexual-health
Disallow: /tag-results

User-agent: DeepSeek
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

India
25.0% block at least one AI crawler
Behind Cloudflare
No
Same group