CrawlerPulse
CrawlerPulse / Asia / India / onmanorama.com

Onmanorama

onmanorama.com · India · Malayala Manorama · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,488 bytes. 3 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: CCBots
Disallow: /

User-agent: AmazonAdBot
Allow: /
Crawl-delay: 0

User-agent: *
Disallow: /cgi-bin/
Disallow: /advt/
Disallow: /rss/
Disallow: /mmfont/
Disallow: /.MM*
Disallow: /servlet/
Disallow: /ADVT/
Disallow: /Cgi-bin/
Disallow: /content/mm/en/food/kerala-kitchen-utility-page/
Disallow: /food/kerala-kitchen-utility-page/
Disallow: /content/mm/en/food/mrs-km-mathew-utility-page-folder/
Disallow: /food/mrs-km-mathew-utility-page-folder/
Disallow: /content/mm/en/food/in-season-utility-page-folder/
Disallow: /food/in-season-utility-page-folder/
Disallow: /content/mm/en/food/special-diet-utility-page-folder/
Disallow: /food/special-diet-utility-page-folder/
Disallow: /content/mm/en/food/editorpicks-utility-page-folder/
Disallow: /food/editorpicks-utility-page-folder/
Disallow: /content/mm/en/food/around-the-world-utility-page-folder
Disallow: /food/around-the-world-utility-page-folder/
Disallow: /content/mm/en/food/readers-recipe-utility-page-folder/
Disallow: /food/readers-recipe-utility-page-folder/
Disallow: /content/mm/en/food/foodie-utility-page-folder1/
Disallow: /food/foodie-utility-page-folder1/
Disallow: /content/mm/en/food/celebrities-recipe-folder/
Disallow: /food/celebrities-recipe-folder/
Disallow: /content/mm/en/food/eatouts-utility-page-folder
Disallow: /food/eatouts-utility-page-folder/
Disallow: /content/mm/ml
Disallow: /ACP/
Disallow: /ACP/*
Disallow: /OnmanoramaPortal/
Disallow: /authors.html
Disallow: /*.feed.xml$
Disallow: /content/mm/mo
Disallow: /search-results.html
Disallow: /search-results.html*
Disallow: /search-results.premium.html*
Disallow: /searchresults.html
Disallow: /searchresults.html*
Disallow: /content/experience-fragments/*
Disallow: /content/mm/en/

User-agent: DeepSeek
Disallow: /
Sitemap: https://www.onmanorama.com/sitemap/sitemap-news-kerala/jcr:content/col_top/google_news_feed.xml
Sitemap: https://www.onmanorama.com/sitemap/sitemap-news-nation/jcr:content/col_top/google_news_feed.xml
Sitemap: https://www.onmanorama.com/sitemap/sitemap-entertainment-news/jcr:content/col_top/google_news_feed.xml
Sitemap: https://www.onmanorama.com/sitemap/sitemap-sports-news-n/jcr:content/col_top/google_news_feed.xml
Sitemap: https://www.onmanorama.com/sitemap/sitemap-travel-news/jcr:content/col_top/google_news_feed.xml
Sitemap: https://www.onmanorama.com/sitemap/sitemap-lifestyle-health/jcr:content/col_top/google_news_feed.xml

History

Changes recorded since June 2026.

No change recorded.

In context

India
25.0% block at least one AI crawler
Behind Cloudflare
No
Same group