CrawlerPulse
CrawlerPulse / Asia / India / outlookindia.com

Outlook India

outlookindia.com · India · Outlook Publishing (India Pvt Ltd) · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,673 bytes. 7 rule groups name AI crawlers; shown first.

User-agent: GPTBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Claude-Web
Allow: /

User-Agent: Meta-ExternalAgent
Allow: /

User-agent: DeepSeekBot
Allow: /

User-agent: *
Allow: /
Disallow: /search
Disallow: /outlook-spotlight/
Disallow: /business-spotlight/
Disallow: /health-spotlight/
Disallow: /topic/outlook-spotlight
Disallow: /topic/outlook-business-spotlight
Disallow: /topic/outlook-health-spotlight
Disallow: /topic/business-spotlight
Disallow: /hub4gaming/
Disallow: /hub4crypto/
Disallow: /betting/
Disallow: /outlook-apprise/
Disallow: /hub4health/
Disallow: /whats-hot/
Disallow: /outlookhub/
Disallow: /plugin-play/
Disallow: /special/
Disallow: /lifestyleplug
Disallow: /playworldinsights
Disallow: /insightforum
Disallow: /cryptolens
Disallow: /wellnessway
Disallow: /carechronicles
Disallow: /*.pdf$
Disallow: /*.doc$
Disallow: /website*
Disallow: /newsscroll/
Disallow: /amp/story/business-spotlight/
Disallow: /amp/story/outlook-spotlight/
Disallow: /events
Disallow: /educare
Disallow: /agritech
Disallow: /amp/story/amp/story
Disallow: /outlooktraveller/
Disallow: /people/
Disallow: /magazine/story/
Disallow: /amp/story/website/*
Disallow: /*botrequest=true
Disallow: /topic/*//
Disallow:/topic/*/
Disallow:/*utm_source=related_story//
Disallow:/*next/*
Disallow:/*utm_source=related_story*
Disallow:/*prev/
Disallow:/*requestId=
Disallow: /traveller/*/feed/
Disallow: /outlookspotlight/*
Disallow: /outlookmoney/*
Disallow: /markets/*
Disallow: /equity/*
Disallow: /market-intelligence/*
Disallow: /economy-and-policy/*
Disallow: /corporate/*
Disallow: /newswire/*
Disallow: /ask/*
Disallow: /economy-and-policy/*
Disallow: /newsflash/*
Disallow: /testing/*
Disallow: /credit-cards/*
Disallow: /cryptocurrency/*
Disallow: /cars-and-bikes/*
Disallow: /expenses/*
Disallow: /xhub/e-gaming
Disallow: /xhub/igaming

User-agent: Bingbot
Allow: /

User-agent: Dalvik
Disallow: /

User-agent: *Dalvik*
Disallow: /
Sitemap: https://www.outlookindia.com/alloisitemap.xml
Sitemap: https://www.outlookindia.com/oisitemap.xml
Sitemap: https://www.outlookindia.com/oisitemap-news.xml
Sitemap: https://www.outlookindia.com/oisitemap/monthly.xml
Sitemap: https://www.outlookindia.com/oisitemap/topics
Sitemap: https://www.outlookindia.com/live-blog.xml
Sitemap: https://www.outlookindia.com/visual-story.xml
Sitemap: https://www.outlookindia.com/oisitemap-photo.xml
Sitemap: https://www.outlookindia.com/oisitemap-video.xml
Sitemap: https://www.outlookindia.com/oisitemap-section.xml

History

Changes recorded since June 2026.

No change recorded.

In context

India
25.0% block at least one AI crawler
Behind Cloudflare
Yes