hindustantimes.com · India · HT Digital Streams Ltd · measured 8 Oct 2026
As read on 8 Oct 2026, 2,449 bytes. 1 rule group name AI crawlers; shown first.
User-agent: Googlebot User-agent: Google-Extended Allow: / Disallow: /what-now/card-details/ Disallow: /*/url* Disallow: /*/imageURL Disallow: /fragment/ Disallow: /Fragment/ Disallow: /Error/ Disallow: /error/ Disallow: /login/ Disallow: /intfeeds/ Disallow: /Images/HTEditImages Disallow: /images/HTPopups/ Disallow: /Images/Popup/ Disallow: /homenew Disallow: /dummytestpage/ Disallow: /brand-stories/international/* Disallow: /origin-pre-prod/ Disallow: /sponsored-stories/ Disallow: /brand-stories/ Disallow: /brand-post/ Disallow: /cdp/api* Disallow: /cdp/user* Disallow: /sponsored-post/ Disallow: /hot-amazon-deals* Disallow: /s/* Disallow: /static-content/1y* Disallow: /static_content/1y* Disallow: /static-content/10s* Disallow: /my-ht/* Disallow: /games/trivia* Disallow: /trivia/* Disallow: /author/*/page-* Disallow: /topic/*/page-* Disallow: /feed-elections/* User-agent: * User-agent: Googlebot-News Allow: / Disallow: /what-now/card-details/ Disallow: /*/url* Disallow: /*/imageURL Disallow: /fragment/ Disallow: /Fragment/ Disallow: /Error/ Disallow: /error/ Disallow: /login/ Disallow: /intfeeds/ Disallow: /Images/HTEditImages Disallow: /images/HTPopups/ Disallow: /Images/Popup/ Disallow: /homenew Disallow: /dummytestpage/ Disallow: /brand-stories/international/* Disallow: /origin-pre-prod/ Disallow: /sponsored-stories/ Disallow: /brand-stories/ Disallow: /brand-post/ Disallow: /cdp/api* Disallow: /cdp/user* Disallow: /sponsored-post/ Disallow: /hot-amazon-deals* Disallow: /s/* Disallow: /static-content/1y* Disallow: /static_content/1y* Disallow: /static-content/10s* Disallow: /my-ht/* Disallow: /games/trivia* Disallow: /trivia/* Disallow: /author/*/page-* Disallow: /topic/*/page-* Disallow: /feed-elections/* User-agent: facebookexternalhit User-agent: Facebot Allow: /s/ User-agent: AmazonAdBot User-agent: AdsBot-Google User-agent: Mediapartners-Google Allow: / Allow: /trivia/ Sitemap: https://www.hindustantimes.com/sitemap/news.xml Sitemap: https://www.hindustantimes.com/sitemap/index.xml Sitemap: https://www.hindustantimes.com/sitemap/liveblog.xml Sitemap: https://www.hindustantimes.com/sitemap/section.xml Sitemap: https://www.hindustantimes.com/sitemap/education-static.xml Sitemap: https://www.hindustantimes.com/telugu/sitemap/news.xml Sitemap: https://www.hindustantimes.com/bangla/sitemap/news.xml
Changes recorded since June 2026.
No change recorded.