CrawlerPulse
CrawlerPulse / Asia / Iran / farsnews.ir

Fars News Agency

farsnews.ir · Iran · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 1,657 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /_hybrid/
Sitemap: https://farsnews.ir/sitemap.xml
Sitemap: https://farsnews.ir/sitemaps/profiles/index.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2002.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2003.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2004.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2005.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2006.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2007.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2008.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2009.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2010.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2011.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2012.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2013.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2014.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2015.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2016.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2017.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2018.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2019.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2020.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2021.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2022.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2023.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2024.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2025.xml
Sitemap: https://farsnews.ir/sitemaps/contents/index2026.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Iran
5.6% block at least one AI crawler
Behind Cloudflare
No
Same group
farsnews.com