CrawlerPulse
CrawlerPulse / Asia / Turkey / yeniasir.com.tr

Yeni Asır

yeniasir.com.tr · Turkey · Turkuvaz Medya Grubu · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 569 bytes. No rule names an AI crawler.

User-agent: *
Sitemap: https://www.yeniasir.com.tr/sitemap/news.xml
Sitemap: https://www.yeniasir.com.tr/sitemap/index.xml
Disallow: /arsiv
Disallow: /haberadvertorial
Disallow: /iframe/*
Disallow: /video/iframe/*
Disallow: /js
Disallow: /json
Disallow: /ajax
Disallow: /get/tag/*
Disallow: /haber/getsurmanset
Disallow: /infinite/article/*
Disallow: /dunya-kupasi/article/infinite*
Allow: /turkiye-kupasi
Disallow: /turkiye-kupasi/*
Disallow: /secim/
Disallow: *getcandidatetopinfo*
Content-Signal: search=yes, ai-input=yes, ai-train=no

History

Changes recorded since June 2026.

No change recorded.

In context

Turkey
11.8% block at least one AI crawler
Behind Cloudflare
No
Same group