CrawlerPulse
CrawlerPulse / Asia / Turkey / donanimhaber.com

DonanimHaber

donanimhaber.com · Turkey · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 1,272 bytes. No rule names an AI crawler.

User-agent:*
Sitemap: https://www.donanimhaber.com/sitemaps/sitemap.xml
Disallow: /api/
Disallow: /api2/
Disallow: /Api/
Disallow: /controls/
Disallow: /comments.aspx*
Disallow: /appredirect.aspx*
Disallow: /ScriptResource.axd*
Disallow: /WebResource.axd*
Disallow: /videomobile/*
Disallow: /*?url=*
Disallow: /*?arama=*
Disallow: /*?q=*
Disallow: /?pid=*
Disallow: /*?pid=*
Disallow: /Odul/*
Disallow: /*?pgidx=*
Disallow: /activity.aspx*
Disallow: /uye/*
Disallow: /VideoMobile/*
Disallow: /ads/j.js*
Disallow: /*/rss
Disallow: /*/hareket-dokumu
Disallow: /videoyukle/*
Disallow: /data/*
Disallow: /Data/*
Disallow: /cache/*
Disallow: /NewsSend.aspx
Disallow: /gallerybox?g=*
Disallow: /editorNews.aspx*
Disallow: /NewsPrint.aspx
Disallow: /mesaj/yonlen/*
Disallow: /*/uye/*
Disallow: /?type=*
Disallow: /profil/*
Disallow: /images/Thumbs.aspx?Id=*
Disallow: /icerik-bildir
Disallow: /amp-video/*.jpg
Disallow: /updatestats.aspx
Disallow: /ads/*
Disallow: /MobileApi/*
Disallow: /*?type=*
Sitemap: https://www.donanimhaber.com/sitemaps/tagSitemapIndex.xml
Sitemap: https://www.donanimhaber.com/site-sitemaps/news-sitemap
Disallow: /teknotel/*
Disallow: /member/operations*
Disallow: /testler/*/*?s=
Disallow: /gundem/*
Disallow: /chunk-
Disallow: /test-lider-tablosu?id

History

Changes recorded since June 2026.

No change recorded.

In context

Turkey
11.8% block at least one AI crawler
Behind Cloudflare
No