CrawlerPulse
CrawlerPulse / Asia / Turkey / haberturk.com

haberturk

haberturk.com · Turkey · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,949 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /Flash
Disallow: /uyelik
Disallow: /liste/sonhaberler
Disallow: /dynamics/*
Disallow: /*/dynamics/*
Disallow: /chart/*
Disallow: /globals
Disallow: /yorumlar
Disallow: /video/yorumlar
Disallow: /video/dynamics/*
Disallow: /galeri/yorumlar
Disallow: /magazin/yorumlar
Disallow: /ekonomi/yorumlar
Disallow: /spor/yorumlar
Disallow: /haberdetay/tavsiyeHaber
Disallow: /spor/haberdetay/tavsiyeHaber
Disallow: /spor/macmerkezi/*
Disallow: /ekonomi/haberdetay/tavsiyeHaber
Disallow: /magazin/haberdetay/tavsiyeHaber
Disallow: /arama/*
Disallow: /sinema-rehberi/ara
Disallow: /sinema-rehberi/ara?tr=*
Disallow: /haber-tuneli/
Disallow: /etiket/
Disallow: /general/
Disallow: /*/infiniteLoad*
Disallow: /infinite/kategori/*
Disallow: /video/infinite/kategori/*
Disallow: /infinite/kategori/htgastro/*
Disallow: /infinite/news/*
Disallow: /infinite/local-news/*
Disallow: /infinite/special-author/*/*
Disallow: /infinite/yerel-haberler/*
Disallow: /infinite/stil/*
Disallow: /anket/index/*
Disallow: /index
Disallow: /basinilan
Disallow: /liste/arama
Disallow: /htyazarlar/liste
Disallow: /tumhaberler/liste
Disallow: /magazin/etiket
Disallow: /magazin/tumhaberler
Disallow: /ekonomi/tumhaberler
Disallow: /info/gizlilik-politikasi
Disallow: /widgets/widget-republic-day
Disallow: /widgets/widget-10-kasim
Disallow: /tv/arama/*
Disallow: /*/ajaxload/
Disallow: /htgastro/ara
Disallow: /ekonomi/haberdetay/siblings/*
Disallow: /spor/haberdetay/siblings/*
Disallow: /magazin/haberdetay/siblings/*
Disallow: /ekonomi/details/siblings/*
Disallow: /spor/details/siblings/*
Disallow: /magazin/details/siblings/*
Disallow: /uyelik/login
Disallow: /tummansetler/LoadMoreNews
Disallow: /ekonomi/tummansetler/LoadMoreNews
Disallow: /spor/tummansetler/LoadMoreNews
Disallow: /kesfet/LoadMoreNews
Disallow: /magazin/muzik-eski/*
Disallow: /magazin/globals/SocialBox/*
Disallow: /ekonomi/globals/SocialBox/*
Disallow: /spor/globals/SocialBox/*
Disallow: /*/details/FotoHaberKategoriSidebar/*
Disallow: /haberdetay/yazarindexDevam/*
Disallow: /haberdetay/index/*
Disallow: /siteneekle
Disallow: /siteneekle/*
Disallow: /gazetekeyfi/htmanset
Disallow: /kategori/ajaxKategoriData2/*
Disallow: /spor/iddaa/takim_karsilastirma/*
Disallow: /spor/kategori/teamListMenu/
Disallow: /kategori/loadmorenews?cat=*
Disallow: /yenimedya/yenimedya/hitsay/*/*
Disallow: /documentation/*
Disallow: /adscbg/test
Disallow: /ayar
Disallow: /video-test
Disallow: /video-test-qr
Disallow: /app-widget
Disallow: /haberdetay/preview/*
Disallow: /force-update/*
Disallow: /ekonomi/borsa/hisse/kaphaber/*
Disallow: /color-game
Allow: /dynamics/vdo
Allow: /dynamics/googlenewsstandrss
Sitemap: https://www.haberturk.com/sitemap.xml
Sitemap: https://www.haberturk.com/sitemap_google_news.xml
Sitemap: https://www.haberturk.com/sitemap_index_video.xml
Sitemap: https://www.haberturk.com/sitemap_recentvideo.xml
Sitemap: https://hthayat.haberturk.com/sitemap_google_news.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Turkey
11.8% block at least one AI crawler
Behind Cloudflare
No