haberantalya.com · Turkey · measured 8 Oct 2026
As read on 8 Oct 2026, 978 bytes. 1 rule group name AI crawlers; shown first.
User-agent: meta-externalagent Crawl-delay: 10 User-agent: WhatsApp Allow: / User-agent: WhatsApp/2.0 Allow: / User-agent: facebookexternalhit Allow: / User-agent: Facebot Allow: / User-agent: meta-externalfetcher Allow: / User-agent: Twitterbot Allow: / User-agent: TelegramBot Allow: / User-agent: * Disallow: /api/ Disallow: /v.js/ Disallow: /categories Disallow: /post/*/comments Disallow: /post/*/emojis Disallow: /post/*/emoji-votes Disallow: /arama$ Disallow: /arama? Disallow: /*.php$ Disallow: /_mail_ Disallow: /images/fonts/ Disallow: /*?ref= Disallow: /*?q= Disallow: /*?query= Disallow: /*?utm_source= Disallow: /*?page= Disallow: /*?cursor= Disallow: /*_token= Sitemap: https://www.haberantalya.com/sitemap.xml Sitemap: https://www.haberantalya.com/google_news.xml User-agent: bingbot Crawl-delay: 10 User-agent: Yandex Crawl-delay: 10 User-agent: meta-webindexer Crawl-delay: 10
Changes recorded since June 2026.
No change recorded.