CrawlerPulse
CrawlerPulse / Asia / Turkey / aspor.com.tr

A Spor

aspor.com.tr · Turkey · Turkuvaz Medya Grubu · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 892 bytes. No rule names an AI crawler.

User-agent: *
Sitemap: https://www.aspor.com.tr/sitemap/news.xml
Sitemap: https://www.aspor.com.tr/sitemap/post.xml
Sitemap: https://www.aspor.com.tr/sitemap/video.xml
Sitemap: https://www.aspor.com.tr/sitemap/tags.xml
Sitemap: https://www.aspor.com.tr/sitemap/image.xml
Disallow: /bize-ulasin
Disallow: /arama
Disallow: /webtv/iframe/*
Disallow: /iframe/*
Disallow: /js
Disallow: /json
Disallow: /ajax
Disallow: /infinite/article/*
Disallow: /cdn-cgi/speculation
Disallow: /infinitecategoryjson/
Disallow: /turkiye-kupasi/kupatv/popupvideo*
Disallow: /turkiye-kupasi/infinite/article/*
Disallow: /turkiye-kupasi/json/galeri/*
Disallow: /turkiye-kupasi/haber-gonder*
Disallow: /turkiye-kupasi/video/othervideoframe*
Disallow: /turkiye-kupasi/ajax/home/widgetframes*
Disallow: /secim/
Disallow: /fetch
Disallow: *getcandidatetopinfo*
Content-Signal: search=yes, ai-input=yes, ai-train=no

History

Changes recorded since June 2026.

No change recorded.

In context

Turkey
11.8% block at least one AI crawler
Behind Cloudflare
No
Same group