CrawlerPulse
CrawlerPulse / Europe / Hungary / 24.hu

24.hu

24.hu · Hungary · Central Médiacsoport Zrt. · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 886 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /wp-admin/
Disallow: /trackback/
Disallow: /xmlrpc.php
Disallow: /files/
Disallow: /*?*skip=
Disallow: /*&*skip=
Disallow: /*?*Skip=
Disallow: /*&*Skip=
Disallow: /centralsso/
Disallow: /*?jwsource=cl
Disallow: /*&jwsource=cl
Disallow: /*utm_
Disallow: /*fbclid
Disallow: /*gclid

User-agent: facebookexternalhit
Disallow: /wp-admin/
Disallow: /trackback/
Disallow: /xmlrpc.php
Disallow: /files/
Disallow: /*?*skip=
Disallow: /*&*skip=
Disallow: /*?*Skip=
Disallow: /*&*Skip=
Disallow: /centralsso/
Disallow: /*?jwsource=cl
Disallow: /*&jwsource=cl
Disallow: /*gclid
Allow: /*utm_
Allow: /*fbclid
Sitemap: https://24.hu/app/uploads/sitemap/24.hu_sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Hungary
6.7% block at least one AI crawler
Behind Cloudflare
No
Same group