CrawlerPulse
CrawlerPulse / Asia / Cyprus / euronews.com

Euronews

euronews.com · Cyprus · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Blocked
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 2,387 bytes. 2 rule groups name AI crawlers; shown first.

User-agent: OAI-SearchBot
User-agent: ChatGPT-User
User-agent: PerplexityBot
User-agent: FirecrawlAgent
User-agent: AndiBot
User-agent: ExaBot
User-agent: PhindBot
User-agent: YouBot
Disallow: /api/
Disallow: /media/Player6_0.swf*
Disallow: /js/main-*.js
Disallow: /js/streamsense-*.min.js
Disallow: /modules
Disallow: /plugin
Disallow: /src
Disallow: /handler
Disallow: /utils
Disallow: /lib
Disallow: /helper
Disallow: /update_
Disallow: /instances
Disallow: /dom
Disallow: /class
Disallow: /client
Disallow: /_partners/
Disallow: /login
Disallow: /register
Disallow: /meteo/*p=
Disallow: /weather/*p=
Disallow: /wetter/*p=
Disallow: /tempo/*p=
Disallow: /tiempo/*p=
Disallow: /meteorologia/*p=
Disallow: /hava-durumu/*p=
Disallow: /idojaras/*p=
Allow: /

User-agent: GPTBot
User-agent: CCBot
Disallow: /
Sitemap: https://www.euronews.com/news.xml
Sitemap: https://www.euronews.com/sitemap/articles.xml
Sitemap: https://www.euronews.com/sitemap/ai-translated.xml
Sitemap: https://www.euronews.com/sitemap/external-pages.xml
Sitemap: https://www.euronews.com/sitemap/internal-pages.xml
Sitemap: https://www.euronews.com/sitemap/lettered-pages/tags.xml
Sitemap: https://www.euronews.com/sitemap/lettered-pages/programs.xml
Sitemap: https://www.euronews.com/sitemap/lettered-pages/themes.xml
Sitemap: https://www.euronews.com/sitemap/lettered-pages/contributors.xml
Sitemap: https://www.euronews.com/sitemap/lettered-pages/countries.xml
Sitemap: https://www.euronews.com/sitemap/lettered-pages/hubs.xml
Sitemap: https://www.euronews.com/sitemap/lettered-pages/verticals.xml
Sitemap: https://www.euronews.com/sitemap/lettered-pages/continents.xml

User-agent: *
Disallow: /api/
Disallow: /media/Player6_0.swf*
Disallow: /js/main-*.js
Disallow: /js/streamsense-*.min.js
Disallow: /modules
Disallow: /plugin
Disallow: /src
Disallow: /handler
Disallow: /utils
Disallow: /lib
Disallow: /helper
Disallow: /update_
Disallow: /instances
Disallow: /dom
Disallow: /class
Disallow: /client
Disallow: /_partners/
Disallow: /login
Disallow: /register
Disallow: /internal/articles/previous/
Disallow: /internal/articles/next/
Disallow: /meteo/*p=
Disallow: /weather/*p=
Disallow: /wetter/*p=
Disallow: /tempo/*p=
Disallow: /tiempo/*p=
Disallow: /meteorologia/*p=
Disallow: /hava-durumu/*p=
Disallow: /idojaras/*p=

History

Changes recorded since June 2026.

No change recorded.

In context

Cyprus
6.6% block at least one AI crawler
Behind Cloudflare
No