CrawlerPulse
CrawlerPulse / North America / Dominican Republic / domrep-magazin.de

DomRep-Magazin / Nachrichten aus und über die Dominikanische Republik

domrep-magazin.de · Dominican Republic · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 307 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /webdesk/
Disallow: /paypal/
Sitemap: https://www.domrep-magazin.de/sitemap.txt
Sitemap: https://www.domrep-magazin.de/archiv/artikel/sitemap.txt
Sitemap: https://www.domrep-magazin.de/archiv/kurznotiert/sitemap.txt
Sitemap: https://www.domrep-magazin.de/archiv/panorama/sitemap.txt

History

Changes recorded since June 2026.

No change recorded.

In context

Dominican Republic
6.2% block at least one AI crawler
Behind Cloudflare
Yes