x17online.com

x17online.com · United States · measured 8 Oct 2026

Google Search

Allowed

Google-Extended

Allowed

OpenAI

Allowed

Anthropic

Allowed

Perplexity

Allowed

robots.txt

As read on 8 Oct 2026, 533 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /celebrities/britney_spears/should_britney_have_performed-09082008.php
Disallow: /celebrities/britney_spears/in_case_you_missed_it_brits_vmas_intro_with_jonah_hill-09082008.php
Disallow: /celebrities/britney_spears/britney_does_a_photoshoot_in_belair-09102008.php
Disallow: /celebrities/britney_spears/x17_first_brit_debuts_womanizer_video-10102008.php
Disallow: /media/*
Disallow: /celebrities/*

User-agent: DataForSeoBot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: Barkrowler
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

United States

63.2% block at least one AI crawler

Behind Cloudflare