dailykos.com · United States · measured 8 Oct 2026
As read on 8 Oct 2026, 710 bytes. 1 rule group name AI crawlers; shown first.
User-agent: Amazonbot User-agent: Applebot-Extended User-agent: CCBot User-agent: ClaudeBot User-agent: GPTBot User-agent: Google-Extended User-agent: GoogleOther User-agent: Meta-ExternalAgent User-agent: FacebookBot Disallow: / Allow: /license.xml License: https://www.dailykos.com/license.xml User-agent: * Disallow: /wp-admin/ Disallow: /?s= Allow: /wp-admin/admin-ajax.php Allow: /license.xml User-agent: AhrefsBot User-agent: AhrefsSiteAudit User-agent: barkrowler User-agent: DataForSeoBot User-agent: dotbot User-agent: rogerbot User-agent: SemrushBot User-agent: SiteAuditBot User-agent: SemrushBot-BA Disallow: / Allow: /license.xml Sitemap: https://www.dailykos.com/sitemap.xml
Changes recorded since June 2026.
No change recorded.