riotimesonline.com · Brazil · measured 9 Oct 2026
As read on 9 Oct 2026, 3,590 bytes. 20 rule groups name AI crawlers; shown first.
User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: YouBot Allow: / User-agent: MistralAI-User Allow: / User-agent: CCBot Disallow: / Sitemap: https://www.riotimesonline.com/sitemap_index.xml Sitemap: https://www.riotimesonline.com/news-sitemap.xml User-agent: Applebot-Extended Disallow: / User-agent: meta-externalagent Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Diffbot Disallow: / User-agent: Timpibot Disallow: / User-agent: omgili Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: * Crawl-delay: 2 Disallow: /xmlrpc.php Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /readme.html Disallow: /license.txt Disallow: /comments/feed/ Disallow: /trackback/ Disallow: /wp-json/wordpress-popular-posts/ Disallow: /dev2/ Disallow: /log-in/ User-agent: Googlebot Disallow: /tag/*/feed/ Allow: /wp-json/ Disallow: /wp-json/rtv6/ Disallow: /wp-json/rtlane/ Allow: /wp-admin/admin-ajax.php Allow: /wp-content/uploads/ Disallow: /dev2/ Disallow: /log-in/ User-agent: Googlebot-News Allow: / User-agent: Googlebot-Image Allow: /wp-content/uploads/ User-agent: * Disallow: /wp-json/rtv6/ Disallow: /wp-json/rtlane/ User-agent: Bingbot Disallow: /tag/*/feed/ Crawl-delay: 10 Disallow: /wp-json/ Allow: /wp-admin/admin-ajax.php Allow: /wp-content/uploads/ Disallow: /dev2/ Disallow: /xmlrpc.php Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /log-in/ User-agent: AdsBot-Google Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Perplexity-User Allow: / User-agent: GoogleOther Allow: / User-agent: DuckAssistBot Allow: / User-agent: Scrapy Disallow: / User-agent: AhrefsBot Crawl-delay: 2 Allow: / Disallow: /log-in/ Disallow: /dev2/
Changes recorded since June 2026.
No change recorded.