90minutos.co · Colombia · measured 8 Oct 2026
As read on 8 Oct 2026, 2,607 bytes. 1 rule group name AI crawlers; shown first.
User-agent: Facebookbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: * Disallow: /wp-admin/ Disallow: /xmlrpc.php Disallow: /cgi-bin/ Disallow: /?s= Disallow: /search Disallow: /*trackback Disallow: /trackback Disallow: /*/trackback Disallow: /comments/ Disallow: /comments/feed/ Disallow: /*/attachment/ Disallow: /*/*/*/feed/ Disallow: /*/*/*/feed/rss2/ Disallow: /tag/*/page/ Disallow: /tag/*/feed/ Disallow: /page/ Disallow: /*/page/ Disallow: /?attachment_id* Disallow: /error_log.txt Disallow: /error_log Disallow: /cron.php Disallow: /cron.sh Disallow: /install.php Disallow: /LICENSE.* Disallow: /STATUS.txt Disallow: /*.pdf$ Allow: /wp-content/themes/ Allow: /wp-content/plugins/ Allow: /wp-content/uploads/ Allow: /wp-content/*.js Allow: /wp-content/*.css Allow: /wp-includes/*.js Allow: /wp-includes/*.css Allow: /*.css$ Allow: /*.js$ Allow: /sitemap/ Allow: /sitemap/* Allow: /sitemaps/* Allow: /rss/ Allow: /rss/* User-agent: Googlebot Allow: /wp-content/uploads/ Allow: /wp-includes/*.js Allow: /wp-includes/*.css Allow: /*.css$ Allow: /*.js$ Allow: /wp-json/wp/v2/ User-agent: Googlebot-Video Allow: /videos/ Allow: /wp-content/uploads/videos/ User-agent: facebookexternalhit Allow: / User-agent: Facebot Allow: / User-agent: noxtrumbot Crawl-delay: 20 User-agent: msnbot Crawl-delay: 20 User-agent: Slurp Crawl-delay: 20 User-agent: HTTrack Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: wget Disallow: / User-agent: grub-client Disallow: / User-agent: k2spider Disallow: / User-agent: NPBot Disallow: / User-agent: WebReaper Disallow: / User-agent: libwww Disallow: / User-agent: Download Ninja Disallow: / User-agent: MSIECrawler Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: ZyBORG Disallow: / Sitemap: https://90minutos.co/sitemap_index.xml Sitemap: https://90minutos.co/category-sitemap.xml Sitemap: https://90minutos.co/video-sitemap.xml Sitemap: https://90minutos.co/news-sitemap.xml
Changes recorded since June 2026.
No change recorded.