eluniversal.com.mx · Mexico · El Universal, Compañía Periodística Nacional · measured 8 Oct 2026
As read on 8 Oct 2026, 4,836 bytes. 17 rule groups name AI crawlers; shown first.
User-agent: Google-Extended Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: PerplexityBot Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: FacebookBot Disallow: / User-agent: Diffbot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: PetalBot Disallow: / User-agent: * Disallow: / User-agent: Googlebot User-agent: Googlebot-News User-agent: Googlebot-Image User-agent: Googlebot-Video User-agent: Googlebot-Mobile User-agent: Storebot-Google User-agent: bingbot User-agent: DuckDuckBot User-agent: Applebot User-agent: Yandex Allow: / Disallow: /files/ Disallow: /descuentos/ Disallow: /buscador Disallow: /mi-cuenta/ Disallow: /sala-plus/mi-cuenta/ Disallow: /content/ User-agent: AdsBot-Google User-agent: Mediapartners-Google Allow: / Disallow: /files/ Disallow: /mi-cuenta/ Disallow: /sala-plus/mi-cuenta/ Disallow: /content/ User-agent: Twitterbot User-agent: facebookexternalhit User-agent: Facebot User-agent: LinkedInBot User-agent: WhatsApp User-agent: Slackbot User-agent: TelegramBot User-agent: Pinterestbot User-agent: Discordbot Allow: / Disallow: /mi-cuenta/ Disallow: /sala-plus/mi-cuenta/ Disallow: /content/ Disallow: /buscador User-agent: Claude-User Disallow: / User-agent: Claude-SearchBot Disallow: / User-agent: Perplexity-User Disallow: / User-agent: meta-webindexer Disallow: / User-agent: meta-externalads Disallow: / User-agent: meta-externalfetcher Disallow: / User-agent: AI2Bot Disallow: / User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-agent: wget Disallow: / User-agent: grub-client Disallow: / User-agent: k2spider Disallow: / User-agent: NPBot Disallow: / User-agent: WebReaper Disallow: / Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/tendencias/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/techbit/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/opinion/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/nacion/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/mundo/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/menu/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/estados/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/espectaculos/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/destinos/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/cultura/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/cartera/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/autopistas/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/general/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/news/?outputType=xml Sitemap: https://www.eluniversal.com.mx/arc/outboundfeeds/sitemap/category/deportes/?outputType=xml Sitemap: https://www.eluniversal.com.mx/consultas/sitemapindex.xml Sitemap: https://www.eluniversal.com.mx/horoscopo/sitemap.xml
Changes recorded since June 2026.