CrawlerPulse
CrawlerPulse / North America / Mexico / milenionovedades.com

Milenio Novedades, las noticias de hoy en Yucatán

milenionovedades.com · Mexico · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 8,570 bytes. No rule names an AI crawler.

<!DOCTYPE html><html lang="es"><head><meta charSet="utf-8"/><meta name="theme-color" content="#FF681F"/><link rel="apple-touch-icon" href="/images/icons-192.png"/><link crossorigin="true" href="https://suplement-panel.novedadesqroo.com" rel="preconnect"/><link crossorigin="true" href="https://imasdk.googleapis.com" rel="preconnect"/><meta charSet="utf-8"/><meta name="viewport" content="width=device-width,minimum-scale=1,initial-scale=1"/><meta name="next-head-count" content="2"/><link rel="preload" href="/_next/static/-4QUSko0Tpxh9p0XnIM_X/pages/section.js" as="script"/><link rel="preload" href="/_next/static/-4QUSko0Tpxh9p0XnIM_X/pages/_app.js" as="script"/><link rel="preload" href="/_next/static/runtime/webpack-d263bb24e3cfae7b0dd5.js" as="script"/><link rel="preload" href="/_next/static/chunks/commons.9194f22653cbc360caf0.js" as="script"/><link rel="preload" href="/_next/static/runtime/main-64b092ee30eba9afc3ae.js" as="script"/><link rel="preload" href="/_next/static/chunks/styles.6d72493d21958c419ed7.js" as="script"/><link rel="preload" href="/_next/static/css/commons.9dea4f61.chunk.css" as="style"/><link rel="stylesheet" href="/_next/static/css/commons.9dea4f61.chunk.css"/><link rel="preload" href="/_next/static/css/styles.392c25d3.chunk.css" as="style"/><link rel="stylesheet" href="/_next/static/css/styles.392c25d3.chunk.css"/><style id="__jsx-2138236485">#nprogress{pointer-events:none;}#nprogress .bar{background:#FF681F;position:fixed;z-index:1000000000;top:0;left:0;width:100%;height:3px;}#nprogress .peg{display:block;position:absolute;right:0px;width:100px;height:100%;box-shadow:0 0 10px #FF681F,0 0 5px #FF681F;opacity:1;-webkit-transform:rotate(3deg) translate(0px,-4px);-ms-transform:rotate(3deg) translate(0px,-4px);-webkit-transform:rotate(3deg) translate(0px,-4px);-ms-transform:rotate(3deg) translate(0px,-4px);transform:rotate(3deg) translate(0px,-4px);}#nprogress .spinner{display:"block";position:fixed;z-index:10000000;top:15px;right:15px;}#nprogress .spinner-icon{width:18px;height:18px;box-sizing:border-box;border:solid 2px transparent;border-top-color:#FF681F;border-left-color:#FF681F;border-radius:50%;-webkit-animation:nprogresss-spinner 400ms linear infinite;-webkit-animation:nprogress-spinner 400ms linear infinite;animation:nprogress-spinner 400ms linear infinite;}.nprogress-custom-parent{overflow:hidden;position:relative;}.nprogress-custom-parent #nprogress .spinner,.nprogress-custom-parent #nprogress .bar{position:absolute;}@-webkit-keyframes nprogress-spinner{0%{-webkit-transform:rotate(0deg);}100%{-webkit-transform:rotate(360deg);}}@-webkit-keyframes nprogress-spinner{0%{-webkit-transform:rotate(0deg);-ms-transform:rotate(0deg);transform:rotate(0deg);}100%{-webkit-transform:rotate(360deg);-ms-transform:rotate(360deg);transform:rotate(360deg);}}@keyframes nprogress-spinner{0%{-webkit-transform:rotate(0deg);-ms-transform:rotate(0deg);transform:rotate(0deg);}100%{-webkit-transform:rotate(360deg);-ms-transform:rotate(360deg);transform:rotate(360deg);}}</style><style id="jss-server-side"></style></head><body><div id="__next"><div style="color:#000;background:#fff;font-family:-apple-system, BlinkMacSystemFont, Roboto, &quot;Segoe UI&quot;, &quot;Fira Sans&quot;, Avenir, &quot;Helvetica Neue&quot;, &quot;Lucida Grande&quot;, sans-serif;height:100vh;text-align:center;display:flex;flex-direction:column;align-items:center;justify-content:center"><div><style>body { margin: 0 }</style><h1 style="display:inline-block;border-right:1px solid rgba(0, 0, 0,.3);margin:0;margin-right:20px;padding:10px 23px 10px 0;font-size:24px;font-weight:500;vertical-align:top">404</h1><div style="display:inline-block;text-align:left;line-height:49px;height:49px;vertical-align:middle"><h2 style="font-size:14px;font-weight:normal;line-height:inherit;margin:0;padding:0">This page could not be found<!-- -->.</h2></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"dataManager":"[]","props":{"isServer":true,"initialState":{"menu":{"state":{"data":null},"data":[{"label":"Mérida","slug":"merida","type":"category","title":"Noticias de Mérida","target":"_top"},{"label":"Municipios","slug":"municipios","type":"category","title":"Noticias de Municipios de Yucatán","target":"_top"},{"label":"Policía","slug":"policia","type":"category","title":"Noticias de Policía en Yucatán","target":"_top"},{"label":"Deportes","slug":"deportes","type":"category","title":"Deportes de Yucatán","target":"_top"},{"label":"Espectáculos","slug":"espectaculos","type":"category","title":"Espectáculos","target":"_top"},{"label":"Tecnología y Salud","slug":"tecnologia-salud","type":"category","title":"Tecnología y Salud","target":"_top"},{"label":"Opinión","slug":"opinion","type":"category","title":"opinion","target":"_top"},{"label":"Ofertas","slug":"https://sipse.com/ofertas/","type":"url","title":"Ofertas","target":"_blank"},{"label":"Periódico","slug":"https://suscripciones.sipse.com/","type":"url","title":"Suscripciones Digitales","target":"_blank"},{"label":"Edición del día","slug":"https://suscripciones.sipse.com/edicion/","type":"url","title":"Edición del día","target":"_black"}]},"topNews":{"data":null},"topNewsNovedades":{"data":null},"topNewsYucatan":{"data":null},"dataSite":{"state":{"data":null},"data":{"home":"/","homeAs":"/novedades-yucatan/","domain":"novedadesyucatan.com","site":"novedades-yucatan","site_name":"Novedades Yucatán","url_suplemments":"/novedades-yucatan/suplementos/","socialNetworks":{"facebook":"https://www.facebook.com/NovedadesYucatan/","twitter":"https://twitter.com/NovedadesYuc","instagram":"https://www.instagram.com/novedadesyuc/","youtube":"https://www.youtube.com/user/gruposipse","rss":"https://twitter.com/NovedadesYuc"},"seo":{"description":"Infórmate de las noticias de hoy en Yucatán en Sipse.com. Las noticias de último minuto más sonadas y relevantes a nivel estatal y más.","keywords":"noticias yucatan, noticias de yucatan, noticias yucatan policia, noticias yucatan digital","author":"Novedades Yucatán","title":"Noticias de hoy en Yucatán - Grupo SIPSE"},"images":{"logoHeader":"logo-novedades-yucatan.svg"},"socialIds":{"facebookApp":132929594054447,"facebookPage":156286191058601,"twitter":"@NovedadesYuc"}}},"userAgent":{"state":{"data":""},"data":"desktop"},"actionsMenu":{"data":false},"categoryMenu":{"state":{"data":null},"data":{"name":"","slug":"","type":"category"}},"actionMenuMobile":{"data":false}},"initialProps":{"pageProps":{"seo":{"description":"Descripcion seccion","keywords":"Keywords seccion","author":"Grupo Sipse","title":"Title seccion"},"infoTaxonomy":{"name":"","slug":"","type":"category"},"postsFeatured":[],"posts":[],"excludeIds":[],"page":1,"errorPage":true,"isMinuteByMinute":false,"slug":"novedadesyucatan.comrobots.txt1","taxonomyType":"post_category","urlNextPage":"https://sipse.com/novedades-yucatan/robots.txt/archivo?pagina=2","urlPrevPage":"","postsDataStructure":[]}}},"page":"/section","query":{"category":"robots.txt","tag":false},"buildId":"-4QUSko0Tpxh9p0XnIM_X"}</script><script nomodule="" src="/_next/static/runtime/polyfills-ffbee8fc2d56778163a1.js" type="8cc15ac75d1eabb940a672b5-text/javascript"></script><script async="" data-next-page="/section" src="/_next/static/-4QUSko0Tpxh9p0XnIM_X/pages/section.js" type="8cc15ac75d1eabb940a672b5-text/javascript"></script><script async="" data-next-page="/_app" src="/_next/static/-4QUSko0Tpxh9p0XnIM_X/pages/_app.js" type="8cc15ac75d1eabb940a672b5-text/javascript"></script><script src="/_next/static/runtime/webpack-d263bb24e3cfae7b0dd5.js" async="" type="8cc15ac75d1eabb940a672b5-text/javascript"></script><script src="/_next/static/chunks/commons.9194f22653cbc360caf0.js" async="" type="8cc15ac75d1eabb940a672b5-text/javascript"></script><script src="/_next/static/runtime/main-64b092ee30eba9afc3ae.js" async="" type="8cc15ac75d1eabb940a672b5-text/javascript"></script><script src="/_next/static/chunks/styles.6d72493d21958c419ed7.js" async="" type="8cc15ac75d1eabb940a672b5-text/javascript"></script><script src="/cdn-cgi/scripts/7d0fa10a/cloudflare-static/rocket-loader.min.js" data-cf-settings="8cc15ac75d1eabb940a672b5-|49" defer></script><script type="module" src="https://static.cloudflareinsights.com/beacon.min.js/v4bc70e2c01a94c73b74392e4234840661791215815920" integrity="sha512-L0ha0OXavK/8okipN9F8BtP84dg9DUhPERbBXzwI6dgTA55d2+yweo3pn5CSFYs45/r8md2+xvUPtTdvTNRfjA==" data-cf-beacon='{"version":"2024.11.0","token":"a5263298ee064325af53eedd841b21fc","spa":2}' crossorigin="anonymous"></script>
</body></html>

History

Changes recorded since June 2026.

No change recorded.

In context

Mexico
11.1% block at least one AI crawler
Behind Cloudflare
Yes