aristeguinoticias.com · Mexico · Aristegui Noticias · measured 8 Oct 2026
As read on 8 Oct 2026, 61,825 bytes. 2 rule groups name AI crawlers; shown first.
User-agent: PetalBot Allow: User-agent: CCBot Disallow:/ User-agent: * User-agent: grapeshot Disallow: Allow: /editorial/wp-admin/admin-ajax.php Allow: /?feed=notificaciones Allow: /?feed=msnarticulo Sitemap: https://editorial.aristeguinoticias.com/news-sitemap.xml Disallow: /videojs-flashls-source-handler/1.4.8/video-js.swf User-agent: 173.212soso Disallow:/ User-agent: 192.comagent Disallow:/ User-agent: 1noonbot Disallow:/ User-agent: 1on1searchbot Disallow:/ User-agent: 360Spider Disallow:/ User-agent: 3de_search2 Disallow:/ User-agent: 3d_search Disallow:/ User-agent: 3g bot Disallow:/ User-agent: 3gse Disallow:/ User-agent: 404checker Disallow:/ User-agent: 404enemy Disallow:/ User-agent: 50.nu Disallow:/ User-agent: 80legs Disallow:/ User-agent: A1 sitemap generator Disallow:/ User-agent: A1 website download Disallow:/ User-agent: A6-indexer Disallow:/ User-agent: Aasp Disallow:/ User-agent: Abachobot Disallow:/ User-agent: Abonti Disallow:/ User-agent: Abotemailsearch Disallow:/ User-agent: Aboundex Disallow:/ User-agent: Aboutusbot Disallow:/ User-agent: Accmonitor compliance server Disallow:/ User-agent: Accoon Disallow:/ User-agent: Achulkov.net page walker Disallow:/ User-agent: Acme.spider Disallow:/ User-agent: Acoonbot Disallow:/ User-agent: Acquia-crawler Disallow:/ User-agent: Activetouristbot Disallow:/ User-agent: Acunetix Disallow:/ User-agent: Adamm bot Disallow:/ User-agent: Adbeat_bot Disallow:/ User-agent: ADmantX Disallow:/ User-agent: Adminshop.com Disallow:/ User-agent: Ad muncher Disallow:/ User-agent: Advanced email extractor Disallow:/ User-agent: Aesop_com_spiderman Disallow:/ User-agent: Aespider Disallow:/ User-agent: AfD-Verbotsverfahren Disallow:/ User-agent: Af knowledge now verity spider Disallow:/ User-agent: Aggregator:vocus Disallow:/ User-agent: Ah-ha.com crawler Disallow:/ User-agent: Ahrefs Disallow:/ User-agent: AhrefsBot Disallow:/ User-agent: AIBOT Disallow:/ User-agent: Aidu Disallow:/ User-agent: AiHitBot Disallow:/ User-agent: Aipbot Disallow:/ User-agent: Aisiid Disallow:/ User-agent: Aitcsrobot/1.1 Disallow:/ User-agent: Ajsitemap Disallow:/ User-agent: Akamai-sitesnapshot Disallow:/ User-agent: Alexawebsearchplatform Disallow:/ User-agent: Alexfdownload Disallow:/ User-agent: Alexibot Disallow:/ User-agent: Alkalinebot Disallow:/ User-agent: All acronyms bot Disallow:/ User-agent: Alligator Disallow:/ User-agent: AllSubmitter Disallow:/ User-agent: AlphaBot Disallow:/ User-agent: Alpha search agent Disallow:/ User-agent: Amerla search bot Disallow:/ User-agent: Amfibibot Disallow:/ User-agent: Ampmppc.com Disallow:/ User-agent: Amznkassocbot Disallow:/ User-agent: Anarchie Disallow:/ User-agent: Anemone Disallow:/ User-agent: Anonymous Disallow:/ User-agent: Anotherbot Disallow:/ User-agent: Answerbot Disallow:/ User-agent: Answerbus Disallow:/ User-agent: Answerchase prove Disallow:/ User-agent: Antbot Disallow:/ User-agent: Antibot Disallow:/ User-agent: Antisantyworm Disallow:/ User-agent: Antro.net Disallow:/ User-agent: Aonde-spider Disallow:/ User-agent: Apexoo Disallow:/ User-agent: Aport Disallow:/ User-agent: Appengine-google Disallow:/ User-agent: Appid: s~stremor-crawler- Disallow:/ User-agent: Aqua_products Disallow:/ User-agent: Arabot Disallow:/ User-agent: Arachmo Disallow:/ User-agent: Arachnophilia Disallow:/ User-agent: Aria equalizer Disallow:/ User-agent: Arianna.libero.it Disallow:/ User-agent: Arikus_spider Disallow:/ User-agent: Artavisbot Disallow:/ User-agent: Artera Disallow:/ User-agent: Art-online.com Disallow:/ User-agent: Asaha search engine turkey Disallow:/ User-agent: Ask Disallow:/ User-agent: Aspider Disallow:/ User-agent: ASPSeek Disallow:/ User-agent: Asterias Disallow:/ User-agent: Astrofind Disallow:/ User-agent: Athenusbot Disallow:/ User-agent: Atlocalbot Disallow:/ User-agent: Atomic_email_hunter Disallow:/ User-agent: Attach Disallow:/ User-agent: Attrakt Disallow:/ User-agent: Attributor Disallow:/ User-agent: Augurfind Disallow:/ User-agent: Auresys Disallow:/ User-agent: Autobaron crawler Disallow:/ User-agent: Autoemailspider Disallow:/ User-agent: Autowebdir Disallow:/ User-agent: Avsearch- Disallow:/ User-agent: Axfeedsbot Disallow:/ User-agent: Axonize-bot Disallow:/ User-agent: Ayna Disallow:/ User-agent: B2w Disallow:/ User-agent: BackDoorBot Disallow:/ User-agent: Backlink-Ceck Disallow:/ User-agent: Backlink-check Disallow:/ User-agent: BacklinkCrawler Disallow:/ User-agent: Backrub Disallow:/ User-agent: BackStreet Disallow:/ User-agent: Backstreet browser Disallow:/ User-agent: BackWeb Disallow:/ User-agent: Badass Disallow:/ User-agent: Bandit Disallow:/ User-agent: Barkrowler Disallow:/ User-agent: BatchFTP Disallow:/ User-agent: Battleztar Bazinga Disallow:/ User-agent: Baypup Disallow:/ User-agent: BBBike Disallow:/ User-agent: BDCbot Disallow:/ User-agent: BDFetch Disallow:/ User-agent: Becomebot Disallow:/ User-agent: Becomejpbot Disallow:/ User-agent: Beetlebot Disallow:/ User-agent: Bender Disallow:/ User-agent: Besserscheitern-crawl Disallow:/ User-agent: BetaBot Disallow:/ User-agent: Bigado.com Disallow:/ User-agent: Big brother Disallow:/ User-agent: Bigcliquebot Disallow:/ User-agent: Big data Disallow:/ User-agent: Bigfoot Disallow:/ User-agent: Biglotron Disallow:/ User-agent: Bilbo Disallow:/ User-agent: Bilgibetabot Disallow:/ User-agent: Bilgibot Disallow:/ User-agent: Bintellibot Disallow:/ User-agent: Bitacle Disallow:/ User-agent: Bitlybot Disallow:/ User-agent: Bitvouseragent Disallow:/ User-agent: Bizbot Disallow:/ User-agent: Bizworks retriever Disallow:/ User-agent: Blackbird Disallow:/ User-agent: Blackboard Disallow:/ User-agent: Black.hole Disallow:/ User-agent: Black Hole Disallow:/ User-agent: Blackmask.net search engine Disallow:/ User-agent: BlackWidow Disallow:/ User-agent: Bladder fusion Disallow:/ User-agent: Blaiz-bee Disallow:/ User-agent: Blexbot Disallow:/ User-agent: Blinkx Disallow:/ User-agent: Blitzbot Disallow:/ User-agent: Blog conversation project Disallow:/ User-agent: Blogmyway Disallow:/ User-agent: Blogpulselive Disallow:/ User-agent: Blogrefsbot Disallow:/ User-agent: Blogscope Disallow:/ User-agent: Blogslive Disallow:/ User-agent: Bloobybot Disallow:/ User-agent: Blow Disallow:/ User-agent: BlowFish Disallow:/ User-agent: Blt Disallow:/ User-agent: Bnf.fr_bot Disallow:/ User-agent: Boaconstrictor Disallow:/ User-agent: Boardreader Disallow:/ User-agent: Boia.org Disallow:/ User-agent: Boia-scan-agent Disallow:/ User-agent: Boi_crawl_00 Disallow:/ User-agent: Boitho Disallow:/ User-agent: Bolt Disallow:/ User-agent: Bookmark buddy bookmark checker Disallow:/ User-agent: Bookmark search tool Disallow:/ User-agent: Bosug Disallow:/ User-agent: BotALot Disallow:/ User-agent: Bot apoena Disallow:/ User-agent: Botrighthere Disallow:/ User-agent: Botswana Disallow:/ User-agent: Bottybot Disallow:/ User-agent: Bpbot Disallow:/ User-agent: Braintime_search Disallow:/ User-agent: Brandprotect Disallow:/ User-agent: Brandwatch Disallow:/ User-agent: Brokenlinkcheck.com Disallow:/ User-agent: Browseremulator Disallow:/ User-agent: Browsermob Disallow:/ User-agent: Bruinbot Disallow:/ User-agent: Bsearchr&d Disallow:/ User-agent: Bspider Disallow:/ User-agent: Btbot Disallow:/ User-agent: Btsearch Disallow:/ User-agent: Bubing Disallow:/ User-agent: Buddy Disallow:/ User-agent: Buibui Disallow:/ User-agent: Buildcms crawler Disallow:/ User-agent: BuiltBotTough Disallow:/ User-agent: BuiltWith Disallow:/ User-agent: Bullseye Disallow:/ User-agent: Bumblebee Disallow:/ User-agent: BunnySlippers Disallow:/ User-agent: Buscadorclarin Disallow:/ User-agent: Buscaplus robi Disallow:/ User-agent: Butterfly Disallow:/ User-agent: Buyhawaiibot Disallow:/ User-agent: Buzzbot Disallow:/ User-agent: BuzzSumo Disallow:/ User-agent: Byindia Disallow:/ User-agent: Byspider Disallow:/ User-agent: Byteserver Disallow:/ User-agent: Bzbot Disallow:/ User-agent: Cacheblaster Disallow:/ User-agent: Caddbot Disallow:/ User-agent: Cafi Disallow:/ User-agent: Calculon Disallow:/ User-agent: Camcrawler Disallow:/ User-agent: Camelstampede Disallow:/ User-agent: Canon-webrecord Disallow:/ User-agent: Careerbot Disallow:/ User-agent: Cataguru Disallow:/ User-agent: Catchbot Disallow:/ User-agent: CATExplorador Disallow:/ User-agent: Cazoodle Disallow:/ User-agent: Ccgcrawl Disallow:/ User-agent: Ccubee Disallow:/ User-agent: Cd-preload Disallow:/ User-agent: Cegbfeieh Disallow:/ User-agent: Ce-preload Disallow:/ User-agent: Cerberian drtrs Disallow:/ User-agent: Cert figleafbot Disallow:/ User-agent: Cfetch Disallow:/ User-agent: Cfnetwork Disallow:/ User-agent: Chameleon Disallow:/ User-agent: Charlotte Disallow:/ User-agent: Checkbot Disallow:/ User-agent: Check&get Disallow:/ User-agent: Checklinks Disallow:/ User-agent: CheeseBot Disallow:/ User-agent: Chemiede-nodebot Disallow:/ User-agent: CherryPicker Disallow:/ User-agent: Chilkat Disallow:/ User-agent: ChinaClaw Disallow:/ User-agent: Chlooe Disallow:/ User-agent: Chromeframe Disallow:/ User-agent: Cipinetbot Disallow:/ User-agent: Cis455crawler Disallow:/ User-agent: Citeseerxbot Disallow:/ User-agent: Cizilla Disallow:/ User-agent: Clariabot Disallow:/ User-agent: Claritybot Disallow:/ User-agent: Climate ark Disallow:/ User-agent: Climateark spider Disallow:/ User-agent: Cliqzbot Disallow:/ User-agent: Cloud mapping Disallow:/ User-agent: Clshttp Disallow:/ User-agent: Clushbot Disallow:/ User-agent: Coast scan engine Disallow:/ User-agent: Coast webmaster pro Disallow:/ User-agent: Coccoc Disallow:/ User-agent: Coccocbot-web Disallow:/ User-agent: Cogentbot Disallow:/ User-agent: Cognitiveseo Disallow:/ User-agent: Collapsarweb Disallow:/ User-agent: Collector Disallow:/ User-agent: Colocrossing Disallow:/ User-agent: Combine Disallow:/ User-agent: Com.plumanalytics Disallow:/ User-agent: Connectsearch Disallow:/ User-agent: Conpilot Disallow:/ User-agent: Contentsmartz Disallow:/ User-agent: Contextad bot Disallow:/ User-agent: Contype Disallow:/ User-agent: Cookienet Disallow:/ User-agent: Coolbot Disallow:/ User-agent: Coolcheck Disallow:/ User-agent: Copernic Disallow:/ User-agent: Copier Disallow:/ User-agent: CopyRightCheck Disallow:/ User-agent: Copyscape Disallow:/ User-agent: Core-project Disallow:/ User-agent: Cosmos Disallow:/ User-agent: Covario-ids Disallow:/ User-agent: Cowbot- Disallow:/ User-agent: Cowdog bot Disallow:/ User-agent: Crabbybot Disallow:/ User-agent: Craftbot Disallow:/
Changes recorded since June 2026.
No change recorded.