CrawlerPulse
CrawlerPulse / Europe / Portugal / maxima.pt

Maxima

maxima.pt · Portugal · MediaLivre, S.A. · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 8 Oct 2026, 8,705 bytes. 17 rule groups name AI crawlers; shown first.

User-agent:Bytespider
Disallow: /

User-agent:CCBot
Disallow: /

User-agent:Diffbot
Disallow: /

User-agent:FacebookBot
Disallow: /

User-agent:ClaudeBot
Disallow: /

User-agent:anthropic-ai
Disallow: /

User-agent:Timpibot
Disallow: /

User-agent:Applebot-Extended
Disallow: /

User-agent:meta-externalagent
Disallow: /

User-agent:Amazonbot
Disallow: /

User-agent:omgili
Disallow: /

User-agent:omgilibot
Disallow: /

User-agent:cohere-ai
Disallow: /

User-agent:GPTBot
Disallow: /

User-agent:YouBot
Disallow: /

User-agent:DeepSeekBot
Disallow: /

User-agent:MistralAI-User
Disallow: /

User-agent: *
Disallow: /4196/
Sitemap: https://www.maxima.pt/sitemap

User-agent:ArenaUnfurlBot
Disallow: /

User-agent:ArsenalRadar
Disallow: /

User-agent:DiogoHub
Disallow: /

User-agent:Discourse
Disallow: /

User-agent:FacePlanetBot
Disallow: /

User-agent:FlagsideNewsBot
Disallow: /

User-agent:FootIA-NewsSync
Disallow: /

User-agent:GoalSignalNewsBot
Disallow: /

User-agent:HWRBot
Disallow: /

User-agent:Jornada.pt-Newsroom
Disallow: /

User-agent:KNK-Radar
Disallow: /

User-agent:KartalRecordAlerts
Disallow: /

User-agent:KauaiBot+runid=dev-test
Disallow: /

User-agent:LOCKR+Sports+App
Disallow: /

User-agent:LiveMentionBot
Disallow: /

User-agent:LosTops26
Disallow: /

User-agent:LuminaRadar
Disallow: /

User-agent:MercatoMaestroBot
Disallow: /

User-agent:PGCD-Monitor
Disallow: /

User-agent:PitchPaperHerald
Disallow: /

User-agent:PrescoutingBot
Disallow: /

User-agent:RadarFutebolBot
Disallow: /

User-agent:ScoopSonar
Disallow: /

User-agent:ScorPion
Disallow: /

User-agent:SevenSlipsNewsBot
Disallow: /

User-agent:SignalTowerMonitor
Disallow: /

User-agent:SportTickerArticleIngester
Disallow: /

User-agent:SportTickerHealthChecker
Disallow: /

User-agent:SportTickerScraper
Disallow: /

User-agent:SportsMonitor
Disallow: /

User-agent:YancoCup
Disallow: /

User-agent:bancada.
Disallow: /

User-agent:4AllVenturesBot
Disallow: /

User-agent:GoalClub
Disallow: /

User-agent:GoalIQ+Intelligence
Disallow: /

User-agent:SportsEdgeNewsBot
Disallow: /

User-agent:wc26-stack
Disallow: /

User-agent:worldcup-predictions
Disallow: /

User-agent:WorldCup2026Headlines
Disallow: /

User-agent:RelvadoBot
Disallow: /

User-agent:ScoresOnTheDoorAI
Disallow: /

User-agent:TakaBot
Disallow: /

User-agent:FootballHub
Disallow: /

User-agent:GYN-Bot
Disallow: /

User-agent:SportsPrediction-Bot
Disallow: /

User-agent:DamnHellYeahBot
Disallow: /

User-agent:FieldmarkBot
Disallow: /

User-agent:LeSignalBot
Disallow: /

User-agent:MeraNewsBot
Disallow: /

User-agent:SumulaNewsBot
Disallow: /

User-agent:TifoHub
Disallow: /

User-agent:TrendLensBot
Disallow: /

User-agent:UnzoiNewsBot
Disallow: /

User-agent:WiefiansFeedBot
Disallow: /

User-agent:MarcNewsEngine
Disallow: /

User-agent:Mordomo
Disallow: /

User-agent:NewProjet26
Disallow: /

User-agent:Radar-Hubia
Disallow: /

User-agent:RedacaoHG
Disallow: /

User-agent:SLNewsBot
Disallow: /

User-agent:WorkingStation
Disallow: /

User-agent:ainews
Disallow: /

User-agent:news_apis_collection
Disallow: /

User-agent:nexo-scraper
Disallow: /

User-agent:recon-news-bot
Disallow: /

User-agent:rimc-hermes-rsp
Disallow: /

User-agent:PitchSignal
Disallow: /

User-agent:MetaInspector (various)
Disallow: /

User-agent:MetaInspector
Disallow: /

User-agent:ORBIT+News+Engine
Disallow: /

User-agent:newsflow-engine
Disallow: /

User-agent:oped-bot
Disallow: /

User-agent:topicsearch-crawler
Disallow: /

User-agent:tudopartido-build
Disallow: /

User-agent:ARK3+laboratorio+de+investigacion+luisluchofb@gmail.com
Disallow: /

User-agent:BancoDigitalBot
Disallow: /

User-agent:CryptoAsymmetryRadar
Disallow: /

User-agent:FinanceAnalyser
Disallow: /
Disallow: /

User-agent:GCRIP-Direction1-Research
Disallow: /

User-agent:Gasly
Disallow: /

User-agent:GoldStandardMarketNews
Disallow: /

User-agent:HandelsavisenFeedBot
Disallow: /

User-agent:JET-PR-Monitor
Disallow: /

User-agent:MACTRON_FINANZ
Disallow: /

User-agent:apex-research
Disallow: /

User-agent:invest-ingest-rss
Disallow: /

User-agent:stocks-on-watch
Disallow: /

User-agent:GlobalFundamentalV33
Disallow: /

User-agent:Otnox-Radar
Disallow: /

User-agent:Credito365-NewsBot
Disallow: /

User-agent:FamilyOfficeIntelBot
Disallow: /

User-agent:PUTT-News
Disallow: /

User-agent:trading212
Disallow: /

User-agent:BlissSignals
Disallow: /

User-agent:DobbyNewsBot
Disallow: /

User-agent:YBM-Artist-Intelligence
Disallow: /

User-agent:AkousaNewsBot
Disallow: /

User-agent:AllNewsBot
Disallow: /

User-agent:AlvoPublico
Disallow: /

User-agent:AmiNews
Disallow: /

User-agent:DailyBriefingWorker
Disallow: /

User-agent:Global+News+Intelligence+Wire
Disallow: /

User-agent:my-sabichao-news
Disallow: /

User-agent:AdmaticMarketCrawler
Disallow: /

User-agent:AirbnbBot
Disallow: /

User-agent:AuctiMail-Enrichment-Bot
Disallow: /

User-agent:AwarioSmartBot
Disallow: /

User-agent:BocconiAcademicResearchBot
Disallow: /

User-agent:CapricciosaMonitor
Disallow: /

User-agent:CompanyInternalSearchBot
Disallow: /

User-agent:DataKraken
Disallow: /

User-agent:GCPA-Media-Monitor
Disallow: /

User-agent:MeltwaterNews+www.meltwater.com
Disallow: /

User-agent:Meltwater
Disallow: /

User-agent:Neticle+Crawler+v1.0+(+https://neticle.com/bot/en/+)
Disallow: /

User-agent:PolecatBot
Disallow: /

User-agent:PriberamBot
Disallow: /

User-agent:RadarReputacional
Disallow: /

User-agent:SiteCheckerBotCrawler
Disallow: /

User-agent:Vable+Ltd+admin@vable.com
Disallow: /

User-agent:VeillorBot/1.0+(+https://veillor.com/bot)
Disallow: /

User-agent:WebTuga+Prospecting+Analyzer
Disallow: /

User-agent:smartocto-bot
Disallow: /

User-agent:ApolloLinkPreviews
Disallow: /

User-agent:BedrijvengidsBot
Disallow: /

User-agent:SAPO+Thumbs+(+https://www.sapo.pt/)
Disallow: /

User-agent:GlobalIntelligenceBot
Disallow: /

User-agent:PressPortCrawler
Disallow: /

User-agent:SGI-Fitouticon
Disallow: /

User-agent:ClippingService
Disallow: /

User-agent:TerraCotta+0.2
Disallow: /

User-agent:TerraCotta
Disallow: /

User-agent:Scrapy
Disallow: /

User-agent:cohere-training-data-crawler
Disallow: /

User-agent:magpie-crawler
Disallow: /

User-agent:Clickagy
Disallow: /

User-agent:cXensebot
Disallow: /

User-agent:GovHorizon
Disallow: /

User-agent:Mediatoolkitbot
Disallow: /

User-agent:SourceHealthAuditor
Disallow: /

User-agent:Factalbot
Disallow: /

User-agent:FreakOutAdsTxtBot+(+https://www.fout.co.jp)
Disallow: /

User-agent:AICIS-LRIL
Disallow: /

User-agent:AIWebIndex
Disallow: /

User-agent:ARIA-Search-Bot
Disallow: /

User-agent:CATALYST-OSINT
Disallow: /

User-agent:ChatGPT
Disallow: /

User-agent:DEOS-WarRoom
Disallow: /

User-agent:EGB-Copilot-V3
Disallow: /

User-agent:Lightpanda
Disallow: /

User-agent:MSM-Global-News-AI
Disallow: /

User-agent:News-Studio-AI
Disallow: /

User-agent:RebornAI
Disallow: /

User-agent:megawika2-report-generation
Disallow: /

User-agent:ScryBot
Disallow: /

User-agent:LCC+(+https://corpora.wortschatz-leipzig.de/crawler_faq.html)
Disallow: /

User-agent:ChiefScout
Disallow: /

User-agent:AgenticWebResearch
Disallow: /

User-agent:langflow
Disallow: /

User-agent:MistralBot
Disallow: /

User-agent:primal-kernel
Disallow: /

User-agent:pyprimalnews-export
Disallow: /

User-agent:VibeIA-Agent
Disallow: /

User-agent:Blogy-AI
Disallow: /

User-agent:Google-NotebookLM
Disallow: /

User-agent:GoogleOther
Disallow: /

User-agent:GoogleOther-Image
Disallow: /

User-agent:Goose
Disallow: /

User-agent:LogosBot
Disallow: /

User-agent:ManicTime
Disallow: /

User-agent:news-intelligence-tool
Disallow: /

User-agent:PulseAI
Disallow: /

User-agent:quillbot.com
Disallow: /

User-agent:TimpiNewsBot
Disallow: /

User-agent:Amazon-Bot
Disallow: /

User-agent:Amzn-User
Disallow: /

User-agent:meta-externalfetcher
Disallow: /

User-agent:Brightbot
Disallow: /

User-agent:FirecrawlAgent
Disallow: /

User-agent:MyCentralAIScraperBot
Disallow: /

User-agent:ShapBot
Disallow: /

User-agent:AI2Bot-Dolma
Disallow: /

User-agent:ApifyBot
Disallow: /

User-agent:ApifyWebsiteContentCrawler
Disallow: /

User-agent:PanguBot
Disallow: /

User-agent:DuckAssistBot
Disallow: /

User-agent:ia_archiver
Disallow: /

User-agent:LinerBot
Disallow: /

User-agent:Redactie+AI+Content+Engine
Disallow: /

User-agent:Beloud
Disallow: /

User-agent:PriviumBot
Disallow: /

User-agent:CookieBot
Disallow: /
License: https://www.record.pt/license.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Portugal
28.8% block at least one AI crawler
Behind Cloudflare
No
Same group