CrawlerPulse
CrawlerPulse / Europe / Greece / xronos.gr

Xronos

xronos.gr · Greece · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Blocked
Perplexity
Allowed
Meta
Allowed
Common Crawl
Blocked
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 25,123 bytes. 1 rule group name AI crawlers; shown first.

User-agent: CCBot
Disallow:/

User-agent: *
Allow: /core/*.css$
Allow: /core/*.css?
Allow: /core/*.js$
Allow: /core/*.js?
Allow: /core/*.gif
Allow: /core/*.jpg
Allow: /core/*.jpeg
Allow: /core/*.png
Allow: /core/*.svg
Allow: /profiles/*.css$
Allow: /profiles/*.css?
Allow: /profiles/*.js$
Allow: /profiles/*.js?
Allow: /profiles/*.gif
Allow: /profiles/*.jpg
Allow: /profiles/*.jpeg
Allow: /profiles/*.png
Allow: /profiles/*.svg
Disallow: /core/
Disallow: /profiles/
Disallow: /README.txt
Disallow: /web.config
Disallow: /admin/
Disallow: /comment/reply/
Disallow: /filter/tips
Disallow: /node/add/
Disallow: /search/
Disallow: /user/register
Disallow: /user/password
Disallow: /user/login
Disallow: /user/logout
Disallow: /index.php/admin/
Disallow: /index.php/comment/reply/
Disallow: /index.php/filter/tips
Disallow: /index.php/node/add/
Disallow: /index.php/search/
Disallow: /index.php/user/password
Disallow: /index.php/user/register
Disallow: /index.php/user/login
Disallow: /index.php/user/logout

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

User-agent: 01h4x.com
Disallow:/

User-agent: 360Spider
Disallow:/

User-agent: 404checker
Disallow:/

User-agent: 404enemy
Disallow:/

User-agent: 80legs
Disallow:/

User-agent: ADmantX
Disallow:/

User-agent: AIBOT
Disallow:/

User-agent: ALittle Client
Disallow:/

User-agent: ASPSeek
Disallow:/

User-agent: Abonti
Disallow:/

User-agent: Aboundex
Disallow:/

User-agent: Aboundexbot
Disallow:/

User-agent: Acunetix
Disallow:/

User-agent: AfD-Verbotsverfahren
Disallow:/

User-agent: AhrefsBot
Disallow:/

User-agent: AiHitBot
Disallow:/

User-agent: Aipbot
Disallow:/

User-agent: Alexibot
Disallow:/

User-agent: AllSubmitter
Disallow:/

User-agent: Alligator
Disallow:/

User-agent: AlphaBot
Disallow:/

User-agent: Anarchie
Disallow:/

User-agent: Anarchy
Disallow:/

User-agent: Anarchy99
Disallow:/

User-agent: Ankit
Disallow:/

User-agent: Anthill
Disallow:/

User-agent: Apexoo
Disallow:/

User-agent: Aspiegel
Disallow:/

User-agent: Asterias
Disallow:/

User-agent: Atomseobot
Disallow:/

User-agent: Attach
Disallow:/

User-agent: AwarioRssBot
Disallow:/

User-agent: AwarioSmartBot
Disallow:/

User-agent: BBBike
Disallow:/

User-agent: BDCbot
Disallow:/

User-agent: BDFetch
Disallow:/

User-agent: BLEXBot
Disallow:/

User-agent: BackDoorBot
Disallow:/

User-agent: BackStreet
Disallow:/

User-agent: BackWeb
Disallow:/

User-agent: Backlink-Ceck
Disallow:/

User-agent: BacklinkCrawler
Disallow:/

User-agent: Badass
Disallow:/

User-agent: Bandit
Disallow:/

User-agent: Barkrowler
Disallow:/

User-agent: BatchFTP
Disallow:/

User-agent: Battleztar Bazinga
Disallow:/

User-agent: BetaBot
Disallow:/

User-agent: Bigfoot
Disallow:/

User-agent: Bitacle
Disallow:/

User-agent: Black Hole
Disallow:/

User-agent: BlackWidow
Disallow:/

User-agent: Blackboard
Disallow:/

User-agent: Blow
Disallow:/

User-agent: BlowFish
Disallow:/

User-agent: Boardreader
Disallow:/

User-agent: Bolt
Disallow:/

User-agent: BotALot
Disallow:/

User-agent: Brandprotect
Disallow:/

User-agent: Brandwatch
Disallow:/

User-agent: Buck
Disallow:/

User-agent: Buddy
Disallow:/

User-agent: BuiltBotTough
Disallow:/

User-agent: BuiltWith
Disallow:/

User-agent: Bullseye
Disallow:/

User-agent: BunnySlippers
Disallow:/

User-agent: BuzzSumo
Disallow:/

User-agent: CATExplorador
Disallow:/

User-agent: CODE87
Disallow:/

User-agent: CSHttp
Disallow:/

User-agent: Calculon
Disallow:/

User-agent: CazoodleBot
Disallow:/

User-agent: Cegbfeieh
Disallow:/

User-agent: CensysInspect
Disallow:/

User-agent: CheTeam
Disallow:/

User-agent: CheeseBot
Disallow:/

User-agent: CherryPicker
Disallow:/

User-agent: ChinaClaw
Disallow:/

User-agent: Chlooe
Disallow:/

User-agent: Citoid
Disallow:/

User-agent: Claritybot
Disallow:/

User-agent: Cliqzbot
Disallow:/

User-agent: Cloud mapping
Disallow:/

User-agent: Cocolyzebot
Disallow:/

User-agent: Cogentbot
Disallow:/

User-agent: Collector
Disallow:/

User-agent: Copier
Disallow:/

User-agent: CopyRightCheck
Disallow:/

User-agent: Copyscape
Disallow:/

User-agent: Cosmos
Disallow:/

User-agent: Craftbot
Disallow:/

User-agent: Crawling at Home Project
Disallow:/

User-agent: CrazyWebCrawler
Disallow:/

User-agent: Crescent
Disallow:/

User-agent: CrunchBot
Disallow:/

User-agent: Curious
Disallow:/

User-agent: Custo
Disallow:/

User-agent: CyotekWebCopy
Disallow:/

User-agent: DBLBot
Disallow:/

User-agent: DIIbot
Disallow:/

User-agent: DSearch
Disallow:/

User-agent: DTS Agent
Disallow:/

User-agent: DataCha0s
Disallow:/

User-agent: DatabaseDriverMysqli
Disallow:/

User-agent: Demon
Disallow:/

User-agent: Deusu
Disallow:/

User-agent: Devil
Disallow:/

User-agent: Digincore
Disallow:/

User-agent: DigitalPebble
Disallow:/

User-agent: Dirbuster
Disallow:/

User-agent: Disco
Disallow:/

User-agent: Discobot
Disallow:/

User-agent: Discoverybot
Disallow:/

User-agent: Dispatch
Disallow:/

User-agent: DittoSpyder
Disallow:/

User-agent: DnBCrawler-Analytics
Disallow:/

User-agent: DnyzBot
Disallow:/

User-agent: DomCopBot
Disallow:/

User-agent: DomainAppender
Disallow:/

User-agent: DomainCrawler
Disallow:/

User-agent: DomainSigmaCrawler
Disallow:/

User-agent: DomainStatsBot
Disallow:/

User-agent: Domains Project
Disallow:/

User-agent: Dotbot
Disallow:/

User-agent: Download Wonder
Disallow:/

User-agent: Dragonfly
Disallow:/

User-agent: Drip
Disallow:/

User-agent: ECCP/1.0
Disallow:/

User-agent: EMail Siphon
Disallow:/

User-agent: EMail Wolf
Disallow:/

User-agent: EasyDL
Disallow:/

User-agent: Ebingbong
Disallow:/

User-agent: Ecxi
Disallow:/

User-agent: EirGrabber
Disallow:/

User-agent: EroCrawler
Disallow:/

User-agent: Evil
Disallow:/

User-agent: Exabot
Disallow:/

User-agent: Express WebPictures
Disallow:/

User-agent: ExtLinksBot
Disallow:/

User-agent: Extractor
Disallow:/

User-agent: ExtractorPro
Disallow:/

User-agent: Extreme Picture Finder
Disallow:/

User-agent: EyeNetIE
Disallow:/

User-agent: Ezooms
Disallow:/

User-agent: FDM
Disallow:/

User-agent: FHscan
Disallow:/

User-agent: FemtosearchBot
Disallow:/

User-agent: Fimap
Disallow:/

User-agent: Firefox/7.0
Disallow:/

User-agent: FlashGet
Disallow:/

User-agent: Flunky
Disallow:/

User-agent: Foobot
Disallow:/

User-agent: Freeuploader
Disallow:/

User-agent: FrontPage
Disallow:/

User-agent: Fuzz
Disallow:/

User-agent: FyberSpider
Disallow:/

User-agent: Fyrebot
Disallow:/

User-agent: G-i-g-a-b-o-t
Disallow:/

User-agent: GT::WWW
Disallow:/

User-agent: GalaxyBot
Disallow:/

User-agent: Genieo
Disallow:/

User-agent: GermCrawler
Disallow:/

User-agent: GetRight
Disallow:/

User-agent: GetWeb
Disallow:/

User-agent: Getintent
Disallow:/

User-agent: Gigabot
Disallow:/

User-agent: Go!Zilla
Disallow:/

User-agent: Go-Ahead-Got-It
Disallow:/

User-agent: GoZilla
Disallow:/

User-agent: Gotit
Disallow:/

User-agent: GrabNet
Disallow:/

User-agent: Grabber
Disallow:/

User-agent: Grafula
Disallow:/

User-agent: GrapeFX
Disallow:/

User-agent: GrapeshotCrawler
Disallow:/

User-agent: GridBot
Disallow:/

User-agent: HEADMasterSEO
Disallow:/

User-agent: HMView
Disallow:/

User-agent: HTMLparser
Disallow:/

User-agent: HTTP::Lite
Disallow:/

User-agent: HTTrack
Disallow:/

User-agent: Haansoft
Disallow:/

User-agent: HaosouSpider
Disallow:/

User-agent: Harvest
Disallow:/

User-agent: Havij
Disallow:/

User-agent: Heritrix
Disallow:/

User-agent: Hloader
Disallow:/

User-agent: HonoluluBot
Disallow:/

User-agent: Humanlinks
Disallow:/

User-agent: HybridBot
Disallow:/

User-agent: IDBTE4M
Disallow:/

User-agent: IDBot
Disallow:/

User-agent: IRLbot
Disallow:/

User-agent: Iblog
Disallow:/

User-agent: Id-search
Disallow:/

User-agent: IlseBot
Disallow:/

User-agent: Image Fetch
Disallow:/

User-agent: Image Sucker
Disallow:/

User-agent: IndeedBot
Disallow:/

User-agent: Indy Library
Disallow:/

User-agent: InfoNaviRobot
Disallow:/

User-agent: InfoTekies
Disallow:/

User-agent: Intelliseek
Disallow:/

User-agent: InterGET
Disallow:/

User-agent: Internet Ninja
Disallow:/

User-agent: InternetSeer
Disallow:/

User-agent: Iria
Disallow:/

User-agent: Iskanie
Disallow:/

User-agent: IstellaBot
Disallow:/

User-agent: JOC Web Spider
Disallow:/

User-agent: JamesBOT
Disallow:/

User-agent: Jbrofuzz
Disallow:/

User-agent: JennyBot
Disallow:/

User-agent: JetCar
Disallow:/

User-agent: Jetty
Disallow:/

User-agent: JikeSpider
Disallow:/

User-agent: Joomla
Disallow:/

User-agent: Jorgee
Disallow:/

User-agent: JustView
Disallow:/

User-agent: Jyxobot
Disallow:/

User-agent: Kenjin Spider
Disallow:/

User-agent: Keybot Translation-Search-Machine
Disallow:/

User-agent: Keyword Density
Disallow:/

User-agent: Kinza
Disallow:/

User-agent: Kozmosbot
Disallow:/

User-agent: LNSpiderguy
Disallow:/

User-agent: LWP::Simple
Disallow:/

User-agent: Lanshanbot
Disallow:/

User-agent: Larbin
Disallow:/

User-agent: Leap
Disallow:/

User-agent: LeechFTP
Disallow:/

User-agent: LeechGet
Disallow:/

User-agent: LexiBot
Disallow:/

User-agent: Lftp
Disallow:/

User-agent: LibWeb
Disallow:/

User-agent: Libwhisker
Disallow:/

User-agent: LieBaoFast
Disallow:/

User-agent: Lightspeedsystems
Disallow:/

User-agent: Likse
Disallow:/

User-agent: LinkScan
Disallow:/

User-agent: LinkWalker
Disallow:/

User-agent: Linkbot
Disallow:/

User-agent: LinkextractorPro
Disallow:/

User-agent: LinkpadBot
Disallow:/

User-agent: LinksManager
Disallow:/

User-agent: LinqiaMetadataDownloaderBot
Disallow:/

User-agent: LinqiaRSSBot
Disallow:/

User-agent: LinqiaScrapeBot
Disallow:/

User-agent: Lipperhey
Disallow:/

User-agent: Lipperhey Spider
Disallow:/

User-agent: Litemage_walker
Disallow:/

User-agent: Lmspider
Disallow:/

User-agent: Ltx71
Disallow:/

User-agent: MFC_Tear_Sample
Disallow:/

User-agent: MIDown tool
Disallow:/

User-agent: MIIxpc
Disallow:/

User-agent: MJ12bot
Disallow:/

User-agent: MQQBrowser
Disallow:/

User-agent: MSFrontPage
Disallow:/

User-agent: MSIECrawler
Disallow:/

User-agent: MTRobot
Disallow:/

User-agent: Mag-Net
Disallow:/

User-agent: Magnet
Disallow:/

User-agent: Mail.RU_Bot
Disallow:/

User-agent: Majestic SEO
Disallow:/

User-agent: Majestic-SEO
Disallow:/

User-agent: Majestic12
Disallow:/

User-agent: MarkMonitor
Disallow:/

User-agent: MarkWatch
Disallow:/

User-agent: Mass Downloader
Disallow:/

User-agent: Masscan
Disallow:/

User-agent: Mata Hari
Disallow:/

User-agent: MauiBot
Disallow:/

User-agent: Mb2345Browser
Disallow:/

User-agent: MeanPath Bot
Disallow:/

User-agent: Meanpathbot
Disallow:/

User-agent: Mediatoolkitbot
Disallow:/

History

Changes recorded since June 2026.

No change recorded.

In context

Greece
12.9% block at least one AI crawler
Behind Cloudflare
Yes