puls.bg · Bulgaria · Investor Media Group · measured 8 Oct 2026
As read on 8 Oct 2026, 21,751 bytes. 3 rule groups name AI crawlers; shown first.
User-agent: Bytespider Disallow:/ User-agent: CCBot Disallow:/ User-agent: GPTBot Disallow:/ User-agent: 01h4x.com Disallow:/ User-agent: 360Spider Disallow:/ User-agent: 404checker Disallow:/ User-agent: 404enemy Disallow:/ User-agent: 80legs Disallow:/ User-agent: ADmantX Disallow:/ User-agent: AIBOT Disallow:/ User-agent: ALittle Client Disallow:/ User-agent: ASPSeek Disallow:/ User-agent: Abonti Disallow:/ User-agent: Aboundex Disallow:/ User-agent: Aboundexbot Disallow:/ User-agent: Acunetix Disallow:/ User-agent: AdsTxtCrawlerTP Disallow:/ User-agent: AfD-Verbotsverfahren Disallow:/ User-agent: AhrefsBot Disallow:/ User-agent: AiHitBot Disallow:/ User-agent: Aipbot Disallow:/ User-agent: Alexibot Disallow:/ User-agent: AllSubmitter Disallow:/ User-agent: Alligator Disallow:/ User-agent: AlphaBot Disallow:/ User-agent: Anarchie Disallow:/ User-agent: Anarchy Disallow:/ User-agent: Anarchy99 Disallow:/ User-agent: Ankit Disallow:/ User-agent: Anthill Disallow:/ User-agent: Apexoo Disallow:/ User-agent: Aspiegel Disallow:/ User-agent: Asterias Disallow:/ User-agent: Atomseobot Disallow:/ User-agent: Attach Disallow:/ User-agent: AwarioRssBot Disallow:/ User-agent: AwarioSmartBot Disallow:/ User-agent: BBBike Disallow:/ User-agent: BDCbot Disallow:/ User-agent: BDFetch Disallow:/ User-agent: BLEXBot Disallow:/ User-agent: BackDoorBot Disallow:/ User-agent: BackStreet Disallow:/ User-agent: BackWeb Disallow:/ User-agent: Backlink-Ceck Disallow:/ User-agent: BacklinkCrawler Disallow:/ User-agent: Badass Disallow:/ User-agent: Bandit Disallow:/ User-agent: Barkrowler Disallow:/ User-agent: BatchFTP Disallow:/ User-agent: Battleztar Bazinga Disallow:/ User-agent: BetaBot Disallow:/ User-agent: Bigfoot Disallow:/ User-agent: Bitacle Disallow:/ User-agent: BlackWidow Disallow:/ User-agent: Black Hole Disallow:/ User-agent: Blackboard Disallow:/ User-agent: Blow Disallow:/ User-agent: BlowFish Disallow:/ User-agent: Boardreader Disallow:/ User-agent: Bolt Disallow:/ User-agent: BotALot Disallow:/ User-agent: Brandprotect Disallow:/ User-agent: Brandwatch Disallow:/ User-agent: Buck Disallow:/ User-agent: Buddy Disallow:/ User-agent: BuiltBotTough Disallow:/ User-agent: BuiltWith Disallow:/ User-agent: Bullseye Disallow:/ User-agent: BunnySlippers Disallow:/ User-agent: BuzzSumo Disallow:/ User-agent: CATExplorador Disallow:/ User-agent: CODE87 Disallow:/ User-agent: CSHttp Disallow:/ User-agent: Calculon Disallow:/ User-agent: CazoodleBot Disallow:/ User-agent: Cegbfeieh Disallow:/ User-agent: CensysInspect Disallow:/ User-agent: CheTeam Disallow:/ User-agent: CheeseBot Disallow:/ User-agent: CherryPicker Disallow:/ User-agent: ChinaClaw Disallow:/ User-agent: Chlooe Disallow:/ User-agent: Citoid Disallow:/ User-agent: Claritybot Disallow:/ User-agent: Cliqzbot Disallow:/ User-agent: Cloud mapping Disallow:/ User-agent: Cocolyzebot Disallow:/ User-agent: Cogentbot Disallow:/ User-agent: Collector Disallow:/ User-agent: Copier Disallow:/ User-agent: CopyRightCheck Disallow:/ User-agent: Copyscape Disallow:/ User-agent: Cosmos Disallow:/ User-agent: Craftbot Disallow:/ User-agent: Crawling at Home Project Disallow:/ User-agent: CrazyWebCrawler Disallow:/ User-agent: Crescent Disallow:/ User-agent: CrunchBot Disallow:/ User-agent: Curious Disallow:/ User-agent: Custo Disallow:/ User-agent: CyotekWebCopy Disallow:/ User-agent: DBLBot Disallow:/ User-agent: DIIbot Disallow:/ User-agent: DSearch Disallow:/ User-agent: DTS Agent Disallow:/ User-agent: DataCha0s Disallow:/ User-agent: DatabaseDriverMysqli Disallow:/ User-agent: Demon Disallow:/ User-agent: Deusu Disallow:/ User-agent: Devil Disallow:/ User-agent: Digincore Disallow:/ User-agent: DigitalPebble Disallow:/ User-agent: Dirbuster Disallow:/ User-agent: Disco Disallow:/ User-agent: Discobot Disallow:/ User-agent: Discoverybot Disallow:/ User-agent: Dispatch Disallow:/ User-agent: DittoSpyder Disallow:/ User-agent: DnBCrawler-Analytics Disallow:/ User-agent: DnyzBot Disallow:/ User-agent: DomCopBot Disallow:/ User-agent: DomainAppender Disallow:/ User-agent: DomainCrawler Disallow:/ User-agent: DomainSigmaCrawler Disallow:/ User-agent: DomainStatsBot Disallow:/ User-agent: Domains Project Disallow:/ User-agent: Dotbot Disallow:/ User-agent: Download Wonder Disallow:/ User-agent: Dragonfly Disallow:/ User-agent: Drip Disallow:/ User-agent: ECCP/1.0 Disallow:/ User-agent: EMail Siphon Disallow:/ User-agent: EMail Wolf Disallow:/ User-agent: EasyDL Disallow:/ User-agent: Ebingbong Disallow:/ User-agent: Ecxi Disallow:/ User-agent: EirGrabber Disallow:/ User-agent: EroCrawler Disallow:/ User-agent: Evil Disallow:/ User-agent: Exabot Disallow:/ User-agent: Express WebPictures Disallow:/ User-agent: ExtLinksBot Disallow:/ User-agent: Extractor Disallow:/ User-agent: ExtractorPro Disallow:/ User-agent: Extreme Picture Finder Disallow:/ User-agent: EyeNetIE Disallow:/ User-agent: Ezooms Disallow:/ User-agent: FDM Disallow:/ User-agent: FHscan Disallow:/ User-agent: FemtosearchBot Disallow:/ User-agent: Fimap Disallow:/ User-agent: Firefox/7.0 Disallow:/ User-agent: FlashGet Disallow:/ User-agent: Flunky Disallow:/ User-agent: Foobot Disallow:/ User-agent: Freeuploader Disallow:/ User-agent: FrontPage Disallow:/ User-agent: Fuzz Disallow:/ User-agent: FyberSpider Disallow:/ User-agent: Fyrebot Disallow:/ User-agent: G-i-g-a-b-o-t Disallow:/ User-agent: GT::WWW Disallow:/ User-agent: GalaxyBot Disallow:/ User-agent: Genieo Disallow:/ User-agent: GermCrawler Disallow:/ User-agent: GetRight Disallow:/ User-agent: GetWeb Disallow:/ User-agent: Getintent Disallow:/ User-agent: Gigabot Disallow:/ User-agent: Go!Zilla Disallow:/ User-agent: Go-Ahead-Got-It Disallow:/ User-agent: GoZilla Disallow:/ User-agent: Gotit Disallow:/ User-agent: GrabNet Disallow:/ User-agent: Grabber Disallow:/ User-agent: Grafula Disallow:/ User-agent: GrapeFX Disallow:/ User-agent: GrapeshotCrawler Disallow:/ User-agent: GridBot Disallow:/ User-agent: HEADMasterSEO Disallow:/ User-agent: HMView Disallow:/ User-agent: HTMLparser Disallow:/ User-agent: HTTP::Lite Disallow:/ User-agent: HTTrack Disallow:/ User-agent: Haansoft Disallow:/ User-agent: HaosouSpider Disallow:/ User-agent: Harvest Disallow:/ User-agent: Havij Disallow:/ User-agent: Heritrix Disallow:/ User-agent: Hloader Disallow:/ User-agent: HonoluluBot Disallow:/ User-agent: Humanlinks Disallow:/ User-agent: HybridBot Disallow:/ User-agent: IDBTE4M Disallow:/ User-agent: IDBot Disallow:/ User-agent: IRLbot Disallow:/ User-agent: Iblog Disallow:/ User-agent: Id-search Disallow:/ User-agent: IlseBot Disallow:/ User-agent: Image Fetch Disallow:/ User-agent: Image Sucker Disallow:/ User-agent: IndeedBot Disallow:/ User-agent: Indy Library Disallow:/ User-agent: InfoNaviRobot Disallow:/ User-agent: InfoTekies Disallow:/ User-agent: Intelliseek Disallow:/ User-agent: InterGET Disallow:/ User-agent: InternetSeer Disallow:/ User-agent: Internet Ninja Disallow:/ User-agent: Iria Disallow:/ User-agent: Iskanie Disallow:/ User-agent: IstellaBot Disallow:/ User-agent: JOC Web Spider Disallow:/ User-agent: JamesBOT Disallow:/ User-agent: Jbrofuzz Disallow:/ User-agent: JennyBot Disallow:/ User-agent: JetCar Disallow:/ User-agent: Jetty Disallow:/ User-agent: JikeSpider Disallow:/ User-agent: Joomla Disallow:/ User-agent: Jorgee Disallow:/ User-agent: JustView Disallow:/ User-agent: Jyxobot Disallow:/ User-agent: Kenjin Spider Disallow:/ User-agent: Keybot Translation-Search-Machine Disallow:/ User-agent: Keyword Density Disallow:/ User-agent: Kinza Disallow:/ User-agent: Kozmosbot Disallow:/ User-agent: LNSpiderguy Disallow:/ User-agent: LWP::Simple Disallow:/ User-agent: Lanshanbot Disallow:/ User-agent: Larbin Disallow:/ User-agent: Leap Disallow:/ User-agent: LeechFTP Disallow:/ User-agent: LeechGet Disallow:/ User-agent: LexiBot Disallow:/ User-agent: Lftp Disallow:/ User-agent: LibWeb Disallow:/ User-agent: Libwhisker Disallow:/ User-agent: LieBaoFast Disallow:/ User-agent: Lightspeedsystems Disallow:/ User-agent: Likse Disallow:/ User-agent: LinkScan Disallow:/ User-agent: LinkWalker Disallow:/ User-agent: Linkbot Disallow:/ User-agent: LinkextractorPro Disallow:/ User-agent: LinkpadBot Disallow:/ User-agent: LinksManager Disallow:/ User-agent: LinqiaMetadataDownloaderBot Disallow:/ User-agent: LinqiaRSSBot Disallow:/ User-agent: LinqiaScrapeBot Disallow:/ User-agent: Lipperhey Disallow:/ User-agent: Lipperhey Spider Disallow:/ User-agent: Litemage_walker Disallow:/ User-agent: Lmspider Disallow:/ User-agent: Ltx71 Disallow:/ User-agent: MFC_Tear_Sample Disallow:/ User-agent: MIDown tool Disallow:/ User-agent: MIIxpc Disallow:/ User-agent: MJ12bot Disallow:/ User-agent: MQQBrowser Disallow:/ User-agent: MSFrontPage Disallow:/ User-agent: MSIECrawler Disallow:/ User-agent: MTRobot Disallow:/ User-agent: Mag-Net Disallow:/ User-agent: Magnet Disallow:/ User-agent: Mail.RU_Bot Disallow:/ User-agent: Majestic-SEO Disallow:/ User-agent: Majestic12 Disallow:/ User-agent: Majestic SEO Disallow:/ User-agent: MarkMonitor Disallow:/ User-agent: MarkWatch Disallow:/ User-agent: Mass Downloader Disallow:/ User-agent: Masscan Disallow:/ User-agent: Mata Hari Disallow:/ User-agent: MauiBot Disallow:/ User-agent: Mb2345Browser Disallow:/ User-agent: MeanPath Bot Disallow:/ User-agent: Meanpathbot Disallow:/ User-agent: Mediatoolkitbot Disallow:/ User-agent: MegaIndex.ru Disallow:/ User-agent: Metauri Disallow:/ User-agent: MicroMessenger Disallow:/ User-agent: Microsoft Data Access Disallow:/ User-agent: Microsoft URL Control Disallow:/ User-agent: Minefield Disallow:/ User-agent: Mister PiX Disallow:/ User-agent: Moblie Safari Disallow:/ User-agent: Mojeek Disallow:/ User-agent: Mojolicious Disallow:/ User-agent: MolokaiBot Disallow:/ User-agent: Morfeus Fucking Scanner Disallow:/ User-agent: Mozlila Disallow:/ User-agent: Mr.4x3 Disallow:/ User-agent: Msrabot Disallow:/ User-agent: Musobot Disallow:/ User-agent: NICErsPRO Disallow:/ User-agent: NPbot Disallow:/ User-agent: Name Intelligence Disallow:/
Changes recorded since June 2026.
No change recorded.