CrawlerPulse
CrawlerPulse / Europe / Poland / wyborcza.biz

Wyborcza biz

wyborcza.biz · Poland · Agora PL · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Blocked
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Blocked
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 20,659 bytes. 4 rule groups name AI crawlers; shown first.

User-agent: ChatGPT-User
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: Mozilla/5.0 (compatible; ImagesiftBot; +imagesift.com)
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: *
Disallow: /ot-amp-consent
Disallow: /aliasy/hp2018/bo/bo-info.js
Disallow: /aliasy/hp2018/bo/bo-info
Disallow: /reloadwww?
Disallow: /ods?
Disallow: /nowy/
Disallow: /insider/61*
Disallow: /znajdz.do
Disallow: /internet/0,0.html?
Disallow: /katalog/0,51443.html?
Disallow: /kielce/1,35261,2930339.html
Disallow: /kraj/1,34317,2342480.html
Disallow: /aliasy/blad.jsp
Disallow: /katowice/2,82932,,,,89764753,P_SLASK.html
Disallow: /portalSearch.do
Disallow: /wyszukaj
Disallow: /wyszukaj/artykul
Disallow: /wyszukaj/zdjecie
Disallow: /wyszukaj/video
Disallow: /edziecko/wyszukaj/artykul
Disallow: /edziecko/wyszukaj/zdjecie
Disallow: /edziecko/wyszukaj/video
Disallow: /MotoPL/wyszukaj/artykul
Disallow: /MotoPL/wyszukaj/zdjecie
Disallow: /MotoPL/wyszukaj/video
Disallow: /kotek/wyszukaj/artykul
Disallow: /kotek/wyszukaj/zdjecie
Disallow: /kotek/wyszukaj/video
Disallow: /Zdrowie/wyszukaj/artykul
Disallow: /Zdrowie/wyszukaj/zdjecie
Disallow: /Zdrowie/wyszukaj/video
Disallow: /podroze/wyszukaj/artykul
Disallow: /podroze/wyszukaj/zdjecie
Disallow: /podroze/wyszukaj/video
Disallow: /gazetawyborcza_/wyszukaj/artykul
Disallow: /gazetawyborcza_/wyszukaj/zdjecie
Disallow: /gazetawyborcza_/wyszukaj/video
Disallow: /plotek/wyszukaj/artykul
Disallow: /plotek/wyszukaj/zdjecie
Disallow: /plotek/wyszukaj/video
Disallow: /sport/wyszukaj/artykul
Disallow: /sport/wyszukaj/zdjecie
Disallow: /sport/wyszukaj/video
Disallow: /wiadomosci/wyszukaj/artykul
Disallow: /wiadomosci/wyszukaj/zdjecie
Disallow: /wiadomosci/wyszukaj/video
Disallow: /biznes/wyszukaj/artykul
Disallow: /biznes/wyszukaj/zdjecie
Disallow: /biznes/wyszukaj/video
Disallow: /agora/wyszukaj/artykul
Disallow: /agora/wyszukaj/zdjecie
Disallow: /agora/wyszukaj/video
Disallow: /agora_english/wyszukaj/artykul
Disallow: /agora_english/wyszukaj/zdjecie
Disallow: /agora_english/wyszukaj/video
Disallow: /wiadomosci/0,114911,8062111.html?
Disallow: /sport/0,115902,9857221.html?
Disallow: /internet/0,114243,9475559.html?
Disallow: /popcorner/0,96100,5453539.html?
Disallow: /Polygamia/0,102680,5453539.html?
Disallow: /Logo24/0,111686,8929945.html?
Disallow: /archiwum/szukaj
Disallow: /sklep/szukaj
Disallow: /male_dziecko/1,131064,13319299.html
Disallow: /duzyformat/1,130280,13165330,REGULAMIN_UDZIALU_W_KONKURSIE___JOLKA_W_DUZYM_FORMACIE__.html
Disallow: /budowa/1,106575,13292106,Regulamin_konkursu__Okna_z_mistrzowskiej_ligi_.html
Disallow: /metromsn/1,126216,13283245,Regulamin_konkursu_filmowego__PLUSZAK_.html
Disallow: /metromsn/1,127229,12733570,Regulamin_Konkursu__Motywacja_.html
Disallow: /metromsn/1,126216,12785897,Regulamin_konkursu__Fonobranie____Regulamin___.html
Disallow: /metromsn/1,126216,12341524,Regulamin_Szybkich_Konkursow__Metra_.html
Disallow: /metromsn/1,127229,10783648,Regulamin_innych_konkursow_i_plebiscytow_w_dzienniku.html
Disallow: /ludzie/0,111217,9356602.html
Disallow: /filmnews/1,94586,7877967,Regulamin.html
Disallow: /gazetapraca/1,97963,7013274,Regulamin_Extranetu_GazetaPraca_pl.html
Disallow: /emetro/1,85666,10783648,Regulamin_innych_konkursow_i_plebiscytow_w_dzienniku.html
Disallow: /testy_konsumenckie/0,132908.html
Disallow: /wiadomosci/1,114873,4688178.html
Disallow: /wiadomosci/2029020,114873,4688178.html
Disallow: /wiadomosci/1,114871,14710459,Niewidomy___Restauracja_nie_wpuscila_mnie_z_psem_przewodnikiem__.html
Disallow: /im/6a/6f/bd/z12414826X.jpg
Disallow: /ogl/1699148/mechanical+engineer
Disallow: /czterykaty/10,124846,10694760,Odc__34__Zadanie_na_Ochocie.html
Disallow: /wideo/10,92065,11676941,Wielkie_otwarcie____salon_z_kuchnia.html
Disallow: /czterykaty/10,124846,11399430,Wystroj_wnetrz__szara_eminencja_odc__39.html
Disallow: /czterykaty/10,124846,11214574,Odcinek_38___Salon_w_kobiecym_stylu.html
Disallow: /czterykaty/10,124846,10875901,Odcinek_36___Jadalnia_w_niebieskim_salonie.html
Disallow: /czterykaty/10,124846,10801539,Odc__35___Gwiezdna_metamorfoza_.html
Disallow: /ogl/1699145/project+construction+engineer
Disallow: /*,124846,
Disallow: /wnetrza/10,94250,10202180,Pokoj_ucznia.html
Disallow: /wnetrza/10,94250,10414816,Czekoladowy_salon_na_fali.html
Disallow: /wnetrza/10,94250,10694671,Salon_wielofunkcyjny.html
Disallow: /wnetrza/10,94250,10875592,Jadalnia_w_niebieskim_salonie.html
Disallow: /wnetrza/10,94250,7119913,Kawalerka_mlodego_artysty.html
Disallow: /wnetrza/10,94250,7213097,Szybkie_Metamorfozy___Sypialnia_aktorki_Basi_Kaluznej.html
Disallow: /wnetrza/10,94250,7250914,Szybkie_Metamorfozy___salon_z_kuchnia_i_przedpokoj.html
Disallow: /wnetrza/10,94250,7313641,Szybkie_Metamorfozy___Livingroom_w_bloku.html
Disallow: /wnetrza/10,94250,7371090,Szybkie_Metamorfozy___sypialnia_i_korytarz.html
Disallow: /wnetrza/10,94250,7425858,Szybkie_Metamorfozy___Duzy_remont_malego_mieszkania.html
Disallow: /wnetrza/10,94250,7492108,Remont_malego_mieszkania__cz__II.html
Disallow: /wnetrza/10,94250,7566813,Szybkie_Metamorfozy___Salon_w_nowym_wydaniu__cz__I.html
Disallow: /wnetrza/10,94250,7618142,Szybkie_Metamorfozy___salon_w_nowym_wydaniu__cz__II.html
Disallow: /wnetrza/10,94250,9227029,Afrykanskie_klimaty.html
Disallow: /wnetrza/10,94250,9251879,Afrykanskie_klimaty.html
Disallow: /wnetrza/10,94250,9457815,Salon_z_widokiem_na_Manhattan.html
Disallow: /wnetrza/10,94250,9614179,Sypialnia_w_ulubionych_kolorach.html
Disallow: /wnetrza/10,94250,9871792,Mala_zielona_sypialnia_.html
Disallow: /wnetrza/10,94250,9879057,Mala_zielona_sypialnia.html
Disallow: /wnetrza/10,94250,10801327,Gwiezdna_metamorfoza.html
Disallow: /miejsca_opole/161133445/Eugenia+Wr%C3%B3blewska+-+Khemiri+Po%C5%9Brednictwo+Ubezpieczeniowe/miasto-K%C4%99dzierzyn-Ko%C5%BAle/p/
Disallow: /szukaj/forum/dobroplast
Disallow: /aliasy/nlt/toplayer/nlt_targeted/zdrowie/ol.htm
Disallow: /getFile.servlet*
Disallow: /1,75478,17068768,CBA_zatrzymalo_wysokich_urzednikow_ZUS__Chodzi_o_przetargi.html
Disallow: /biznes/1,100896,17073195,CBA_wchodzi_do_ZUS__To_dopiero_poczatek_.html
Disallow: /pub/ips/*
Disallow: /Tokfm/0,147963
Disallow: /Tokfm/1,147963
Disallow: /Tokfm/5,147963
Disallow: /Tokfm/51,147963
Disallow: /Tokfm/55,147963
Disallow: /Tokfm/56,147963
Disallow: /Tokfm/7,147963
Disallow: /Tokfm/10,147963
Disallow: /Tokfm/12,147963
Disallow: /*servlet
Disallow: /bialystok/1,35241,19674535*
Disallow: /bialystok/1,35241,19697480*
Disallow: /im/ab/b4/10/z17515435Q.jpg
Disallow: /75224259/
Disallow: /forum/w,72,129658107,129658107,Ostrzezenie_salon_Agata_Meble_Wroclaw_Bielany.html
Disallow: /forum/w,382,104294602,104294602,krakvet_ostrzezenie_dla_kupujacych_.html*
Disallow: /dfptools/adview/
Disallow: /*druk=
Disallow: /opinions20/

User-agent: Googlebot-News
Disallow: /nowy/
Disallow: /mapa_strony
Disallow: /szukaj/forum
Disallow: /Blox/szukaj
Disallow: /szukaj/poradnik
Disallow: /temat/moto
Disallow: /szukaj/ogrody
Disallow: /temat/gazetapraca
Disallow: /temat/ladnydom
Disallow: /szukaj/plotek
Disallow: /szukaj/polygamia
Disallow: /temat/porady
Disallow: /szukaj/sport
Disallow: /szukaj/gospodarka
Disallow: /temat/wyborcza
Disallow: /szukaj/kuchnia
Disallow: /temat/czterykaty
Disallow: /temat/edukacja
Disallow: /szukaj/edziecko
Disallow: /szukaj/logo
Disallow: /temat/podroze
Disallow: /szukaj/technologie
Disallow: /szukaj/wiadomosci
Disallow: /temat/zdrowie
Disallow: /*/51,
Disallow: /*order=
Disallow: /*obxx=
Disallow: /*tag=
Disallow: /*/55,
Disallow: /*/2,
Disallow: /reloadwww?
Disallow: /ods?
Disallow: /wyszukaj
Disallow: /*/wyszukaj/
Disallow: /*servlet
Disallow: /Archiwum/1,0,5106871,20080108BY-DLO,Nie_trawie_ludzi_z_fochem,.html
Disallow: /dfptools/adview/
Disallow: /*druk=
Disallow: /opinions20/

User-agent: 360Spider
Disallow: /

User-agent: 80legs
Disallow: /

User-agent: Aboundex
Disallow: /

User-agent: accelobot
Disallow: /

User-agent: Add\ Catalog
Disallow: /

User-agent: aiHitBot
Disallow: /

User-agent: Alexibot
Disallow: /

User-agent: Aqua_Products
Disallow: /

User-agent: AskJeeves
Disallow: /

User-agent: asterias
Disallow: /

User-agent: awcheckBot
Disallow: /

User-agent: b2w/0.1
Disallow: /

User-agent: BackDoorBot/1.0
Disallow: /

User-agent: BacklinkCrawler
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: Barkrowler
Disallow: /

User-agent: BecomeBot
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: BlowFish/1.0
Disallow: /

User-agent: Bookmark search tool
Disallow: /

User-agent: BotALot
Disallow: /

User-agent: brandwatch.net
Disallow: /

User-agent: BuiltBotTough
Disallow: /

User-agent: Bullseye/1.0
Disallow: /

User-agent: BunnySlippers
Disallow: /

User-agent: Butterfly
Disallow: /

User-agent: CatchBot
Disallow: /

User-agent: Charlotte
Disallow: /

User-agent: CheeseBot
Disallow: /

User-agent: CherryPicker
Disallow: /

User-agent: CherryPickerElite/1.0
Disallow: /

User-agent: CherryPickerSE/1.0
Disallow: /

User-agent: Clickagy Intelligence Bot v2
Disallow: /

User-agent: CLIPish
Disallow: /

User-agent: Cliqzbot
Disallow: /

User-agent: COMODO
Disallow: /

User-agent: Comodo-Certificates-Spider
Disallow: /

User-agent: CompSpyBot
Disallow: /

User-agent: Copernic
Disallow: /

User-agent: CopyRightCheck
Disallow: /

User-agent: cosmos
Disallow: /

User-agent: crawler
Disallow: /

User-agent: Crescent
Disallow: /

User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
Disallow: /

User-agent: Curious
Disallow: /

User-agent: curl
Disallow: /

User-agent: DataForSeoBot
Disallow: /

User-agent: dataprovider\.com
Disallow: /

User-agent: DinoPing
Disallow: /

User-agent: discoverybot
Disallow: /

User-agent: DittoSpyder
Disallow: /

User-agent: DomainCrawler
Disallow: /

User-agent: dotbot
Disallow: /

User-agent: dotnetdotcom
Disallow: /

User-agent: Dow\ Jones\ Searchbot
Disallow: /

User-agent: dumbot
Disallow: /

User-agent: EasouSpider
Disallow: /

User-agent: EmailCollector
Disallow: /

User-agent: EmailSiphon
Disallow: /

User-agent: EmailWolf
Disallow: /

User-agent: Enterprise_Search
Disallow: /

User-agent: Enterprise_Search/1.0
Disallow: /

User-agent: EroCrawler
Disallow: /

User-agent: es
Disallow: /

User-agent: Exabot
Disallow: /

User-agent: ExtractorPro
Disallow: /

User-agent: EyeMonIT
Disallow: /

User-agent: EzineArticlesLinkScanner
Disallow: /

User-agent: Ezooms
Disallow: /

User-agent: FairAd Client
Disallow: /

User-agent: Feedpresso Content Index Bot
Disallow: /

User-agent: Flaming AttackBot
Disallow: /

User-agent: Foobot
Disallow: /

User-agent: FreeFind
Disallow: /

User-agent: FTRF\:\ Friendly
Disallow: /

User-agent: Gaisbot
Disallow: /

User-agent: GetRight/4.2
Disallow: /

User-agent: gigabot
Disallow: /

User-agent: grub
Disallow: /

User-agent: grub-client
Disallow: /

User-agent: Harvest/1.5
Disallow: /

User-agent: Hatena Antenna
Disallow: /

User-agent: hloader
Disallow: /

User-agent: http://linkfluence.com
Disallow: /

User-agent: http://mediacloud.org
Disallow: /

User-agent: http://www.SearchEngineWorld.com  bot
Disallow: /

User-agent: http://www.WebmasterWorld.com  bot
Disallow: /

User-agent: HTTP_Request
Disallow: /

User-agent: HTTP_Request2
Disallow: /

User-agent: httplib
Disallow: /

User-agent: https://developers.snap.com/robots
Disallow: /

User-agent: https://help.qwant.com/bot/
Disallow: /

User-agent: humanlinks
Disallow: /

User-agent: ia_archiver
Disallow: /

User-agent: ia_archiver/1.6
Disallow: /

User-agent: Indy\ Library
Disallow: /

User-agent: InfoNaviRobot
Disallow: /

User-agent: ip\-web\-crawler\.com
Disallow: /

User-agent: Iron33/1.0.2
Disallow: /

User-agent: Jakarta\ Commons-HttpClient
Disallow: /

User-agent: Jeeves
Disallow: /

User-agent: JennyBot
Disallow: /

User-agent: Jetbot
Disallow: /

User-agent: Jetbot/1.0
Disallow: /

User-agent: JikeSpider
Disallow: /

User-agent: Kenjin Spider
Disallow: /

User-agent: Keyword Density/0.9
Disallow: /

User-agent: larbin
Disallow: /

User-agent: LexiBot
Disallow: /

User-agent: libWeb/clsHTTP
Disallow: /

User-agent: libwww-perl
Disallow: /

User-agent: lindex\.com
Disallow: /

User-agent: Linguee
Disallow: /

User-agent: linkdex\.com
Disallow: /

User-agent: linkdexbot
Disallow: /

User-agent: LinkextractorPro
Disallow: /

User-agent: LinkScan/8.1a Unix
Disallow: /

User-agent: LinkWalker
Disallow: /

User-agent: lipperhey
Disallow: /

User-agent: LNSpiderguy
Disallow: /

User-agent: looksmart
Disallow: /

User-agent: ltbot
Disallow: /

User-agent: lwp-trivial
Disallow: /

User-agent: lwp-trivial/1.34
Disallow: /

User-agent: Lynx
Disallow: /

User-agent: magpie\-crawler
Disallow: /

User-agent: Mata Hari
Disallow: /

User-agent: Mattermost-Bot
Disallow: /

User-agent: http://MegaIndex.ru
Disallow: /

User-agent: Microsoft URL Control
Disallow: /

User-agent: Microsoft URL Control - 5.01.4511
Disallow: /

User-agent: Microsoft URL Control - 6.00.8169
Disallow: /

User-agent: MIIxpc
Disallow: /

User-agent: MIIxpc/4.2
Disallow: /

User-agent: Mister PiX
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: moget
Disallow: /

User-agent: moget/2.1
Disallow: /

User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
Disallow: /

User-agent: Mozilla/5.0 (compatible; Googlebot/2.1; startmebot/1.0; +https://start.me/bot)
Disallow: /

User-agent: MSIE\ or\ Firefox\ mutant
Disallow: /

User-agent: MSIECrawler
Disallow: /

User-agent: naver
Disallow: /

User-agent: NCBot
Disallow: /

User-agent: NetAnts
Disallow: /

User-agent: NetcraftSurveyAgent
Disallow: /

User-agent: netEstate\ NE\ Crawler
Disallow: /

User-agent: Neticle Crawler
Disallow: /

User-agent: NetMechanic
Disallow: /

User-agent: Netseer
Disallow: /

User-agent: NextGenSearchBot
Disallow: /

User-agent: NICErsPRO
Disallow: /

User-agent: Nutch
Disallow: /

User-agent: Ocelli
Disallow: /

User-agent: Offline Explorer
Disallow: /

User-agent: OmniExplorer_Bot
Disallow: /

User-agent: Openbot
Disallow: /

User-agent: Openfind
Disallow: /

User-agent: Openfind data gathere
Disallow: /

User-agent: OpenWebIndex
Disallow: /

User-agent: Oracle Ultra Search
Disallow: /

User-agent: PagesInventory
Disallow: /

User-agent: PEAR
Disallow: /

User-agent: PeoplePal
Disallow: /

User-agent: PerMan
Disallow: /

User-agent: ProCogSEOBot
Disallow: /

User-agent: ProPowerBot/2.14
Disallow: /

User-agent: ProWebWalker
Disallow: /

User-agent: proximic
Disallow: /

User-agent: psbot
Disallow: /

User-agent: PubMatic Crawler Bot
Disallow: /

User-agent: purebot
Disallow: /

User-agent: QueryN Metasearch
Disallow: /

User-agent: QuerySeekerSpider
Disallow: /

User-agent: Radiation Retriever 1.1
Disallow: /

User-agent: RepoMonkey
Disallow: /

User-agent: RepoMonkey Bait & Tackle/v1.01
Disallow: /

User-agent: Riddler
Disallow: /

User-agent: RMA
Disallow: /

User-agent: rojerbot
Disallow: /

User-agent: RyteBot
Disallow: /

User-agent: scooter
Disallow: /

User-agent: ScoutJet
Disallow: /

User-agent: Scrapy
Disallow: /

User-agent: ScreenerBot
Disallow: /

User-agent: searchmetrics
Disallow: /

User-agent: searchpreview
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: sentibot
Disallow: /

User-agent: SEO-CRAWLING
Disallow: /

User-agent: SEOENGWorldBot
Disallow: /

User-agent: SEOkicks-Robot
Disallow: /

User-agent: ShopWiki
Disallow: /

User-agent: sistrix
Disallow: /

User-agent: sitebot
Disallow: /

User-agent: SiteSnagger
Disallow: /

User-agent: Snoopy
Disallow: /

User-agent: SocialSearcher
Disallow: /

User-agent: sogou
Disallow: /

User-agent: SolomonoBot
Disallow: /

User-agent: sootle
Disallow: /

User-agent: Sosospider
Disallow: /

User-agent: SpankBot
Disallow: /

User-agent: spanner
Disallow: /

User-agent: spbot
Disallow: /

User-agent: Speedy
Disallow: /

User-agent: Stanford
Disallow: /

User-agent: Stanford Comp Sci
Disallow: /

History

Changes recorded since June 2026.

No change recorded.

In context

Poland
36.4% block at least one AI crawler
Behind Cloudflare
No
Same group