CrawlerPulse
CrawlerPulse / Europe / Belgium / jobat.be

Jobat

jobat.be · Belgium · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 1,317 bytes. 1 rule group name AI crawlers; shown first.

User-agent: PetalBot
Disallow: /

User-agent: *
disallow: /nl/artikels-zoeken*
disallow: /fr/recherche-articles*
disallow: /en/search-articles*
disallow: */secure/register*
disallow: */secure/login*
disallow: */myjobat/login*
disallow: /*?*joblanguage=*
disallow: /*?*action=*
disallow: /*?*Pref_Lang=*
disallow: /*?*favorites=*
disallow: /nl/werkgevers-oud*
disallow: /fr/employeurs-vieux*
disallow: /*.aspx*
disallow: /*/art/2025/*
disallow: /*/art/2024/*
disallow: /*/art/2023/*
disallow: /*/art/2022/*
disallow: /*/art/2021/*
disallow: /*/art/2020/*
disallow: /*/art/2019/*
disallow: /nl/jobs/bedrijvenold*
disallow: /fr/emplois/entreprisesold*
disallow: /en/jobs/companiesold*

User-agent: DataForSeoBot
Disallow: /

User-agent: AwarioBot
Disallow: /

User-agent: Cxensebot
Disallow: /

User-agent: cXensebot
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: Baiduspider-image
Disallow: /

User-agent: Baiduspider-video
Disallow: /
Sitemap: https://www.jobat.be/sitemaps/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Belgium
37.5% block at least one AI crawler
Behind Cloudflare
Yes