CrawlerPulse
CrawlerPulse / Africa / Senegal / senego.com

senego.com

senego.com · Senegal · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 3,296 bytes. No rule names an AI crawler.

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-login.php
Disallow: /xmlrpc.php
Disallow: /wp-json/
Disallow: /*?s=
Disallow: /*?s$
Disallow: /*?s&
Disallow: /search/
Disallow: /page/
Disallow: */page/
Disallow: /20*/
Disallow: /date/
Disallow: /mot/
Disallow: /tag/
Disallow: /*?amp=
Disallow: /*?amp$
Disallow: /*?amp;
Disallow: /*?amp&
Disallow: /*/amp/
Disallow: /*/amp$
Disallow: /ptv/
Disallow: /foot/
Disallow: /ramadan-2020-region/
Disallow: /cdn-fpw/
Disallow: /cdn-cgi/
Disallow: /tmp
Disallow: /*?author=
Disallow: /*?nomobile
Disallow: /*?do=
Disallow: /*?wordfence_lh=
Disallow: /*?wordfence_logHuman=
Disallow: /*?hid=
Disallow: /*?refresh=
Disallow: /*?paged1=
Disallow: /*?paged2=
Disallow: /*?paged3=
Disallow: /*?paged4=
Disallow: /*?paged5=
Disallow: /*?paged6=
Disallow: /*?paged7=
Disallow: /*?paged8=
Disallow: /*?paged9=
Disallow: /*?paged10=
Disallow: /*?Itemid=
Disallow: /*?layout=
Disallow: /*?option=com_
Disallow: /*?utm_*
Disallow: /*?fbclid=
Disallow: /*?gclid=
Disallow: /*?replytocom=
Disallow: /connexion
Disallow: /*?ad_click=
Disallow: /*?archive
Disallow: /*?subaction=
Disallow: /*?opt__=
Disallow: /*?action=
Disallow: /*?attachment_id=
Disallow: /*?theme=
Disallow: /*?channel=
Disallow: /*?trk=
Disallow: /*?pwa_serviceworker=
Disallow: /*?php_the_permalink
Disallow: /*?php_the_permalink()_
Disallow: /*?PageSpeed=
Disallow: /*?ModPagespeed=
Disallow: /*?amp-wp-skip-redirect=
Disallow: /*?nonamp=
Disallow: /*?redirect=
Disallow: /*?mobile=
Disallow: /*?q=
Disallow: /*?p=
Disallow: /*?wps_preview=
Disallow: /*?ref=
Disallow: /*?kuid=
Disallow: /*?kref=
Disallow: /*?http
Disallow: /*_html$
Disallow: /*&PageSpeed=
Disallow: /*&ModPagespeed=
Disallow: /*&refresh=
Disallow: /*&utm_
Disallow: /*&fbclid=
Disallow: /*&gclid=
Disallow: /*&replytocom=
Disallow: /*&action=
Disallow: /*&post_id=
Disallow: /*&comments=
Disallow: /*&ref=
Disallow: /*&kuid=
Disallow: /*&kref=
Disallow: /*&
Disallow: /*.html/feed
Disallow: /*.html/feed/
Disallow: /rubrique/actualite/
Disallow: /rubrique/rubrique/
Disallow: /rubrique/contribution
Disallow: /rubrique/buzz
Disallow: /rubrique/insolite
Disallow: /rubrique/finance
Disallow: /rubrique/divertissement-2
Disallow: /rubrique/divertissement-3
Disallow: /rubrique/divertissement-4
Disallow: /rubrique/divertissement-5
Disallow: /rubrique/divertissement-6
Disallow: /rubrique/divertissement-7
Disallow: /rubrique/divertissement-8
Disallow: /rubrique/divertissement-9
Disallow: /rubrique/senego-tv
Disallow: /rubrique/senego-photos
Disallow: /rubrique/people
Disallow: /rubrique/lutte-senegalaise
Disallow: /rubrique/humour
Disallow: /rubrique/football
Disallow: /rubrique/drame
Disallow: /rubrique/revue-de-presse
Disallow: /rubrique/autres-sports
Disallow: /rubrique/sketch-telefilm
Disallow: /rubrique/vedette
Disallow: /rubrique/telecommunications
Disallow: /rubrique/en-direct
Disallow: /rubrique/agriculture-2
Disallow: /rubrique/environnement
Disallow: /rubrique/afrique
Sitemap: https://senego.com/sitemap.xml
Sitemap: https://senego.com/sitemap-news.xml
Sitemap: https://senego.com/services/sitemap.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Senegal
4.2% block at least one AI crawler
Behind Cloudflare
No