CrawlerPulse
CrawlerPulse / Africa / Egypt / masrawy.com

Masrawy

masrawy.com · Egypt · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 9 Oct 2026, 2,336 bytes. No rule names an AI crawler.

User-agent: *
Disallow: */bin
Disallow: */ctrl
Disallow: */ctrlt
Disallow: */Masrawy_Lite
Disallow: */masrawy_lite
Disallow: */xml
Disallow: */lib/
Disallow: */swf/
Disallow: */*.axd
Disallow: */news/2006/
Disallow: */news/2007/
Disallow: */news/2008/
Disallow: */news/2009/
Disallow: */news/2010/
Disallow: */new/
Disallow: */2006/
Disallow: */2007/
Disallow: */2008/
Disallow: */2009/
Disallow: */2010/
Disallow: */sports/media/images/
Disallow: */sports/media/videos/
Disallow: */nateega/2008/
Disallow: */nateega/2010/
Disallow: */nateega/2011/
Disallow: */news/dynamicservices
Disallow: */chat2007/
Disallow: */news/world/reuters/
Disallow: */women/
Disallow: */Classfied/
Disallow: */sms/freesms/
Disallow: */freenet/
Disallow: */petition/
Disallow: */games/
Disallow: */Albums/
Disallow: */albums/
Disallow: */samiyusuf
Disallow: */controls
Disallow: */files/post
Disallow: */files/category
Disallow: */files/area
Disallow: */files/slider
Disallow: */files/general
Disallow: */files/pageslide
Disallow: */vas
Disallow: */widget
Disallow: */49151695/
Disallow: */WebForms/Comment.aspx
Disallow: */webforms/comment.aspx
Disallow: */ar/ContactUs?returnURL=
Disallow: */ar/contactus?returnurl=
Disallow: */mail
Disallow: *beta
Disallow: *beta*
Disallow: *aflam
Disallow: */ar/register
Disallow: *mtest.masrawy.com
Disallow: */ctrl/
Disallow: */ctrlt/
Disallow: */news/dynamicservices/
Disallow: */chat2007/
Disallow: */nateega/2008/
Disallow: */nateega/2010/
Disallow: */nateega/2011/
Disallow: */News/World/Reuters/
Disallow: */Classfied/
Disallow: *mtest.masrawy.com/*
Disallow: */polldetail.aspx
Disallow: */polldetail.aspx
Disallow: */moraselon
Disallow: */ketabat
Disallow: */coupons
Disallow: */Account/ExternalLogin*
Disallow: */cdn-cgi/challenge-platform*
Disallow: */article/addpostview*
Disallow: */article/addpostview
Disallow: */Article/AddPostView*
Disallow: */Article/AddPostView
Disallow: */General/InterestingArticles*
Disallow: */General/InterestingArticles
Disallow: */General/WayaContent*
Disallow: */General/WayaContent
Disallow: */General/GetLocation
Disallow: */General/GetLocation*
Disallow: */NewsPointer
Disallow: */~/*
Disallow: *.aspx*
Disallow: /search
Allow: /
Sitemap: https://www.masrawy.com/feeds/sitemap

History

Changes recorded since June 2026.

No change recorded.

In context

Egypt
0.0% block at least one AI crawler
Behind Cloudflare
Yes