africannewsagency.com · South Africa · https://www.africannewsagency.com/ · measured 8 Oct 2026
As read on 8 Oct 2026, 974 bytes. 1 rule group name AI crawlers; shown first.
User-agent: PetalBot Disallow: / User-agent: * Crawl-delay: 600 Allow: /wp-content/uploads/ Allow: /wp-admin/admin-ajax.php Allow: *.js Allow: *.css Disallow: /wp-admin/ Disallow: *?z= Disallow: *?s= Disallow: *?q= Disallow: /author/ Disallow: /tag/ Disallow: /wp-includes/ Disallow: /xmlrpc.php Disallow: /profile Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /junk/ Disallow: /index.php?* Disallow: /trackback/ Disallow: /comments/ Disallow: /administrator/ Disallow: */trackback/ Disallow: */comments/ Disallow: /license.txt Disallow: /*.php$ User-agent: mj12bot Disallow: / User-agent: rogerbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: dotbot Disallow: / User-agent: MauiBot Disallow: / User-agent: twiceler Disallow: / User-agent: SEOkicks-Robot Disallow: / Sitemap: https://www.africannewsagency.com/sitemap_index.xml
Changes recorded since June 2026.
No change recorded.