CrawlerPulse
CrawlerPulse / Oceania / Australia / manofmany.com

Man of Many

manofmany.com · Australia · Man of Many Pty Ltd · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 956 bytes. No rule names an AI crawler.

User-Agent: Google-Agent
Allow: /

User-Agent: *
Allow: /
Disallow: /cdn-cgi/
Disallow: /cdn-fpw/
Disallow: /api/
Disallow: /search/
Disallow: /feed-edm
Disallow: /assets/
Disallow: /static/
Disallow: /v/media/
Disallow: /media/mp4/
Disallow: /public/video/
Disallow: /player
Disallow: /content/stream/
Disallow: /resource/video_files/
Disallow: /upload/media/video/
Disallow: /feed
Disallow: */feed
Disallow: */feed/
Disallow: /wp-json/
Disallow: /wp-admin/
Disallow: /?preview=
Disallow: /?attachment_id=
Disallow: /*&
Disallow: /*?_rt=
Disallow: /*&_rt=
Disallow: /*?utm_
Disallow: /*&utm_
Disallow: /*?ref=
Disallow: /*&ref=
Disallow: /*?sub_id=
Disallow: /*&sub_id=
Disallow: /*?amp
Disallow: /*?lang=all
Disallow: /*&lang=all
Disallow: /*?loc=
Disallow: /*&loc=
Disallow: /*?w=
Disallow: /*?q=
Disallow: /*?wordpressNode=
Disallow: /*&wordpressNode=
Disallow: /*?jw_start=
Disallow: /*&jw_start=
Sitemap: https://manofmany.com/sitemap_index.xml

History

Changes recorded since June 2026.

No change recorded.

In context

Australia
34.0% block at least one AI crawler
Behind Cloudflare
Yes