nit.com.au · Australia · measured 8 Oct 2026
As read on 8 Oct 2026, 3,360 bytes. 21 rule groups name AI crawlers; shown first.
User-agent: Applebot-Extended Allow: / User-agent: Google-Extended Allow: / User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: YouBot Allow: / User-agent: cohere-ai Allow: / User-agent: CCBot Allow: / User-agent: meta-externalagent Allow: / User-agent: FacebookBot Allow: / User-agent: Bytespider Allow: / User-agent: Amazonbot Allow: / User-agent: Diffbot Disallow: / User-agent: Omgilibot Disallow: / User-agent: Omgili Disallow: / User-agent: Timpibot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: Yahoo Allow: / User-agent: Slurp Allow: / User-agent: YandexBot Allow: / User-agent: Baiduspider Allow: / User-agent: Applebot Allow: / User-agent: Perplexity-User Allow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: MegaIndex Disallow: / User-agent: MauiBot Disallow: / User-agent: SeznamBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: Cliqzbot Disallow: / User-agent: AspiegelBot Disallow: / User-agent: Exabot Disallow: / User-agent: WallabyupBot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: Webzio-Extended Disallow: / User-agent: MeltwaterNews Disallow: / User-agent: TurnitinBot Disallow: / User-agent: * Disallow: /seeker/ Disallow: /member/ Disallow: /preview-article/ Disallow: /search-results/ Disallow: /nova-helper/ Disallow: /extend-session Disallow: /impersonation Disallow: /advertiser/ Disallow: /mob/ Disallow: /posts/tag/ Disallow: /events/tag/ Sitemap: https://nit.com.au/sitemap.xml
Changes recorded since June 2026.
No change recorded.