nzherald.co.nz · New Zealand · NZME · measured 8 Oct 2026
As read on 8 Oct 2026, 44,665 bytes. 10 rule groups name AI crawlers; shown first.
User-agent: anthropic-ai Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Claude-Web Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: cohere-ai Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: PerplexityBot User-agent: Perplexity-User Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: Meta-ExternalAgent User-agent: meta-externalagent User-agent: Meta-ExternalFetcher User-agent: meta-externalfetcher Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: Google-Extended User-agent: Google-CloudVertexBot Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: Applebot-Extended Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: Bytespider Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: CCBot Allow: /sponsored-stories/* Disallow: / Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=nzh Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=viva Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=bay-of-plenty-times Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=hawkes-bay-today Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=newstalk-zb Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=rotorua-daily-post Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=the-country Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=northern-advocate Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=northland-age Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=waikato-news Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=whanganui-chronicle Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=eatwell Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=the-listener Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-index/?outputType=xml&_website=gisborne-herald Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=nzh Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=viva Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=bay-of-plenty-times Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=hawkes-bay-today Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=newstalk-zb Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=rotorua-daily-post Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=the-country Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=northern-advocate Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=northland-age Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=waikato-news Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=whanganui-chronicle Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=eatwell Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=the-listener Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-video-index/?outputType=xml&_website=gisborne-herald Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-sites/?outputType=xml Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-authors/?outputType=xml Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-sections/?outputType=xml Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemaptopics/?outputType=xml&from=0&to=a Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemaptopics/?outputType=xml&from=b&to=d Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemaptopics/?outputType=xml&from=e&to=g Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemaptopics/?outputType=xml&from=h&to=j Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemaptopics/?outputType=xml&from=k&to=m Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemaptopics/?outputType=xml&from=n&to=p Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemaptopics/?outputType=xml&from=q&to=s Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemaptopics/?outputType=xml&from=t&to=v Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemaptopics/?outputType=xml&from=w&to=z Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=nzh Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=viva Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=bay-of-plenty-times Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=hawkes-bay-today Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=newstalk-zb Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=rotorua-daily-post Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=the-country Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=northern-advocate Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=northland-age Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=waikato-news Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=whanganui-chronicle Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=eatwell Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=the-listener Sitemap: https://www.nzherald.co.nz/arc/outboundfeeds/sitemap-news/?outputType=xml&_website=gisborne-herald User-agent: BingBot Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in User-agent: msnbot Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in User-agent: Slurp Crawl-Delay: 30 Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in User-agent: Yahoo-Newscrawler Crawl-Delay: 30 Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in User-agent: Googlebot Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /S1=* Disallow: /SITE=NZH/* Disallow: /*printadvert.cfm* Disallow: /*respondtoad.cfm* Disallow: /*?c_id=* Disallow: /*?o_id=* Disallow: /*?l_id=* Disallow: /*?ref=* Disallow: /*?objectid=* Disallow: /*?gallery_id=* User-agent: AASA-Bot/1.0.0 Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: /S1=* Disallow: /SITE=NZH/* Disallow: /*printadvert.cfm* Disallow: /*respondtoad.cfm* Disallow: */premium/* Disallow: / User-agent: AASA-Bot Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: /S1=* Disallow: /SITE=NZH/* Disallow: /*printadvert.cfm* Disallow: /*respondtoad.cfm* Disallow: */premium/* Disallow: / User-agent: Apple-Bot/1.0.0 Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: /S1=* Disallow: /SITE=NZH/* Disallow: /*printadvert.cfm* Disallow: /*respondtoad.cfm* User-agent: Apple-Bot Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: /S1=* Disallow: /SITE=NZH/* Disallow: /*printadvert.cfm* Disallow: /*respondtoad.cfm* User-agent: Googlebot-News Disallow: /*classifieds* Disallow: /puzzles-games/ Disallow: /news/marketplace.cfm* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in User-agent: EchoboxBot/1.0 Crawl-Delay: 30 Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in User-agent: * Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* User-agent: AliyunSecBot Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: quillbot.com Allow: /sponsored-stories/* Disallow: / User-agent: DuckAssistBot Allow: /sponsored-stories/* Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in Disallow: */premium/* Disallow: / User-agent: MeltwaterNews Disallow: /fakebots Disallow: /*keyword=* Disallow: /*print.cfm* Disallow: /*NaN/* Disallow: /nzh-search/ Disallow: */my-account/profile* Disallow: */my-account/reset-password Disallow: */my-account/register/newsletters-setup Disallow: */my-account/register/profile-setup Disallow: */my-account/subscription/checkout/register/ Disallow: */my-account/subscription/checkout/sign-in/ Disallow: */my-account/subscription/checkout/ Disallow: */my-account/subscription/payment/ Disallow: */my-account/subscription/confirmation/ Disallow: */my-account/subscription/offers/sign-in/ Disallow: */my-account/subscription/offers/?campaignId=* Disallow: /app/my-account/register Disallow: /app/my-account/sign-in User-agent: psbot Disallow: / User-agent: Yahoo-MMCrawler Disallow: / User-agent: grapeshot Disallow: / User-agent: *OrkashBot* Disallow: / User-agent: *Flamingo_SearchEngine*
Changes recorded since June 2026.
No change recorded.