CrawlerPulse
CrawlerPulse / Oceania / Australia / timeout.com

Time Out

timeout.com · Australia · Print & Digital Publishing Pty Ltd · measured 8 Oct 2026

Google Search
Allowed
Google-Extended
Allowed
OpenAI
Allowed
Anthropic
Allowed
Perplexity
Allowed
Meta
Allowed
Common Crawl
Allowed
ByteDance
Allowed
Apple
Allowed
Amazon
Allowed

robots.txt

As read on 8 Oct 2026, 3,151 bytes. No rule names an AI crawler.

User-agent: *
Disallow: /*/pages/*/zone/
Disallow: /graffiti/v1/
Disallow: /user/ajax/
Disallow: */pages-ajax
Disallow: */paginate
Disallow: /user/mtoPopupLogin
Disallow: /ajax/mastercard-theme
Disallow: */user/sign-up
Disallow: *user/myAccount
Disallow: *user/forgotPassword
Disallow: */user/email/review
Disallow: */user/token
Disallow: /user/attending/upcoming*
Disallow: */rss/               # Blocks folders named 'rss'
Disallow: */rss_en_all         # Blocks specific legacy string
Disallow: */rss_ja_all         # Blocks specific legacy string
Disallow: */rss/Features
Disallow: */rss/Events
Disallow: */rss_for_twitter
Disallow: */rss/Venues
Disallow: /search*
Disallow: /*/search*
Disallow: /*/search/
Disallow: /*/search
Disallow: /*/*/search*
Disallow: /*/*/search/
Disallow: /*/*/search
Disallow: /search-listings?*
Disallow: /*/*.php
Disallow: /*/*/bookings
Sitemap: https://www.timeout.com/sitemap.xml.gz
Sitemap: https://www.timeout.com/news_sitemap.xml
Sitemap: https://www.timeout.com/london/news_sitemap.xml
Sitemap: https://www.timeout.com/uk/news_sitemap.xml
Sitemap: https://www.timeout.es/madrid/es/news_sitemap.xml
Sitemap: https://www.timeout.es/barcelona/es/news_sitemap.xml
Sitemap: https://www.timeout.cat/barcelona/ca/news_sitemap.xml
Sitemap: https://www.timeout.pt/lisboa/pt/news_sitemap.xml
Sitemap: https://www.timeout.pt/porto/pt/news_sitemap.xml
Sitemap: https://www.timeout.fr/paris/news_sitemap.xml
Sitemap: https://www.timeout.com/newyork/news_sitemap.xml
Sitemap: https://www.timeout.com/usa/news_sitemap.xml
Sitemap: https://www.timeout.com/los-angeles/news_sitemap.xml
Sitemap: https://www.timeout.com/chicago/news_sitemap.xml
Sitemap: https://www.timeout.com/montreal/news_sitemap.xml
Sitemap: https://www.timeout.com/hong-kong/news_sitemap.xml
Sitemap: https://www.timeout.com.hk/hong-kong/hk/news_sitemap.xml
Sitemap: https://www.timeout.com/singapore/news_sitemap.xml
Sitemap: https://www.timeout.com/tokyo/news_sitemap.xml
Sitemap: https://www.timeout.jp/tokyo/ja/news_sitemap.xml
Sitemap: https://www.timeout.com/bangkok/news_sitemap.xml
Sitemap: https://www.timeout.com/bangkok/th/news_sitemap.xml
Sitemap: https://www.timeout.com/sydney/news_sitemap.xml
Sitemap: https://www.timeout.com/melbourne/news_sitemap.xml
Sitemap: https://www.timeout.com/australia/news_sitemap.xml

User-agent: 80bot
Disallow: /

User-agent: genieBot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: MLBot
Disallow: /

User-agent: Nutch
Disallow: /

User-agent: OmniExplorer_Bot
Disallow: /

User-agent: spock
Disallow: /

User-agent: BecomeBot # Removing time delay which bots ignored anyway
User-agent: TurnitinBot # Removing time delay which bots ignored anyway

History

Changes recorded since June 2026.

No change recorded.

In context

Australia
34.0% block at least one AI crawler
Behind Cloudflare
No