information.dk · Denmark · Dagbladet Information · measured 8 Oct 2026
As read on 8 Oct 2026, 5,419 bytes. 2 rule groups name AI crawlers; shown first.
User-agent: AI2Bot User-agent: AddSearchBot User-agent: Ai2Bot-Dolma User-agent: Amazonbot User-agent: Andibot User-agent: Applebot-Extended User-agent: Awario User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: Brightbot 1.0 User-agent: Bytespider User-agent: CCBot User-agent: ChatGPT Agent User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Claude-Web User-agent: ClaudeBot User-agent: CloudVertexBot User-agent: Cotoyogi User-agent: Crawlspace User-agent: Datenbank Crawler User-agent: Devin User-agent: Diffbot User-agent: DuckAssistBot User-agent: Echobot Bot User-agent: EchoboxBot User-agent: FacebookBot User-agent: Factset_spyderbot User-agent: FirecrawlAgent User-agent: FriendlyCrawler User-agent: GPTBot User-agent: Gemini-Deep-Research User-agent: Google-CloudVertexBot User-agent: Google-Firebase User-agent: GoogleAgent-Mariner User-agent: ICC-Crawler User-agent: ISSCyberRiskCrawler User-agent: ImagesiftBot User-agent: Kangaroo Bot User-agent: LinerBot User-agent: Meta-ExternalAgent User-agent: Meta-ExternalFetcher User-agent: MistralAI-User User-agent: MistralAI-User/1.0 User-agent: MyCentralAIScraperBot User-agent: NovaAct User-agent: OAI-SearchBot User-agent: OpenAI User-agent: Operator User-agent: PanguBot User-agent: Panscient User-agent: Perplexity-User User-agent: PerplexityBot User-agent: PetalBot User-agent: PhindBot User-agent: Poseidon Research Crawler User-agent: QualifiedBot User-agent: QuillBot User-agent: SBIntuitionsBot User-agent: Scrapy User-agent: SemrushBot-OCOB User-agent: SemrushBot-SWA User-agent: ShapBot User-agent: Sidetrade indexer bot User-agent: Thinkbot User-agent: TikTokSpider User-agent: Timpibot User-agent: VelenPublicWebCrawler User-agent: WARDBot User-agent: Webzio-Extended User-agent: YaK User-agent: YandexAdditional User-agent: YandexAdditionalBot User-agent: YouBot User-agent: aiHitBot User-agent: anthropic-ai User-agent: bedrockbot User-agent: bigsur.ai User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: facebookexternalhit User-agent: iaskspider/2.0 User-agent: img2dataset User-agent: meta-externalagent User-agent: meta-externalfetcher User-agent: netEstate Imprint Crawler User-agent: omgili User-agent: omgilibot User-agent: panscient.com User-agent: quillbot.com User-agent: wpbot Disallow: / User-agent: AhrefsBot User-agent: AwarioBot User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: Buck User-agent: CriteoBot User-agent: DataForSeoBot User-agent: ImagesiftBot User-agent: MJ12bot User-agent: Mediapartners-Google User-agent: OpenindexBot User-agent: OpenindexSpider User-agent: Pinterestbot User-agent: SemrushBot User-agent: SentiBot User-agent: Twitterbot User-agent: barkrowler User-agent: dotbot User-agent: proximic User-agent: turnitinbot Disallow: / User-agent: * Allow: /core/*.css$ Allow: /core/*.css? Allow: /core/*.js$ Allow: /core/*.js? Allow: /core/*.avif Allow: /core/*.gif Allow: /core/*.jpg Allow: /core/*.jpeg Allow: /core/*.png Allow: /core/*.svg Allow: /core/*.webp Allow: /profiles/*.css$ Allow: /profiles/*.css? Allow: /profiles/*.js$ Allow: /profiles/*.js? Allow: /profiles/*.avif Allow: /profiles/*.gif Allow: /profiles/*.jpg Allow: /profiles/*.jpeg Allow: /profiles/*.png Allow: /profiles/*.svg Allow: /profiles/*.webp Disallow: /core/ Disallow: /profiles/ Disallow: /README.md Disallow: /composer/Metapackage/README.txt Disallow: /composer/Plugin/ProjectMessage/README.md Disallow: /composer/Plugin/Scaffold/README.md Disallow: /composer/Plugin/VendorHardening/README.txt Disallow: /composer/Template/README.txt Disallow: /modules/README.txt Disallow: /sites/README.txt Disallow: /themes/README.txt Disallow: /admin/ Disallow: /comment/reply/ Disallow: /filter/tips Disallow: /node/add/ Disallow: /search/ Disallow: /search? Disallow: /user/register Disallow: /user/password Disallow: /user/login Disallow: /user/logout Disallow: /media/oembed Disallow: /*/media/oembed Disallow: /index.php/admin/ Disallow: /index.php/comment/reply/ Disallow: /index.php/filter/tips Disallow: /index.php/node/add/ Disallow: /index.php/search/ Disallow: /index.php/search? Disallow: /index.php/user/password Disallow: /index.php/user/register Disallow: /index.php/user/login Disallow: /index.php/user/logout Disallow: /index.php/media/oembed Disallow: /index.php/*/media/oembed User-agent: * Sitemap: https://www.information.dk/sitemap.xml Disallow: /bruger?destination=* Disallow: /en/ Disallow: /eavis Disallow: /epaper_redirect Disallow: /gavekort Disallow: /redirect/epaper/ Disallow: /soeg-arkiv Disallow: /user/login Allow: / User-agent: SeekportBot User-agent: YandexBot Disallow: /
Changes recorded since June 2026.
No change recorded.