forbes.com · United States · Forbes · measured 8 Oct 2026
As read on 8 Oct 2026, 33,649 bytes. 16 rule groups name AI crawlers; shown first.
User-agent: Amazonbot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot User-agent: CCbot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: cohere-ai User-agent: Cohere-AI Disallow: / User-agent: Diffbot Disallow: / User-agent: FacebookBot Disallow: / User-agent: GPTBot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: meta-externalagent User-agent: Meta-ExternalAgent Disallow: / User-Agent: OAI-SearchBot Allow: / User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-Agent: PerplexityBot Disallow: / User-agent: * Allow: /ajax/follow_info* Allow: /ajax/getUniregUserData* Disallow: /following/ Disallow: /search/ Disallow: /follow/ Disallow: /ajax/ Disallow: /author/following/ Disallow: /blog/following/ Disallow: /json/ Disallow: /header/channels/ Disallow: /find-more/ Disallow: /preview/ Disallow: *wp-admin* Disallow: /typeahead/ Disallow: /pepe/ Disallow: /media-manager/ Disallow: /coupons/visit/* Disallow: /test/ Disallow: /advisor/*zx1fa* Disallow: /advisor/journey/ Disallow: /wui/ Disallow: /research-survey User-agent: googlebot-news Disallow: /sites/adobe/ Disallow: /sites/arizonacommerce/ Disallow: /sites/bmoharrisbank/ Disallow: /sites/businessaviation/ Disallow: /sites/capitalonespark/ Disallow: /sites/cdw/ Disallow: /sites/centurylink/ Disallow: /sites/dell/ Disallow: /sites/emc/ Disallow: /sites/ey/ Disallow: /sites/fedex/ Disallow: /sites/fidelity/ Disallow: /sites/gyro/ Disallow: /sites/hsbc/ Disallow: /sites/houlihanlawrence/ Disallow: /sites/hiscox/ Disallow: /sites/ibm/ Disallow: /sites/infosys/ Disallow: /sites/mdanderson/ Disallow: /sites/medidata/ Disallow: /sites/microsoft/ Disallow: /sites/microsoftdynamics/ Disallow: /sites/netapp/ Disallow: /sites/northwesternmutual/ Disallow: /sites/oppenheimerfunds/ Disallow: /sites/oracle/ Disallow: /sites/pace/ Disallow: /sites/raymondjames/ Disallow: /sites/sage/ Disallow: /sites/samsung/ Disallow: /sites/sap/ Disallow: /sites/sungardas/ Disallow: /sites/taboola/ Disallow: /sites/ups/ Disallow: /sites/delta/ Disallow: /sites/airbus/ Disallow: /sites/symantec/ Disallow: /sites/paypal/ Disallow: /sites/olddominion/ Disallow: /sites/salesforce/ Disallow: /sites/gapinternational/ Disallow: /sites/sprintbusiness/ Disallow: /sites/transamerica/ Disallow: /sites/constantcontact/ Disallow: /sites/robertocoin/ Disallow: /sites/canon/ Disallow: /sites/samsungbusiness/ Disallow: /sites/att/ Disallow: /sites/lasvegas/ Disallow: /sites/iowa/ Disallow: /sites/teradata/ Disallow: /sites/thehartford/ Disallow: /sites/statoil/ Disallow: /sites/cit/ Disallow: /sites/deloitte/ Disallow: /sites/huawei/ Disallow: /sites/relateiq/ Disallow: /sites/cftc/ Disallow: /sites/celebritycruises/ Disallow: /sites/universityofcalifornia/ Disallow: /sites/coxbusiness/ Disallow: /sites/pega/ Disallow: /sites/athenahealth/ Disallow: /sites/etrade/ Disallow: /sites/comcastbusiness/ Disallow: /sites/optum/ Disallow: /sites/seagate/ Disallow: /sites/rbcwealthmanagement/ Disallow: /sites/avigilon/ Disallow: /sites/citi/ Disallow: /sites/castlight/ Disallow: /sites/hyatt/ Disallow: /sites/johnhancock/ Disallow: /sites/koreanair/ Disallow: /sites/merrilllynch/ Disallow: /sites/ptc/ Disallow: /sites/toyota/ Disallow: /sites/unify/ Disallow: /sites/xerox/ Disallow: /sites/united/ Disallow: /sites/zenithwatches/ Disallow: /sites/jpmorganchase/ Disallow: /sites/ramcommercial/ Disallow: /sites/puremichigan/ Disallow: /sites/tmfgroup/ Disallow: /sites/usaa/ Disallow: /sites/emerson/ Disallow: /sites/aberdeen/ Disallow: /sites/kellogg/ Disallow: /sites/zurich/ Disallow: /sites/freeenterprise/ Disallow: /sites/allclearid/ Disallow: /sites/accenture/ Disallow: /sites/mercedesbenz/ Disallow: /sites/nice/ Disallow: /sites/riverbed/ Disallow: /sites/pimco/ Disallow: /sites/netjets/ Disallow: /sites/vmware/ Disallow: /sites/visa/ Disallow: /sites/statefarm/ Disallow: /sites/philips/ Disallow: /sites/adp/ Disallow: /sites/zenithwatches/ Disallow: /sites/citrix/ Disallow: /sites/gwcic/ Disallow: /sites/cargill/ Disallow: /sites/bankofsingapore/ Disallow: /sites/dbsbank/ Disallow: /sites/gradsoflife/ Disallow: /sites/internationaliotcouncil/ Disallow: /pega/customers-for-life Disallow: /celebritycruises/guide-to-the-globe Disallow: /sites/disneyinstitute/ Disallow: /sites/concertocloud/ Disallow: /sites/capitalonefutureedge/ Disallow: /sites/mahindracomviva/ Disallow: /sites/workday/ Disallow: /sites/colorado/ Disallow: /sites/charlesschwab/ Disallow: /sites/chicagobooth/ Disallow: /sites/morganstanley/ Disallow: /sites/opentext/ Disallow: /sites/icims/ Disallow: /sites/thriventmutualfunds/ Disallow: /sites/cbre/ Disallow: /sites/universityofphoenix/#57934e047260 Disallow: /sites/ppg/ Disallow: /sites/americanfunds/ Disallow: /sites/lilly/ Disallow: /sites/norton/ Disallow: /sites/qualityassurance/ Disallow: /sites/qlik/ Disallow: /whats-next/planes-trains-and-analytics Disallow: /top-50-wealth-managers Disallow: /toyota/fueled-by-skepticism Disallow: /toyota/coming-soon Disallow: /dell/cloud-future-of-medicine Disallow: /cit/renewable-energy Disallow: /retail Disallow: /mobile/cities-transformed Disallow: /cit/small-business-mergers-2 Disallow: /cit/small-business-mergers Disallow: /sites/kpmg/ Disallow: /dell/cities-transformed Disallow: /sites/neustar Disallow: /sites/ubs Disallow: /sites/northerntrust Disallow: /sites/infiniti Disallow: /sites/honeywell Disallow: /sites/charlesschwabadvisor Disallow: /sites/frisco Disallow: /sites/colehaan Disallow: /sites/gapincthiswayahead Disallow: /sites/discoverpersonalloans Disallow: /sites/delltechnologies Disallow: /colehaan/daring-to-step-forward Disallow: /johnhancock/ Disallow: /johnhancock/in-a-lifetime-healthcare Disallow: /johnhancock/in-a-lifetime-work Disallow: /oppenheimerfunds/the-upside Disallow: /sites/hpeenterprisenxt Disallow: /sites/rackspace Disallow: /sites/themacallan Disallow: /themacallan/worlds-together Disallow: /sites/inteliotpartnership Disallow: /oppenheimerfunds/the-upside Disallow: /partners/ Disallow: /johnhancock/in-a-lifetime-sustainability Disallow: /sites/domperignon Disallow: /sites/shinola Disallow: /sites/hpinc Disallow: /sites/hp Disallow: /sites/alfresco Disallow: /cbre/built-for-performance Disallow: /sites/mmedric Disallow: /sites/indiana Disallow: /sites/siemenshealthineers Disallow: /sites/rackspace Disallow: /rackspace/elevating-performance Disallow: /sites/suntrust Disallow: /sites/unicefusa Disallow: /sites/mitsubishiheavyindustries Disallow: /best-countries-for-business/list Disallow: /sites/paloaltonetworks Disallow: /sites/f5 Disallow: /sites/samsungtv Disallow: /sites/qa Disallow: /sites/paycom Disallow: /sites/testbrandvoice Disallow: /business/blahblah Disallow: /sites/spdr Disallow: /sites/lincoln Disallow: /sites/abb Disallow: /sites/eycybersecurity Disallow: /sites/civicnation Disallow: /sites/bcg Disallow: /sites/vanguard Disallow: /sites/akamai Disallow: /sites/kyocera Disallow: /sites/socialimpact Disallow: /sites/emirates Disallow: /sites/hpincemea Disallow: /sites/ibmperformancecomputing Disallow: /sites/pfizer Disallow: /sites/ibmpowersystems Disallow: /sites/vanguardcharitable Disallow: /sites/suntrustprivatewealth Disallow: /sites/capitalone Disallow: /sites/juniper Disallow: /sites/wellsfargo Disallow: /sites/bnymellon Disallow: /sites/braintree Disallow: /sites/bnymellonwealthmanagement Disallow: /sites/epson Disallow: /sites/thomsonreuters Disallow: /sites/paysafe Disallow: /sites/josabank Disallow: /sites/hennessyparadisimperial Disallow: /sites/cartier Disallow: /sites/anabluewing Disallow: /sites/eidoo Disallow: /sites/cmstesting Disallow: /sites/adobepartnership Disallow: /sites/cornelljohnson Disallow: /sites/quantcast Disallow: /sites/japan Disallow: /sites/impactpartners Disallow: /sites/nvidia Disallow: /sites/personalcapital Disallow: /sites/microsoft365 Disallow: /sites/providencedigitalinnovation Disallow: /sites/whittiertrust Disallow: /sites/kinetica Disallow: /sites/paulevans Disallow: /sites/ritz-carltonleadershipcenter Disallow: /sites/icoengine Disallow: /sites/tesaro Disallow: /sites/theglenlivet Disallow: /feature/sf-test Disallow: /sites/courtyardmarriott Disallow: /sites/nuveen Disallow: /sites/intelai Disallow: /sites/secret Disallow: /sites/hec Disallow: /retail/old Disallow: /sites/alliantgroup Disallow: /sites/intuitivesurgical Disallow: /sites/sunovion Disallow: /sites/ofx Disallow: /sites/firstrepublicbank Disallow: /sites/1850byfolgers Disallow: /sites/audi Disallow: /sites/nuveencef Disallow: /sites/1850brandcoffee Disallow: /sites/cisco Disallow: /sites/blackstarcapitalltd Disallow: /sites/usbankaltitudereserve Disallow: /sites/dassaultsystemes Disallow: /sites/urogen Disallow: /sites/smartsheet Disallow: /sites/iwc Disallow: /sites/datingcom Disallow: /sites/intuitquickbooks Disallow: /sites/oticon Disallow: /sites/servicenow Disallow: /sites/deloitteriskandfinancialadvisory Disallow: /sites/dbsprivatebank Disallow: /sites/americanexpress Disallow: /sites/tanotofoundation Disallow: /sites/citizensaccess Disallow: /sites/salesforceessentials Disallow: /sites/drexeluniversity Disallow: /sites/microsoftinnovation Disallow: /sites/mypos Disallow: /sites/harvardpilgrimhealthcare Disallow: /sites/appdynamics Disallow: /sites/ministryoftourismindia Disallow: /sites/orlando Disallow: /sites/extrahop Disallow: /sites/ascm Disallow: /sites/crowe Disallow: /sites/peerfit Disallow: /sites/theleukemialymphomasociety Disallow: /sites/hewlettpackardenterprise Disallow: /sites/montblanc Disallow: /sites/meero Disallow: /sites/braze Disallow: /sites/publicissapient Disallow: /sites/flexport User-agent: FriendlyCrawler Disallow: / User-agent: AhrefsBot User-agent: AhrefsSiteAudit Crawl-delay: 2 User-Agent: Claude-User User-Agent: Claude-SearchBot Allow: / User-agent: AmazonAdBot Allow: /following/ Allow: /search/ Allow: /follow/ Allow: /author/following/ Allow: /blog/following/ Allow: /header/channels/ Allow: /find-more/ Allow: /preview/ Allow: /typeahead/ Allow: /pepe/ Allow: /media-manager/ Allow: /coupons/visit/* Allow: /advisor/*zx1fa* Allow: /wui/ User-agent: APSMeridianBot Disallow: /advisor Disallow: /betting/ Disallow: /councils/ Disallow: /financial-services/ Disallow: /sites/_glenfiddich/ Disallow: /sites/1850brandcoffee/ Disallow: /sites/84-lumber/ Disallow: /sites/aarp/ Disallow: /sites/ab-inbev/ Disallow: /sites/abb/ Disallow: /sites/aberdeen/ Disallow: /sites/accenture-india/ Disallow: /sites/accenture/ Disallow: /sites/acoustic/ Disallow: /sites/acronis/ Disallow: /sites/adobe/ Disallow: /sites/adobepartnership/ Disallow: /sites/adp/ Disallow: /sites/adyen/ Disallow: /sites/airbus/ Disallow: /sites/akamai/ Disallow: /sites/alfresco/ Disallow: /sites/alibaba/ Disallow: /sites/alight/ Disallow: /sites/allclearid/ Disallow: /sites/alliantgroup/ Disallow: /sites/almanac/ Disallow: /sites/alpine/ Disallow: /sites/alteryx/ Disallow: /sites/amazon-ads/ Disallow: /sites/amazon-black-business-accelerator/ Disallow: /sites/amazon-web-services-asean/ Disallow: /sites/amazonwebservices/ Disallow: /sites/amd/ Disallow: /sites/american-cancer-society/ Disallow: /sites/american-heart-association/ Disallow: /sites/american-heart-associations-leaders-of-impact/ Disallow: /sites/american-tire-distributors/ Disallow: /sites/americanexpress/ Disallow: /sites/amp-energy/ Disallow: /sites/amtd-group/ Disallow: /sites/anabluewing/ Disallow: /sites/anaplan/ Disallow: /sites/ant-international/ Disallow: /sites/aptpay/ Disallow: /sites/arizona-commerce-authority/ Disallow: /sites/arizonacommerce/ Disallow: /sites/arm/ Disallow: /sites/ascm/ Disallow: /sites/astrazeneca/ Disallow: /sites/athenahealth/ Disallow: /sites/athene/ Disallow: /sites/atlassian/ Disallow: /sites/att/ Disallow: /sites/audemars-piguet/ Disallow: /sites/audemarspiguet/ Disallow: /sites/audi/ Disallow: /sites/avanade/ Disallow: /sites/avigilon/ Disallow: /sites/aviram-family-foundation/ Disallow: /sites/aws-and-pega/ Disallow: /sites/aws-business-transformation/ Disallow: /sites/aws-enterprise-transformation/ Disallow: /sites/aws-transformation/ Disallow: /sites/awscloudmigration/ Disallow: /sites/awsinfrastructuresolutions/ Disallow: /sites/awsmediaandentertainment/ Disallow: /sites/awsstartups/ Disallow: /sites/bacardi/ Disallow: /sites/bankofsingapore/ Disallow: /sites/baume_mercier/ Disallow: /sites/bayer/ Disallow: /sites/bbtsuntrustnowtruist/ Disallow: /sites/bcbsassociation/ Disallow: /sites/bcg/ Disallow: /sites/benbridgejeweler/ Disallow: /sites/beximco-group/ Disallow: /sites/blackstarcapitalltd/ Disallow: /sites/block-advisors/ Disallow: /sites/bloodcancerunited/ Disallow: /sites/bluejeans-by-verizon/ Disallow: /sites/bluetti-power-inc/ Disallow: /sites/bmc/ Disallow: /sites/bmoharrisbank/ Disallow: /sites/bnymellonwealthmanagement/ Disallow: /sites/bold-by-veuve-clicquot/ Disallow: /sites/boston-university-questrom-school-of-business/ Disallow: /sites/bowlero/ Disallow: /sites/braintree/ Disallow: /sites/brandstorytelling/ Disallow: /sites/braze/ Disallow: /sites/bristol-myers-squibb/ Disallow: /sites/bt/ Disallow: /sites/bushmills/ Disallow: /sites/businessaviation/ Disallow: /sites/businessreporter/ Disallow: /sites/cadence/ Disallow: /sites/calm/ Disallow: /sites/cambium-learning-group/ Disallow: /sites/canon-inc/ Disallow: /sites/canon/ Disallow: /sites/canva/ Disallow: /sites/capgemini/ Disallow: /sites/capital-group-american-funds/ Disallow: /sites/capitalone/ Disallow: /sites/capitalonefutureedge/ Disallow: /sites/capitalonespark/ Disallow: /sites/carecredit/ Disallow: /sites/cargill/ Disallow: /sites/cartier/ Disallow: /sites/castlight/ Disallow: /sites/cathay-pacific/ Disallow: /sites/cbre/ Disallow: /sites/cdw/ Disallow: /sites/celebritycruises/ Disallow: /sites/celonis/ Disallow: /sites/centurylink/ Disallow: /sites/cerity-partners/ Disallow: /sites/cftc/ Disallow: /sites/chainalysis/ Disallow: /sites/charlesschwabadvisor/ Disallow: /sites/chase-ink-business-credit-cards/ Disallow: /sites/chase-ink/ Disallow: /sites/chase-sapphire/ Disallow: /sites/chasehomelending/ Disallow: /sites/checkmarx/ Disallow: /sites/chicagobooth/ Disallow: /sites/cigna/ Disallow: /sites/cirocvs/ Disallow: /sites/cisco-webex/ Disallow: /sites/cisco/ Disallow: /sites/ciscoappdynamics/ Disallow: /sites/cit/ Disallow: /sites/citi/ Disallow: /sites/citizensaccess/ Disallow: /sites/citrix/ Disallow: /sites/city-of-hope/ Disallow: /sites/civicnation/ Disallow: /sites/cle-de-peau-beaute/ Disallow: /sites/cloudera/ Disallow: /sites/cloudflare/ Disallow: /sites/cme-group/ Disallow: /sites/coalition-for-faith-and-media/ Disallow: /sites/coconut-software/ Disallow: /sites/cognizant/ Disallow: /sites/coldwellbanker/ Disallow: /sites/colehaan/ Disallow: /sites/colorado/ Disallow: /sites/comarch/ Disallow: /sites/comcastbusiness/ Disallow: /sites/commure/ Disallow: /sites/commvault/ Disallow: /sites/company-of-good/ Disallow: /sites/concertocloud/ Disallow: /sites/connection/ Disallow: /sites/connectly/ Disallow: /sites/constantcontact/ Disallow: /sites/cornelljohnson/ Disallow: /sites/courtyard/ Disallow: /sites/coxbusiness/ Disallow: /sites/crowe/ Disallow: /sites/ctia-wireless-foundation/ Disallow: /sites/dassaultsystemes/ Disallow: /sites/dataiku/ Disallow: /sites/dbs-wealth-management/ Disallow: /sites/dbsbank/ Disallow: /sites/dbsprivatebank/ Disallow: /sites/deep-instinct/ Disallow: /sites/dell-technologies/ Disallow: /sites/dell/ Disallow: /sites/delltechnologies/ Disallow: /sites/deloitte-microsoft-technology-services-practice/ Disallow: /sites/deloitte/ Disallow: /sites/deloitteriskandfinancialadvisory/ Disallow: /sites/delta/ Disallow: /sites/dhl-supply-chain/ Disallow: /sites/diageo-rare--exceptional/ Disallow: /sites/dimopoulos-injury-law/ Disallow: /sites/diners-club-international/ Disallow: /sites/discoverpersonalloans/ Disallow: /sites/disneyinstitute/ Disallow: /sites/dockers/ Disallow: /sites/doctors-without-borders/ Disallow: /sites/docusign/ Disallow: /sites/dollar-general/ Disallow: /sites/dominican-republic-ministry-of-tourism/ Disallow: /sites/domperignon/ Disallow: /sites/dpworld/ Disallow: /sites/drexeluniversity/ Disallow: /sites/dubai-tourism/ Disallow: /sites/dxc-technology/ Disallow: /sites/ebay/ Disallow: /sites/ecolab/ Disallow: /sites/ehealth/ Disallow: /sites/eidoo/ Disallow: /sites/elevance-health/ Disallow: /sites/emc/ Disallow: /sites/emirates/ Disallow: /sites/empower/ Disallow: /sites/energy-asia/ Disallow: /sites/epos/ Disallow: /sites/epson/ Disallow: /sites/epsoncorporate/ Disallow: /sites/eset/ Disallow: /sites/etrade/ Disallow: /sites/everbridge/ Disallow: /sites/exl/ Disallow: /sites/exness/ Disallow: /sites/extrahop/ Disallow: /sites/ey-global-government--infrastructure/ Disallow: /sites/ey/ Disallow: /sites/eycybersecurity/ Disallow: /sites/f45training/ Disallow: /sites/f5/ Disallow: /sites/facebook/ Disallow: /sites/familyofficehk/ Disallow: /sites/fannie-mae/ Disallow: /sites/fedex-express/ Disallow: /sites/fedex/ Disallow: /sites/ferrari-roma/ Disallow: /sites/fidelity/ Disallow: /sites/first-horizon-bank/ Disallow: /sites/first-tee/ Disallow: /sites/firstrepublicbank/ Disallow: /sites/fis-global/ Disallow: /sites/flexport/ Disallow: /sites/forbeseq/
Changes recorded since June 2026.
No change recorded.