CrawlerPulse
CrawlerPulse / Europe / United Kingdom / britishpathe.com

Pathé News

britishpathe.com · United Kingdom · measured 9 Oct 2026

Google Search
Allowed
Google-Extended
Blocked
OpenAI
Blocked
Anthropic
Blocked
Perplexity
Allowed
Meta
Blocked
Common Crawl
Blocked
ByteDance
Blocked
Apple
Blocked
Amazon
Blocked

robots.txt

As read on 9 Oct 2026, 15,792 bytes. 15 rule groups name AI crawlers; shown first.

User-agent: Amazonbot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: omgili
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: Claude-Web
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: Google-CloudVertexBot
Disallow: /

User-agent: *
Content-Signal: search=yes,ai-train=no,use=reference
Allow: /

User-agent: MistralAI-Training
Disallow: /

User-agent: GoogleOther
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: AwarioSmartBot
User-agent: AwarioRssBot
Disallow: /

User-agent: QualifiedBot
Disallow: /

User-agent: Cotoyogi
Disallow: /

User-agent: ICC-Crawler
Disallow: /

User-agent: atlassian-bot
Disallow: /

User-agent: FishBot
Disallow: /

User-agent: BorderxBot
Disallow: /

User-agent: NavuBot
Disallow: /

User-agent: SemrushBot-SWA
Disallow: /

User-agent: WARDBot
Disallow: /

User-agent: magpie-crawler
Disallow: /

User-agent: KimiBot
Disallow: /

User-agent: CitibotSiteCrawler
Disallow: /
<script id="licenseValueItem" type="text/x-jsrender">
	{{if selectable == 1}}
	<div class="licenseOptionValues licenseDetails{{:ecom_license_id}} hide licenseDetails">
		<div class="licenseDetailsInner">
			<form class="form licenseValuesForm licenceValuesFor{{:ecom_license_id}}" novalidate>
				{{if download_sizes}}
					<div class="select margin-y-sm">
					    <div class="hide">
                            <label for="downloadSizesfor{{:ecom_license_id}}" class="hide">Download sizes</label>
                            <select class="select__input btn btn--subtle btn--subtle--primary" style="width: 100%;" id="downloadSizesfor{{:ecom_license_id}}">
                                <option value="default" disabled="disabled" selected="selected">Download sizes</option>
                                {{props download_sizes}}
                                    <option value="{{>prop.download_size_id}}">{{>prop.name}}</option>
                                {{/props}}
                            </select>
						    <svg class="icon select__icon" aria-hidden="true" viewBox="0 0 16 16"><polyline points="1 5 8 12 15 5" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/></svg>
					    </div>
					</div>
				{{/if}}
				{{props fields itemVar="~outerProp" ~parent=ecom_license_id}}
					{{if prop.field_type == 'input'}}
						<div class="formGroupItem">
							<label for="{{>prop.field_name}}" class="hide">{{>key}}</label>
							<input type="text" pattern="{{>prop.field_regex}}" name="{{>prop.field_name}}" class="textbox licenseFormValue {{if prop.required == 1}}isRequired{{/if}}" placeholder="{{>prop.field_label}}" data-option="{{>prop.ecom_license_option_id}}" />
							{{if prop.required == 1}}
								<span class="required">*</span>
							{{/if}}
							<div class="response"></div>
						</div>
					{{else prop.field_type == 'number'}}
						<div class="formGroupItem">
							<label for="{{>prop.field_name}}" class="hide">{{>key}}</label>
							<input type="number" pattern="{{>prop.field_regex}}" name="{{>prop.field_name}}" class="textbox licenseFormValue {{if prop.required == 1}}isRequired{{/if}}" placeholder="{{>prop.field_label}}" data-option="{{>prop.ecom_license_option_id}}" />
							{{if prop.required == 1}}
								<span class="required">*</span>
							{{/if}}
							<div class="response"></div>
						</div>
					{{else prop.field_type == 'select'}}
						<div class="formGroupItem">
							<select class="select {{if prop.required == 1}}isRequired{{/if}} licenseFormValue" data-option="{{>prop.ecom_license_option_id}}">
								<option value="default" disabled="disabled" selected="selected">{{>prop.field_label}}</option>
								{{props prop.options}}
									<option value="{{>prop.id}}">{{>prop.name}}</option>
								{{/props}}
							</select>
							{{if prop.required == 1}}
								<span class="required">*</span>
							{{/if}}
							<div class="response"></div>
						</div>
					{{else prop.field_type == 'multiselect'}}
						<div class="formGroupItem">
							<p class="fieldLabel">{{:prop.field_label}}</p>
							<select class="select {{if prop.required == 1}}isRequired{{/if}} licenseFormValue" data-option="{{>prop.ecom_license_option_id}}" multiple>
								{{props prop.options}}
									<option value="{{>prop.id}}">{{>prop.name}}</option>
								{{/props}}
							</select>
							{{if prop.required == 1}}
								<span class="required">*</span>
							{{/if}}
							<div class="response"></div>
						</div>
					{{else prop.field_type == 'date'}}
						<div class="formGroupItem">
							<label for="{{>prop.field_name}}">{{>prop.field_name}}</label>
							<input type="date" name="{{>prop.field_name}}" class="textbox date licenseFormValue {{if prop.required == 1}}isRequired{{/if}}" placeholder="{{>prop.field_label}}" data-option="{{>prop.ecom_license_option_id}}" />
							{{if prop.required == 1}}
								<span class="required">*</span>
							{{/if}}
							<div class="response"></div>
						</div>
					{{else prop.field_type == 'textarea'}}
						<div class="formGroupItem">
							<label for="{{>prop.field_name}}">{{>prop.field_name}}</label>
							<textarea name="{{>prop.field_name}}" class="textarea date licenseFormValue {{if prop.required == 1}}isRequired{{/if}}" placeholder="{{>prop.field_label}}" data-option="{{>prop.ecom_license_option_id}}"></textarea>
							{{if prop.required == 1}}
								<span class="required">*</span>
							{{/if}}
							<div class="response"></div>
						</div>
					{{else prop.field_type == 'checkbox'}}
						<div class="formGroup clearfix groupedOptions">
							<p class="fieldLabel">{{:prop.field_label}}</p>
							{{props prop.options }}
								<div class="formGroupItem">
									<input type="checkbox" class="checkbox {{if ~outerProp.prop.required == 1}}isRequired{{/if}} licenseFormValue" data-id="{{>prop.id}}" id="option-{{:~parent+1}}{{:#index+1}}-{{>prop.id}}"  name="{{:~outerProp.prop.field_name}}" value="{{>prop.id}}" data-option="{{:~outerProp.prop.ecom_license_option_id}}" />
									<label for="option-{{:~parent+1}}{{:#index+1}}-{{>prop.id}}">
										<span class="checkboxText">{{>prop.name}}</span>
									</label>
								</div>
							{{/props}}
							{{if prop.required == 1}}
								<span class="required">*</span>
							{{/if}}
						</div>
					{{else prop.field_type == 'radio'}}
						{{if prop.field_regex == '/(d+)-(d+)/gi'}}
							<div class="text-component margin-bottom-sm hide">
								<p>{{:prop.field_label}}</p>
							</div>
							<fieldset class="margin-bottom-md groupedOptions">
								<ul class="text-sm@md gap-x-md gap-y-sm" style="">
									{{props prop.options}}
										<li class="formGroupItem regexCheck" data-name="{{>prop.name}}" data-value="{{>prop.id}}" data-option="{{:~outerProp.prop.ecom_license_option_id}}">
											<input type="radio" class="radio {{if ~outerProp.prop.required == 1}}isRequired{{/if}} licenseFormValue" id="option-{{:~parent+1}}{{:#index+1}}-{{>prop.id}}" name="{{:~outerProp.prop.field_name}}" value="{{>prop.id}}" data-option="{{:~outerProp.prop.ecom_license_option_id}}" {{if regexCheckDuration:name}} {{/if}} />
											<label for="option-{{:~parent+1}}{{:#index+1}}-{{>prop.id}}" class="labelPad">{{>prop.name}}</label>
										</li>
									{{/props}}
								</ul>
							</fieldset>
						{{else}}
							<div class="text-component margin-bottom-sm hide">
								<p>{{:prop.field_label}}</p>
							</div>
							<fieldset class="margin-bottom-md groupedOptions">
								<ul class="text-sm@md gap-x-md gap-y-sm" style="">
									{{props prop.options}}
										<li class="formGroupItem">
											<input type="radio" class="radio {{if ~outerProp.prop.required == 1}}isRequired{{/if}} licenseFormValue" id="option-{{:~parent+1}}{{:#index+1}}-{{>prop.id}}" name="{{:~outerProp.prop.field_name}}" value="{{>prop.id}}" data-option="{{:~outerProp.prop.ecom_license_option_id}}" />
											<label for="option-{{:~parent+1}}{{:#index+1}}-{{>prop.id}}" class="labelPad">{{>prop.name}}</label>
										</li>
									{{/props}}
								</ul>
							</fieldset>
						{{/if}}
					{{/if}}
				{{/props}}
			</form>
		</div>
	</div>
	{{/if}}
	{{for children tmpl="#licenseValueItem"}}
	{{/for}}
</script>
<script id="licenseTermsBlock" type="text/x-jsrender">
	<div class="licenseTermsWrapper hide" id="licenseTermsFor{{:ecom_license_id}}">
		<div class="licenseTermsInner">
			<p class="text-sm text-space-y-xxs white-space-pre-line"><span class="font-bold">License terms</span>: {{:description}}</p>
		</div>
	</div>
	{{for children tmpl="#licenseTermsBlock"}}
	{{/for}}
</script>
<script id="licenseOptionsSingle" type="text/x-jsrender">
	<div class="addLicenseOptions">
		<div class="addLicenseOptionsInner">
			<input type="hidden" id="selectedLicense" readonly="readonly" />
			<input type="hidden" id="selectedAsset" readonly="readonly" value="{{:meta.id}}" />
			<div class="margin-bottom-sm text-component text-space-y-sm">
            <h3 class="font-primary text-space-y-lg" id="modal-form-title">License Film</h3>
            <p class="text-sm text-space-y-xxs"><span class="font-bold">Title</span>: {{:meta.name}}</p>
            <p class="text-sm text-space-y-xxs" id="durationVal" data-duration="{{:meta.duration}}"><span class="font-bold">Duration</span>: {{:meta.duration}}</p>
            <p class="text-sm"><span class="font-bold">Archive</span>: {{:meta.archive}}</p>
            <p id="modal-form-description" class="text-sm">Please select the rights you require:</p>
            {{if meta.multiple && meta.multiple > 0}}
	            <p class="text-sm"><span class="font-bold">your selection includes</span>: {{:meta.multiple}} more Films</p>
            {{/if}}
         </div>
			<div class="licenseOptionsWrapper">
				<div class="licenseOptionsInner">
					<div class="optionSelection">
					</div>
					<div class="optionValues">
					</div>
				</div>
			</div>
			<div class="flex flex-row justify-between items-center padding-top-xs" style="border-top: 1px solid var(--color-contrast-low);">
               <div id="modal-price-message">
                  <span id="totalPrice" class="text-md font-bold">
                  	Price: <span class="priceValue"></span>
            			{{if meta.multiple && meta.multiple > 0}}
                  		<span class="padding-left-xxxs text-xs">per asset</span>
            			{{/if}}
                  </span>
               </div>
               <div id="modal-add-to-cart">
                  <button class="btn btn--primary btn--sm height-40 letter-spacing-md applyLicenseToSingle" disabled="disabled">Apply</button>
				  <a href="#" class="btn btn--primary btn--sm height-40 letter-spacing-md licenseContactUs hide">Contact us</a>
				</div>
            </div>
		</div>
	</div>
</script>
<script id="licenseOptionItem" type="text/x-jsrender">
	<div class="select margin-y-sm">
		<select class="select__input btn btn--subtle btn--subtle--primary selectLicenseParent" style="width: 100%;">
			<option value="default">Please Select</option>
			{{for data}}
				<option value="{{:ecom_license_id}}" data-selectable="{{:selectable}}">{{:name}}</option>
			{{/for}}
		</select>
		<svg class="icon select__icon" aria-hidden="true" viewBox="0 0 16 16"><polyline points="1 5 8 12 15 5" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/></svg>
	</div>
	{{for data}}
		{{if children}}
			{{include children ~parent_id=ecom_license_id ~i=0 tmpl="#childrenSelectTemplate"/}}
		{{/if}}
	{{/for}}
</script>
<script id="childrenSelectTemplate" type="text/x-jsrender">
	<div class="select margin-bottom-xs hide selectLicenseChildWrapper" data-id="{{:~parent_id}}" data-level="{{:~i}}">
		<select class="select__input btn btn--subtle btn--subtle--primary selectLicenseChild" style="width: 100%;">
			<option value="default">Please Select</option>
			{{props}}
				<option value="{{:prop.ecom_license_id}}" data-selectable="{{:prop.selectable}}">{{:prop.name}}</option>
			{{/props}}
		</select>
		<svg class="icon select__icon" aria-hidden="true" viewBox="0 0 16 16"><polyline points="1 5 8 12 15 5" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/></svg>
	</div>
	{{props}}
		{{if prop.children}}
			{{include prop.children ~parent_id=prop.ecom_license_id ~i=~i+1 tmpl="#childrenSelectTemplate"/}}
		{{/if}}
	{{/props}}
</script>
<script id="navBasketBox" type="text/x-jsrender">
	<div class="basketPanelNav navSideItem">
		<div class="contentBlock">
			<div class="sidebarItem basketSidebarItem">
				<div class="basketList clearfix">
					<div class="basketListInner">
						<div class="sidebarSubTitle">
							<h3>Default Basket</h3>
						</div>
						<div class="currentBasket">
						</div>
						<div class="addNewBasket">
							<a href="#" class="primary-button" id="addNewBasket">Add new</a>
						</div>
						<p class="hide loginForMoreMessageBasket">Please <a href="https://www.britishpathe.com/login/" class="textLink02">sign in</a>/<a href="https://www.britishpathe.com/register/" class="textLink02">register</a> to add a cart</p>
						<div class="sidebarSubTitle saved">
							<h3>Saved Baskets</h3>
						</div>
						<div class="savedBaskets">
						</div>
					</div>
				</div>
			</div>
		</div>
	</div>
</script>
<script id="basketSidebar" type="text/x-jsrender">
	<div class="basketPanelSidebar">
		<div class="contentBlock">
			<div class="sidebarItem basketSidebarItem">
				<div class="basketList clearfix">
					<div class="basketListInner">
						<div class="sidebarSubTitle">
							<h3>Default Basket</h3>
						</div>
						<div class="currentBasket">
						</div>
						<div class="addNewBasket">
							<a href="#" class="primary-button" id="addNewBasket">Add new</a>
						</div>
						<div class="sidebarSubTitle">
							<h3>Saved Baskets</h3>
						</div>
						<div class="savedBaskets">
						</div>
					</div>
				</div>
			</div>
		</div>
	</div>
</script>

History

Changes recorded since June 2026.

No change recorded.

In context

United Kingdom
73.8% block at least one AI crawler
Behind Cloudflare
Yes