CriteoBot

Verifiable

Criteo's advertising crawler. It fetches merchant and publisher pages to extract product and content data used for Criteo's commerce and retargeting ads, and respects robots.txt and crawl-delay directives.

Operated by Criteo · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexCriteoBot
observedCriteoBot/0.1 (+https://www.criteo.com/criteo-crawler/)

How to verify

Look up the announced ranges by ASN

whois -h whois.radb.net -- '-i origin AS19750' | grep route

Documented static ranges: 74.119.116.0/22, 91.199.242.0/24, 91.212.98.0/24, 116.213.20.0/22, 177.73.128.0/21, 178.250.0.0/21, 182.161.72.0/22, 185.235.84.0/22, 199.204.168.0/22, 2406:2600::/32, 2620:100:a000::/44, 2a02:2638::/32

IP ranges (12)

Refreshed daily from the operator's feed. Also available as /data/ips/criteo.ips and /data/bots/criteo.json.

116.213.20.0/22
177.73.128.0/21
178.250.0.0/21
182.161.72.0/22
185.235.84.0/22
199.204.168.0/22
2406:2600::/32
2620:100:a000::/44
2a02:2638::/32
74.119.116.0/22
91.199.242.0/24
91.212.98.0/24

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Verifiable
Respects robots.txt
Honors robots.txt (token: CriteoBot)
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.