Scope3 Crawler
VerifiableScope3's crawler, which indexes publicly available web content (and paywalled media where the publisher has granted access) to produce content classification and brand-safety assessments for advertising. Scope3 documents adaptive rate limiting of five pages per minute per domain and publishes the single address it crawls from.
Operated by Scope3 · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexScope3/\d
- observedMozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 Scope3/2.0 (scope3.com)
How to verify
Documented static ranges: 34.70.81.55/32
IP ranges (1)
Refreshed daily from the operator's feed. Also available as /data/ips/scope3-crawler.ips and /data/bots/scope3-crawler.json.
34.70.81.55/32
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Honors robots.txt
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.