Directory / SEO tools

Scope3 Crawler

Verifiable

Scope3's crawler, which indexes publicly available web content (and paywalled media where the publisher has granted access) to produce content classification and brand-safety assessments for advertising. Scope3 documents adaptive rate limiting of five pages per minute per domain and publishes the single address it crawls from.

Operated by Scope3 · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexScope3/\d
  • observedMozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 Scope3/2.0 (scope3.com)

How to verify

Documented static ranges: 34.70.81.55/32

IP ranges (1)

Refreshed daily from the operator's feed. Also available as /data/ips/scope3-crawler.ips and /data/bots/scope3-crawler.json.

34.70.81.55/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.