Directory / SEO tools

OnCrawl

Verifiable

OnCrawl's SEO crawler, used to analyze a customer's own site structure and content for technical SEO reporting. OnCrawl publishes the fixed set of static addresses its crawler uses — three in the EU (Belgium), which crawls use by default, and three in the US available on request — and tells customers to allow them. The bot's name is configurable per crawl, so the user agent alone does not establish identity.

Operated by OnCrawl · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexOncrawl/\d
  • observedMozilla/5.0 (compatible; Oncrawl/1.0; +http://www.oncrawl.com/)

How to verify

Documented static ranges: 35.187.15.33/32, 35.187.69.66/32, 104.199.98.197/32, 35.199.9.128/32, 35.230.188.244/32, 35.245.139.31/32

IP ranges (6)

Refreshed daily from the operator's feed. Also available as /data/ips/oncrawl.ips and /data/bots/oncrawl.json.

104.199.98.197/32
35.187.15.33/32
35.187.69.66/32
35.199.9.128/32
35.230.188.244/32
35.245.139.31/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt (token: Oncrawl)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.