OnCrawl
VerifiableOnCrawl's SEO crawler, used to analyze a customer's own site structure and content for technical SEO reporting. OnCrawl publishes the fixed set of static addresses its crawler uses — three in the EU (Belgium), which crawls use by default, and three in the US available on request — and tells customers to allow them. The bot's name is configurable per crawl, so the user agent alone does not establish identity.
Operated by OnCrawl · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexOncrawl/\d
- observedMozilla/5.0 (compatible; Oncrawl/1.0; +http://www.oncrawl.com/)
How to verify
Documented static ranges: 35.187.15.33/32, 35.187.69.66/32, 104.199.98.197/32, 35.199.9.128/32, 35.230.188.244/32, 35.245.139.31/32
IP ranges (6)
Refreshed daily from the operator's feed. Also available as /data/ips/oncrawl.ips and /data/bots/oncrawl.json.
104.199.98.197/32 35.187.15.33/32 35.187.69.66/32 35.199.9.128/32 35.230.188.244/32 35.245.139.31/32
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Honors robots.txt (token: Oncrawl)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.