Botify

Verifiable

Botify's SEO crawler, used by its SiteCrawler product to analyze enterprise websites for search-indexing insights. Botify publishes the addresses its crawls originate from and recommends site owners allow the full list, which it documents as shared by SiteCrawler, AlertPanel and SpeedWorkers. The crawler's user agent is configurable per crawl, so identity rests on the published ranges rather than the agent string alone.

Operated by Botify · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexcompatible; botify
observedMozilla/5.0 (compatible; botify; http://botify.com)

How to verify

Documented static ranges: 31.41.37.0/24, 44.206.2.192/26, 15.235.106.96/27, 52.6.26.195/32, 52.203.178.227/32, 52.0.46.73/32, 52.204.9.239/32, 52.204.10.127/32, 52.204.10.46/32

IP ranges (9)

Refreshed daily from the operator's feed. Also available as /data/ips/botify.ips and /data/bots/botify.json.

15.235.106.96/27
31.41.37.0/24
44.206.2.192/26
52.0.46.73/32
52.203.178.227/32
52.204.10.127/32
52.204.10.46/32
52.204.9.239/32
52.6.26.195/32

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Verifiable
Respects robots.txt
Honors robots.txt (token: Botify)
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.