Audisto Crawler

Fully verifiable

Crawler for Audisto's hosted technical SEO and site-audit platform, fetching pages of the sites its customers analyse. Audisto publishes its crawler addresses as JSON and documents reverse-DNS verification.

Operated by Audisto GmbH · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexAudisto Crawler
observedAudisto Crawler (mobile; +https://audisto.com/bot)
observedAudisto Crawler (desktop; +https://audisto.com/bot)
observedAudisto Crawler (desktop; essential; +https://audisto.com/bot)

How to verify

Fetch the official IP range feed

curl -s https://audisto.com/ips.json

Fetch the official IP range feed

curl -s https://audisto.com/ips.json

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.crawler.audisto.com

Reverse-DNS suffixes: *.crawler.audisto.com

IP ranges (30)

Refreshed daily from the operator's feed. Also available as /data/ips/audisto.ips and /data/bots/audisto.json.

116.202.161.186/32
138.201.254.123/32
142.132.180.252/32
148.251.68.22/32
162.55.235.248/32
167.235.32.214/32
168.119.181.43/32
168.119.245.51/32
168.119.53.206/32
176.9.73.44/32
195.201.226.139/32
195.201.226.141/32
195.201.23.108/32
195.201.233.95/32
195.201.25.108/32
195.201.25.74/32
2a01:4f8:1c1e:8943::1/128
2a01:4f8:1c1e:8944::1/128
2a01:4f8:1c1e:91fd::1/128
2a01:4f8:1c1e:9227::1/128
2a01:4f8:1c1e:9228::1/128
2a01:4f8:c010:be17::1/128
2a01:4f8:c010:be18::1/128
2a01:4f8:c010:be19::1/128
2a01:4f8:c010:be34::1/128
2a01:4f8:c010:be35::1/128
46.4.40.37/32
46.4.65.48/32
5.9.120.199/32
5.9.152.57/32

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Fully verifiable
Respects robots.txt
Honors robots.txt (token: audisto)
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.