Audisto Crawler

Fully verifiable

The crawler behind Audisto, a German SaaS platform for technical website analysis and continuous website monitoring. It fetches the accessible URLs of a site so the product can report crawling and indexation errors, hreflang and canonical problems, and internal link-graph issues. The operator runs two crawlers: an Essential crawler that may crawl any site, and a Full crawler that only crawls sites whose ownership has been verified. The bot reference documents automated overload protection — after 10 error responses within a hundred requests the crawler lengthens its delay and reduces parallelism, and relaxes again once the error rate drops below 5 percent — plus a 30-second total request budget and per-content-type response size caps.

Operated by Audisto GmbH · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexAudisto Crawler
observedAudisto Crawler (mobile; +https://audisto.com/bot)
observedAudisto Crawler (desktop; +https://audisto.com/bot)
observedAudisto Crawler (mobile; essential; +https://audisto.com/bot)
observedAudisto Crawler (desktop; essential; +https://audisto.com/bot)

How to verify

Fetch the official IP range feed

curl -s https://audisto.com/ips.json

Fetch the official IP range feed

curl -s https://audisto.com/ips.json

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.crawler.audisto.com

Reverse-DNS suffixes: *.crawler.audisto.com

IP ranges (30)

Refreshed daily from the operator's feed. Also available as /data/ips/audisto.ips and /data/bots/audisto.json.

116.202.161.186/32
138.201.254.123/32
142.132.180.252/32
148.251.68.22/32
162.55.235.248/32
167.235.32.214/32
168.119.181.43/32
168.119.245.51/32
168.119.53.206/32
176.9.73.44/32
195.201.226.139/32
195.201.226.141/32
195.201.23.108/32
195.201.233.95/32
195.201.25.108/32
195.201.25.74/32
2a01:4f8:1c1e:8943::1/128
2a01:4f8:1c1e:8944::1/128
2a01:4f8:1c1e:91fd::1/128
2a01:4f8:1c1e:9227::1/128
2a01:4f8:1c1e:9228::1/128
2a01:4f8:c010:be17::1/128
2a01:4f8:c010:be18::1/128
2a01:4f8:c010:be19::1/128
2a01:4f8:c010:be34::1/128
2a01:4f8:c010:be35::1/128
46.4.40.37/32
46.4.65.48/32
5.9.120.199/32
5.9.152.57/32

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Fully verifiable
Respects robots.txt
Honors robots.txt (token: audisto)
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.