IONOS Crawler
VerifiableIONOS Crawler (IonCrawl) continuously crawls publicly accessible domains to generate insights into how they are used, which IONOS uses to improve and expand its hosting products. IONOS documents reverse-DNS verification and deletes crawled data after 60 days.
Operated by IONOS · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexIonCrawl
- observedIonCrawl (https://www.ionos.de/terms-gtc/faq-crawler-en/)
How to verify
Reverse-DNS check a client IP
dig -x <client-ip> +short # expect a hostname matching *.1and1.org Reverse-DNS suffixes: *.1and1.org
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Honors robots.txt (token: IonCrawl)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.