Directory / Search engines

IONOS Crawler

Verifiable

IONOS Crawler (IonCrawl) continuously crawls publicly accessible domains to generate insights into how they are used, which IONOS uses to improve and expand its hosting products. IONOS documents reverse-DNS verification and deletes crawled data after 60 days.

Operated by IONOS · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexIonCrawl
  • observedIonCrawl (https://www.ionos.de/terms-gtc/faq-crawler-en/)

How to verify

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.1and1.org

Reverse-DNS suffixes: *.1and1.org

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt (token: IonCrawl)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.