Verified Bots Directory

Directory / SEO tools

DataForSeoBot

Verifiable

DataForSEO's crawler. It fetches pages to build the backlink and SEO datasets that power DataForSEO's marketing-data APIs, and honours robots.txt and crawl-delay directives.

Operated by DataForSEO · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexDataForSeoBot
  • observedMozilla/5.0 (compatible; DataForSeoBot; +https://dataforseo.com/dataforseo-bot)

How to verify

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.dataforseo.com

Reverse-DNS suffixes: *.dataforseo.com

Documented static ranges: 136.243.220.208/29, 136.243.228.176/29, 136.243.228.192/29, 2a01:4f8:2b03:38b::/64, 2a01:4f8:2b03:38c::/64, 2a01:4f8:2b03:38d::/64

IP ranges (6)

Refreshed daily from the operator's feed. Also available as /data/ips/dataforseo.ips and /data/bots/dataforseo.json.

136.243.220.208/29
136.243.228.176/29
136.243.228.192/29
2a01:4f8:2b03:38b::/64
2a01:4f8:2b03:38c::/64
2a01:4f8:2b03:38d::/64

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt (token: DataForSeoBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.