Verified Bots Directory

Directory / SEO tools

DomCopBot

Verifiable

The crawler behind DomCop's domain-research service. DomCop members ask it to crawl websites of their choice; it reads those pages, follows links to the depth the member chose and checks the domain behind every outgoing link to find expired domains, recording only the domain names of links that lead nowhere. It also reads a domain's robots.txt once per domain to establish whether a site is still live there. The operator documents robots.txt and Crawl-delay support, a minimum three seconds between requests to the same host, HTML-only fetches capped at 2 MB, and the single address the crawler requests from.

Operated by DomCop · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexDomCopBot
  • observedDomCopBot (https://www.domcop.com/bot)

How to verify

Documented static ranges: 45.79.173.72/32

IP ranges (1)

Refreshed daily from the operator's feed. Also available as /data/ips/domcopbot.ips and /data/bots/domcopbot.json.

45.79.173.72/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt (token: DomCopBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.