Directory / Monitoring

Dubbotbot

Verifiable

The crawler behind DubBot's web-governance platform. It inventories a customer's own website by following every link from a supplied URL and checks the pages for accessibility, broken links, spelling and content-policy problems. DubBot runs it from AWS on static IP addresses that the operator publishes for allowlisting.

Operated by DubBot · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexDubbotbot
  • observedMozilla/5.0 (compatible; Dubbotbot/0.2; +http://dubbot.com)

How to verify

Documented static ranges: 34.213.65.175/32, 52.36.131.191/32, 52.39.13.97/32

IP ranges (3)

Refreshed daily from the operator's feed. Also available as /data/ips/dubbot.ips and /data/bots/dubbot.json.

34.213.65.175/32
52.36.131.191/32
52.39.13.97/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Service traffic you configured — robots.txt does not apply

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.