Directory / SEO tools

Brightbot

Verifiable

Bright Data's data-collection crawler, documented as the main collection pipeline for its products, with a 24-hour cache layer to avoid re-downloading the same page. The operator states Brightbot is deliberately transparent — a unique user agent plus a single published source subnet — so its traffic can be separated from user traffic. Its documented control mechanism is Bright Data's own collectors.txt file and Web Master console; the page states no robots.txt behaviour.

Operated by Bright Data · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexBrightbot \d
  • observedBrightbot 1.0

How to verify

Documented static ranges: 82.97.199.0/24

IP ranges (1)

Refreshed daily from the operator's feed. Also available as /data/ips/brightbot.ips and /data/bots/brightbot.json.

82.97.199.0/24

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Does not honor robots.txt

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.