Directory / SEO tools

SemrushBot

Listed only

Semrush's web crawler, feeding the backlink and site-audit data behind the Semrush SEO platform. Semrush's own bot page explicitly states it does not use consecutive IP blocks, so no CIDR list can be sourced.

Operated by Semrush · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexSemrushBot/\d
  • observedMozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)

How to verify

No verification recipe published by the operator.

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Operator publishes no verification path

  • Respects robots.txt

    Honors robots.txt (token: SemrushBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.