SemrushBot-ESI

Listed only

The crawler for Semrush Enterprise Site Intelligence, which analyses a customer's site for on-page SEO, technical and usability issues. Semrush documents it as its own robots.txt user agent, separate from the SiteAuditBot used by the standard Site Audit tool, and publishes no IP ranges for it.

Operated by Semrush · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexSemrushBot-ESI
observedSemrushBot-ESI

How to verify

No verification recipe published by the operator.

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Operator publishes no verification path
Respects robots.txt
Honors robots.txt (token: SemrushBot-ESI)
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.