SemrushBot-SI
VerifiableThe crawler behind Semrush's On Page SEO Checker and related on-page tools, run against a domain when a Semrush customer sets up a campaign for it. It is a separate robots.txt user agent from SemrushBot, and Semrush documents its own addresses to allowlist for it.
Operated by Semrush · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexSemrushBot-SI
- observedMozilla/5.0 (compatible; SemrushBot-SI/0.97; +http://www.semrush.com/bot.html)
How to verify
Documented static ranges: 85.208.98.53, 85.208.98.0/24
IP ranges (2)
Refreshed daily from the operator's feed. Also available as /data/ips/semrushbot-si.ips and /data/bots/semrushbot-si.json.
85.208.98.0/24 85.208.98.53
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Honors robots.txt (token: SemrushBot-SI)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.