ScalePostBot
Listed onlyScalePost's on-demand fetcher. The operator documents that it fetches a publicly available page with a single GET request when a customer asks for an analysis of how that content is being crawled, cited and referenced by AI systems, that it does not execute JavaScript, submit forms or follow links out of the page body, and that it retains only extracted metadata. ScalePost states it fetches robots.txt before any URL on a host and obeys both its own token and the wildcard, honours Crawl-Delay across its parallel workers, and backs off on Retry-After.
Operated by ScalePost Corporation · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexScalePostBot/\d
- observedMozilla/5.0 (compatible; ScalePostBot/1.0; +https://scalepost.ai/bot)
How to verify
No verification recipe published by the operator.
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Operator publishes no verification path
- Respects robots.txt
Honors robots.txt (token: ScalePostBot)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.