YandexBot
VerifiableYandex's primary web crawler, fetching pages for Yandex Search indexing.
Operated by Yandex · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexYandexBot/\d
- observedMozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
- observedMozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; +http://yandex.com/bots)
How to verify
Reverse-DNS check a client IP
dig -x <client-ip> +short # expect a hostname matching *.yandex.ru Reverse-DNS suffixes: *.yandex.ru, *.yandex.net, *.yandex.com
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Honors robots.txt (token: YandexBot)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.