Directory / Search engines

YandexBot

Verifiable

Yandex's primary web crawler, fetching pages for Yandex Search indexing.

Operated by Yandex · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexYandexBot/\d
  • observedMozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
  • observedMozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; +http://yandex.com/bots)

How to verify

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.yandex.ru

Reverse-DNS suffixes: *.yandex.ru, *.yandex.net, *.yandex.com

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt (token: YandexBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.