Directory / SEO tools

YaDirectFetcher

Verifiable

The fetcher for Yandex Direct advertising, which downloads the target pages of ads to check their availability and topic before the ads are placed in search results and on partner sites. Yandex states plainly that this robot does not use the robots.txt file and ignores the directives set for it.

Operated by Yandex · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexYaDirectFetcher/\d
  • observedMozilla/5.0 (compatible; YaDirectFetcher/1.0; Dyatel; +http://yandex.com/bots)

How to verify

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.yandex.ru

Reverse-DNS suffixes: *.yandex.ru, *.yandex.net, *.yandex.com

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Does not honor robots.txt

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.