YaDirectFetcher
VerifiableThe fetcher for Yandex Direct advertising, which downloads the target pages of ads to check their availability and topic before the ads are placed in search results and on partner sites. Yandex states plainly that this robot does not use the robots.txt file and ignores the directives set for it.
Operated by Yandex · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexYaDirectFetcher/\d
- observedMozilla/5.0 (compatible; YaDirectFetcher/1.0; Dyatel; +http://yandex.com/bots)
How to verify
Reverse-DNS check a client IP
dig -x <client-ip> +short # expect a hostname matching *.yandex.ru Reverse-DNS suffixes: *.yandex.ru, *.yandex.net, *.yandex.com
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Does not honor robots.txt
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.