peer39_crawler
Listed onlyContextual-intelligence crawler operated by Peer39, an advertising data company. It visits publisher pages to categorise their content so that advertisers buying through programmatic platforms can judge the context and suitability of the pages their ads appear on. Peer39's crawler notice states that it drops no cookies and does not track or append browsing behaviour to individual users, and that the crawler reads robots.txt so administrators can allow or disallow it.
Operated by Peer39 · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexpeer39_crawler
- observedpeer39_crawler/1.0
How to verify
No verification recipe published by the operator.
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Operator publishes no verification path
- Respects robots.txt
Honors robots.txt (token: peer39_crawler)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.