Outbrain crawler
VerifiableOutbrain's content-recommendation crawler. It fetches advertiser landing pages so Outbrain's system can pull the correct image and headline for a promoted-content unit, and rejects submitted URLs it cannot reach.
Operated by Outbrain · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexMozilla/5\.0 \(Java\) outbrain
- observedMozilla/5.0 (Java) outbrain
How to verify
Documented static ranges: 192.82.211.0/24, 64.202.112.0/24, 70.42.32.0/24, 66.150.103.0/24, 192.82.210.0/24, 50.31.142.0/24, 64.74.236.0/24, 167.88.57.0/24, 165.254.24.192/27, 66.225.223.0/24, 38.104.143.176/28, 38.133.127.0/24
IP ranges (12)
Refreshed daily from the operator's feed. Also available as /data/ips/outbrain.ips and /data/bots/outbrain.json.
165.254.24.192/27 167.88.57.0/24 192.82.210.0/24 192.82.211.0/24 38.104.143.176/28 38.133.127.0/24 50.31.142.0/24 64.202.112.0/24 64.74.236.0/24 66.150.103.0/24 66.225.223.0/24 70.42.32.0/24
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Does not honor robots.txt
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.