MetaJobBot
VerifiableMetaJobBot is the focused web crawler operated by the METAJob job meta-search engine. It searches websites for job listings to include in the METAJob index.
Operated by METAJob · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexMetaJobBot
- observedMozilla/5.0 (compatible; MetaJobBot; http://www.metajob.de/crawler)
How to verify
Documented static ranges: 157.90.179.220/32, 157.90.179.228/32, 157.90.179.241/32
IP ranges (3)
Refreshed daily from the operator's feed. Also available as /data/ips/metajob-crawler.ips and /data/bots/metajob-crawler.json.
157.90.179.220/32 157.90.179.228/32 157.90.179.241/32
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Honors robots.txt (token: metajobbot)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.