Directory / Search engines

MetaJobBot

Verifiable

MetaJobBot is the focused web crawler operated by the METAJob job meta-search engine. It searches websites for job listings to include in the METAJob index.

Operated by METAJob · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexMetaJobBot
  • observedMozilla/5.0 (compatible; MetaJobBot; http://www.metajob.de/crawler)

How to verify

Documented static ranges: 157.90.179.220/32, 157.90.179.228/32, 157.90.179.241/32

IP ranges (3)

Refreshed daily from the operator's feed. Also available as /data/ips/metajob-crawler.ips and /data/bots/metajob-crawler.json.

157.90.179.220/32
157.90.179.228/32
157.90.179.241/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt (token: metajobbot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.