MojeekBot
Fully verifiableMojeek's web crawler, fetching pages for the independent Mojeek search engine index.
Operated by Mojeek · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexMojeekBot/\d
- observedMozilla/5.0 (compatible; MojeekBot/0.6; +https://www.mojeek.com/bot.html)
- observedMojeekBot/0.2 (archi; http://www.mojeek.com/bot.html)
How to verify
Fetch the official IP range feed
curl -s https://www.mojeek.com/mojeekbot.json IP ranges (1)
Refreshed daily from the operator's feed. Also available as /data/ips/mojeekbot.ips and /data/bots/mojeekbot.json.
5.102.173.64/28
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Fully verifiable
- Respects robots.txt
Honors robots.txt (token: MojeekBot)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.