Verified Bots Directory

Directory / AI crawlers

ShapBot

Fully verifiable

Parallel's indexing crawler, which collects publicly available web content to build and maintain the search index behind Parallel's web APIs. The operator documents the robots.txt token ShapBot and publishes the crawler's addresses as a JSON feed.

Operated by Parallel Web Systems · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexShapBot/\d
  • observedMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0

How to verify

Fetch the official IP range feed

curl -s https://docs.parallel.ai/resources/shapbot.json

IP ranges (10)

Refreshed daily from the operator's feed. Also available as /data/ips/shapbot.ips and /data/bots/shapbot.json.

23.251.146.115/32
34.122.173.216/32
34.31.203.120/32
34.44.142.114/32
34.44.196.215/32
34.45.55.180/32
34.46.138.166/32
34.68.39.29/32
34.70.129.79/32
34.9.172.22/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: ShapBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.