Verified Bots Directory

Directory / AI crawlers

Claude-SearchBot

Fully verifiable

Anthropic's crawler that indexes pages to improve search-style answer quality in Claude products, distinct from ClaudeBot's training-data crawl.

Operated by Anthropic · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexClaude-SearchBot/\d
  • observedMozilla/5.0 (compatible; Claude-SearchBot/1.0; [email protected])

How to verify

Fetch the official IP range feed

curl -s https://claude.com/crawling/bots.json

IP ranges (26)

Refreshed daily from the operator's feed. Also available as /data/ips/claude-searchbot.ips and /data/bots/claude-searchbot.json.

136.107.176.208/32
16.58.26.69/32
18.225.238.228/32
18.227.226.255/32
20.102.46.224/28
20.64.57.208/28
216.73.216.0/22
34.11.34.31/32
34.150.241.79/32
34.162.191.81/32
34.162.230.222/32
34.162.244.71/32
34.182.140.95/32
34.182.161.143/32
34.182.218.27/32
34.182.220.85/32
34.182.222.37/32
34.182.225.167/32
34.182.226.151/32
34.182.226.221/32
34.186.108.163/32
34.85.172.162/32
35.221.29.174/32
35.245.175.129/32
35.245.89.239/32
40.124.101.48/28

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: Claude-SearchBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.