Directory / AI crawlers

Reflectionbot

Fully verifiable

The web crawler of Reflection AI, which visits publicly available pages to help build and improve the company's open models. Its bot page is unusually complete for an AI crawler: it names the single user-agent token the crawler uses, tells site owners to match on that token rather than the whole string, publishes the crawler's address ranges as a JSON feed, and states that the addresses reverse-resolve under the operator's own domain.

Operated by Reflection AI · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexReflectionbot/\d
  • observedMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Reflectionbot/1.0; +https://reflection.ai/bot) Chrome/151.0.0.0 Safari/537.36

How to verify

Fetch the official IP range feed

curl -s https://reflection.ai/bot/ips.json

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.reflection.ai

Reverse-DNS suffixes: *.reflection.ai

IP ranges (2)

Refreshed daily from the operator's feed. Also available as /data/ips/reflectionbot.ips and /data/bots/reflectionbot.json.

16.216.88.0/23
16.216.94.0/23

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: Reflectionbot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.