Directory / AI crawlers

YouBot

Fully verifiable

You.com's crawler that indexes pages for its AI-powered search product. You.com documents a dedicated IP range, a reverse-DNS pattern, and support for signed-request verification via Web Bot Auth.

Operated by You.com · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexYouBot/\d
  • observedMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; YouBot/1.0; +https://docs.you.com/youbot; env:prod) Chrome/W.X.Y.Z Safari/537.36

How to verify

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.search.you.com

Fetch the Web Bot Auth key directory

curl -s https://you.com/.well-known/http-message-signatures-directory

Reverse-DNS suffixes: *.search.you.com

Documented static ranges: 68.67.112.0/24

IP ranges (1)

Refreshed daily from the operator's feed. Also available as /data/ips/youbot.ips and /data/bots/youbot.json.

68.67.112.0/24

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: YouBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.