Directory / AI assistants

Google-Agent

Fully verifiable

The fetcher used by AI agents hosted on Google infrastructure to navigate the web and perform actions on behalf of a user who asked for them. Google publishes a dedicated IP range list for it and signs a subset of its requests with Web Bot Auth under the agent.bot.goog identity. As a user-triggered fetcher it generally ignores robots.txt rules.

Operated by Google · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexGoogle-Agent
  • observedMozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Google-Agent; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent) Chrome/W.X.Y.Z Safari/537.36
  • observedMozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Google-Agent; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent)

How to verify

Fetch the official IP range feed

curl -s https://developers.google.com/static/crawling/ipranges/user-triggered-agents.json

Fetch the Web Bot Auth key directory

curl -s https://agent.bot.goog/.well-known/http-message-signatures-directory

IP ranges (20)

Refreshed daily from the operator's feed. Also available as /data/ips/google-agent.ips and /data/bots/google-agent.json.

136.121.16.0/24
136.121.24.0/21
136.121.40.0/21
136.122.0.0/16
2001:4860:c::/124
2001:4860:c::10/124
2001:4860:c::20/124
2001:4860:c::30/124
2001:4860:c::40/124
2001:4860:c::50/124
2001:4860:c::60/124
2001:4860:c::70/124
74.125.232.0/28
74.125.232.112/28
74.125.232.16/28
74.125.232.32/28
74.125.232.48/28
74.125.232.64/28
74.125.232.80/28
74.125.232.96/28

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Does not honor robots.txt

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.