Google-Agent
Fully verifiableThe fetcher used by AI agents hosted on Google infrastructure to navigate the web and perform actions on behalf of a user who asked for them. Google publishes a dedicated IP range list for it and signs a subset of its requests with Web Bot Auth under the agent.bot.goog identity. As a user-triggered fetcher it generally ignores robots.txt rules.
Operated by Google · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexGoogle-Agent
- observedMozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Google-Agent; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent) Chrome/W.X.Y.Z Safari/537.36
- observedMozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Google-Agent; +https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent)
How to verify
Fetch the official IP range feed
curl -s https://developers.google.com/static/crawling/ipranges/user-triggered-agents.json Fetch the Web Bot Auth key directory
curl -s https://agent.bot.goog/.well-known/http-message-signatures-directory IP ranges (20)
Refreshed daily from the operator's feed. Also available as /data/ips/google-agent.ips and /data/bots/google-agent.json.
136.121.16.0/24 136.121.24.0/21 136.121.40.0/21 136.122.0.0/16 2001:4860:c::/124 2001:4860:c::10/124 2001:4860:c::20/124 2001:4860:c::30/124 2001:4860:c::40/124 2001:4860:c::50/124 2001:4860:c::60/124 2001:4860:c::70/124 74.125.232.0/28 74.125.232.112/28 74.125.232.16/28 74.125.232.32/28 74.125.232.48/28 74.125.232.64/28 74.125.232.80/28 74.125.232.96/28
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Fully verifiable
- Respects robots.txt
Does not honor robots.txt
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.