ExaSearchBot
Fully verifiableExa's search crawler, which discovers and indexes pages on the public web so that people and applications can find, retrieve and cite them through Exa. Every request is signed with HTTP Message Signatures (RFC 9421) under the Web Bot Auth scheme, so a request can be verified cryptographically regardless of its source IP address.
Operated by Exa · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexExaSearchBot/\d
- observedMozilla/5.0 (compatible; ExaSearchBot/1.0; +https://crawler.exa.ai/)
How to verify
Fetch the Web Bot Auth key directory
curl -s https://crawler.exa.ai/.well-known/http-message-signatures-directory Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Fully verifiable
- Respects robots.txt
Honors robots.txt (token: ExaSearchBot)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.