AmazonProductDiscoverybot

Fully verifiable

Amazon's product crawler, which collects publicly available product details from Amazon selling partner, brand and retailer websites to improve the accuracy and completeness of product information in Amazon's store. Amazon documents that it honours robots.txt user-agent and disallow directives, with changes taking up to 24 hours to apply, and that it does not support crawl-delay, nofollow or noindex. Amazon signs every request from this crawler with HTTP message signatures, publishing the Ed25519 key directory the Signature-Agent header points at.

Operated by Amazon · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexAmazonProductDiscovery/\d
observedMozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0 (compatible; AmazonProductDiscovery/1.0; https://vendorcentral.amazon.com/support/amazonproductbot)

How to verify

Fetch the Web Bot Auth key directory

curl -s https://d3sqdbcybbdvkr.cloudfront.net/.well-known/http-message-signatures-directory

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Fully verifiable
Respects robots.txt
Honors robots.txt (token: AmazonProductDiscoverybot)
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.