Verified Bots Directory

Directory / AI crawlers

Context7-Crawler

Fully verifiable

Context7's documentation crawler, an Upstash project. It reads public documentation pages so that AI coding agents can retrieve and cite them, and the operator states the content is used for AI search with links back to the source rather than for model training. Requests are signed with HTTP Message Signatures (RFC 9421) under the Web Bot Auth scheme.

Operated by Upstash · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexContext7-Crawler/\d
  • observedContext7-Crawler/1.0 (+https://context7.com/crawler)

How to verify

Fetch the Web Bot Auth key directory

curl -s https://context7.com/.well-known/http-message-signatures-directory

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: Context7-Crawler)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.