Directory / Search engines

Amazon Q Business Web Crawler

Listed only

The web crawler AWS runs for Amazon Q Business, which fetches the websites an AWS customer has connected as a data source and indexes them into that customer's Q Business application. It is customer-directed but operator-run: AWS states the customer must only index their own webpages or webpages they have authorisation to index, and documents the robots.txt token site owners can use to allow or stop it.

Operated by Amazon · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexamazon-QBusiness
  • observedamazon-QBusiness

How to verify

No verification recipe published by the operator.

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Operator publishes no verification path

  • Respects robots.txt

    Honors robots.txt (token: amazon-QBusiness)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.