Directory / Search engines

Algolia Crawler

Verifiable

Algolia's Crawler, which visits a customer's pages, extracts search-relevant content, and pushes it to Algolia search indices. Algolia documents a fixed User-Agent token and a single static egress IP address for allowlisting.

Operated by Algolia · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexAlgolia Crawler/[\d.]+
  • observedAlgolia Crawler/1.0.0

How to verify

Documented static ranges: 34.66.202.43/32

IP ranges (1)

Refreshed daily from the operator's feed. Also available as /data/ips/algolia-crawler.ips and /data/bots/algolia-crawler.json.

34.66.202.43/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt (token: Algolia Crawler)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.