Directory / AI crawlers

LinerBot

Fully verifiable

Web crawler operated by Liner, an AI search and research assistant, which gathers pages from the public web and indexes them so Liner's search and research agents can retrieve and cite them. Liner's crawler page documents the user agent, states that access is controlled through robots.txt, and gives worked examples for both a full disallow and path-scoped allow rules. Liner also publishes the crawler's addresses as a JSON feed under the heading "IP address ranges", noting the pool may change over time.

Operated by Liner · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexLinerBot/\d
  • observedMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; LinerBot/1.0; +https://docs.getliner.com/docs/linerbot)

How to verify

Fetch the official IP range feed

curl -s https://docs.getliner.com/linerbot.json

IP ranges (10)

Refreshed daily from the operator's feed. Also available as /data/ips/linerbot.ips and /data/bots/linerbot.json.

34.121.11.68/32
34.134.213.56/32
34.16.62.88/32
34.171.199.186/32
34.29.166.174/32
34.29.23.49/32
34.29.249.74/32
34.66.1.86/32
35.224.198.28/32
35.226.131.201/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: LinerBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.