AIWebIndex-Agent

Fully verifiable

Lyrenth's on-demand fetcher. It identifies itself separately from the AIWebIndex crawler when a customer asks the index for a URL that is not in it yet, so site owners can tell scheduled crawling and on-demand fetches apart in their logs. The operator states both user agents honour robots.txt the same way, and the crawler's address feed covers this user agent too.

Operated by Aleksma Ai, Inc. (Lyrenth) · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexAIWebIndex-Agent/\d
observedAIWebIndex-Agent/2.0 (+https://lyrenth.com/bot; on-demand index fetch)

How to verify

Fetch the official IP range feed

curl -s https://lyrenth.com/bot/ip-ranges.json

Fetch the Web Bot Auth key directory

curl -s https://api.lyrenth.com/.well-known/http-message-signatures-directory

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.lyrenth.com

Reverse-DNS suffixes: *.lyrenth.com

IP ranges (22)

Refreshed daily from the operator's feed. Also available as /data/ips/aiwebindex-agent.ips and /data/bots/aiwebindex-agent.json.

138.201.157.96/32
142.132.225.162/32
152.53.93.229/32
159.69.116.231/32
159.69.189.54/32
168.119.98.242/32
178.104.212.30/32
178.105.121.172/32
178.105.146.59/32
178.105.195.233/32
178.105.197.214/32
178.105.200.108/32
178.105.207.129/32
178.105.210.26/32
178.105.220.145/32
178.105.223.90/32
178.105.66.244/32
178.105.70.116/32
178.105.9.229/32
46.224.73.201/32
46.225.147.220/32
49.13.94.158/32

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Fully verifiable
Respects robots.txt
Honors robots.txt
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.