LinksIndexerBot
VerifiableThe crawler behind the Links Indexer URL indexing service. It parses third-party sites to verify their URLs and status for sitemap campaigns, querying pages for metadata and favicons and taking a homepage screenshot. The operator states it never harvests e-mail addresses or content unrelated to sitemap campaigns, runs at most four parallel requests, and publishes the single address it crawls from.
Operated by Links Indexer (Kalpraj Solutions (OPC) Private Limited) · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexLinksIndexerBot/\d
- observedMozilla/5.0 (compatible; LinksIndexerBot/1.0; +http://linksindexer.com/bot)
How to verify
Documented static ranges: 38.242.228.97/32
IP ranges (1)
Refreshed daily from the operator's feed. Also available as /data/ips/linksindexerbot.ips and /data/bots/linksindexerbot.json.
38.242.228.97/32
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Honors robots.txt (token: LinksIndexerBot)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.