Feeder Crawler

Fully verifiable

Crawler for Feeder, a hosted RSS reading service. The operator documents that it only fetches feeds users have actively subscribed to, that it acts as an agent on the user's behalf and therefore does not check robots.txt, and that rate limits can be arranged by contacting support. Its user agent is a browser-shaped string in which Feeder deliberately inserts the feeder.co identifier as the honest self-identification. The operator publishes the addresses of its crawler servers, each with a reverse DNS name under feeder.co that resolves back to the same address, and offers the same list as JSON.

Operated by Feeder · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexfeeder\.co(?:/crawler)?[;)]
observedMozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6; +feeder.co/crawler) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36
observedMozilla/5.0 (Macintosh; Intel Mac OS X 10_8_2; +feeder.co/crawler) AppleWebKit/537.31 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36
observedMozilla/5.0 (feeder.co; Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36

How to verify

Fetch the official IP range feed

curl -s https://feeder.co/1/service-urls/crawlers.json

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.feeder.co

Reverse-DNS suffixes: *.feeder.co

IP ranges (20)

Refreshed daily from the operator's feed. Also available as /data/ips/feeder-co.ips and /data/bots/feeder-co.json.

104.131.105.190/32
138.197.71.121/32
142.93.74.129/32
144.217.180.83/32
144.217.180.84/32
144.217.76.102/32
15.235.82.82/32
157.245.117.2/32
157.245.117.25/32
159.89.183.157/32
159.89.43.145/32
165.227.116.114/32
165.227.125.60/32
165.227.76.164/32
167.71.89.133/32
174.138.49.150/32
174.138.57.235/32
209.97.147.246/32
68.183.151.227/32
68.183.157.237/32

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Fully verifiable
Respects robots.txt
Does not honor robots.txt
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.