Use the data
Everything on this site is also machine-readable — static JSON and plain-text files, rebuilt daily from first-party operator feeds, no auth, no rate limits. CC-BY-4.0: use it anywhere, credit this project.
Try it
curl -s https://verifiedbots.dev/data/all.json | head -40 | Path | What it is |
|---|---|
| /data/all.json | The full catalogue: every bot with identity, UA patterns, verification recipes, tier, and resolved IP ranges. |
| /data/by-category/<category>.json | The same shape, filtered to one category (e.g. ai-crawler.json). |
| /data/by-tier/tier-<n>.json | The same shape, filtered to one verification tier: tier-1 (fully verifiable), tier-2 (verifiable), tier-3 (listed only). |
| /data/bots/<id>.json | A single bot artifact. |
| /data/ips/<id>.ips | Plain-text CIDR list for one bot, one range per line (GoodBots-compatible). |
| /data/ips/by-category/<category>.ips | Union of verified ranges for one category (only categories with at least one verified range). |
| /data/ips/by-tier/tier-<n>.ips | Union of verified ranges for one tier (tier-3 has none by definition). |
| /data/ips/all.ips | Union of all verified ranges in the directory. |
| /data/ua-patterns.json | Just the UA regex patterns, per bot, with categories. |
| /rss.xml | RSS feed of bots newly added to the directory. |
How fresh is this data?
- IP ranges refresh daily. Every bot with a published IP feed is re-fetched from the operator's first-party source once a day and the dataset is rebuilt automatically.
- Bad feeds can't poison the data. Every range passes CIDR sanity checks, and a feed that errors or changes suspiciously is held on the last-known-good ranges and flagged for a human to review before it's trusted — the site never publishes a range we couldn't stand behind.
- Identity is curated, not scraped. User-agent patterns, static IP lists, and reverse-DNS masks come from operator documentation and are re-verified by periodic research passes rather than an automatic feed. Docs links are checked weekly so dead pages get caught.
Dataset generated 2026-08-23T13:31:38.100Z.