Directory / Search engines

FindFilesBot

Verifiable

The crawler behind the FindFiles.net file search engine. It checks that publicly accessible files users search for are still available, using multiplexed HTTP/2 HEAD requests with a minimum ten-second interval per server, and may download images, videos and executables for classification and safety checks. Purpose-specific user agents are published for its link checking, favicon fetching, virus scanning and image classification agents, which all share one crawler host and address.

Operated by FindFiles.net · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexFindFilesBot/\d
  • regexFindFiles\.net-[A-Za-z]+/\d
  • observedFindFilesBot/1.0 (+https://findfiles.net/en/bot)
  • observedFindFiles.net-LinkChecker/1.1 https://findfiles.net/bot
  • observedFindFiles.net-FaviconFetcher/1.0 (+https://findfiles.net/bot)
  • observedFindFiles.net-VirusScan/1.0 (+https://findfiles.net/bot)
  • observedFindFiles.net-ImageNSFWClassifier/1.0 (+https://findfiles.net/bot)

How to verify

Documented static ranges: 65.21.31.180/32, 2a01:4f9:3080:2b61::2/128

IP ranges (2)

Refreshed daily from the operator's feed. Also available as /data/ips/findfilesbot.ips and /data/bots/findfilesbot.json.

2a01:4f9:3080:2b61::2/128
65.21.31.180/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (2 patterns)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Does not honor robots.txt

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.