Verified Bots Directory

Directory / AI crawlers

ICC-Crawler

Verifiable

The web crawler of the Universal Communication Research Institute at Japan's National Institute of Information and Communications Technology. It collects web pages for NICT's research and development of information processing technologies including multilingual translation, information analysis and artificial intelligence, and NICT states that collected information and research products may be provided to third parties for joint or further research. The crawler page documents a load policy that caps connections per unit of time across a host's several addresses or hostnames.

Operated by National Institute of Information and Communications Technology (NICT) · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexICC-Crawler
  • observedICC-Crawler/2.0 (Mozilla-compatible; ; http://ucri.nict.go.jp/en/icccrawler.html)

How to verify

Documented static ranges: 202.180.34.186/32, 61.86.246.72/32

IP ranges (2)

Refreshed daily from the operator's feed. Also available as /data/ips/nict-crawler.ips and /data/bots/nict-crawler.json.

202.180.34.186/32
61.86.246.72/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt (token: ICC-Crawler)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.