Verified Bots Directory

Directory / Archivers

Cotoyogi

Verifiable

A research web crawler run by the Data Lake Research and Development Center of the Joint Support-Center for Data Science Research (ROIS-DS), Research Organization of Information and Systems, Japan. It collects Japanese-language web data for research use. The operator page documents RFC 9309 robots.txt handling with Crawl-delay support, robots meta tag support, and the address range the crawler requests from.

Operated by ROIS-DS Data Lake Research and Development Center · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexCotoyogi/\d
  • observedMozilla/5.0 (compatible; Cotoyogi/4.0; +https://ds.rois.ac.jp/center8/crawler/)

How to verify

Documented static ranges: 157.1.136.4/30, 157.1.136.8/30

IP ranges (2)

Refreshed daily from the operator's feed. Also available as /data/ips/cotoyogi.ips and /data/bots/cotoyogi.json.

157.1.136.4/30
157.1.136.8/30

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Verifiable

  • Respects robots.txt

    Honors robots.txt (token: Cotoyogi)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.