Directory / SEO tools

IAS Crawler

Listed only

Content-rating and ad-verification crawler operated by Integral Ad Science. It visits web pages to assess content quality and brand safety and to support invalid-traffic detection for advertisers.

Operated by Integral Ad Science · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexias_crawler
  • observedIAS Crawler (ias_crawler; http://integralads.com/site-indexing-policy/)

How to verify

No verification recipe published by the operator.

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Operator publishes no verification path

  • Respects robots.txt

    Honors robots.txt

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.