Directory / SEO tools

AudigentBot

Listed only

The broader of the two crawlers Audigent documents on its bot page. Unlike AudigentAdBot, which reads only HTML head metadata, Audigent states that AudigentBot can scrape any content available on the page, from both the header and the body, and that it can be blocked with a wildcard robots.txt rule. Audigent says it crawls only sites where it or its advertiser partners may serve ads.

Operated by Audigent · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexAudigentBot
  • observedMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; AudigentBot; +https://audigent.com/bot.html) Chrome/W.X.Y.Z Safari/537.36

How to verify

No verification recipe published by the operator.

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Operator publishes no verification path

  • Respects robots.txt

    Honors robots.txt (token: AudigentBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.