Directory / SEO tools

GoGuidesCrawler

Listed only

The two crawlers GoGuides runs for its web-evidence service, which publishes machine-readable records about public websites — crawl status, first-seen and last-seen history, freshness and canonical matching — for people and automated systems that query it about a domain. GoGuidesCrawler checks publicly accessible pages to refresh those observations and GoGuidesDiscoveryBot performs limited discovery checks on supported public URLs. The operator states the bots request public URLs only and should not sign in, defeat access controls or enter private account areas.

Operated by GoGuides, LLC · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexGoGuidesCrawler/\d
  • regexGoGuidesDiscoveryBot/\d
  • observedGoGuidesCrawler/3.0 (trust-transparency; +https://www.goguides.com/crawler)
  • observedGoGuidesCrawler/3.0
  • observedGoGuidesDiscoveryBot/1.0 (+https://www.goguides.com/crawler)

How to verify

No verification recipe published by the operator.

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (2 patterns)

  • Verifiable

    Operator publishes no verification path

  • Respects robots.txt

    Honors robots.txt (token: GoGuidesCrawler)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.