Streamline3Bot

Verifiable

UBT's web crawler, which powers a classification service that categorises public websites by their content. It re-crawls a given site roughly once every three days. UBT publishes no IP list, and instead documents reverse-DNS verification against the ubtsupport.com domain.

Operated by UBT (EU) Ltd · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexStreamline3Bot
observedMozilla/5.0 (compatible; MSIE 8.0; Windows NT 5.1) Streamline3Bot/1.0
observedMozilla/5.0 (Windows NT 6.1; Win64; x64; +https://www.ubtsupport.com/legal/Streamline3Bot.php) Streamline3Bot/1.0

How to verify

Reverse-DNS check a client IP

dig -x <client-ip> +short   # expect a hostname matching *.ubtsupport.com

Reverse-DNS suffixes: *.ubtsupport.com

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Verifiable
Respects robots.txt
Does not honor robots.txt
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.