netEstate NE Crawler

Listed only

The crawler netEstate GmbH runs for its information-extraction products. The operator documents two uses: an Impressums-Crawler that locates a site's imprint page and extracts postal addresses, contact data and company names for address verification, and a Jobcrawler that finds job postings on employer websites. netEstate states that the crawler observes robots.txt, the robots meta element and common opt-out wordings, and that it returns only a hash of any email address rather than the address itself.

Operated by netEstate GmbH · Official documentation

User agents

Patterns this directory matches, with real observed strings.

regexnetEstate NE Crawler
observednetEstate NE Crawler (+http://www.sengine.info/)
observednetEstate NE Crawler (+http://www.website-datenbank.de/)

How to verify

No verification recipe published by the operator.

Good Bot Practices scorecard

Identifies honestly
Stable UA token documented (1 pattern)
Verifiable
Operator publishes no verification path
Respects robots.txt
Honors robots.txt
Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
Reachable operator
Operator and documentation published

Measured against the Good Bot Practices.