← all agents

VelenPublicWebCrawler

"Our goal with this crawler is to build business datasets and machine learning models to better understand the web."

Operator [Velen Crawler](https://velen.io)Training crawlerrobots.txt policy: reported to respectno published IP rangesvendor documentation ↗

Matches user-agent tokens: VelenPublicWebCrawler· source: ai.robots.txt list

This directory documents crawler identity and declared purpose. It does not infer usage, model activity or web-wide volume from visits to gcdTracker.

Explore published crawler traffic →