Crawlspace
Crawlspace is a web crawler platform that fetches and extracts website content for AI agents, RAG applications, and structured data workflows. More info can be found at https://knownagents.com/agents/crawlspace
Operator [Crawlspace](https://crawlspace.dev)AI tooling / data providerrobots.txt policy: reported to respectno published IP rangesvendor documentation ↗
Matches user-agent tokens: Crawlspace· source: ai.robots.txt list
This directory documents crawler identity and declared purpose. It does not infer usage, model activity or web-wide volume from visits to gcdTracker.