← all agents

anthropic-ai / Claude-Web (legacy)

Legacy robots.txt names; not seen as live user agents.

Operator AnthropicTraining crawlerrobots.txt policy: unknowncontrol token onlyno published IP ranges

Matches user-agent tokens: anthropic-aiClaude-Web· source: curated from vendor docs

This directory documents crawler identity and declared purpose. It does not infer usage, model activity or web-wide volume from visits to gcdTracker.

Explore published crawler traffic →