← all agents

Bytespider

Widely reported to ignore robots.txt.

Operator ByteDanceTraining crawlerrobots.txt policy: reported noncomplianceno published IP ranges

Matches user-agent tokens: Bytespider· source: curated from vendor docs

This directory documents crawler identity and declared purpose. It does not infer usage, model activity or web-wide volume from visits to gcdTracker.

Explore published crawler traffic →