AI2Bot
Broad crawls that build training corpora or datasets for models.
Operator Allen Institute for AITraining crawlerrobots.txt policy: reported to respectno published IP ranges
Matches user-agent tokens: AI2BotAi2Bot-Dolma· source: curated from vendor docs
This directory documents crawler identity and declared purpose. It does not infer usage, model activity or web-wide volume from visits to gcdTracker.